Forum Discussion

mtran21's avatar
mtran21
New Contributor III
5 years ago

All green but no upload file

I am doing a very simple pipeline that read one single file, then PGP encrypt it then SFTP to a remote server. When I execute the pipeline, I got all green but the file never got transmitted to the server.

Why? any hint?

12 Replies

  • Supratim's avatar
    Supratim
    Contributor III
    5 years ago

    @mtran21 Can add output view of file writer and run the pipeline. If it’s working fine then can see one document count should comes from output view of file writer.

    • mtran21's avatar
      mtran21
      New Contributor III
      5 years ago

      Can you tell me more about adding output view? What snap do I need to add after File Writer?

      Thanks

      • Supratim's avatar
        Supratim
        Contributor III
        5 years ago

        @mtran21 Open file writer, then go to view tab click on + icon besides output as shown below. I believe you have used sftp url correctly like -
        sftp://:// with valid account

  • mtran21's avatar
    mtran21
    New Contributor III
    5 years ago

    Not sure what happened over night. My guess is that the FTP server admin did something and this morning I ran the pipeline again, the file finally got transferred. Not sure why but it’s working now. Thanks for all your help.

  • koryknick's avatar
    koryknick
    Employee
    5 years ago

    If you are doing this in data preview mode you will want to check to make sure that the file writer is set to validate and execute

  • del's avatar
    del
    Contributor III
    5 years ago

    @mtran21, here are 2 hints, based on my experience:

    1. “all green” doesn’t necessarily mean your pipeline read or transmitted a file. Different snap configurations (error handling config, etc.) have different behaviors. You’ll need to check your Pipeline statistics to see if a file was actually read and processed downstream in the pipeline.

    2. Some SFTP servers immediately move a file for processing after receiving it in the inbox. So, depending on the target SFTP server configuration, just because you don’t see the file in the inbox after you attempted to transmit it, doesn’t mean it wasn’t delivered. If the delivery was to an outside party system, you need to work with that party to see if they received it.

    • mtran21's avatar
      mtran21
      New Contributor III
      5 years ago

      On my Pipeline statistics, it shows all green. It even shows one file has been process.

      But when I check SFTP server, the file is not there.

      This SFTP server does not remove file. I can manually upload the file to the SFTP server just fine and the file I manually uploaded is still there.