I am doing a very simple pipeline that read one single file, then PGP encrypt it then SFTP to a remote server. When I execute the pipeline, I got all green but the file never got transmitted to the server.
Why? any hint?
@mtran21, here are 2 hints, based on my experience:
-
“all green” doesn’t necessarily mean your pipeline read or transmitted a file. Different snap configurations (error handling config, etc.) have different behaviors. You’ll need to check your
Pipeline statistics to see if a file was actually read and processed downstream in the pipeline.
-
Some SFTP servers immediately move a file for processing after receiving it in the inbox. So, depending on the target SFTP server configuration, just because you don’t see the file in the inbox after you attempted to transmit it, doesn’t mean it wasn’t delivered. If the delivery was to an outside party system, you need to work with that party to see if they received it.
On my Pipeline statistics, it shows all green. It even shows one file has been process.
But when I check SFTP server, the file is not there.
This SFTP server does not remove file. I can manually upload the file to the SFTP server just fine and the file I manually uploaded is still there.
