Forum Discussion

plancor's avatar
plancor
New Contributor
2 years ago

File Reader doesn't always return the entire file

Hello, I have a simple pipeline where the first snap is a File Reader.  It should read a ~3.3M file using SFTP.  Sometimes it reads the entire file, and other times it partially reads the file.  I ran the pipeline twice three minutes apart.  The first execution read 1.6M and the second execution read the entire file.  Why would this occur, and is there a way to ensure the entire file is read?  Thank you