I currently have 37 file readers that are reading from an SFTP to write into a SQL Server database. I have those 37 file readers separated into 5 different pipelines. I’m starting to get issues connecting to SFTP source, and when validating it spins and spins until it finally errors out. Wanted to see if anyone else has had this issue or who I should contact?
Are you trying to have those all running concurrently? Many SFTP servers will have limited incoming connections enabled. Can you try serializing the readers?