File Writer says - SLDB does not support data larger than 100 MB

[dimap]

Hello
I receive “SLDB does not support data larger than 100 MB” while attempting to write a large .csv file. If I limit the size I have no problems. I couldn’t find any mentioning of the limit of the File Writer in the documentation and have a couple of questions, so perhaps somebody had a similar problem.

• Is it possible to use the File Writer to save a large files (more than 100Mb)?
• If it is a pre-set somewhere is it possible to change?
  Thank you

[dmiller]

From the FAQ (https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/1438441/FAQ😞

How many tasks/how much data/what limits are there on the platform?

Files uploaded to SLFS have a 100MB per file limit. There are limits on the number of concurrent triggered pipelines and total triggered pipelines per day, these limits vary based on the size and number of Snaplexes. There are no limits currently on non-triggered pipeline executions.

[tlikarish]

Is it possible to use the File Writer to save a large files (more than 100Mb)?

Might be worth noting this restriction is only for the SnapLogic provided storage (SLFS). Writing to other file storage doesn’t have these limits.