Forum Discussion

dimap's avatar
dimap
New Contributor
8 years ago

File Writer says - SLDB does not support data larger than 100 MB

Hello I receive “SLDB does not support data larger than 100 MB” while attempting to write a large .csv file. If I limit the size I have no problems. I couldn’t find any mentioning of the limit of t...
dmiller's avatar
dmiller
Former Employee
8 years ago

From the FAQ (https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/1438441/FAQ):

How many tasks/how much data/what limits are there on the platform?

Files uploaded to SLFS have a 100MB per file limit. There are limits on the number of concurrent triggered pipelines and total triggered pipelines per day, these limits vary based on the size and number of Snaplexes. There are no limits currently on non-triggered pipeline executions.

tlikarish's avatar
tlikarish
Employee
8 years ago

Is it possible to use the File Writer to save a large files (more than 100Mb)?

Might be worth noting this restriction is only for the SnapLogic provided storage (SLFS). Writing to other file storage doesn’t have these limits.