Forum Discussion

dimap's avatar
dimap
New Contributor
7 years ago

File Writer says - SLDB does not support data larger than 100 MB

Hello
I receive “SLDB does not support data larger than 100 MB” while attempting to write a large .csv file. If I limit the size I have no problems. I couldn’t find any mentioning of the limit of the File Writer in the documentation and have a couple of questions, so perhaps somebody had a similar problem.

  • Is it possible to use the File Writer to save a large files (more than 100Mb)?
  • If it is a pre-set somewhere is it possible to change?
    Thank you

2 Replies

  • dmiller's avatar
    dmiller
    Former Employee
    7 years ago

    From the FAQ (https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/1438441/FAQ):

    How many tasks/how much data/what limits are there on the platform?

    Files uploaded to SLFS have a 100MB per file limit. There are limits on the number of concurrent triggered pipelines and total triggered pipelines per day, these limits vary based on the size and number of Snaplexes. There are no limits currently on non-triggered pipeline executions.

    • tlikarish's avatar
      tlikarish
      Employee
      7 years ago

      Is it possible to use the File Writer to save a large files (more than 100Mb)?

      Might be worth noting this restriction is only for the SnapLogic provided storage (SLFS). Writing to other file storage doesn’t have these limits.