Forum Discussion

mjain's avatar
mjain
New Contributor
6 years ago
Solved

How to divide array into json with headers

Hi , I need a help I am getting data in the array format and I have to create it in the json format to dump it in CSV file
  • darshthakkar's avatar
    darshthakkar
    9 months ago

    arvindnsn - I tried with a sample pipeline that generates 6 files over the SLDB and the performance is pretty good. It took ~1.5 mins for completion.
    I didn't connect to SFTP but just to add complexity on the same lines, I added an email snap that sent me a copy of those files, screenshots below:

     

    I have used the innate FileDelete snap for deleting multiple files at once (which does process files one by one)

    I do agree that if you're having a huge volume, this process would have to run over the weekend. Please lemme know your volume and frequency of this run to understand the issue in detail and whether we can scale up the solution.

    Thanks.

    Best Regards,

    Darsh

mjain's avatar
mjain
New Contributor
6 years ago
Copy LinkReport

Thank you so much. It worked.

  • arvindnsn's avatar
    arvindnsn
    Contributor
    6 months ago
    Copy LinkReport

    Thanks for the solution. The above one seems to be pretty effective if not super effecient especially when deleting files in thousands.