Zipping whole directory with subfolders

[jfpelletier]

Hello all,

I'm having an issue with my pipeline, and would like to get some help.

The pipeline I just created simply downloads files from a server, does some transformations, then stores them temporarily directly in SnapLogic (sldb:) until the last one is downloaded. When the last file is downloaded, I have to create a ZIP package that contains all the files that I downloaded, in the same folder structure that I created.

Please note that the pipeline runs as a triggered task, and it is called when the files are ready to be downloaded individually. So I'm not downloading all the files in a single task operation, they come one at the time.

The files that I download need to be organized using the project ID as top folder, then a language code as subfolder under which I store the files for the different languages of that project.

This works fine for getting all the files in SnapLogic in the folder structure that I need. I'm trying to use the Directory Browser to list all the files, then I'm planning to write them all in the ZIP file with their respective path. My issue is that the Directory Browser returns nothing, I cannot even list the files that I just saved.

At some point I managed to make the Directory Browser to list at least the top folders, but I couldn't get the subfolders. Is the Directory Browser the correct snap to add a whole directory structure in a zip file? Is there a better technique?

Thanks in advance for any help!

Kind regards,

JF

[koryknick]

@jfpelletier - Best practices recommends against using the SLDB for data storage for the reasons I listed earlier.  I suggest that you consider moving the data to another shared location, such as a network share, FTP server, S3, etc.

However, I understand your desire for this simple solution and if SLDB is your desired path forward, then working with our support team to determine why the Directory Browser isn't picking up your directory listings is your correct path.

Hope this helps!