I’m just beginning with SnapLogic, and wanted to see if my current pipelines could be simplified. What I have is source data that looks like this:
I want to normalise this data, so that folder details go into one table, and file details go to another table, with a foreign key reference to the folder table. My current pipeline (still in development) looks like this:
I’ve managed to insert the folder details, and I need to insert file details by:
- Looking up the respective folder id in the folder table, after folder data insert is done
- Inserting/updating the file details after lookup is done
As my pipeline is designed right now, the only way I can see that happening is if I create a new pipeline for file insert. Is there a better way to do this, so that I can be done sequentially?