Hi, I’m building a pipeline to load excel file, looks like the file reader snap can read file property (especially last modified date), but I’m not able to find a solution which can let me save the modified date for later process.
If I try to using excel parser snap in next step, it can change binary data to excel stream, but it will also lose file property which belong to the original file. Has anyone encounter same issue and resolve it without using script snap?
If I understand the question, you’re looking to retain information about the file’s last-modified date and the file’s contents. If that’s the case, you might look at the Binary To Document snap. I’ve also attached a pipeline that might be useful. Basically it reads the file and then joins the last-modified date as an additional column.
If you need to make a value available to different snaps of a pipeline, you can use a child pipeline and pass in pipeline parameters with the values of interest. In this case, you can use a DirectoryBrowser snap to get the file metadata and then use a PipelineExecute snap to start the child pipeline and pass it the relevant metadata.
The following is a screenshot of the parent pipeline showing the PipelineExecute snap that is calling the child and passing in the file path and last update time:
Just one more question, since snaplogic is case sensitive, when I loading the excel file, it will fail due to excel header using mixed upper and lower case, but actually column name in my destination is full upper case. Mapper can definitely fix it, but if I’m trying to make the pipeline dynamic, and reusable, I will need some method can read the excel header row and upper case the whole header dynamically. If there is not possible being done by regular snap, I will try script. Thanks again.