Is there a parser snap that is converting the binary documents?
My apologies for lack of detail, yes there is indeed a CSV parser following the multi file reader.
It’s currently not possible to pass the binary header that contains the file name through the CSVParser. Instead, you can use a DirectoryBrowser snap to get the file names and then kick off child pipelines to read the files and do the SnowflakeUpserts. In that case, you’ll be passing the filename as a pipeline parameter to the child pipeline, so you can use a Mapper to add the parameter into the documents that are going into the Upsert. A side-benefit of this is that you can process multiple files in parallel.
hi tstack,
Is there an inbuilt snaplogic functionality for the same ?
