Forum Discussion

mxpeskir's avatar
mxpeskir
New Contributor
7 years ago

How to get the file name(s) from a Multi File Reader

I have a Multi File Reader reading a series of S3 files using a wildcard, and writing the data to Snowflake. There is a Mapper in between. Functionally, everything is working as expected. I’d like...
expression_language
sghneim's avatar
sghneim
New Contributor
4 years ago

Was this ever resolved I am facing the same issue currently pulling files from s3 then using json parser and mapper to write data into a file. Is there a way to get the file name in a column ?

I am using the multi file reader.

    • sghneim's avatar
      sghneim
      New Contributor
      4 years ago

      Hi Spiro,

      i am getting an error on the join shape .
      .

      not sure what i am doing wrong. my multifile reader is set with a wildcard and the subfolders option is checked. any idea what might be the cause of this error ?

      • SpiroTaleski's avatar
        SpiroTaleski
        Valued Contributor
        4 years ago

        @sghneim

        Hmm, the same code it is working on my side. So, I am wondering if the file data can have some impact.

        Could you try to re-drag the Join Snap(first delete existing Join, and drag new one from Snap Pallet again), and add the same configuration.

        Inner Join with “1” for Left and Right Join Paths.

        Regards,
        Spiro Taleski