Forum Discussion
GZip stuff is a little bit more work, but it’s possible here, you’ll want to set the REST Get Response Entity Type to BINARY
With that, you’ll then have to map the data from the output document to content for a document to binary transition, to do this, you’ll want to map the settings in the mapper (some of these are optional, but I’d say content-type
, content-encoding
, and content
are all required on the output map)
With that, you can use the Document to Binary to get it in a binary form (I set the drop-down for Encode or Decode to NONE), then decompress (you select GZip), then you can parse the JSON with the JSON Parser.
Full pipeline screenshot
download (you’ll need to change the URL to download in the REST Get)
json gzip_2023_03_03.slp (8.0 KB)
- cstewart6 years agoFormer Employee
If you create a pipeline which reads the multiple input files, and a single output writer, that should achieve your objective. You might use the Multi-file reader Snap, or perhaps the Directory browser which gives a list of files, which you filter, and pass the names of the files to be read into the the file reader. Multiple ways to achieve it.
- mohit6 years agoNew Contributor
But it will overwrite the data, I want to Append the data in a single file.
- jcampion6 years agoNew Contributor III
You may have to re-read the original file, along with the new file(s), in order to append. Several file systems don’t support append. I’m not sure if this is excel-specific, or just an append issue with your filesystem of choice.