Head/Tail snap dynamically setting Offset value

[mithsrini]

Hello,

I am working on loading data from big excel file into a database. I want to use Head/Tail snaps to dynamically take “Documents offset*” from upstream. Please suggest if there is an alternative to this approach.

Thanks,
Mithila

[mithsrini]

Kory,

Thanks for your support. I used Pipeline execute and GroupByN to make data groups. Wonderful!, except I am not able to gather the response data that is returned in a Filewriter, as csv or xlsx not supporting ‘append’ action.

Thanks,

Mithila JT

[koryknick]

Per File Writer snap documentation: Append is supported for file, FTP, FTPS and SFTP protocols only.

I’m not sure what you mean that you can’t gather the response data returned by the File Writer. The output view from the File Writer snap (once enabled) provides a document with information on the filename, result, and original binary header data.

If you can provide a simple example pipeline with the issues you are facing, it might make it more clear to me so I can help further.