Forum Discussion
The sort operates on a document by document basis, but the input to the snap contains only 1 document. In order to sort on the field you'd like you'll need to first split the document into multiple documents, sort those, then group them back together. Here's an example that demonstrates how you could do that sort of thing.
- koryknick3 years agoEmployee
Personally I like pipe.startTime over Date.now() since it is consistent throughout your pipeline execution and correlates to your pipeline execution time in the Dashboard - try this:
"s3:///bucket/" + pipe.startTime.toLocaleDateString( { format : "yyyy/MM/dd" } ) + "/filename.csv"
This should yield what you’re looking for. - SnapWizard3 years agoNew Contributor III
I placed the logic in the csv formatter and stored it as a variable and used the variable as part of the path used by the writer snap. This worked.
Related Content
- 4 months ago