Forum Discussion

amubeen's avatar
amubeen
New Contributor II
5 years ago

Getting list of csv files through directory browser and parsing by date

Hey All, So I’ve been trying to develop a pipeline that reads a bunch of files from an s3 bucket, checks which ones are no more than a week old, and then sends those to be parsed and eventually upl...
SpiroTaleski's avatar
SpiroTaleski
Valued Contributor
5 years ago

Hi @amubeen,

One possible solution would be if you list all the files from s3 bucket using the Directory browser snap. As an output you will get the creation date of the files. Then by using the filter snap you can filter the files that are week old or younger(ex: $[‘Creation date’] >= Date.now().minusDays(7)).

Regards,
Spiro Taleski