06-19-2023 01:21 PM
I used the following to prompt to successfully generate a pipeline that reads data from a csv file, filtered the data and wrote the data to a new file.
Read a csv file, then map Registered, Last Name, Email and % complete, then filter records where Registered is equal to or greater than 2023-05-15, and % complete is equal to or less than 40, then write records to csv file
Resulting pipeline:
I did need to modify the Mapper Snap and provide a file name but the filter expression was a success.
06-22-2023 07:19 PM
This is an interesting use case where the goal was a data processing action without system integration on input or output. Are you planning to update the pipeline with a connection to the origin system @arodriguez?
06-23-2023 06:06 AM
Yes, my intention is to use the origin system API endpoints.