Solved
Routing files from S3
Continuing the discussion from How to load Today Date Files from s3 Bucket to SLDB:
Try using this:
Wildcard is your file format, it will go into a single route for one format.
Forum Discussion
If you setup a JSON formatter WITHOUT setting the ignore empty result, an empty result will be returned as: . This works even if you have a filter preventing it. If you let data through… you get something more like: [{“test”:“HELLO”}]
Steve
After reading the community blogs(2379) found that we should not have open o/p view in error pipe except ultra case with one i/p one o/p, that might be reason after some docs in above post it stopped processing further error.
But considering this how we will show the error pipeline data to the caller ?
ex-
1)calling a while child pipe by PE and all doc in child went to error pipe from child(error pipe enabled in child), PE will not get any o/p, What to show to client/caller?
Can PE get those child pipe error which went to error pipe?
2)In case of trigger pipe(exposed as rest api) if all error went in error pipe, the caller will get nothing.Please suggest how to get the errors back in main flow and return it to caller.
