Issue (or bug) with mapper snap
Hello,
I have found something like bug. I cannot understand the strange result of the following pipeline.
When I run validation of this pipeline, I see following results.
As expected count...
Forum Discussion
@cstewart the column names remain same but number of columns changes. Need help to configure the mapper accordingly.
Sounds like what you’re looking for here is schema change detection and we have a blog article on that (video and link to download pipelines at the bottom of the blog post). That demo shows how to alert on the schema change detection, so you would need to customize the pipeline so you could run ALTER TABLE statements to add/remove columns appropriately after the Diff snap.
This pipleine does what you want I think. I put the inoput data in the CSV generator at the beginning, and the output of the join give the data you need.
Take a look.Group_test_2019_03_23 (1).slp (23.7 KB)
Thanks for the Solution. The Solution is almost what i need except the "Transaction_id should be displayed at the header level only. “The tenders” child array also displays the “TRANSACTION_ID” attribute which i don’t want to display at the tenders level.
I tried removing by having empty expression variable for “transactiod_id” in the “Remove groupBy tenders” Snap but didn’t work. It would be really helpful if this is sorted.
Thanks
Add a line in the mapper “Remove GroupBy” to remove that:
Updated pipeline: Group_test_2019_03_25.slp (23.8 KB)
Updated Output: Join.txt (2.6 KB)
receipt_no,item_id,quantity,item_total,item_gross,item_tax are item attributes grouped for each transaction_id.
media_id,media_no,media_value are tenders attributes grouped for each transaction_id
