@Precy - As per my design-
- Create one single pipeline which will accept table name,query and sql account from pipeline param. This pipeline can have only single SQL snap.
- From parent pipeline , use json generator/mapper/file to hold those 3 param mention in point -1.
- Use pipeline execute snap (can use pool size 20/30 based on the snap infrastructure you have)
- After pipeline execute use groupby N and make grp size 0 and then use $tableList.reduce((accum, curr) => curr.merge(accum), {}) , here tableList is target field in groupBy N snap. It will merge all unique column in single row.
Hope this might solved your issue.