Forum Discussion
I believe that the glob filter is only applied for the suggest operation in the Designer, not a run-time setting. If you want to scan for files, you may want to use the Hadoop directory Browser Snap, which will output the list of files, which you can then pass into the HDFS File Reader to do the actual file reading.
Hi ,
i have attached my pipeline for your reference.
SJ Group by N_2021_02_03.slp (3.5 KB) SJ new pipeline 0_2021_02_03.slp (5.2 KB)- SpiroTaleski5 years agoValued Contributor
Please find the attached sample pipelines:
SJ Group by N_2021_02_03 (1).slp (2.2 KB)
SJ new pipeline 0_2021_02_03 (1).slp (3.8 KB)Hope this will work for you.
Regards,
Spiro Taleski
Why did you put the Group By N in a child pipeline? If you merge the child pipeline into the parent pipeline it will work. Pipeline Execute invokes a separate child pipeline instance for every input document when the “Reuse…” checkbox is unchecked, so the Group By N will only receive one document.
Related Content
- 2 years ago
- 2 years ago
- 3 years ago
- 4 years ago