Forum Discussion

Matthias's avatar
Matthias
New Contributor III
4 years ago
Solved

Reusable pipeline with Aggregate / Group by fields

Is it possible (and how) to build reusable pipelines with Aggregate / Group by fields, where the “group by” clauses are dynamic (and the number of clauses is provided as a list in the document). I’...
  • alchemiz's avatar
    alchemiz
    4 years ago

    Hi Matthias,

    Good day, what I did before was put the streaming documents in an array (you can use the Gate snap) then loop through the array doing the aggregate and grouping

    See attached poc pipeline

    input:

    output:

    test_2021_11_10.slp (13.4 KB)

    Thanks,
    EmEm

ptaylor's avatar
ptaylor
Employee
4 years ago

Matthias,

I’m afraid the Aggregate snap doesn’t have the flexibility you’re looking for. While each field name in each row of both fields tables can be dynamically derived using an expression, you can’t dynamically populate the entire content of these tables.