Anyone successfully use Snaplogic to manage their ETL hive queries?
One of the main capabilities I need is the ability to dynamically initiate pipelines / hive queries based on table references.
e.g.
query 1: reference table 1, 2, 3 : write a
query 2: reference table 4, 5, 6 : write b
query 3: reference table a, b. 9 : write c
query 4: reference table b, 1, 2 : write d
query 5: reference table c, d : write e
execute order: q1 and q2 > q3 and q4 > q5
Any ideas?
