Order of Execution Not Right

What is the Join type?

Just seen this on the Join Snap article here:

Known Issue : When the upstream Snaps of the Join Snap contains Copy, Router, Aggregate, or similar Snaps, it is likely that the data flow of a branch in a Pipeline gets blocked until another branch completes streaming the document. The Join Snap might hang if its upstream Snaps in a Pipeline has a blocked branch.

Workaround : Set Sorted streams to Unsorted in the Join Snap to effectively buffer all documents in all input views internally—this unblocks the document flow of all the upstream branches. The internal sorters sort the input documents from the input views into the local temporary stage.

I’ll do some investigating

@NAl - if you want all the data to be inserted into the Create Deal/Job before any data is sent to the Upsert Content, you could simply place a Sort just before the Upsert. This will effectively cache all the data until the upstream snaps have completed.

You are basically running into a race condition where the Deal/Job records may not have been committed to the database before the Upsert Content tries to insert a new record that is reliant on that relationship.

@NAl - I just noticed that you are looking at a pipeline validation - it appears that you perhaps have the “Snap Execution” mode set to “Execute Only” meaning that it wouldn’t allow those documents to actually update the endpoint unless you actually execute the pipeline. If that is the case, you are correct that the Upsert would be failing due to those missing references.