Forum Discussion

ssmith266's avatar
ssmith266
New Contributor
4 years ago

The root pipeline execution is no longer running

I get the attached error while I was running one of my pipelines. This doesn’t look like a SQL or syntax issue – could SnapLogic be acting funky here? Has anyone run into this error before?
Developing Snaps
gregbowers's avatar
gregbowers
New Contributor
2 years ago
Copy LinkReport

Hello

Here are some quick tips for real-time data integration with SnapLogic:

  1. Break down workflows into reusable components.
  2. Monitor pipeline performance closely.
  3. Test thoroughly before deployment.
  4. Utilize Ultra Pipelines for high performance.
  5. Check out the SnapLogic blog for success stories.

Hope this helps!

  • cstewart's avatar
    cstewart
    Former Employee
    6 years ago
    Copy LinkReport

    I believe that the glob filter is only applied for the suggest operation in the Designer, not a run-time setting. If you want to scan for files, you may want to use the Hadoop directory Browser Snap, which will output the list of files, which you can then pass into the HDFS File Reader to do the actual file reading.

  • philliperamos's avatar
    philliperamos
    Contributor
    6 years ago
    Copy LinkReport

    Thanks @cstewart . Unfortunately we are not using Azure Data Lake for our infrastructure as at this point, we are using Blob storage. And the Hadoop Dir Browser needs an Azure Data Lake account.
    We are considering moving to the data lake as it has other benefits that the organization can utilize.

    Barring the Hadoop Dir browser snap, is there any other way?