aprabhav
New Contributor III
Joined 4 years ago
User Profile
User Widgets
Contributions
Error Handling in multitple levels of parent-child hierarchy
I have a parent child pipeline hierarchy that is 4-5 level deep. In other words, parent pipeline (p1) calls a child pipeline (c1). c1 in turn invokes its child pipeline (c2). c2 then invoked its child pipeline c3 etc…etc… p1 → c1 → c2 → c3 → c4 I would like to have the error pipeline only configured for the main pipeline p1 and not have error pipeline for any other child pipelines. I expect that any error in a child pipeline would be propagated up the hierarchy till it hits the error pipeline. What I am finding is that the error is propagated only one level up and not beyond. Is that correct or is there any way I can achieve what I intend?Embedding SnapLogic in a SaaS product
We are a SaaS product company. We use SnapLogic as the iPaaS integration platform in our product. We have built pipelines to onboard data from our customer’s source systems (erp, google drive, sftp etc.) and bring it into products data lake. Currently, our customer success/support team ends up configuring connections to customer’s source systems in SnapLogic platform. IMO, the ideal experience for our customers is to have a self service ability to define the connection to their source systems from within our product UI. Has anyone been able to do that? I would really appreciate any ideas or thoughts on how to make this happen. Thanks in advance… Regards4.2KViews0likes7CommentsEdit account using API?
I need a way to edit an account programatically using API. In our case, the end-user uses our application to enter the credentials for a data source (e.g. google drive, SFTP etc). I would then like to edit the corresponding account in Snaplogic with these credentials using APIs and then start the pipeline using APIs.2.5KViews0likes1CommentRe: How to handle SERIAL column while using Postgres Bulk Load Snap
Thanks Pero for your helpful suggestions. It should not be required to add the serial column data in the input document. I was able to fix this problem by doing the following… specified the list of columns (excluding the serial id column) in the Columns list in the snap used ‘Text’ option for the format field in the snap unchecked ‘Header provided’ field in the snap.596Views1like0CommentsRe: How to handle SERIAL column while using Postgres Bulk Load Snap
Thanks for the response, Pero. However, this solution would cause duplicate entries getting inserted into the id column (serial column) in the table for multiple runs of the pipeline. Postgres /Copy command allows you to do this by not including such id column and specifying the names of the other columns explicitly in the copy command. I tried the same using the Columns field in the Postgres Bulk Load snap and included the other columns explicitly and left the serial column out. But it throws errors where it still tries to load the serial id column incorrectly.2.3KViews0likes2CommentsHow to handle SERIAL column while using Postgres Bulk Load Snap
I am trying to use a Postgres Bulk Load snap. But my table has a serial column (viz. id). I tried a couple of things but the postgres bulk load snap fails due to various errors as my input data does not have id column. I was expecting that the snap would behave like the postgres copy command. I would like to know how others have used postgres bulk load snap in such cases.3.1KViews0likes5Comments