Solved
Kafka consumer Skip messages when fail
Hi ,
We pull the data from Kafka and put it and the database, but we realized the Kafka consumer skips the data/offsets if the pipeline fails.
for example: in a run Kafka consumer is supposed to ...
Forum Discussion
Hi @Pretty,
You can use “type converter” snap to add/modify data type, let me know how it goes.
hello @darshthakkar @ljupcho_machkovski
Thanks for your quick response.
Type converter and type inspector snaps are not available in our snaplogic so is there any alternative method or snaps to achieve this?
the attachment doesn’t contain .slb file needed to import into snapLogic
There isn’t an .slb file format.
Individual pipelines are exported out as .slp files.
Projects are exported out as .zip files and imported in as such within Manager. Once you import the project, you should see the 4 pipelines.
We are able to use this to move stuff from our Stage or to our Prod org (and reversed) but we do not seem to be able to move to our UAT environment, which is where we need to test our pipeline against the forced upgrade November 10th.
When we try, we get:
The requested resource at the supplied path does not exist: /SVG-UAT/projectsAny word on how to move resources to the UAT environment?
@jason.cotterell, I don’t believe you can migrate code between http://elastic.snaplogic.com and http://uat.elastic.snaplogic.com. We push all our assets to Git from elastic.snaplogic.com and pull from Git to uat.elastic.snaplogic.com using rest/metadata snaps.
Hope this helps.@psadasivam I wish the professional services that we paid to come on site had this sort of knowledge. Now we’re in a lurch.
Is there any way to export as slp files without downloading the pipeline file?
Basically I am looking for any automate way of export the entire/specific set of pipelines to S3 or other storage for backup.
I don’t need any manual kind of import and export works? I need any best approach to get the slp file by automation.
Please provide any suggestions? Thanks in advance.
Am developing a pipeline which can be used for Check out, check in to GIT and migrating the pipelines/task/account from GIT(not GIT HUB) to Snaplogic Prod org. I have created a Service account in snaplogic. I need to run the migration pipelines using the service account, so that any pipelines/task/account created in production snaplogic org is owned by service account user. How do I achieve that ?
Mostly likely I will call migration pipeline via triggered task from ansible/Jenkins pipelines.
How are you all migrating accounts from GIT. The account config will be different for dev/qa/prod
@dshen - Can you help answer the questions ?
