gowdhaman008
New Contributor II
Joined 7 years ago
User Profile
User Widgets
Contributions
Amazon Cognito OAuth2 Rest configuration
Hi, Wanted to configure OAuth2 REST account to be configured in Snaplogic. Underlaying the REST calls are deployed in Amazon Cognito. Please check the screenshot below, We have configured all the required parameters, but could not get access token. It is redirecting to new page and access tokens are showing up in URL parameter. Can someone help us out how to configure AWS Cognito APIs in Snaplogic? Thanks, Gowdhaman1KViews0likes0CommentsRead Access key from Azure Key vault
Hi, Is there any way to connect to Azure key vault and read access key information from there? I have requirement to that keys are going to be roated frequently and keys are going to be stored in Azure key vault. So I wanted to read recent access key for connecting to Azure storage. Thanks, GowdhamanCI/CD - Sample Pipelines
Hi, I went through blog post on implementing CI/CD for snaplogic pipelines. Please refer to the following links. End-to-end pipeline automation and governance (Part 1 of 2) | SnapLogic End-to-end pipeline automation and governance (part 2 of 2) | SnapLogic I could not find the sample pipelines shown up in the blog post or snaplogic video. Can you please help me sending those pipeline (slp files)? Thanks, Gowdhaman2.7KViews0likes1CommentRe: Zip write not customisable
@Harsha3, You can try something similar as follows.I was trying to show you some sudo code on how to do that. You can refer to the following screenshot, it may give you some idea as your pipe is having many SOQL query and excel formatting. Thanks, Gowdhaman1.9KViews0likes0CommentsRe: All green but no upload file
We have faced some issues like this. There may be chances that your files are swept after snaplogic writes data into SFTP location. Please try to check SFTP/FTP owners if they found anything in their log. Try to copy the files in SLDB itself and see if files are written and have data in it. Hope it helps!!1.2KViews1like0CommentsRe: Zip write not customisable
Take a look at the following script. You should use the file format or document to binary snap. Zip write accepts many files can be written here. Take a look at the following screenshot, your each process should connect to formater / document to binary and send to zip write. Hope this helps.!!2KViews0likes0CommentsSQL Server Merge Snap - Issues with Date as Null
Hi, I have developed the pipeline which reads the data from the incoming stream and send to SQL Merge. My pipeline looks like below. My Input JSON is as follows: [ { “member_id”: 13000561, “intervention_id”: 1000034495, “sentiment”: null, “last_updated”: null, “incentive_offered”: null, “reaction_details”: null, “dashboard_name”: “SalesForce”, “created”: null, “intervention_assessment”: null, “tactic_details”: null, “created_by”: null, “followup_deadline”: { “_snaptype_localdate”: “2019-10-13” }, “followup”: false, “last_updated_by”: null, “contact_method”: null, “contact_made”: false, “date_of_intervention”: null, “intervention_notes”: null }] Configuration for SQL Merge Snap: Please note that we are allowing null for all the columns expect the intervention id which is the primary key. When we are running the pipeline, we are getting the following error. { “error”: “SQL operation failed”, “stacktrace”: “java.sql.BatchUpdateException: Implicit conversion from data type varbinary to date is not allowed. Use the CONVERT function to run this query.\n\tat com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeBatch(SQLServerPreparedStatement.java:1178)\n\tat com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:128)\n\tat com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java)\n\tat org.jooq.tools.jdbc.DefaultStatement.executeBatch(DefaultStatement.java:93)\n\tat org.jooq.impl.BatchSingle.executePrepared(BatchSingle.java:239)\n\tat org.jooq.impl.BatchSingle.execute(BatchSingle.java:182)\n\tat com.snaplogic.snap.api.sql.operations.JdbcOperationsImpl.lambda$flushBatch$8(JdbcOperationsImpl.java:1547)\n\tat com.snaplogic.snap.api.sql.operations.JdbcOperationsImpl$$Lambda$394/1810556666.call(Unknown Source)\n\tat net.jodah.failsafe.Functions$11.call(Functions.java:263)\n\tat net.jodah.failsafe.SyncFailsafe.call(SyncFailsafe.java:145)\n\tat net.jodah.failsafe.SyncFailsafe.get(SyncFailsafe.java:69)\n\tat com.snaplogic.snap.api.sql.operations.JdbcOperationsImpl.flushBatch(JdbcOperationsImpl.java:1546)\n\tat com.snaplogic.snaps.sql.SimpleSqlWriteSnap.handle(SimpleSqlWriteSnap.java:136)\n\tat com.snaplogic.cc.snap.common.SnapRunnableImpl.callback(SnapRunnableImpl.java:836)\n\tat com.snaplogic.cc.snap.common.SnapRunnableImpl.executeForSuggest(SnapRunnableImpl.java:644)\n\tat com.snaplogic.cc.snap.common.SnapRunnableImpl.doRun(SnapRunnableImpl.java:852)\n\tat com.snaplogic.cc.snap.common.SnapRunnableImpl.access$000(SnapRunnableImpl.java:118)\n\tat com.snaplogic.cc.snap.common.SnapRunnableImpl$1.run(SnapRunnableImpl.java:392)\n\tat com.snaplogic.cc.snap.common.SnapRunnableImpl$1.run(SnapRunnableImpl.java:388)\n\tat java.security.AccessController.doPrivileged(Native Method)\n\tat javax.security.auth.Subject.doAs(Subject.java:422)\n\tat org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)\n\tat com.snaplogic.cc.snap.common.SnapRunnableImpl.call(SnapRunnableImpl.java:387)\n\tat com.snaplogic.cc.snap.common.SnapRunnableImpl.call(SnapRunnableImpl.java:118)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:266)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:266)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)\n\tat java.lang.Thread.run(Thread.java:745)\n”, “reason”: “Implicit conversion from data type varbinary to date is not allowed. Use the CONVERT function to run this query., error code: 257, SQL state: S0003”, “resolution”: “Please check for valid Snap properties and input data.”, “status_code”: “error”, “status”: -3, “snap_details”: { “label”: “SQL Server - Merge”, “instance_id”: “7de1aaf6-483b-4e42-b1ed-46cf7f1fd2bd”, “class_id”: “com-snaplogic-snaps-sqlserver-merge”, “build_tag”: “snapsmrc523”, “views”: { “in”: { “input0”: { “count”: 2 } }, “out”: {}, “error”: { “error0”: { “count”: 0 } } } }, “original”: { “member_id”: 13000561, “intervention_id”: 1000034495, “sentiment”: null, “last_updated”: null, “incentive_offered”: null, “reaction_details”: null, “dashboard_name”: “SalesForce”, “created”: null, “intervention_assessment”: null, “tactic_details”: null, “created_by”: null, “followup_deadline”: { “_snaptype_localdate”: “2019-10-13” }, “followup”: false, “last_updated_by”: null, “contact_method”: null, “contact_made”: false, “date_of_intervention”: null, “intervention_notes”: null } } Please note that same thing works with the SQL Insert, but we are expecting the upsert to the table. Please help us resolving the issues. Thanks, Gowdhaman3.7KViews0likes2Comments