Recent Discussions
Automating Pipeline Deployment with Account Mapping
Hello, If you're looking to automate the deployment of pipelines from your Dev org to your Prod org—while dynamically switching out environment-specific accounts—this post might help. We ran into a challenge: many of our pipelines (some with 50+ accounts) needed to be deployed from Dev to Prod, but with different accounts in each environment. Unfortunately, SnapLogic doesn’t currently offer a native, out-of-the-box solution for replacing accounts during deployment. So, we built a workaround that works well for our use case. We developed a simple web interface to make selecting and deploying projects easier (optional), and we also back up deployed Prod projects and APIs to GitHub (also optional). The core idea, however, doesn’t rely on either of these extras. High-Level Overview The architecture is straightforward: A pipeline in the Dev org displays the available projects and APIs. A pipeline in the Prod org handles the actual deployment, replacing account references along the way. Let’s break down the approach. Pre-requisites Before this will work, four critical conditions must be met: Account Naming Convention Dev accounts: D[0-9][0-9][0-9]_anything (e.g., D001_SQLdb1_admin) Prod accounts: P[0-9][0-9][0-9]_anything_else (e.g., P001_SQLdb1_customer_admin) Each account pair must share a unique numeric prefix (e.g., 001). This prefix is used to map Dev accounts to their corresponding Prod equivalents. Accounts Stored in Root Shared Folder All environment-specific accounts should be stored in /shared/. This ensures that account paths remain consistent regardless of project space. Admin Access The service user executing these operations must have Org Admin rights in both Dev and Prod environments. Mirrored Project Spaces If a project is located in a specific project space in Dev, the exact same project space (same name) must exist in Prod. If all four conditions are satisfied, the process should work reliably. Exporting the Project (from Dev) In the Dev org, we use a pipeline to list available projects or APIs. Users select the item to deploy, and we pass its full path to the Prod pipeline. In the Prod org, we start by calling SnapLogic’s export API: https://docs.snaplogic.com/public-apis/get-project-export-project-path.html We issue a request to: https://{controlplane}/api/1/rest/public/project/export/{project_path}?asset_types=Pipeline&asset_types=Account&force=true This returns a ZIP archive containing: export.json: The pipeline definitions accounts_template.json: The referenced accounts in those pipelines Mapping Dev Accounts to Prod Accounts From accounts_template.json, we extract all Dev account references. For each one, we map it to its corresponding Prod account based on the naming convention: [ { "dev_account_id": "D037", "dev_account_path": "/YourOrg-Dev/shared/D037_something_CRM", "prod_account_id": "P037", "prod_account_path": "/YourOrg-Prod/shared/P037_something_different_CRM" }, ... ] Replacing Accounts in export.json A script (language-agnostic) processes export.json, replacing every instance of a Dev account path with its Prod equivalent. Since all accounts are stored in /shared/, the replacements are consistent across project spaces. This approach can be reversed as well—for example, when syncing from Prod back to Dev. Importing the Modified Project (to Prod) Finally, the updated export.json is zipped up and imported using SnapLogic’s import API: https://docs.snaplogic.com/public-apis/post-project-import-import-path.html Because we’re only modifying account paths, no credentials are exposed or transferred. Final Thoughts While SnapLogic doesn’t natively support environment-aware deployments, this solution fills the gap with automation and repeatability. Unfortunately, I can’t share the pipelines themselves, but with the above approach, you should be able to build a similar solution tailored to your environment. If you have any questions, feel free to ask. Thanks for reading!adam_gataev2 months agoNew Contributor II258Views1like0Commentsin-house AI model building, training, integration and inference
<iframe src="https://www.linkedin.com/embed/feed/update/urn:li:ugcPost:7310991510357852161?collapsed=1" height="399" width="504" frameborder="0" allowfullscreen="" title="Embedded post"></iframe>dimitvl4 months agoNew Contributor389Views0likes0CommentsGenAI Builder Enables Financial Services: ARR/ACV Reconciliation
In the world of Finance, calculating ARR often requires manual review and backfill that is not scalable. This is often worsened by inaccurate reporting when querying Salesforce directly and manual data entry & interpretation of contract term lengths. Using GenAI Builder, you can have a solution that automatically extracts contract start and end dates, and summarizes ARR total amounts for each contract term length This could lead to an estimated 8X faster reporting, reducing 4 hrs down to 0.5 hrs to create reports.dmiller12 months agoFormer Employee1.6KViews1like1CommentGenAI Builder Enables Sales Organizations: Pre-sales Assistant
As a member of a sales organization, what are you to do when researching a prospect is a manual process and you encounter disparate data from public and private sources? With GenAI App Builder, you can build a solution that has the ability to retrieve and summarize information on the prospect and automatically creates a pre-sales report. This not only saves the Sales rep time from manually researching prospect, but also leads to higher satisfaction with the prospect by coming prepared with company information to your discussions.dmiller2 years agoFormer Employee892Views0likes0CommentsGenAI Builder Enables Government/Public Services:Virtual Public Servant
With information on public services often dispersed across departments and locations, government employees are often challenged in rapidly accessing and summarizing this information when responding to citizen inquiries. With a GenAI App Builder solution, you can create a Virtual Assistant to distill and summarize info that has instant access to all data and can summarize and explain available public services. Not only does this save time for government employees, but it also increases customer satisfaction.dmiller2 years agoFormer Employee928Views0likes0CommentsGenAI Builder Enables Manufacturing: Transforming Billing Reconciliation
In manufacturing, payment formulas in contracts that are inaccurate or worse, missing, can lead to $10M’s lost due to underbilling. With GenAI Builder, you could implement a solution that: Accurately extracts payment formulas from contracts Highlights discrepancies between the contracts and the billing system A GenAI Builder solution can go to market 30X faster time when compared to hand-coding (3 days for GenAI Bulder versus 90 days to hand code).dmiller2 years agoFormer Employee865Views0likes0CommentsGenAI Builder Enables Higher-Ed: Customized Student Career Counseling
The process around student academic advising and career counseling is often a manual one, with student data coming from many different sources. With GenAI Builder, you could build a solution that pulls student data to suggest: Fields of study Courses Extracurriculars / Clubs Potential Careers From there, you can then build out customized academic advising and career counseling. The results would be a reduction in the amount of resources required to help students and an improvement student success.dmiller2 years agoFormer Employee1.3KViews2likes0CommentsSnapLogic Mainframe Accelerator
The SnapLogic Mainframe Accelerator is a collection of fully functional pipelines that read and write Cobol Copybooks, DB2 and file systems. It is now available as a free download from the AWS Marketplace. Learn more in this video.rdill2 years agoAdmin1.6KViews1like0CommentsDo you agree with these CIOs?
I recently wrote a blog on CIOs and how they view scaling success at their companies. I felt that being data-driven was one of the best answers. I'm seeing a lot of customers using SnapLogic to enable data-driven decision making for their business. What would you say is the best way to scale success at your company?dliu2 years agoFormer Employee1.1KViews0likes0CommentsHigher Ed Customer WINS AWARD: w/ just 2 ppl they were able to migrate to Oracle Cloud in 9 months?!
It's amazing how many schools have little IT resources and they are trying to transform their IT infrastructure to meet their students needs. Skidmore College as an example were able to use SnapLogic to migrate their data from legacy on-premise servers to the Oracle Cloud with just 2 people. They won an award for this amazing feat! Are any of you struggling with a cloud migration project? Post about it here. You can read more about Skidmore's Data Integration Award here:https://www.snaplogic.com/blog/skidmore-snaplogic-ventana-awards-digital-leadershipdliu2 years agoFormer Employee1.4KViews0likes0Comments