Recent Discussions
Scheduling pipeline to run every 20 mins betwen 05:00 am til 3pm
Is it possible to schedule/ run snaplogic pipeline every 20 mins in timeframe 5am-3pm ? iam able t schedule it every 20 min, but dont know if there is possibility to set time frame. … thank youSolvedSL123453 years agoNew Contributor III94KViews0likes4CommentsUsing Workday RaaS to Extract Data
Using Workday RaaS to Extract Data Workday has a Reporting as a Service (RaaS) interface which allows you to export most data from Workday by creating a custom report within Workday then exposing it as a web service. The output can be various formats such as RSS, XML or JSON format and you can even modify the filters within the URI. RaaS are faster because they are pre-gathered because the actual data gathering happens in Workday cloud whenever the report runs and delivered as the preferred output format of XML or JSON. That’s why it’s faster. Reports are a live look into Workday, and pulls the data as of the current moment just like the WWS which is used by the Workday snap. If you depend on live data, use the Workday snap. Also remember that using reports you’re just shifting the load-debt. It’s still calling Workday, just at a time you may or may not be expecting instead of at the time of the call. Below are high-level instructions on how to retrieve data from Workday within SnapLogic using Workday’s RaaS interface. Step 1 - Create Custom Report in Workday You need to login to a Workday instance Click on Reporting & Analytics Button Click on Create Custom Report Provide some Report Name Report Type: Advanced Data Source: Journal Lines Under Custom Report Data Source Filter: Journal Lines for Financial Reporting and Reporting Time Period Under Columns Journal Number Company Accounting Date Ledger/Budget Debit Amount Ledger/Budget Credit Amount Ledger Currency Journal Source Ledger Line Memo Created By Be sure to share it with the account that you are querying the report with. Some reports Data Sources will enable filters on them so that the data retrieved is indexed and offers some performance benefits. In this report it will prompt you to enable Data source filter Now click on the Prompts tab to populate the default prompts. Once the checkbox is clicked, the prompt defaults are populated. Accept the defaults and if you wish to change the names, please do rename that makes sense for your project. Click OK at bottom to save Step 2 - Ask customer what data do they want. The default behavior is to pull the data as of the current moment. If the customer has a different requirement then please follow this link (Workday Report Data Prompts) to understand how you can control what type of data can be pulled from Workday reports. The above behavior is only possible with Workday Advanced Reports. Step 3 - Get Web Service URL Next to the name of your custom report you’ll see a button … click it and under Actions select Web Services and View URLs You need to set filters for the ones that are mandatory (red asterisk *) Period: 2013 - Jan Ledger: Actuals Amount Type: Activity Time Period: Current Period Company: Global Modern Services, Inc. (USA) Click OK button Workday delivers in multiple formats. (REST - Workday XML, WSDL, JSON, etc). Choose the format you like and copy the URL. It is important to copy the URL for that specific format. REST https://wd2-impl-services1.workday.com/ccx/service/customreport2/tenant_name/nganapathiraju/NG_Journal?Perform_Intercompany_Eliminations=0&Perform_Interworktag_Eliminations=0&Company!WID=cb550da820584750aae8f807882fa79a&Time_Period!WID=ac6e82a2e2d01000180ca7cad7770051&Calculate_Current_Year_Retained_Earnings=0&Calculate_Translation_Gain_or_Loss=0&Amount_Type!WID=dcfe0be6bdf044da8781b873631c71c4&Ledger!WID=93553555942b4b448defb264c084d0fa&Eliminations_Only=0&Period!WID=4facd2281c9a4b2794afc7559475359f WSDL https://wd2-impl-services1.workday.com/ccx/service/customreport2/tenant_name/nganapathiraju/NG_Journal?wsdl JSON https://wd2-impl-services1.workday.com/ccx/service/customreport2/tenant_name/nganapathiraju/NG_Journal?Perform_Intercompany_Eliminations=0&Perform_Interworktag_Eliminations=0&Company!WID=cb550da820584750aae8f807882fa79a&Time_Period!WID=ac6e82a2e2d01000180ca7cad7770051&Calculate_Current_Year_Retained_Earnings=0&Calculate_Translation_Gain_or_Loss=0&Amount_Type!WID=dcfe0be6bdf044da8781b873631c71c4&Ledger!WID=93553555942b4b448defb264c084d0fa&Eliminations_Only=0&Period!WID=4facd2281c9a4b2794afc7559475359f&format=json Refresh URL it will download the report in JSON format after you enter the credentials Step 4 - Create SnapLogic Pipeline to access URL Download Get WD Report.slp included on this page Import pipeline into SnapLogic Modify REST - Get Snap Change Service URL to the URL from Step 2 Create New Account - Basic Auth Enter your Workday Username and Password Validate Pipeline You should see preview data Note you might need to change Mapper if you are using different fields The sample pipeline with basic structure Get WD Report.slp (5.6 KB)nganapathiraju9 years agoFormer Employee54KViews0likes1CommentREST Post Multipart Form-Data + File Upload Issue
I’m having trouble correctly formatting multipart form-data to be sent as the body of a REST Post request along with a single file upload. I’ve managed to get the Post request to correctly send in Postman with the required key/value pairs and a test file: However, when attempting to replicate this in SnapLogic I am unsuccessful. I’ve managed to correctly map the key/value pairs in a mapper, and have created the following JSON in a JSON generator using my mapped values: I’ve used my “entity” object as the HTTP entity in my Post request, and pointed to a local test file for upload in my REST Post snap: Is my approach to compiling the form-data correct, or no?whaleyl7 years agoNew Contributor III30KViews0likes10CommentsSearch in Array
hi there, I have data coming in these structures source1 - { "@type": "array", "order-line": [ { "line-num": "00010", "attachments": { "@type": "array", "attachment": { "type": "AttachmentText", "text": "Testing the Long Text Documents" } } }, { "line-num": "00020", "attachments": { "@type": "array", "attachment": [ { "type": "AttachmentText", "text": "This is the Third time being sent.\n\nIn our continuing efforts to reduce transportation costs and increaseefficiency Clearway Energy Inc. has contracted Malark Logistics andjointly developed the following routing instructions. Please complywith the following instructions. Failure to comply will result inescalating non-compliance fees beginning at $50.00 per shipment andreaching $250 plus freight costs for subsequent violations.\n" }, { "type": "AttachmentText", "text": "This is the second time being sent.\n\nIn our continuing efforts to reduce transportation costs and increaseefficiency Clearway Energy Inc. has contracted Malark Logistics andjointly developed the following routing instructions. Please complywith the following instructions. Failure to comply will result inescalating non-compliance fees beginning at $50.00 per shipment andreaching $250 plus freight costs for subsequent violations.\n" } ] } } ] } and source2 - { "line-num": "00020", "attachments": [ { "type": "AttachmentText", "text": "This is the second time being sent.\n\nIn our continuing efforts to reduce transportation costs and increaseefficiency Clearway Energy Inc. has contracted Malark Logistics andjointly developed the following routing instructions. Please complywith the following instructions. Failure to comply will result inescalating non-compliance fees beginning at $50.00 per shipment andreaching $250 plus freight costs for subsequent violations.\n", "Id": null } ] } how can I compare to see Source2 Atttachment.Text exists in Attachment.Text of Source1’s , where line-num is same? Any help is greatly appreciated. Thanks ManoharSolvedmanohar5 years agoContributor28KViews0likes8Comments- walkerline1178 years agoContributor26KViews0likes3Comments
Converting Datetime with AM/PM to 24Hr date format
Hi, I have a requirement where from the source file. I am getting date as string value ‘10/21/2019 6:16:54 PM’, I want the date to be converted into yyyy-mm-dd hh:mm:ss format. In the example given above the output should be ‘2019-10-21 18:16:54’. 8/3/2019 4:24:00 AM for this input output should be 2019-08-03 04:24:00 for 7/3/2019 12:09:45 PM output should be 2019-07-03 12:09:45 I was able to achieve this using a complex regex but if anyone has a better way to do this please reply to this thread. Regards AnubhavSolvedanubhav_nautiya6 years agoContributor26KViews1like5CommentsUsing Github as a code repository for SnapLogic artifacts
Hello SL community!! Coming from a typical SOA/ESB background and working on tools like TIBCO Businessworks, Webmethods, etc. I was wondering if we have a way of using any code repository tool (Github, etc.) to store our Projects and other artifacts. I understand we have a intuitive Import/Export capabilities, this is manual and is a explicit activity to be performed by a developer. I was wondering: if we have anything (or is there a possibility) to integrate SL and GitHub. This should ensure that the Project and its assets gets checked-in into the GitHub repo without us doing any manual import-export. And that this can be further use to move code from one environment to another (code migration). I am new to the SL world, but already finding the community really helpful 🙂 All response would be of help 🙂 Thank you! Sudhendusudhendu9 years agoNew Contributor II24KViews0likes29CommentsCreate TrustStore & KeyStore Files From Certificate?
I’ve been provided a PEM certificate in a .cer file format for connecting to an API by a third-party, and I’m trying to convert it to the correctly formatted truststore and keystore .jks files so that I can create a REST SSL account. Does anyone have any resources or instructions that clearly outline how to do this? I’ve unfortunately been unsuccessful using the keytool utility bundled with the JDK. I don’t personally have any experience doing this. Thank you in advance.Solvedwhaleyl3 years agoNew Contributor III21KViews0likes3CommentsGetting "error_code": 1207 while validating before loading Redshift database
Hi All, I am trying to load a new redshift table which I have created. While validation, I am getting “error_code”: 1207 “error_message”: "Invalid digit, Value ‘.’, Pos 9, Type: Integer " “column_value”: "595546349.04 " I have tried with DOUBLE PRECISION, REAL to alter the column data type of this redshift table, still getting above error. Also used parseFloat() before using redshift for this field, not working and same error. Does anyone know how to address this? Please let me know. Regards, Amaramardeep20214 years agoNew Contributor III20KViews0likes17CommentsConverting Varchar data into Datetime
Hi everyone, I’ve been trying to convert data I’m receiving from a varchar (20171211 125023) into a datetime (2017-12-11 12:50:23). I’ve been messing with the mapper but I feel like I’m at a road block now. I was wondering if someone in the community has any success in this.Matt7 years agoNew Contributor20KViews0likes13Comments