Hi, I have a REST API where the page index is passed in the request body. There is no indication of total records, so you must increment the page index in the request body until no records are returned. I cannot see how to do this via the pagination ...
I have a use case to load some large CSV files (in GBs) from windows network drive to Snowflake. Used a CSV parser and loading it using Snowflake bulk load. Pipeline is running without any issues. However, it takes a lot of time to load the data. Is ...
Hi Everyone,I created a user with administrator privileges to invoke pipelines in a project using a username and password. However, I now want to reduce the user's role to a lower level.Before making this change, I want to ensure it won't disrupt any...
I have a situation something like this: Employee IDEffective DateOffice11/1/2023San Francisco11/1/2024Oakland26/1/2023Sydney212/1/2023Tokyo I need to add an order column and end date of the previous record column. Can you please suggest any ways of ...
Using Workday RaaS to Extract Data Workday has a Reporting as a Service (RaaS) interface which allows you to export most data from Workday by creating a custom report within Workday then exposing it as a web service. The output can be various format...
Hello,I need to write files into S3 by keeping file Size(<20mb) ,rather than giving number of records batch limit using pipeline execute. My input is dynamic sometimes 1k records write file >20mb , sometimes 10k records is <20mb. We also have batches...
How do I remove spaces from the output ?Output of this pipeline is [ {"lrs": ["Indiana","Alabama",""] }]
I have a two part question. I have to perform 3 queries to extract information from an application. I can put all 3 queries in the same REST Get snap. First question is…is this better or worse than using 3 separate REST Get snaps? Second question d...
