ContributionsMost RecentMost LikesSolutionsRe: Data reconciliation solutions? What would be the issue if you use SystemModStamp as your state. e.g. Assuming Data Warehouse is one of the consumer Data Warehouse : select Max(SystemModStamp) > SFDC > REST SOQL where SystemModStamp > $SystemModStamp via SL > Kafka Producer > Data Warehouse Are there any plans to integrate DataHub with snapLogic? Many organizations data engineering team commonly uses Airflow with DBT. Wondering if SnapLogic has plans to tackle these use cases. Re: Secret Management vs Enhanced Account Encryption Here is what I found out. Secret Management applies for all "Dynamic Account Type" and Enhancement Account Encryption applies to any account's secret encryption (*) Secret Management vs Enhanced Account Encryption Is it true that if I decided to proceed on implementing Secret Management, there is no need to configure Enhanced Account Encryption? Assuming they are mutually exclusive. SolvedSnapGPT Wishlist Auto mapped with mapping expression by providing sample input and expected output. Inline mapping expression suggestion based on natural language prompt Auto suggest a collection of snaps based on natural language prompt (Read Transcript data from Cornerstone Transcript) Re: Downloading files stored in Google Drive Were you able to make this work? If so, can you share what you learn? Re: How it do insertion faster for redshift Can you show us the execution time details? That way we know where is the bottleneck. https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/2447474726/BETA+SnapLogic+Studio+Execution+Details Re: Paginated REST GET calls against Monday.com The easiest way to debug is to use a mapper after your REST Get and placed your expression in 2 fields for HasNext and Next URL to ensure it is correct. Re: How to restrict number of fields in REST GET snap? amardeep2021: y to restrict number of field(sa It is all depends on your pipeline design. Can you share your pipeline for better suggestions? Re: Extract transaction sets from text data aaronb: nt is coming in as just a text file which I am then parsing using a CSV delimiter snap with “*” as the delimiter in this case. The issue I run into is that in the file each ST to SE block of data needs to be kept together as it contains invoice header and invoice detail data. The only context of what invoice line detail goes with which header is that they both reside in the same ST to SE block. Hopefully that makes sense or helps clarify. EDI data usually required a purpose build parser. You either likely need to write a custom python script to group it by ST/SE or some 3rd party solution to get it to a XML or JSON form before feeding it to snapLogic