tom_saunders
New Contributor
Joined 6 years ago
User Profile
User Widgets
Contributions
Re: Compare two files to see if they are the same
With some assistance from our good friends at SnapLogic I have a solution to this now. To get a hash of a file, you can use a Binary to Document snap, and then use a Mapper on the resulting document. The expression “Digest.sha256($content)” will generate an sha256 hash from the file. This hash can then be compared with other hashes to rcognise duplicate files. In my use case I have run this process on files in two different directories and then done an outer Join on the hash values to produce a report on which files match and which do not.3.1KViews1like0CommentsCompare two files to see if they are the same
Does anyone have any experience or recommendations about how to compare two files and check if they are identical? I don’t mean data files, I’m thinking about media files here so something along the lines of creating a hash of the files and comparing them?SolvedBest practice for adding Subscribers to an AWS SNS topic
Apologies if this has already been covered, but I can’t find anything on the search. We need to add Subscribers to an AWS topic in bulk. The most basic use case of this will be a list of Subscribers and adding them via SnapLogic to an empty AWS SNS Topic. A more advanced “nice to have” would be the ability to take a list of potential Subscribers, compare that to an existing AWS SNS Topic, and update the Topic to match (adding missing Subscribers and removing Subscribers that are not on the current list). I’ve read about the AWS SNS API so was thinkg I’d use an API snap, but reading the similar topic below it seems the final result used a Python script snap: Best practices to publish to a AWS SNS topic Designing Pipelines SnapLogic currently doesn’t have a dedicated snap pack for AWS SQS and SNS integration. Though we can use JMS consumer/producer snaps to configure it for SQS seamlessly however there is no mechanism to do that for SNS. I guess the only possible way to publish to an SNS topic within a pipeline is use the REST api via GET/POST snaps. Is that true? What are the configuration steps required for security to send access and secret keys with the REST snap in order to do that? where should be keep thes… A demo pipeline would be ideal but any guidance is appreciated. Thanks, Tom3.1KViews0likes1Comment