Hi Experts,
We are trying to build data warehouse via snaplogic. Whenever there is same record pulled from source (Big data system) we should have same ID generated and when there is new record then new id has to be generated. Since this is decommission of the existing system there is huge volume of data (~165 million) so comparison with target system for the already available records is expensive operation.Also, we are going to load the data in new database and make the previous generated IDs to sync with newly generated IDs. Do share your knowledge if anyone has implemented without comparing the data and generated the ID based on incoming data.
Thanks,
Mani.
