Forum Discussion

Former Employee

8 years ago

Ingest data from Database (Oracle) into the Hadoop Data Lake (HDFS+Hive) using the AVRO as the Data format

Created by @pkona This pattern ingests all the tables present in an Oracle database into the Hadoop Data Lake. This pattern will achieve the following: Automatically creates Avro schemas and...

Pattern 3 - Step 1.2 - Oracle to Hive No Sharding_2018_08_24.slp15 KB

Pattern 3 - Core - Write schema to HDFS_2018_08_24.slp8 KB

Pattern 3 - Step 1.1 - Ingest - Generate Hive table Avro based on Oracle Table metadata_2018_08_24.slp22 KB

Pattern - Core - Query Hive Table Metadata_2018_08_24.slp5 KB

Pattern 3 - Step 1.2.1 Oracle to Hive - process a shard_2018_08_24.slp10 KB

sample_pipeline

Former Employee

6 years ago

Prasad is no longer in this community. Perhaps someone else who has used this pattern can provide further insight.