Forum Discussion

kpatnala's avatar
kpatnala
New Contributor
7 years ago

Storing each document into database table.. [xmlformatter --> generic jdbc insert]

Hi, i’m getting following error when executing “Generic Jdbc insert” snap. i have 2 data values that need to be inserted in 2 column table. mapper gives me col1, col2 each having list of 3 valu...
nsingam's avatar
nsingam
Employee
6 years ago

Hi Philliperamos,

I created a pipeline that will keep the last 3 columns as it is and the rest of the row values will be concatenated under the value field.

Here I am attaching pipeline and sample data file.
Hope this is what you are required.

Dynamic_csv_column_change_2019_11_14.slp (10.3 KB)
sample.txt (231 Bytes)

philliperamos's avatar
philliperamos
Contributor
6 years ago

@nsingam it works great! Thanks!

So my file doesn’t have header info, so now I’m just trying to set a header name to fieldX , fieldY and fieldZ

Thanks again!

  • pranil2k2's avatar
    pranil2k2
    Contributor
    6 years ago

    finally i achived it using Mapper, Aggregator.

  • pranil2k2's avatar
    pranil2k2
    Contributor
    6 years ago

    Hi,

    Please someone advice on this one.

    Thanks

    • Supratim's avatar
      Supratim
      Contributor III
      6 years ago

      @pranil2k2

      Go to Oracle Marge view and add output view. After that use aggregate snap for count.

    • SpiroTaleski's avatar
      SpiroTaleski
      Valued Contributor
      6 years ago

      Hi @pranil2k2

      You can try by opening the error view for Oracle Merge Snap(meaning that all the error rows will be routed in that view). In that way you will isolate the pipeline from failing.

      As an output of the Oracle Merge Snap you will get all successful records.

      To count the records from output you can use :

      1. snap.out.totalCount - you will get total number of documents that have passed through.
      2. Use Aggregate Snap(function Count) on some unique column(field).

      Regards,
      Spiro

  • pranil2k2's avatar
    pranil2k2
    Contributor
    6 years ago

    Hi Spiro,

    Thanks for the reply.