Forum Discussion

chmurray88's avatar
chmurray88
New Contributor II
3 years ago

PostgreSQL - Bulk Load with schema provided

Hello -

I am trying to provide a schema for the PostgreSQL - Bulk Load snap to use. I’m getting an error that “Expecting a schema document with a map of column names to their descriptions”.

I have a query that returns the column names and their data types. I’ve done this with the parquet writer snap and it works fine. With this snap, it seems like there is a different format needed to send in the schema.

I’ve looked on the documentation for the snap and there is no example. Was looking to see if anyone could provide some insight on this for me.

Thanks!

Chris

4 Replies

  • Aleksandar_A's avatar
    Aleksandar_A
    Contributor III
    3 years ago

    Hello @chmurray88,

    Maybe you can try by using PostgreSQL - Select snap with second open output view to feed the wanted schema to the PostgreSQL - Bulk Load snap, or at least you can get an insight of what’s the expected metadata format.

    Try it and let me know if this helps you. 🙂

    BR,
    Aleksandar.

  • chmurray88's avatar
    chmurray88
    New Contributor II
    3 years ago

    Thanks for responding @AleksandarAngelevski

    I think I’m closer now.

    I think I’ve narrowed it down to needing to pass in columns and data_type.

    Now I’m getting a different error that says “Expecting object or array for wildcard path, found: col1, Resolution: Expecting a schema document with a map of column names to their descriptions.”.

    So…any idea?

    • Aleksandar_A's avatar
      Aleksandar_A
      Contributor III
      3 years ago

      Since I haven’t used any of the PostgreSQL Snaps, could you provide a sample of the metadata from a Select Snap output and a sample of what you are passing to the Bulk Load’s second input view?

  • chmurray88's avatar
    chmurray88
    New Contributor II
    3 years ago

    I heard back from the product team on this. There is no support for providing your own schema directly to the second input of the postgresql bulk upload snap.

    As a work around…I created the table first and then pointed to the newly created table. It works, but…if there is no data from the source you have a blank table out there. Not a huge deal, but would like to see SnapLogic support this in the future.