Forum Discussion

darshthakkar's avatar
darshthakkar
Valued Contributor
3 years ago
Solved

Converting value of input schema to distinct columns

Hi Team, I’m reading a text file and wanted to fetch DISTINCT columns out of the data itself, screenshot below for your reference. .txt file: When I read the above data in snaplogic, the f...
REST
  • koryknick's avatar
    koryknick
    2 years ago

    lukaszwisinski - This is a known issue that should be addressed in the next release.  In the meantime, I have created a pipeline that updates the pipeline metadata.  Please download the attached zip file, decompress it, and import the SLP file as a new pipeline.  Update the pipeline parameters to point to your project with the pipeline you want to use the expressions to specify your expression library file and execute the pipeline.  Close and re-open your pipeline and you should see the expression button re-enabled.

    Hope this helps!

pmanchevski's avatar
pmanchevski
New Contributor II
4 years ago

Hi @anayak

If you are able to load it as TEXT easiest fix would be in the mapper to use JSON.stringify(value) function. This function will convert your value into JSON string.

Also you can try to insert your records with “PostgreSQL - Bulk Load” or with “PostgreSQL - Execute” snaps.

Regards,
Pero Manchevski

anayak's avatar
anayak
New Contributor III
4 years ago

I have tried JSON.stringify and Json.parse, the value is converted to JSON but not read as jsonb when run with Postgres-Insert snap. Will try bulk load and execute snaps instead. Thanks!

  • smudassir's avatar
    smudassir
    Employee
    4 years ago

    I don’t see a File Writer snap in your pipeline? I see BinaryToDocument and then Rest Put. Correct me if I am wrong.

    • Trakmaker's avatar
      Trakmaker
      New Contributor
      4 years ago

      Hi @smudassir , I have not used file writer in the above pipeline but I will upload the file using file writer and read it using the upload files field in the REST PUT.

      • smudassir's avatar
        smudassir
        Employee
        4 years ago

        Well, 501 is a server side error. Can you enable the error view on the Rest Put snap, and provide the error view details here?

  • j_angelevski's avatar
    j_angelevski
    Contributor III
    4 years ago

    Hi @Trakmaker,
    Can you share which headers are you passing in the REST Put snap ?

  • Trakmaker's avatar
    Trakmaker
    New Contributor
    4 years ago

    Yes

      • smudassir's avatar
        smudassir
        Employee
        4 years ago

        I would say lets refer to the REST PUT API doc for this endpoint and try to set Transfer-Encoding header accordingly.