Forum Discussion

korey99's avatar
korey99
New Contributor
5 years ago

Reading list of files/directories from Azure Blob Storage

Hi- I’m trying to figure out how to read a list of files and directories from Azure Blob Storage and then do something with those files.

I have succeeded in reading and writing to Azure Blob Storage, to a specific file, using HDFS Reader and Writer.

What I’ve currently got is an HDFS Reader, but I didn’t specify a file:

It’s connected to a JSON Parser. When I click the data preview between the two, I get a list of my files, which is good. I figure I need a parser, because the data coming from HDFS is binary. But I haven’t been able to figure out how to parse them. The JSON parser doesn’t validate, and shows this error:

Any guidance?

  • darshthakkar's avatar
    darshthakkar
    Valued Contributor

    Appreciate it LeeDuffy 
    I will take a peek into this by the end of this week, I was travelling so wasn't able to check the notifications here.

    More than happy to connect with you to discuss on this but lemme first research it from my end so I'm upto the speed.

    Thanks again.

     

    Best Regards,
    Darsh

    • LeeDuffy's avatar
      LeeDuffy
      New Contributor II

      Cool stuff, just message me on here and we can set something up and share some knowledge!