cancel
Showing results for 
Search instead for 
Did you mean: 

How to read a value from a CSV and pass it (edited) further down to be the name of my Azure SQL db

mitsos
New Contributor

Greetings,

I have a pipeline that reads a Splunk report, converts to CSV and uploads to Azure SQL.
One of the columns of my CSV is called _time. All the values of _time are from the same day: 2020-06-01T13:23:22.321 -04:00 where the first ten characters (i.e. “2020-06-01” are identical in the whole column. So, I would like to grab the first value and take the first ten characters to use them down the pipe for my Azure SQL db name (i.e. dbo.temp_dailies_2020-06-01).

Can you suggest a way to do so?

Sample of my CSV:
Screenshot_2020-06-03 21.09.09_

I have done some progress using the Unique snap… Am trying to figure out how to bring it to my main pipeline…

Main pipeline:
image

Here I get the unique “2010-06-01”
image

Basically I kinda need to merge the two… I think… Or any other suggestions are welcome

Thank you,
Mitsos

5 REPLIES 5

mitsos
New Contributor

Thank you very much - this has been very helpful!!