This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
FAQ
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Reading BLOB data from SQL and write it to file share

marenas
Contributor

‎08-13-2021 01:42 PM

Dear Community,

I am successful in creating a pipeline that read blob data from SQL server and writing the file in SLDB. Now, I wanted to write the file on an SFTP server using File Writer - validation is okay but failed during execution.

protocol: smb
file name, = enable: targetDir + ‘/’ + $ID+ '’ + $[‘last-modified’] + ‘.jpg’
write empty file: check

error: Failed to open output stream for … Reason:
Unable to create/open

Thanks in advance for the help.

0 Kudos
Reply
4 REPLIES 4

siwadon
Employee
Employee

‎08-13-2021 02:13 PM

Is it SFTP or SMB protocol? Can you please provide the stacktrace?

You mentioned that the validation was fine. Was the execution mode of File Writer set to Validate & Execute?

0 Kudos
Reply

marenas
Contributor
In response to siwadon

‎08-13-2021 03:29 PM

SMB protocol. I tried setting to Validate & Execute. Below is the stack trace

Failed to open output stream for <share_destination>\id_2021-08-13T22:23:16.629Z.jpg

Resolution:

Please address reported issue.

Reason:

Unable to create/open - <share_destination>\id_2021-08-13T22:23:16.629Z.jpg

Hide Details…

File Writer[5e4268b8907fe00481d73d56_f5dc8c06-411f-46aa-b384-a284c4111483 – 58ab1969-8579-4490-8cde-08e309c17bfe]
`com.snaplogic.snap.api.SnapDataException: Failed to open output stream for <share_destination>\id_2021-08-13T22:23:16.629Z.jpg

at com.snaplogic.snap.api.fs.smb.SmbUrlConnection.getOutputStream(SmbUrlConnection.java:86)

at com.snaplogic.snaps.binary.AbstractWriter.initOutputStream(AbstractWriter.java:815)

at com.snaplogic.snaps.binary.AbstractWriter.writeData(AbstractWriter.java:492)

at com.snaplogic.snaps.binary.AbstractWriter.process(AbstractWriter.java:364)

at com.snaplogic.snaps.binary.AbstractWriter.doWork(AbstractWriter.java:321)

at com.snaplogic.snap.api.SimpleBinarySnap.execute(SimpleBinarySnap.java:57)

at com.snaplogic.cc.snap.common.SnapRunnableImpl.executeSnap(SnapRunnableImpl.java:803)

at com.snaplogic.cc.snap.common.SnapRunnableImpl.execute(SnapRunnableImpl.java:585)

at com.snaplogic.cc.snap.common.SnapRunnableImpl.doRun(SnapRunnableImpl.java:869)

at com.snaplogic.cc.snap.common.SnapRunnableImpl.call(SnapRunnableImpl.java:435)

at com.snaplogic.cc.snap.common.SnapRunnableImpl.call(SnapRunnableImpl.java:117)

at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)

at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)

at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)

at java.base/java.lang.Thread.run(Thread.java:834)

Caused by: Unable to create/open - <share_destination>\id_2021-08-13T22:23:16.629Z.jpg status = -1073741773 (0xc0000033)

at com.visuality.nq.client.File.openOrCreate(File.java:3123)

at com.visuality.nq.client.File.create(File.java:926)

at com.visuality.nq.client.File.<init>(File.java:877)

at com.visuality.nq.client.SmbOutputStream.<init>(SmbOutputStream.java:78)

at com.snaplogic.snap.api.fs.smb.SmbUrlConnection.getOutputStream(SmbUrlConnection.java:84)

... 16 more

Reason: Unable to create/open - <share_destination>\id_2021-08-13T22:23:16.629Z.jpg
Resolution: Please address reported issue.

Error Fingerprint[0] = efp:com.snaplogic.snap.api.fs.smb.IvR2q0Gr
Error Fingerprint[1] = efp:com.visuality.nq.client.79BHBWNu`

File Writer[5e4268b8907fe00481d73d56_f5dc8c06-411f-46aa-b384-a284c4111483 – 58ab1969-8579-4490-8cde-08e309c17bfe]
`com.snaplogic.cc.snap.common.ThreadDetails: prio=4 Id=96986 RUNNABLE
at java.base@11.0.7/java.lang.StackTraceElement.initStackTraceElements(Native Method)
at java.base@11.0.7/java.lang.StackTraceElement.of(StackTraceElement.java:526)
at java.base@11.0.7/java.lang.Throwable.getOurStackTrace(Throwable.java:828)
at java.base@11.0.7/java.lang.Throwable.getStackTrace(Throwable.java:820)
at com.visuality.nq.common.InternalTraceLog.log(InternalTraceLog.java:327)
at com.visuality.nq.common.InternalTraceLog.enter(InternalTraceLog.java:442)
at com.visuality.nq.client.Mount.close(Mount.java:468)
at com.snaplogic.snap.api.fs.smb.SmbUrlConnection.disconnect(SmbUrlConnection.java:54)
…

at java.base@11.0.7/java.lang.StackTraceElement.initStackTraceElements(Native Method)

at java.base@11.0.7/java.lang.StackTraceElement.of(StackTraceElement.java:526)

at java.base@11.0.7/java.lang.Throwable.getOurStackTrace(Throwable.java:828)

at java.base@11.0.7/java.lang.Throwable.getStackTrace(Throwable.java:820)

at com.visuality.nq.common.InternalTraceLog.log(InternalTraceLog.java:327)

at com.visuality.nq.common.InternalTraceLog.enter(InternalTraceLog.java:442)

at com.visuality.nq.client.Mount.close(Mount.java:468)

at com.snaplogic.snap.api.fs.smb.SmbUrlConnection.disconnect(SmbUrlConnection.java:54)

at com.snaplogic.snap.api.binary.UrlUtils.disconnect(UrlUtils.java:185)

at com.snaplogic.snaps.binary.AbstractWriter.cleanup(AbstractWriter.java:635)

at com.snaplogic.snaps.binary.AbstractWriter.consume(AbstractWriter.java:916)

at com.snaplogic.snaps.binary.AbstractWriter.writeData(AbstractWriter.java:529)

at com.snaplogic.snaps.binary.AbstractWriter.process(AbstractWriter.java:364)

at com.snaplogic.snaps.binary.AbstractWriter.doWork(AbstractWriter.java:321)

at com.snaplogic.snap.api.SimpleBinarySnap.execute(SimpleBinarySnap.java:57)

at com.snaplogic.cc.snap.common.SnapRunnableImpl.executeSnap(SnapRunnableImpl.java:803)

at com.snaplogic.cc.snap.common.SnapRunnableImpl.execute(SnapRunnableImpl.java:585)

at com.snaplogic.cc.snap.common.SnapRunnableImpl.doRun(SnapRunnableImpl.java:869)

at com.snaplogic.cc.snap.common.SnapRunnableImpl.call(SnapRunnableImpl.java:435)

at com.snaplogic.cc.snap.common.SnapRunnableImpl.call(SnapRunnableImpl.java:117)

at java.base@11.0.7/java.util.concurrent.FutureTask.run(FutureTask.java:264)

at java.base@11.0.7/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)

at java.base@11.0.7/java.util.concurrent.FutureTask.run(FutureTask.java:264)

at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)

at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)

at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)

Error Fingerprint[0] = efp:java.lang.JJL-PXqh`

0 Kudos
Reply

siwadon
Employee
Employee
In response to marenas

‎08-13-2021 03:47 PM

The problem is the filename contains an illegal character :

The following characters are not allowed for SMB directory and file names: " \ / : | < > * ?

Reply

marenas
Contributor
In response to siwadon

‎08-13-2021 03:55 PM

the illegal character is the value of

“last-modified”: “2021-08-13T22:51:44.288 UTC”

so I removed that for now and it works!!! I guess I need to format that value to an acceptable format. thank you for your help @siwadon!!!

0 Kudos
Reply