SusanB
New Contributor II
Joined 6 years ago
User Profile
User Widgets
Contributions
Re: Design Approach for Downloading SLDB saved files using smb
Hi Spiro, Thanks for your additional input. Luckily the filenames already include a timestamp. Knowing this, the new pipeline will include a parameter of the list of month days that need to have files copied. IE “1,15” (for the first and fifteenth of each month). The pipe will have a router that compares today’s month date to the parameter list. If today is not in the parameter’s list of values we exit. If it is we perform the copy steps: Find and filter the list of files that contain today’s date, route them for zip vs non zip files, read and write (adding the option to Overwrite and/or Ignore if the file is already in the target directory. Currently zip file is having issue with ignore - so we’ll just overwrite those). We will then schedule the task to run daily. When needed for special requests we can easily add another temporary scheduled task for other days. As time allows, I may attempt to make this more flexible by adding a parameter for specific file name prefixes. For now this should eliminate the need for a human to manually copy files.521Views1like0CommentsRe: Design Approach for Downloading SLDB saved files using smb
Thank you for the options/insight. I think we’re probably looking at the first scenario. The files are generated daily and saved in the Snaplogic folder (SLDB?). On certain days of the month they need to be copied to a target server. I think whatever approach we decide on, we’ll need to (re)read the files based on their file types and then use the corresponding file writer snap to write to the target server. Appreciate everyone’s input.2.3KViews1like2CommentsDesign Approach for Downloading SLDB saved files using smb
Hello, looking for input regarding best approach to automate the manual download of various types of files (.csv, .xlsx, .zip) which are saved in the same project folder. We want to keep them available in Snaplogic but also download to another server on certain days of the month. File Operation /Copy does not seem like an option. Thanks!3.6KViews0likes6CommentsRe: Using Oracle Execute to run complicated SQL Select not returning any data
Hi Vineesha, I have had success using complicated “WITH” clause in EXECUTE snaps. If you have the Validate and Execute as the Snap Execution type and you click the save or validate icon, the status of the query will appear in the circle between the two snaps. You can click on the clipboard on the circle to see the returned results or the error if it is red. Change the Preview type to json to get all the specifics. If the execute query is using pipeline parameters OR mapped output (variable) values, check to make sure that the SQL Statement* “=” icon is clicked on and green. Also please consider: I have found that Oracle PL/SQL WITH clause does not work exactly like SQL Server WITH. Hope this helps.3.8KViews1like1Comment