Dai9210
New Contributor II
Joined 5 years ago
User Profile
User Widgets
Contributions
How to move files on HDFS?
My scenario is I need to create some subfolders on HDFS, then zip all of them, and after that, I want to clean these subfolders to release space so next time I will have a “clean” environment before I create any files/folders. However, the [File Delete] and [File Operation] snap seems not support the HDFS location. Is there any way to move/rename/delete files/folders on HDFS? Thanks, Elaine1.7KViews0likes0CommentsCan NOT re-set my password and Can not open the Manager page
Is there anyway to get support besides the support@snaplogic.com email? I forget the password of my snaplogic account, tried to re-set it but did not get any email after 30 mins. I also tried to send email to support@snaplogic.com last Friday, but have not got any reply until now. For now, I am using SSO login to do the development, what’s worse, my ‘Manager’ page can not be opened since Monday, is anyway meet this kind of issue before?SQL Server - deadlocked issue
Hello All, I create a pipeline to create a target table based on source table, the steps in the pipeline are: 1.DROP the target table if exists → 2.Create the table if not exists -->3. Modify some column length in the target table → 4.Read data from source table → 5. Mapper and then Bulk load to target table. I do NOT think any of these steps would get table lock, however, when execute this pipeline from a parent pipeline, it will get deadlocked issue sometimes, and it will always success after 2nd or 3rd time re-run. Anyone has idea about this? Thanks.2.4KViews0likes1CommentCreate a reusable pipeline to dynamic apply default value
Here is the scenario: I want to apply default value to a table, and the column(s) which need to apply default value might be changed. What I am doing is to: Create a parameter csv file with the same column names as the source table. Join the source table with the csv file on 1=1, then the csv columns will get a prefix ‘input1_’. By using hasOwnProperty , it will be able to apply the default value from the csv file to the source table. e.g. $.hasOwnProperty('input1_COUNTRYCODE')?$input1_COUNTRYCODE: $COUNTRYCODE to apply the default value for [COUNTRYCODE] column. My question is, if there is 100 columns in the source table, I need to create 100 hasOwnProperty in the mapper and if the column names in the source table changed I have to modify those expressions, so, is it any expression could get the field names dynamic to replace this COUNTRYCODE in the expression? Source table: [ { "BANKNAME": "Test Bank 001", "BANKNUMBER": "Test123", "COUNTRYCODE": "US01" }, { "BANKNAME": "Test Bank 002", "BANKNUMBER": "Test456", "COUNTRYCODE": "US02" } ] Parameter file (default value): "COUNTRYCODE":"US"