vincenr
New Contributor III
Joined 4 years ago
User Profile
User Widgets
Contributions
Re: Best way to handle conflicting projects in gitHub/snapLogic?
So, if I make a change to pipeline A on one branch, but the branch for pipeline B doesn’t have that change, how does that affect pipeline A when I finally check in the pipeline B branch? I know this is gitHub basics, but again I am a beginner… How do I assure that my check-in for pipeline B doesn’t revert pipeline A back to before the changes I made on it?Best way to handle conflicting projects in gitHub/snapLogic?
I’m still very new to gitHub and was wondering the best way to handle the following situtation? We have a project currently checked out from gitHub in snapLogic, with let’s say pipeline ‘A’. I need to work on pipeline ‘B’ in a different pipeline also in the same project, but under a different branch. What is the best way to handle this situation without resorting the to commandline tool for gitHub?Re: String text in JSON output incorrectly using csv parser/formatter to csv
So, the site I found fixed the issue with my text for the description field getting spread incorrectly across three columns, but now I have roughly 250 rows out of about 7000 rows where the description is messed up, with characters like apostrophes displayed incorrectly on the csv output. Issues: Apostrophe’s are incorrectly output, example: women’s becomes women’s “bad” and “wild” becomes “bad†and “wild†An em-dash in a text like P—GRK becomes P—GRK Can someone help me with this? New Note: I discovered if I open my csv in notepad++ the characters all appear to be correct and not messed up as above. So, I really don’t know what to do now. Can someone please help me with this?String text in JSON output incorrectly using csv parser/formatter to csv
I’ve got the following text in a description field in my raw JSON file, where the double quotes are obviously escaped. How can I change settings in the JSON formatter and/or the CSV parser/formatter to fix this problem? The snaps are at their default settings. JSON: “Charts the development of Black Art in the United States and Great Britain from 1945 to the present through Paul Gilroy’s notion of the \“Black Atlantic\” – the ways that a distinct aesthetic emerged from a fusion of West African, American, and British traditions. Also listed as ART 294.”, But when output to csv, it looks like this: colA: Charts the development of Black Art in the United States and Great Britain from 1945 to the present through Paul Gilroy’s notion of the \Black Atlantic\" – the ways that a distinct aesthetic emerged from a fusion of West African colB: American colC: and British traditions. Also listed as ART 294." So, it appears that the commas in the text are causing it to split into multiple columns and the escaped double quotes don’t end up as just double quotes. In other words, the default setting of '' in the CSV formatter doesn’t appear to be working to resolve text fields like the one above. I found this on a site, which states that if a backslash is immediately followed by a double quote (\") that the csvformat function won’t work: [CSV-200] CSVFormat cannot read its own output if input contain escape character followed by quote character - ASF JIRA. Not sure if this is the same function that your csv formatter snap is using? UPDATE The recommendation on the site above was to remove either the " or the \ and I removed the \ and it fixed my text problem!Filter not working with LARGE json file
Ok, so my team member and myself both ran the exact SAME pipeline and the filter worked when she ran it to filter a huge dataset for one student, but whenever I tried it, the filter did not work. It’s just a simple: $Student_ID = “123” type filter. So, I finally cut the one student and put him/her into a separate json file near the top of the json file (the second student from the top). THEN the filter worked for me. There’s over 6 million rows in this json file, which is why I started thinking about the size of the file and the fact that this particular student started on row 703,250. Also, WITHOUT the modification above, if instead of filtering I write to a csv, the student also makes it into the csv! The ONLY difference between my pc and her pc is that she’s on Windows 10 and I’m on Windows 11. What could be causing this issue?
Groups
Higher Ed Users Group
This user group is for customers within higher education.
