Solved
Pipeline Status Notification
If Iteration 1 then I have to concat all the columns with some special characters and spaces. If the iteration goes to 2nd time them concat all the columns with some special characters and spaces lik...
Forum Discussion
Thanks bojan will try and get back to you
Iteration condition: IF @ITERATION=1 THEN ($TYP : $A : $B : ‘A’ : $C : SPACE(6) : $$CD : SPACE(17) )ELSE IF @ITERATION=2 THEN ($TYP : $A : $B : ‘B’ : $NO : $G : SPACE(31) )ELSE IF @ITERATION=3 THEN ($TYP : $A : $B : ‘$C’ : $NO : SPACE(16) : $F : $DT : $GH : SPACE(23) )ELSE ($TYP : $A : $B : ‘D’ : $NO : SPACE(61) : $D )
In mapper split the Iteration conditions into 4 columns with different names
And then make copy of data. map 1st iteration column to $RECORD column and follow the same for remaining 3 iteration conditions. The target column should be $RECORD for all 4 mappers.
After that I used union and capture the $RECORD column in mapper and finally Got the result.
While I check with the team, have you tried using a ZipFile Read Snap?
Yes I have tried with Zipfile Read snap but its not working. Getting below error
It is CALLED gzip, but really isn’t a zip file at all. For example, you can’t have a gzip ARCHIVE. If someone wants an archive on gnu, they usually gzip a TAR archive. That becomes .tar.gz or .tgz gzip is more like compress, and the decompress snap apparently supports it. Set the scheme on the decompress to gzip. Auto, the default, MIGHT work, but try gzip.
Steve
I have tried with the same which you mentioned gzip but won’t works.
But I have used the first approach which I mentioned, i.e. File Reader > Decompress is working fine. I am not sure how it will work for huge size files. will check it and update here.
Anyhow thanks for your suggestions.
I am not yet sure exactly how snaplogic handles this, but MANY use it through a pipe. I had one customer that thought they had a T3. They effectively had a T1. We SATURATED the bandwidth, and they just didn’t like the performance. I was able to compress, transfer, and decompress, and process such that they not only got the performance they needed, but they have used it for years. And the routine I used was gzip
I am not sure the issue is as same I am facing. I too had issues with unzipping the file. They said the product team is working on the issue .
It does not happen always . It happens sometimes . I was not able to find out the exact reason when it is failing.
This is reply I got for that issue …
My product group is still addressing the issue, and they found that there is a problem with the Binary router parsing incomplete data .Still waiting for the fix to be applied. …
If incomplete data is happening on a preview, the file is probably too large. That problem won’t happen if you RUN the mapping though. So if you want to test, keep the files relatively small.
