HDFS Zip File Writer
Good day Community, I’m trying to create a zip file on an HDFS storage (Azure Data Lake Gen2) and I’m getting this error. Any idea as to why?
Good day Community, I’m trying to create a zip file on an HDFS storage (Azure Data Lake Gen2) and I’m getting this error. Any idea as to why?
Hello Everyone, Snap introduce in memory snap. Can anyone explain the how it’s work behind the scene and what is the difference between join and in memory snaps? Any recommending scenario where we can use memory lookup snap?
Hi, I have developed the pipeline which reads the data from the incoming stream and send to SQL Merge. My pipeline looks like below. My Input JSON is as follows: [ { “member_id”: 13000561, “intervention_id”: 1000034495, “sentiment”: null, “last_upd...
I have a pipeline that reads from Oracle and writes to PGSQL. When inserting to PGSQL, I get this error Batch entry 0 insert into “pg_temp”.“crmi002b_ut_pprs001” (“end_date”, “opportunity_type”, “sales_person”, “opportunity_status_type”, “sr_partitio...
I have created a pipeline that runs while using a triggered task but when I re-create the same pipeline but with using an ultra task I am unable to reach the HTTP endpoint due to timeout. My pipeline starts with an XML formatter, as the content of my...
I am running into a very weird issue. Big Picture - doing a bunch of operations but finally have to make a REST API call {"field1": "random_values", "field2": [ { "field5": "451037", "field6": "d1"} ], "field3": "test", "field4": "True" } I have ...
One of our SL Nodes freezes on high memory and won’t start any new pipelines or accept any webhooks. The only way we’ve found to fix this is a manual reboot. Memory will be going between 70-85%, and CPU between 10-60%… everything will be working fine...
Hello All, I’m trying to get the count of files written by the File Writer Snap and want to write the number into a mapper. If it’s possible can anyone suggest me how to achieve this? Thanks
User | Count |
---|---|
320 | |
216 | |
178 | |
152 | |
115 |