Marwen M.

Commented on How to Configure Pagination and Specify Next URL i...·Posted inCommunity Questions

Hi Matthew, If you only configure: $.entity.meta.page.hasMore == true. => in Has next, SnapLogic knows another page exists, but it may not know how to retrieve it. I'd recommand checking the API definition;

Option 1: API returns a next-page URL

{
  "entity": {
    "meta": {
      "page": {
        "hasMore": true,
        "nextUrl": "https://api.example.com/items?page=2"
      }
    }
  }
}

=> $.entity.meta.page.hasMore => $.entity.meta.page.nextUrl

Option 2: API uses page numbers

{
  "entity": {
    "meta": {
      "page": {
        "hasMore": true,
        "pageNumber": 1
      }
    }
  }
}

=>$.entity.meta.page.hasMore => $.entity.meta.page.pageNumber + 1

Option 3: API uses offset/limit:

{
  "hasMore": true,
  "offset": 100,
  "limit": 100
}

=> Has next: $.hasMore => Next offset: $.offset + $.limit

Posted in Ask SnapGPT·

Marwen M.

Download Button Shows Download in Progress but No Files Download from Snaplogic Monitor Execution History

The download button on the Snaplogic Monitor displays "Download in progress..." however no files are downloaded via the browser (using the execution history).

1Comment

Commented on Error Copying SSL OAuth2 Account Between Orgs: Una...·Posted inCommunity Questions

Marwen M.

You're welcome !

Commented on Error Copying SSL OAuth2 Account Between Orgs: Una...·Posted inCommunity Questions

Marwen M.

(edited)·

Hello Jean-François,

The compatibility result you see, is for the Encryption Settings (not related to the Trusted Environement Settings).
Simply put:

Standard encryption → SnapLogic manages the encryption keys.
Enhanced encryption → your organization manages the private keys stored on your Groundplex nodes.

=> The compatibility result tells if the groundplex configuration is compatible with Enhanced Encryption option (not an error message).

Commented on How to Prevent Empty Error Files When No Data Is P...·Posted inCommunity Questions

Marwen M.

Great! You're welcome.

Commented on How to Prevent Empty Error Files When No Data Is P...·Posted inCommunity Questions

Marwen M.

Hi Ricardo, This usually happens in SnapLogic when the error pipeline is triggered by an empty document stream rather than a real failure. A few common causes:

A downstream Snap expects input but receives no documents
A Mapper/Writer Snap emits an empty document (or "null fafe" disabled mapper config).
The error view is connected and receives a non-fatal validation/error document
“Treat empty result as error” behavior from certain Snaps

Because the error pipeline writes a file whenever it receives anything, it creates an empty error file even though the main pipeline completed successfully. => First thing you can do is toggle the "Ignore empty stream" in the formatter snap in you error pipeline ; this will avoid triggering the file writing. => You might also want to handle the "no data" case within your main pipeline, so it won't throw an error (or the snaps won't generate an output in case of empty stream).

Commented on Postgres Upsert Fails with Oracle Data: How to Han...·Posted inCommunity Questions

Marwen M.

(edited)·

Hi Gunja, There are some technical difference between Oracle and Postgres:

Oracle: By default, column names are case-insensitive. If you create a column EMP_ID, Oracle treats it the same as emp_id or Emp_Id. Internally, Oracle stores names in uppercase, but queries are case-insensitive unless you use quotes.
PostgreSQL: By default, column names are lowercase unless double-quoted.

Based on the snaps documentation:

Insert Snap: forgiving with case → works without mapping.
Update & Upsert Snaps: strict with column names → require exact case match. (columns must match the upstream field names exactly, including case).

To sum up :

Bulk Upsert snap internal behaviour ; The primary keys are used for conflicts handling which require Case-sensitive (exact match) and consequenctly fails if upstream column names ≠ table columns.

Best practice:

Use the mapper snap to set columns to lowercase, before passing data to the Postgres Bulk Upsert Snap. (I would avoid forcing the Postgres target table columns name to match the source Oracle ones)

Commented on Using the Filter Snap with = true to Improve Pipel...·Posted inSnapLogic Best Practices

Marwen M.

Hi Lee, About adding a snap " as a connector to maintain the aesthetic flow of a pipeline construct" :

Each snap in a pipeline has a memory footprint and a good practice is to use the least amount of snaps.
Less snap, less resources used by the pipeline.

About the direct connection and the output view records number showing, it happens when you have snaps heads/tails rotated. As long as both snaps are connected there is no impact.

Commented on How to Call an API Endpoint with OAuth and mTLS: A...·Posted inCommunity Questions

Marwen M.

Hi Thorsten, You generally have two patterns depending on the API:

Option A (most common)

Use:

OAuth2 Account → to obtain access token
HTTP Client snap→ to call API with mTLS

=> In this case:

OAuth token is fetched separately
mTLS is configured on the HTTP transport (Snap)

Option B (if OAuth endpoint itself requires mTLS)

This is the tricky case. SnapLogic’s SSL OAuth2 Account documentation does NOT explicitely mentions support for true mTLS nor describe any mTLS OAuth flow (though you can give it a try). => There is a workaround:

Use a REST Snap with client cert configured
Call the token endpoint manually
Store/access token dynamically (e.g., pipeline parameter or cache)

Commented on Understanding Pipeline Permission Levels: Allowing...·Posted inCommunity Questions

Marwen M.

You're welcome!

About

Company
Title
Technical lead