Salesforce List all records of +100k rows

Hello,
I am using Salesforce IntegrationService “List all records” to get records from the object Product2.
The ouput should be around 100k+ rows. But it returns only 250 rows
When i try to increase the “Max record” Int value, it doesn’t works.

Is there a way to fetch 100k+ rows using IntegrationService activities ?

Hi @simon.l

Yes — but not in a single call Integration Service “List all records” is paginated and returns 250 records per page by design. Increasing Max records alone won’t bypass this.

How to fetch 100k+ records

Use pagination with a loop:

  1. Use List all records
  2. Capture:
  • Records
  • Next page token / Offset
  1. Loop while next page exists
  2. Append results to a DataTable/List

The activity internally limits each fetch; you must iterate pages.

Regards
Gokul

Thank you for the response.

I can’t find “Offset/Pagination” field in output result. And where to pass an argument to change pagination ? I only have those options in the properties panel :


if i only add While Activty, it returns the same output.

@simon.l

Try this solution

@Cristian_Negulescu, would be able to here please!

@simon.l

In List all records, pagination is handled internally by the connector, but UiPath does not have a pagination or offset fields in the activity outputs or properties.

“Use pagination with a loop” means:

Manually calling Salesforce REST API repeatedly using nextRecordsUrl inside a While loop until all records are fetched.

Regards
Gokul

Yes but this solution doesn’t use IntegrationService activities.

Ok, it should actually work.
I must therefore acknowledge that it is impossible to query more than 250 rows using the “List all records” activity or any other IntegrationService activity that I need.

@simon.l

Salesforce Bulk API

Very large data (100k–1M+)

  • Integration Service Bulk Query
    OR
  • HTTP Request → Salesforce Bulk API

Regards
Gokul

1 Like

Thank you, the idea is indeed to use Bulk Job. Here’s how i managed to get the data :

  1. Use the Create Bulk Download Job using SOQL to start a Job in Salesforce.

  2. Inside a Do While, check the Job State with the Get Bulk Job Info activity until we get “JobComplete” state (All states here)

  3. Finally, download the csv file containing query result with the Download SOQL Bulk Job Results activity.

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.