Hi All,
I want to pull data from UiPath data service and push it into sql datatbase.
Is there any simple way to do this task?
I have tried with small table and able to extract from data services using query entity activities of UiPath.
Now, I have to extract 28 L+ data from data service.
Please suggest any alternative approach
thank you
For 28 lakh-plus rows, keep the transfer paged rather than loading everything into one DataTable. Query Entity Records supports Top up to 1,000 and Skip: fetch a page, map it to a DataTable, bulk-insert into a SQL staging table, then checkpoint that completed page.
Use a stable sort and retain the source record ID as a unique key so retries don’t duplicate rows. If records can change during export, use a controlled extraction window or incremental watermark. Reconcile counts before merging staging into the destination.