HTTP Request POST multiple items in body

Help Activities
, ,
#1

Hi, I’m trying to POST 250k rows of data form excel file (uploaded to dataTable) to Table on Azure Blob with HTTP Request UiPath activity.
The problem is looping through 250k items it takes hours to POST all rows.
Do you know if it’s possible to somehow change JSON Body property.

Is it possible to loop through 250k rows in datatable and create one JSON with 250k entries and POST all 250k items by one HTTP POST request?

There is body of POST HTTP request for each row in dataTable, after each row HTTP request is send to server and everything is ok, status 201.

{‘CCd’:’"+row.item(0).toString+"’,‘DocNo’:’"+row.item(1).toString+"’,‘CreatedBy’:’"+row.item(4).toString+"’,‘CreatedOn’:’"+strDateFixed+"’,‘UserType’:’"+row.item(7).toString+"’,‘PartitionKey’:‘7dec2020’,‘RowKey’:’"+strRowKey+"’}"

#2

There is a limit for HTTP calls
https://support.microsoft.com/en-us/help/208427/maximum-url-length-is-2-083-characters-in-internet-explorer

Even if there was no limit, I would not recommend doing this. Depending on the capacity of the server, you could cause problems with the infrastructure of this server.

Could you explain your scenario better?

As I understand it you need to send 250k of content to some website, will you have that amount of items recurrently?

Do you have access to the database of this Site?

#3

Every month I’m calculating one KPI via macro.
To calculate this KPI I got report from SAP (200-250k of rows) and macro is calculating it.
Then I need to upload report (all 200-250k of rows) with recently calculated details etc to the table on MS Blob and PowerBI is configured to calculate KPI and create charts from uploaded set of data.
I’ve read about batching HTTP requests, I it possible to implement similar/same thing in UiPath?

#4

Does your Azure Blob instance support a single request with multiple rows? If so, then it’s easy to supply the entire request body JSON to the HTTP Request activity. If not, there’s nothing the activities can do to help.

#5

I’m not sure if my Blob support such case but I will test it. As far as I know my JSON string should be amended to post multiple rows.
Can somebody help me and write an example how JSON body string should looks like while posting single request with multiple rows?

If 1st row is:
“{‘CCd’:’”+row.item(0).toString+"’,‘DocNo’:’"+row.item(1).toString+"’,‘CreatedBy’:’"+row.item(4).toString+"’,‘CreatedOn’:’"+strDateFixed+"’,‘UserType’:’"+row.item(7).toString+"’,‘PartitionKey’:‘7dec2020’,‘RowKey’:’"+strRowKey+"’}"

and 2nd row is:

“{‘CCd’:’”+row**+1**.item(0).toString+"’,‘DocNo’:’"+row**+1**.item(1).toString+"’,‘CreatedBy’:’"+row**+1**.item(4).toString+"’,‘CreatedOn’:’"+strDateFixed+"’,‘UserType’:’"+row**+1**.item(7).toString+"’,‘PartitionKey’:‘7dec2020’,‘RowKey’:’"+strRowKey+"’}"

How JSON body should looks like in one HTTP request? (with 2 rows from above, lets assume that my variables are already set and stored as a strings)

Such example would be really useful.