At first my scraping was faster, once I ran it a few times it became slower

Help Activities
, , ,
1

At first my scraping was faster, once I ran it a few times it became slower. Is there a logical reason for this?

Im following this steps:

  1. Go to URL
  2. Get Text (Cant use data table extraction because its only one price)
  3. Assign Activity to change “,” to “.”
  4. Write Cell.

So im thinking is there a way to first scrape all the numbers, save all the numbers in UI Path and once it ended the scrape and gathered all the number, paste them to the excel?

May be that would be faster or are there any ideas?

2

You may want to do some computer maintenance and free up some storage, clear your browsing cache, complete any OS updates etc to just make sure your computer is running as it should

3

Hi @Favarelaa ,

Normally, This shouldn’t happen, but could you give us the approximate count that the process was executed and checked ?

It can also depend on the Application end, Application might get throttled by continuous movement within it. Sometimes it is needed to Close the Application after certain Transactions/Count and then ReStart/login again and perform the operations from the point it has left off. (Not a very feasible approach)

4

thank you! Yes it ran in 5 minutes 37 seconds and scraped through 17 links.

The proces consists in getting a url from the excel and scraping the price, then placing the price back to the excel.

5

image
image342×568 54 KB

You can also change the timeout on activities say for example you set this to 1000 the process will only wait 1 second before executing the step. Try changing and setting these for each activity