I have a situation where I was checking the data scraping on a specific web edi. I was able to download the data however, some of the data was duplicated.Datascraping.txt (2.9 KB)
I was to supposed to get the data until 25.10.2021,1,480,480,DI however the second sheets data has been duplicated.
I have set the MaxNumberOfResults to 100 however if I want the extract exact rows I have to set it 0 as per the documentation. When it set it 0 then this goes in an infinite loop. To check if it works I let it run for some time and even after 10 mins it did not stop so I had to manually stop it.
Thank you for sharing.
May i know if next button is clicked by bot and go next page during data scraping running?
We might need to set large number in DelayBetweenPageMS property (such as 5000, for now)
All right. Another approach is to use loop for each page and datascraping without next link selector like the following. Then we can check various condition to exit loop.
It seems that the button used to navigate to next page is still available on your last page.
However, in order for UiPath to work properly, the button to navigate to the next page should not be available if you are actually on the last page.
But since you cannot modify the customer’s portal, you can still use your initial workflow and, as a corrective action you could try to remove the duplicate rows.
The Remove Duplicate Rows activity https://docs.uipath.com/activities/docs/remove-duplicate-rows should help you to do this.
This could be an alternative to @Yoichi 's solution.
arjunpateljk
lrtetala
vrdabberu
Raja.G
divya.x.kuchi
A_Learner