Data scraping multiple pages: next page selector go forward and back issue

Help
,
1

Hi all, i’m new here, and i’m new to rpa process field

I’m trying to scraping an online database from this site:
Link

by searching the information from zip postal code (from external .csv file), typing it on the site’s searching bar, and then scraping the records from the page’s result.

But i have an issue with the next page selector, because the robot go from page 1 to 2 to 1 and so one until I force quit it.

Someone have some tips for this issue, please ?

2

@Filippo_Peron

Hi

Can you please indicate the 2 page selector in next button selector (which is in datascrapping properties) or else you can make it as dynamic while observing first page and second page selector.

Hope this helps

Thanks
Aman

3

thank you @aman_sheik for te answer, but i’m a rookie. Can you be more specific please ? because i don’t understand what i need to do :scream::sob:

4

@Filippo_Peron

You can use below selector it will work

< Webctrl tag=‘A’ parentclass = ‘pagination-next’/>

Click on Extract Structured data activity (in properties panel (which is in right side)) you will get next link selector (inside that you can paste above selector)

Hope this helps
Thanks
Aman

5

@Filippo_Peron

For your reference :

IMG_20190909_152955
IMG_20190909_1529553120×1132 985 KB

Thanks
Aman sheik

6

image
image1047×599 37.5 KB

:scream::scream::scream:

7

@Filippo_Peron

You directly copied and paste? If so, please again indicate the next button (from your website) uncheck the aaname from selected items.

And check the parentclass within unselected items (in the above image you can see)

Thanks
Aman

8

Ok, your solution work for a while, but, when the page arrive to the last one of the pages list, the process freeze.

Then i click on “ignore” button and the process go ahead with another zip postal code in the search bar, wich show me a new page with a new pages list with next page arrow, but now the issue’s show again.
I’ve attached the project here

thankyou again for the help and patience.

test_scraping.zip (575.0 KB)

image
image1535×652 53.1 KB

9

Annotation%202019-09-09%20154849
Annotation%202019-09-09%20154849829×533 32.2 KB

if you check the code u are not extracting any data from the data extraction you are just switching from page 1 to page 2. and there is no condition mentioned here to stop switching to next page if the page end is reached.

10

Annotation%202019-09-09%20155450
Annotation%202019-09-09%20155450843×306 17.3 KB

Please remove any unused variables in your code.

11

Ok, now it works very well, thank you so much for your help.

Now, i want the process stop when the page end is reached or, if the zip postal code searched in the search bar don’t make result in the page (i notice that UiPath do it automatically after some secondo of timeout, but this cause wasting time).
How i can do this ? what i need to do ?
Many thanks again, you’re very help

12

ExtractDataTable is an empty datatable that you created and does not hold any data as you did not extract any data using data scraping. so the data scraping which you did needs to be modified. Please modify the workflow accordingly and let me know so that we can work on any other errors you are getting. attached is an example of how I extracted the data from the website you mentioned.DataExtraction.xaml (10.3 KB)

Please explain if you need anything else.