I’m having trouble with web scraping. When I select the multi-page button and choose a selector, instead of going from page 1 to page 2, it jumps directly to page 9 and then to page 13. Furthermore, when I filter data using advanced search, the URL doesn’t change, so I can’t scrape page by page. Could you try to filter the data in the highlighted section as shown in the image? I hope everyone can help.
URL ( blu)
advanced search ( red)
Thanh for your help.
Hey @Hoang_Nguyen1
1- Use a loop with a Click Activity that targets the “Next” button.
Use a Do While or While loop that continues while the “Next” button is available (or visible/enabled).Use Element Exists to check if the “Next” button is still clickable.
2- look for the selector if button selector is changed For example, aaname='Page 1, aaname=‘Page 2’, etc.
Define a variable, e.g., pageNumber, and initialize it to 1.
Use a Do While loop to iterate through pages:
Do While pageNumber <= totalPages
- Click on the page number using the dynamic selector.
- Perform data scraping.
- Increment pageNumber.
- Check if the “Next” button is enabled; if not, exit the loop.
cheers