Hi, I am having trouble with scraping data which spans multiple webpages. If I scrape data and say that there are no subsequent webpages, the table is extracted and written to Excel with no problems. But, when I then change the automation to say that there are subsequent pages, the automation loops backwards and forwards between pages 1 and 2 (regardless of however many other pages there are) and I ultimately have to cancel the task as it never returns any data.
In the automation, I:
- Select screen scraping.
- Select yes to extract the data from the whole table.
- Change the maximum number of results to 10,000.
- Select yes to the data spanning multiple pages.
- Click on the next arrow.
The automation works until I expect it to go to page 3, except it returns to page 1 and then backwards and forwards between pages 1 and 2 constantly.
This is being performed on my companies intranet so it cannot be run externally, but happy to provide screenshots and/or XAML.
I have seen other topics with similar problems but I have not seen any with a resolution. Grateful for any advice.