Data Scraping Loops From Page 2 Back to Page 1


#1

Hi, I am having trouble with scraping data which spans multiple webpages. If I scrape data and say that there are no subsequent webpages, the table is extracted and written to Excel with no problems. But, when I then change the automation to say that there are subsequent pages, the automation loops backwards and forwards between pages 1 and 2 (regardless of however many other pages there are) and I ultimately have to cancel the task as it never returns any data.

In the automation, I:

  1. Select screen scraping.
  2. Select yes to extract the data from the whole table.
  3. Change the maximum number of results to 10,000.
  4. Select yes to the data spanning multiple pages.
  5. Click on the next arrow.

The automation works until I expect it to go to page 3, except it returns to page 1 and then backwards and forwards between pages 1 and 2 constantly.

This is being performed on my companies intranet so it cannot be run externally, but happy to provide screenshots and/or XAML.

I have seen other topics with similar problems but I have not seen any with a resolution. Grateful for any advice.


#2

Did your issue got resolved. I am also facing same issue in my production AWS machine but its working fine in my local machine.


#3

Hi, no I did not. I keep forgetting to raise it as an incident with the UI Path support team. I will try to raise it later today.

Tom

This message (including any attachments) contains confidential information intended for a specific individual and purpose, and is protected by law. If you are not the intended recipient, you should delete this message. Any disclosure, copying, or distribution of this message, or the taking of any action based on it, is strictly prohibited.

©2018 Deloitte Touche Tohmatsu in Hong Kong, Deloitte Touche Tohmatsu in Macau, and Deloitte Touche Tohmatsu Certified Public Accountants LLP in the Chinese Mainland. All rights reserved.

Deloitte refers to one or more of Deloitte Touche Tohmatsu Limited, a UK private company limited by guarantee (“DTTL”), its network of member firms, and their related entities. DTTL and each of its member firms are legally separate and independent entities. DTTL (also referred to as “Deloitte Global”) does not provide services to clients. Please see http://www2.deloitte.com/cn/zh/legal/about-deloitte.html for a detailed description of DTTL and its member firms.


#4

Please let me know what they are replying for the same