Retrieve All Website Data Using Data Scraping

News Knowledge Base
1

How to retrieve all data on a website using data scraping?

Issue Description :

If the Website contains data that needs to be scrolled down, then this makes Data Scraping wizard retrieve only a few records. As the list gets loaded only on scroll down, it is tricky to extract the information.

Resolution / Workaround :

  • Either use the Mouse Scroll activity or the Page Down hotkey to scroll down eventually and load all the items.
  • Once the page reaches the bottom, extract using Data Scraping wizard and verify.