How to retrieve all data on a website using data scraping?
Issue Description : If the Website contains data that needs to be scrolled down, then this makes Data Scraping wizard retrieve only a few records. As the list gets loaded only on scroll down, it is tricky to extract the information.
Resolution / Workaround :
- Either use the Mouse Scroll activity or the Page Down hotkey to scroll down eventually and load all the items.
- Once the page reaches the bottom, extract using Data Scraping wizard and verify.