Data Scraping for page loading items when you scroll down the page

Help Studio
1

Hi,
i want to do Data Scraping for a web page ( https://www.quikr.com/homes/property/residential-for-sale-in-hyderabad-cid_28 ).
But the problem is there is no next button and the items are loading when you scroll down the page.

Please suggest me how can i extract data of all items. At present the when i try, the Data Scraping brings data of only 1st page items that are visible. But on scroll down there are so many items that are not captured.

2

If you scroll down to the bottom of the page and then extract data, does it return all the data as expected?

3

Is there any activity to scroll down to the bottom of the page in UIPath.

4

image
image1366×768 274 KB

I think below is the next button.

2 Likes
5

@habeebafvan
WE Had good results with using the Hover activity.

Hover to the navigation bar. If an information on the Page is available and can be Retrieved to detect if all items are loaded then the hovering can be done within an loop.

6

It wont work. may be your have used F12 to search for next button. Please search with Hyderabad location. by the time you go to the next button, more items will be dynamically loaded at the bottom.

7

By the time you go to navigation bar, the page will dynamically load. I tried it but it is not working. it gives only first 20 results that are visible on screen .
URL :https://www.quikr.com/homes/property/residential-for-sale-in-hyderabad-cid_28

8

I can have a Look on IT once im Back from my Traveling. As WE have implemented a few similar cases succesfully there IS a high Chance to implement this Case as well

9

Main.xaml (16.2 KB) ScrapeData.xls (43 KB)

Please find the attached.