Webscraping issues

Help
, , ,
1

I am facing issue with the mentioned site while scraping the data
Top Management Colleges in India: Ranking, Fees, Cutoff, Placement 2022
Im getting only few datas when performing web scraping activity.I think there is some loading issue with the site .All the datas are not getting loaded completely.

Could you please check and give me the solution?
Thanks in Advance

2

Hi
welcome to uipath community
we can set the value of DELAYBETWEENPAGES property with a value of around 4000 so that it will wait for 4 seconds till the next page is scrapped with data
image

Cheers @Anitha_anand1

3

There is no Page navigation present in the mentioned site.

1 Like
4

Fine
so if you are trying to extract in a single page
and waiting for page to get loaded completely
then in the TARGET category of EXTRACT DATATABLE ACTIVITY
set the property WAITFORREADY as COMPLETE

Cheers @Anitha_anand1

5

The same has been given.You please access the site share the scraped data file.The problem is small amount of data is getting displayed,everytime i need to drag the site till the end inorder to load the rest of the data.If I do this also,not all the datas are getting scraped.Please help

6

Hi,

You can set Wait for Ready Property as Complete, as it will wait untill and unless the whole page is loaded and then only scrape the data.

This might resolve your problem.

Thanks

7

Hi,
I have changed but there is same problem…

1 Like
8

@Anitha_anand1 The Site is Dynamically loaded as you go down the page. :sweat_smile: