Webscraping issues

I am facing issue with the mentioned site while scraping the data
https://collegedunia.com/management-colleges
Im getting only few datas when performing web scraping activity.I think there is some loading issue with the site .All the datas are not getting loaded completely.

Could you please check and give me the solution?
Thanks in Advance

Hi
welcome to uipath community
we can set the value of DELAYBETWEENPAGES property with a value of around 4000 so that it will wait for 4 seconds till the next page is scrapped with data
image

Cheers @Anitha_anand1

There is no Page navigation present in the mentioned site.

1 Like

Fine
so if you are trying to extract in a single page
and waiting for page to get loaded completely
then in the TARGET category of EXTRACT DATATABLE ACTIVITY
set the property WAITFORREADY as COMPLETE

Cheers @Anitha_anand1

The same has been given.You please access the site share the scraped data file.The problem is small amount of data is getting displayed,everytime i need to drag the site till the end inorder to load the rest of the data.If I do this also,not all the datas are getting scraped.Please help

Hi,

You can set Wait for Ready Property as Complete, as it will wait untill and unless the whole page is loaded and then only scrape the data.

This might resolve your problem.

Thanks

Hi,
I have changed but there is same problem…

1 Like

@Anitha_anand1 The Site is Dynamically loaded as you go down the page. :sweat_smile: