How to scrap data from a webpage , which does not having multiple pages

I have searched in google for rpa jobs, after opening portal i want to click on 100+ jobs option, after clicking on it , webpage shows multiple results on screen , when I’m trying to scrap data then only 10 results getting me even im giving for 100 results option in data scapping…There is no multiple pages available on webpage but there is bulk data available … how to scrap 100 records from current webpage


above image is our scenario

@Prathamesh_Chavan

May be the records are loading only after scroll…

Try scrolling to the bottom and then perform extraction

Cheers

@Prathamesh_Chavan you can scrolling parallel it will scrap parallel to scroll

Hi @Prathamesh_Chavan,

Totally agree with @Anil_G.

It sounds like the webpage is loading only a limited number of results at a time, and you will need to scroll down or click a “Load More” button to load additional results. To scrape more than 10 results, you may need to automate the scrolling or clicking using a web scraping tool that supports dynamic web pages.

even bot will fetch 10 records

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.