Not able to extract entire web page without scrolling to bottom of the page

[RK_0 (RK)]

Hello everyone.

I am able to extract the web page but first i have to scroll to the end of the page, only then all the data loads then im able to extract, but scrolling down to bottom takes lot of time while running,
So, if there any alternative method to extract all the data without scrolling to bottom of the page

i have entered maximum number as 0 and im able to extract the data but this is time consuming

[ppr (Peter Preuss)]

@RK_0

i have to scroll to the end of the page, only then all the data loads

if data is not present (we do not talk about the visibility / display status) then we cannot grab

@RK_0

So, if there any alternative method to extract all the data without scrolling to bottom of the page

we do not know your details but would recommend to check out if data can be grabbed by an api as an alternate

[RK_0 (RK)]

yes, data is not visible/loaded on the page until we load it through scrolling to end. data is more than 500 each scroll only loads 10 units,

What is the approach using api?
Can you explain

[ppr (Peter Preuss)]

@RK_0

What is the approach using api?

we would recommend to come across with more details (e.g. url / webpage details). Then the next check is about the existence of an alternate data provision (is there e.g. an offered api)

[ppr (Peter Preuss)]

Cross Reference:

Not able to extract entire web page without scrolling to bottom of the page

Hello everyone. I am able to extract the web page but first i have to scroll to the end of the page, only then all the data loads then im able to extract, but scrolling down to bottom takes lot of time while running, So, if there any alternative method to extract all the data without scrolling to bottom of the page i have entered maximum number as 0 and im able to extract the data but this is time consuming

[jeevith (Jeevith Hegde, Ph.D.)]

Hi @RK_0,

As @ppr noted, this thread seems to be similar to the one you opened here :

Scroll down to bottom of a page with infinite scroll

Hello Everyone, I want to scroll down to bottom of a page with infinite scroll or scroll to load type page, I was able to do with “hotkey”, its take 2-3 mins for 300 units of data, So, is there is any method to scroll to bottom of page in less time or instantly, Page is build using javascript, cannot share the page Thanks in advacne

Duplicating similar request leads to more confusion and would increase the time to resolve your issues. Duplicate threads means less number of members who read and follow your request.