How to deal with elements on the webpage that are not loaded yet?

@bp777
more details on the page or best the url would be helpfully to adress your scenario more individually.

in general there are two things to analyse:

  • on which info the fully scrolled down page is to bind (eg. 170 of 170 items status bar info)
  • what is the best strategy to scroll down (pg-down, down, click an element, hover an element…)

for bringing some ideas to you have a look here TUI Scrape data until no more search results.

1 Like