Data scraping and find element before scraping next page

Help
1

Hello,

For a project I’m trying to scrape data from a website. Unfortunately the website can be slow at times and the data I’m trying to scrape spans over 100 pages.

Therefore, I’d like to add a element exist activity before clicking on “next page” or something similar but I didn’t find how to do that. For now I’m working with a delay between pages but I’d like to make the datascraping more robust and efficient.

2

Hi @LPlissart
What website is that? :slight_smile:

1 Like
3

@Jan_Brian_Despi

Unfortunately, I can’t share it as it is a private website.

1 Like