I am trying to web scrape the following website:
The data extraction works perfectly when I don’t specify a next button.
However, when I do specify a next button, the robot scrapes through all of the pages until it reaches the last one and then it gets stuck. It seems like it keeps trying to press the next button over and over.
I appreciate your help.