I am trying to scrape data from a web page that doesn’t have a next button and this inhibits me from navigating to the next page. I did the following but it still doesn’t work:
1 Process scrapes first page and saves in a csv file, 2 checks if element (page 2 button) exists - using a while loop, if it does it then clicks that page number and then scrapes the data again, saves in the same csv file.
But i noticed not all data is scraped and even the ones that are saved are from different pages.
How do i solve this issue please? I attached the link to the website i’m scraping from
Thanks so much