Hi, I am trying to datascrape a website and the results are unreliable, it does not seem to be able to extract all the rows from the websites datatable at all times in a consistent way.
This is the output I am generating:
Counters is the same as rows on the websites datatable.
Customer “Stadium Sverige” should equal 165 counters (rows) and not 100.
My first thought is that it is returning 100 rows because each page is limited to 100 rows and the datascraping activity needs to press a “next” button.
But this does not seem consistent because the customer “Apoteket” should equal 549.
The customer “KICKS” should equal 293 but it didn’t scrape any rows?
And finally the customer"CC Gjövik" is correct at 84 counters(rows).
What could be the cause for this inconsistent behavior?
I have set the delay between pages to: 15000 ms.