Data scraping going back and forth between pages


I am trying to extract data from a retail website which has two pages of data. In the Extract Structured Data Section, the NextLinkSelector is mapped properly to the Pagination control.

But while executing the script, the page is going back and forth. i.e first page and second page are loaded multiple times. So instead of populating 21 results in the output file, it is populating 100 records.

I believe this is because of the “MaxNumberOfResults” value is being set as 100 but ideally it should populate only the actual number of results which is 21 only, right?

or How can we extract the data that is only available on the website? say if it changes everyday.