How to set the page limit in data scraper?

Hi,
I need to scrap multiple data with multiple pages,In which I need to limit the number of page to 10 .How can I do that in an effecient way where it should traverse through all the fields upto 10 pages in each field.
for example : Assume that I need to fetch all the products related to mobile phone in flipkart .I need to fetch all the data from each field and i need to limit the page by 20 ,ideally i should only check for 20 pages rather than fetching all the 20+ pages. what the best and suitable solution for this case ??

@Sai_Krishnan .

Run it in a do while loop for counter < totalpages

In the Extractdata activity , give the below selector

“https://www.flipkart.com/search?q=Iphone&otracker=search&otracker1=search&marketplace=FLIPKART&as-show=on&as=off&page=” + counter.tostring

Let me know , if this helps.

Thanks @MinalGupta , I’ll try and let you know.

1 Like