Data Scraping from multiple page

[Sandeep_Kumar2 (Sandeep Kumar)]

i want to extract the data from multiple pages of website.i m able to extract only two page but not able to extract the data from 3 4 5 page.Also how to apply condition that it will scrap the data only for 5 page.Please help

here is my xaml
Main.xaml (12.2 KB)

[phyogananda (Yogananda Reddy)]

Data Scraping (Web) Spanning pages limit

Main.xaml (11.5 KB) 1)i have designed to navigate to number of pages based on your input, it works for me. 2)data scrapping i have put just some dummy, you can change it you own, if you scrap one page and put it inside the do- while it will be enough. only prob is it will start from 2nd page, i.e, page will go to second page and starts data scrapping for this you need to have 1st page data scraped in begining ( before the do-while starts) of the do-while loop. thanks

you can check this for your issue,

Thanks
Yogananda

[Sandeep_Kumar2 (Sandeep Kumar)]

please give me proper solution i have applied your idea but it takes data from more that defined page here is the modified demoMain.xaml (20.8 KB)

[phyogananda (Yogananda Reddy)]

Main.xaml (18.9 KB)

your selectors are wrong, i have updated.

just add data scrapping to it, it will work.

when you are doing data scrapping when it asks if it contains multiple pages,select no as option. if you select yes then it will scrap all the pages.

thanks

[Humberto_Marjuhh (Humberto Andrade)]

I tried to use this file but it doesn’t work for me - I’ve felt a big dum because it - but I’ve put 50 as the MaxNumberofResults at the Data Scraping Results and it work fine. Thank you a lot.

[srinu_balireddy]

I did face a similar issue recently where the data was getting scrapped only for 2 pages.
Once we click “Yes” for Data spanning multiple pages option, be sure to select the “NEXT” or the “>” button rather than selecting the “2” at the bottom of the web page.

For limiting the data scrapping to fewer pages, you can place the data scrapping activity in “Do While” loop and set the maximum number of pages to be scrapped.

Thanks,