Web data scrapping if Next link is not available

[nagakula (Naga)]

Hi, I have a situation where i need to extract data from a web page and found Next button is not present instead simply displaying page numbers. Any idea how to overcome as the page numbers are dynamic based on the entity we select for scrapping data.

[ddpadil (Dilip)]

Hi,
As you mentioned its just a number no hyperlink to it then how your navigating to next the page ?
Did you check this.

How to go next page if no next page link

This is my first post and query problem is very simple but I am yet to find solution. Pardon me if it has been asked and solved earlier. Query:- I have a page with table having multiple pages now issue is it doesnot have link of NEXT page pagination look likes:- [image] issue is I cannot scrap it page wise. can someone tell me how to go about it? thanks for help

[nagakula (Naga)]

hi,
The hyper links were present with the page numbers itself but No Next button to tell the robot to move on. See exactly as below:

[ddpadil (Dilip)]

Hi,

Could you click on 2 when data scrape prompt for the next link and paste the extractmetadata property of of data scraper here.

PS:.you just need to pass the counter variable in page number of metadata.

[nagakula (Naga)]

extractmetadata property is

NextLinkSelector is this:

[nagakula (Naga)]

[ddpadil (Dilip)]

Hi,
Can you change column name by 2,3, and so on and check whether scraper giving different output.

[nagakula (Naga)]

hi, i tried this and it is just scraping only data displayed on first page itself like when get_columns_name=1.
But i come over this by writing a decision block, calculate the number of pages and loop over to move on to the subsequent pages.

[PD2 (Priya Estevez)]

I was trying to see how to pass variables to extractmetadata property and figured it out myself. Just pass the variable in single quotes.