Goal: Data scrape the first 5 pages on a web site when there is no Next button
I am trying to get past an issue and I have searched countless topics on here and have made significant progress but I haven’t resolved the problem.
To get past no Next buttons, I created an string of numbers from 2 to 5 called PageNum, used a spliter variable to split the string, and saved each value in a separate variable called PageNumArray. Then I wrote a custom selector and used Assign activity to assign to a dynamicSelector variable (logic below). Finally, I used a For Each activity to scrape the page for each PageNumArray and passed the dynamicSelector variable through the NextLinkSelector in the properties for the DIV. It did not work!
Logic for dynamicSelector (ignore the right quotes around <): "<“html title=’* Jobs in United States | LinkedIn’ /> “<“webctrl aaname=’”+Item.ToString()+”’ parentid=‘ember*’ tag=‘BUTTON’ type=‘submit’ />”
Screen shot 2