Scraping conumdrum... may or may not be 'next' button


#1

So, depending on what I search for, I may get multiple pages of results, a single page of results, or no results at all.

If have no results, I’m good. If I have multiple pages, I’m good. If I have only a single page I get a selector not found fault, apparently on the next button. Seems like a design flaw to me.

So, I tried doing an Element Exists on that selector, and if it exists setting a variable to that selector string, and if not setting it to “”, and then specifying the variable in the scrape’s “NextLinkSelector”. Result appears to be that now the scrape never returns any results.

Any thoughts? I cannot be the first person who’s ever come up against this.

ddk


#2

instead of setting selector variable to ="", can you try setting with = nothing