I’m trying to use data scraping for multiple pages NOT connected by a “next page” button. To access these pages, I have to click through a series of links containing their names, so I’ve automated that process separately using a for-each loop. Within each for-each loop, I then run a data scaping to acquire what I need and then append it to a csv.
The problem is, when I try to run this, I can successfully scrape the data from the first page, but then it fails to scrape the data from the second. The issue seems to be the data scraping itself, since I’m able to get to the append part of the sequence, where it tells me I’m appending null.
I’ve already confirmed that reusing the same XML for the ExtractMetaData works. I’ve tried data scraping individually using the same XML for both pages, and it works fine. The problem arises when I try to do this in a for-loop. Why does the second data scraping fail?