I have a multi-page extract structured data activity which works on the first multi-page extract, but returns nothing on the second or subsequent iterations. There is no error message, just an empty data table. Any debugging ideas?

Can you please tell me what kind of application you are trying to automate?

It’s a company website. I’m retrieving data from search results pages on the site.

DId you select next link selector ? First page is getting scrapped properly?

Yes, the first multi-page came back with data. The second iteration (search) the data table came back empty.

That should not be the case. 2nd Page also follows the same step as first page data extraction. Can you try extracting from 2nd or 3rd page and check what happens then? Do you get similar one page extraction or not?

I was unable to solve the problem, but I have a workaround, which is I have restructured the workflow to scrape one page at a time and this works. Assume there must have been some issue with large mult-page scraping. In any case the page by page approach is more robust from a retry perspective. T…

Hi did we try incrementing the page with any attribute in the selector like id so that each page data extraction can be done one by one @chris-btp

I haven’t done that yet, as I just wanted to get it working. However I will make that modification later, so that it can recover on a page by page basis. Chris

Fine this could help you indeed [image] Extract structured data by Data Scrap Wizard when there is no NEXT button, only 1234 pages buttons Help Hi guys, Could you please help with this solution – no NEXT button or ARROW, just only 1234 page buttons. [Q4-screenshot1] St…

Extract structured data fails to return data

Help Studio

Palaniyappan (Palaniyappan P ) February 26, 2020, 1:22pm 10

Fine
this could help you indeed

and for creating variable in selector itself

@chris-btp

Topic		Replies	Views
Extract datatable from multiple pages returns nothing Help	5	1968	October 22, 2018
Data Scraping does not work with multiple pages of a web page Help	2	2971	April 25, 2019
Extract Structured Data not working for multiple pages Help datatable , activities , data_scraping	14	4773	August 15, 2019
Extract structured data is not woking Academy Feedback uiautomation , studio	3	1406	September 18, 2019
Data Not Getting Extracted from Multiple Pages Activities activities , question , other	4	162	July 16, 2024

Extract structured data fails to return data

Related topics