Web Scraping - Product list has variations in div structure

[andrei.baluta13]

Hello,
Trying to use Data Scraping on a product list page.
For product without discount it works well, scraping everything fine.

When a product has a discount like in this screenshot the div’s structure changes.

How can I modify my ExtractMetadata in the Data Scrape to accomodate this discount also?

See below with bold the div structure change between normal and discounted product:

discount price […]
div idx 3 - Product Info DIV
div idx 2
div idx 2
div idx 3
div idx 2
div idx 1 → here is discounted price

normal price […]
div idx 3 - Product Info DIV
div idx 2
div idx 1
div idx 2
div idx 2
div idx 1 → here is normal price

Any idea for a solution?

[ashwin.ashok ((TheCodingTheory))]

Hi @andrei.baluta13 ,

Could you check if there is anything that will be of use to you in the link given down below?

[HowTo] Data Scraping - Advanced Configuration - Text Field, Image Source, Url, CSS Classname, Hover text

This HowTo introduces on how Data scraping can be configured to retrieve also on non standard information from a web table. After indicating the different data columns with the wizard the extract data definition was post edited and changed to the relevant attributes e.g. value (Text field), src ( Image Source), class (CSS Class Name), tite (Hover Text), href (Url). Introduction Following web table is to use for data scraping and also the non text information should be retrieved. [grafik] We…

Kind Regards,
Ashwin A.K

[ppr (Peter Preuss)]

yould analyse if with additional attribute a common selector can be found
Another strategy could be to have 2 cols (price, reduced price) in place and later postprocess/consolidate it