Data scraping from web ecommerce product detail page

Hi,

I am new in Uipath, i want to scrap full data from web ecommerce product detail page. How can i reach on detail page and back to listing page and again click on detail page with all pages.
Can you please help?

1 Like

can you share the link to the webpage ?

1 Like

amazon. com/s/ref=nb_sb_noss?url=search-alias%3Daps&field-keywords=samsung

I want data inside each product detail

www.amazon. com/s/ref=nb_sb_noss?url=search-alias%3Daps&field-keywords=samsung

I want data inside each product detail

Please refer above link for more information

https://www.amazon.com/s/ref=nb_sb_noss?url=search-alias%3Daps&field-keywords=samsung

I want data inside each product detail

The above post should give you a good idea on how to do the scraping, but you need to define dynamic selectors to make it more generic.

Can you please refer me any useful video or examples if you familiar on this.

I already saw this video, it is not useful for me

You have a video regarding the data scraping in the foundation training which is exactly what you need

and here another video which may be useful for you

It is not useful to me. Data scrapping activity scrap data only on product listing page but i need a data from each product detail page like
Product
Colour
Memory
Competitor
VAT Included
etc
Which is not available on listing page.

1 Like

My dear @umesh1, what you need is not a simple data scraping then, it is a workflow where you need to go on each product URL and get those values, so you need to create a workflow where

  1. First, you need to scrape the URL of the products using simple data scraping in excel(which is posted)
  2. Second, you need to read the excel and click the link to land on the details page one by one.
  3. And last, you need to get the desired details you want and then write in the same excel or in another.
3 Likes

Thanks @Sheshrocks

@Sheshrocks, could you give more details on how to access the URL for each product’s excel for more information? I have a similar case where I need to extract data from each company that makes the access on the site of bovespa.

1 Like

Hi @victorfrs, i think it will depend on what site and what URL you want to use e.g. for any search query on google you may need to use someting like below :

url = ‘https://google.com/search?q=’ + text

where text being what you want to search for, this you need to repeat in a loop to get the webpages of all the query text you want.

Usually there must be a pattern of the website which you need to observe and follow.

Hope it helps!

1 Like

Thanks for the attention and help @Sheshrocks

1 Like

Hi @Sheshrocks I have a doubt

if I want to know the one product detail if the product cost is high, I want to get a mail whenever the price is low, at least I get mail about the product details
can you please help me to do that…