Web scraping - Not complete data, no value, page not move

Help Studio
, ,
1

Web Scrape.zip (14.5 KB)

Hi, can help me on web scraping?

I want to grab ‘Product Name’ and ‘Price’ from Tokopedia web into excel file. The website is similar to Amazon and public can access it through www. tokopedia.com.

I shared the xaml file and the problems are:

  1. For 1 page scraping, the data is not complete and write to excel is null.
    Example: the product is “cisco SG110 24HP”
    URL: https://www.tokopedia.com/search?st=product&q=cisco%20SG110%2024HP&srp_component_id=02.01.00.00&navsource=home

Should be there are 43 items, but the UiPath only recognize 15 items. Then, no value is written in the excel.

  1. For multiple pages scraping, the web can not move to the next page.
    Example: the product is “server Lenovo SR550”
    URL: https://www.tokopedia.com/search?st=product&q=server%20Lenovo%20SR550&srp_component_id=02.01.00.00&navsource=home

Besides not complete items grabbed in the first page, UiPath also not moving to the next page.

  1. How can I make the page I want to scrape only certain pages i.e. page 2-5 ?

Anyone willing to help please? Thank you.

2

Hello @wenwen!

It seems that you have trouble getting an answer to your question in the first 24 hours.
Let us give you a few hints and helpful links.

First, make sure you browsed through our Forum FAQ Beginner’s Guide. It will teach you what should be included in your topic.

You can check out some of our resources directly, see below:

  1. Always search first. It is the best way to quickly find your answer. Check out the image icon for that.
    Clicking the options button will let you set more specific topic search filters, i.e. only the ones with a solution.

  2. Topic that contains most common solutions with example project files can be found here.

  3. Read our official documentation where you can find a lot of information and instructions about each of our products:

  4. Watch the videos on our official YouTube channel for more visual tutorials.

  5. Meet us and our users on our Community Slack and ask your question there.

Hopefully this will let you easily find the solution/information you need. Once you have it, we would be happy if you could share your findings here and mark it as a solution. This will help other users find it in the future.

Thank you for helping us build our UiPath Community!

Cheers from your friendly
Forum_Staff