Web Data Scraping - Cannot get correlated data

Help Activities
1

Hello Robot Masters,

I was practicing on the page Major Group 01: Agricultural Production Crops | Occupational Safety and Health Administration, which looks like this:

image
image458×672 15.4 KB

I want to use one single Data Scraping scope to extract the bullet items’ full texts (both the numbers and the words, highlighted on the screenshot above) and their URLs; however after I selected correlated data I can only get the first bullet item of each group, even if I deleted the idx=“1” attribute. Where was I wrong?

image
image877×670 46.1 KB

2

In the modern uiautomation activities, there’s an activity called “Extract table data”(this is similar to data scraping wizard).

You can use this acitivity, indicate target on screen, click on “Add data” , then click on 0111 Wheat, then on 0112 Rice, then on 0131 cotton, then click on tick mark in the selection and finish the selection.

This way you can extract all name from 20 rows. As the URL is dependent on numbers in the names, you can create your data column by extracting numbers(like 0111,0112 etc.,) from the names.

I tried extracting all 20 names this way and it worked. Refer this workflow
A_test.xaml (9.7 KB)

3

Hi Surya,

Thank you so much for the kind solution and example workflow :grinning:
However I was looking for a more generic solution…If the website got updated and the URL is no longer dependent on numbers in the names, then I have to use another extract steps and try to link the two extractions which might be excessive - that’s why I wanted to “use one single Data Scraping scope” to extract both the names and URLs. It would be appreciated if you can give further suggestions…

1 Like
4

I tried normal data scraping scope too.

But the problem is that all the names under Industry Group 011 should be extracted to one column, the names under Industry group 013 should be extracted to another column and so on. You can also extract URLs into seperate columns.

So I feel the solution I gave in previous post is the best solution as of now.

5

Hi, I am scraping data from website but data is scraped in one column and i need to scrape the same details in multiple column. Can you help me on this. Also, i dont see extract data table activity option under activities.

6

Hi Pramod.

Please enable modern design in your UiPath project:

image
image1034×704 57.7 KB

Then you can see extract table data activity

7

Hi Im facing another issue. im scrapping data but i dont see the values in it.

Can you help me on this asap.










9

image

10

Can anyone help me how to extract last amount from a single line item.
1 D2740 Crown - 1 9 $1,354.50 $639.00 $715.50 $639.00 $0.00. I have to extract last single item $0.00. Can anyone help me with this please