Can't scrape unstructured data

Learning Hub Academy Feedback
1

How to scrape unstructured data from a website? I am using “get text” activity but it is not showing anything in my excel sheet. Thanks for the help.

1 Like
2

@Nikhil_Khapre,

First try to print the output of Get Text activity and check whether it is giving any output or not.

3

It is giving output for one of many elements I am trying to get data from. But for rest of the elements, it is not taking any data. dal_1.xaml (24.7 KB)
dal_1.xlsx (9.5 KB) here is the xaml file and the excel file. It is working perfectly fine for the address part but it is not taking any value for restaurant website. Thanks for helping

4

Hi @Nikhil_Khapre,

If you have data in excel then read excel & use for each row get the data

5

There is no data in excel except names and url of the hotel. What i am trying to do is iterate through each url and scrape specific information from the page. But, when I use get text activity for scrapping address, it is taking the address but for rest of the elements, it is not taking anything as it is unstructured data. I have attached the respective files above. If you can take a look, it will be really grateful.

1 Like
6

Hi @Nikhil_Khapre,

Get that url using for each
Then use open browser & take what you want

7

That much I have done but when I use open browser then only the “get text” activity is not functioning properly for me.

1 Like
8

It may be due to dynamic selectors :slight_smile:

9

I tried unchecking that too…

10

I’ll help you on this one :slight_smile:

11

Thanks

12

@Nikhil_Khapre,

I have gone through your work flow. After going to each url and want to scrape Address, rest website, Contact no and Specialty right ?

Are you trying to write those scraped data result into excel file or what ?

13

Yes, I am trying to write that scraped data into excel file. And for the above part, you got everything right.

1 Like
14

Hi @Nikhil_Khapre,

Can you try this revised .xaml file?
dal_1.xaml (24.8 KB)

If there are any issues, please don’t hesitate to ask for help.

Thanks and regards,
Despi

1 Like
15

What I just did here was: I updated the selectors :slight_smile:

16

@Nikhil_Khapre,

Use Write Cell activity to write into excel file but you did not use that activity in your workflow.

1 Like
17

it is showing an exception
19.3.0+Branch.master.Sha.5fdb43627d7d3c011018bb545ddf9470210d44a9

Source: Get Text ‘ADDRESS’ (Get Text ‘ADDRESS’)

Message: Cannot find the UI element corresponding to this selector:

Exception Type: UiPath.Core.SelectorNotFoundException

An ExceptionDetail, likely created by IncludeExceptionDetailInFaults=true, whose value is:
UiPath.Core.SelectorNotFoundException: Cannot find the UI element corresponding to this selector: ----> System.Runtime.InteropServices.COMException: Cannot find the UI element corresponding to this selector:
at UiPath.UiNodeClass.FindFirst(UiFindScope scope, String nodeID)
at UiPath.Core.UiElement.FindFirst(FindScope scope, Selector selector)
— End of inner ExceptionDetail stack trace —
at UiPath.Core.Activities.ScopeActivity.OnFaulted(NativeActivityFaultContext faultContext, Exception propagatedException, ActivityInstance propagatedFrom)
at System.Activities.Runtime.FaultCallbackWrapper.Invoke(NativeActivityFaultContext faultContext, Exception propagatedException, ActivityInstance propagatedFrom)
at System.Activities.Runtime.FaultCallbackWrapper.FaultWorkItem.Execute(ActivityExecutor executor, BookmarkManager bookmarkManager)

1 Like
18

Hi @Nikhil_Khapre,

use dynamic selector & try

19

wouldn’t “write range” work in the last section work as “readDT” datatable is taking the item for each row?
If not, then do I have to use “write cell” activity after each “assign” activity?

20

Hi @Nikhil_Khapre, it is better to do write cell on this one.