Hello Community! I Hope you are doing well. I would like to ask how can i scrap from an URL that has been assigned to a variable. I already watch lot of videos but I think it can be work by using old Design and not the Modern one.
Hi, we can use regular expressions to extract the URL from the variable however, if you could share a sample input, I can help you with the solution.
Exactly how you want to scrap as in title present or some query present in the url
If you can share the sample it will be helpful
Using regular expressions and string manipulation techniques you can easily assign the desired value ! @reyhandwip
Thank you for the reply. For my case it is like this, I have a DataTable with Product Description and Product Link columns. What I want to do is to visit the Product Link for each product then retrieve the information on that page. Unfortunately, (as far as I know, for additional information I’m still new to using UiPath) the Open Application/Browser Activity URL input cannot be replaced with a special variable. The workflow might look like this
Thank you for the reply. For my case it is like this, I have a DataTable with Product Description and Product Link columns. What I want to do is to visit the Product Link for each product then retrieve the information on that page. Unfortunately, (as far as I know, for additional information I’m still new to using UiPath) the Open Application/Browser Activity URL input cannot be replaced with a special variable. The workflow might look like this
Thanks for the details. I can see that you’re already passing the product link to the URL variable and then using that in the Use Browser activity.
The warning seems to be coming from the Extract Table Data activty. Please note that this activity can only be used to extract structured tables from webpages. The output type is DataTable and before you can run the process, you need to capture the selector of the table which you want to extract.
Click on the “Indicate in Chrome: Google” button inside the Exatract Table Data activity and simply incidate the table you want to extract (keep the webpage open in the background). Once you’ve done this, simply hit run and see if it works.
Few pointers:
- If you are using different webpages of the same website then, it is better that you open the webpage first and then loop through the input table.
- If you are going to extract tables from different websites then, the selectors need to be handled accordingly.
I hope this helps. Please write back if you’re facing issues.
Your flow is fine, just you have to indicate which fields you need to extract in extract table activity.
each time it will open a new URL.
if you elaborate issue more that will be helpful to provide the solution
Special variable ?
You have already pass the the url and try to set the properties of resize to maximise always
Than before you extract the data you can use activate window and then extract
Or you can use check app state or element exist activity to confirm that page and elements you want are loaded
And then you can use extract data activity
Here your extract data activity is showing error
Exactly what is the error remark? @reyhandwip
Sorry, you can ignore the error in the extract data activity because I didn’t define the scope of the variable correctly. That’s right, I’ve thrown the URL variable into the URL Parameters in the Use Browser activity, but when I debug, the Activity doesn’t go to the page with the url I’ve given. Is there anything I missed?
Post a screenshot of your Use App/Browser activity.
Thank you for the reply, it’s true that I have provided the variable in the URL field. But my open browser activity does not open the page according to the given URL. And it gives an error like the following, Am I missing something?
the error is in extract
because you need to give the table structure or indicate the table on the page
also to open browser use the property open as always
cheers
Thank you for the reply. Let’s assume that every product page with the url ProductURL has the same HTML structure, what should I learn so I can define that table structure?
you can indicate the table on of of the site and it would take the structure automatically
but they should be same across if they are different it might fail or would not extract…you can indicate and check…just make sure the selector does not include any site level data
cheers
You can check if page is loading or not by removing extract data
See if just opening url in browser is working or not
If that works
Than add your extract data block
This will help u to understand wether exactly issue is with application launch or data extract selector
Sorry for the late response. In the screenshot I provided, I set up the activity on the main Google page. However, the URL value I assigned to this activity is for a different page. When I run this activity, it opens the Google page instead of the page according to the URL I provided. As far as I know, when we drag and drop an ‘Open Browser’ activity, we need to install this activity on the page we are opening or capture a screenshot stored in the Object Repository. But what I want is for this activity to open the page with the URL I specified, not the page where the activity was set up
That will create an issue Ui activities has to be inside its container
However try using closing activity of open browser and see if that works
Also if u can share the properties of use browser activity we can see if any setting is causing issue @reyhandwip
Did you mean by “closing activity” is closing the tab in the browser navigation activity? I have tried it but the open browser activity instead opens the page that I have defined for the open browser activity and not the URL variable. Sure, Here’s the screenshot of my current properties.
Common
Continue on Error : -
Display Name : Activity Name
Timeout : -
Input
Unified Application Target : TargetApp
Arguments : -
File Path : -
Selector :
<htmlapp=‘chrome.exe’ title='How to Scrap URL that assigned to a variable - Help / Studio - UiPath Community Forum
" ( I Assign the screen in open browser activity to this current community page)
URL = URL
Misc
Private : -
Options
Close : IfOpenedByAppBrowser
Input Mode : ChromiumAPI
Open : -
Resize Window : Maximize
Window Attach Mode : Single Window
Option- Browser
Incognito : False
Use Data Folder Mode : -
Use data folder Path : -
WebDriver Mode : NWebDriverMode.WithGUI
This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.