This is my 2nd week on UI Path. I’ve taken about 15 hours of overall training which briefly included the topic of data scraping.
For practice, I’ve run into a use case where I am able to scrape and save the data from a website into an Excel. The next step is to expand each item and scrape more information. Could someone help on how an action be performed on the current row before data scraping wizard moves on to the next row? In this case, I have to click once to expand the menu which has more information, then scrape the row, and then move on to the next row and so on…
You should explain better. What do you mean with “data scraping wizard moves on to the next row?” Can’t you use click activity or what?
About whether or not I can use the click activity, this is my question. I’m not able to find a way to click, scrape, move to the next row…click, scrape, and move to the next row and so on. Let me know what information you need and I can provide it.
When you use click activity can’t you indicate menu button?
If you can share that website or similar to it so i can check it.
It took a little while to find a similar use case but here is one. For the displayed loan options, I have enough understanding on how to scrape elements such as APR, Mo. Payment, and Min Credit but now the ask is to click the drop down (“See Details”), scrape additional information, close the drop down and move on to the next row item.
Hi…were you able to figure out this problem?
I am sorry. I was trying to pass certification exam. Which i couldn’t…
Check those “see details” elements selectors.
<html title='Personal Loans: Compare Top Online Lenders Now | NerdWallet' /> <webctrl parentid='details-toggle' tag='svg' idx='5' /> <html title='Personal Loans: Compare Top Online Lenders Now | NerdWallet' /> <webctrl parentid='details-toggle' tag='svg' idx='7' /> <html title='Personal Loans: Compare Top Online Lenders Now | NerdWallet' /> <webctrl parentid='details-toggle' tag='svg' idx='23' />
These are some of them. You should create a dynamic selector for clicking it. If I was try to get them i could try like this;
Check difference between them.
Create a dynamic selector for clicking.
Click all those “see detail” buttons.
Then try to scrape all data.
This didn’t work since there are 15 pages with 20 dropdowns each and changing the selectors for each became too time consuming. Any other ideas on how to better tackle this problem without manually updating selectors (in this case over 200).
I have the same issue, did u solve your problem with the click?
@hhajar No - this issue was abandoned by the Robot Masters and MVPs and I haven’t been able to find anything online on my own. Let me know if you have better luck.