Web data extraction - Get Data Activity

Hi Everyone,

I am currently building an RPA Workflow in Studio, wherein i want data to be fetched from general web and input it in an excel. I tried Get Data activity but since the information i want is dynamic, its not helping. Can someone guide on how to fetch dynamic data from all over the web?

Hi @Philip_Shiny_IN

There are a few ways of doing this dynamically from the web:

  1. If you are trying to extract a Table on the webpage, use the “Screen Scraping” recorder. This will take you through a wizard that will guide you. Completely dynamic.
  2. If you are trying to extract normal text/information - use “Get Text” Activity. This SHOULD by default extract everything dynamically, but if not, please configure it to be dynamic by including variables/wild cards in the selector.
  3. If you are trying to extract information from a dropdown, use the “Select Item” activity. This will automatically find all elements inside a dropdown list on the web and then you can use a variable or list to automatically select the correct option you need.

There are a few other ways, but I think with this approach you should be good.

Let me know if it helps :slight_smile:

Hi @Philip_Shiny_IN,

There are multiple UiPath activities to extract data from the web, you can choose based on your requirement, such as Extract Table, Get Text etc. You’ll also need to fine-tune the selectors for better accuracy.

If possible, please share a snapshot of the webpage and the specific issue you’re facing so we can guide you better.

Thanks

I tried Get Data, but since its dynamic information its not working.

For example, For company A, its searching for number of employees, it might pickup information from Source 1 of webpage which is website of company, but for company B, its searching number of employyes, but source 1 of webpage is not the company’s website, but a random source.

So information is dynamic in nature.

That level of dynamic searching can only be done with an AI Driven approach. You can experiment with UiPath Screenplay to see how well it can handle doing this based on your prompts.

Bear in mind services like these have costs, so its worth figuring out how much the executions will charge you.