Website Data Extraction

Hello there. I have created an automation process that extracts data from a webpage and it has number of pages around 5000 pages with 31 rows in each pages. I have used Table extraction and also excel to write the data. I have even pointed the next page button but whenever i run the program, it returns excels extracting data from a single page. Can you suggest me more on this or provide an alternative to achieve this task.

Hi @basant_mote,

Can you please share the screenshot of properties panel.

Hi @basant_mote

Check if the Next button is inside an iframe or not clickable. Reconfigure it in Table Extraction. If that fails, use a While loop: click Next, extract data, repeat until the button disappears.

for more:

If you found helpful, Mark as a solution tick .
Happy Automation

1 Like

@basant_mote

Welcome to the UiPath Community!
I believe you have correctly used the “Extract Table Data” activity to capture your data. You can find this activity in the Design Panel or in the Activities section.

Here’s a quick recap of the steps to ensure nothing is missed in your automation:

  1. Select the column(s) from the table and click Confirm.
  2. To extract data across multiple pages, enable the toggle and click the Next icon.
  3. Verify or adjust the selectors by clicking the Settings icon.

Note:

  • Keep the application in the foreground if you’re using the default input mode to capture data from multiple pages.
  • To capture data even when the webpage is not in the foreground, use the Simulate input mode.

I recommend exploring the different input methods to enhance your automation.

Please give it a try and let me know if my inputs were helpful.

It was really helpful as i tried input mode chromium api and also made silent all windows activities while execution and it worked.

I solved this and extracted more than 1 million table

@basant_mote
Please mark the reply that helped resolve your query as the solution to close this conversation.

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.