Data Scrapping in structured data intermittently giving output

Help Activities
, , , , , ,
1

Hi,

I need to scrap data from web url in chrome and write to excel. This will be used as a bot input.

Data is structured , it has heading, hyperlink and date … hyperlink are urls…
100 to 120 urls…But on same page … Next page not requied. On same page by scroling all data is there.

But when i do data scrpping below happening

  1. Only few initial content coming
  2. Some times running same workflow full data coming
  3. I gave re fresh browser , used delay , page down , etc

Anyone faced similar issue?

2

Hi @1a2bc346dgjk7544ebjkkbvf

Can you check any unique element is there at the end of the table/ data in the webpage, so when the page got loaded with the data, make the setfocus to the end of the webpage and let it load properly and then try to scrape

As it is dynamic, so you need to check giving some delays as well

Hope this may help you

Thanks,
Srini

1 Like
3

Hello @1a2bc346dgjk7544ebjkkbvf, I think you can try using the “Element exists” activity or the Retry mechanism to solve this problem.

Hope it helps,
Cheers! :slight_smile:

1 Like
4

Hi @1a2bc346dgjk7544ebjkkbvf

To extract data from both the foreground and the area below, you might want to consider using

1.Data Scraping activitie or
2.screen Scraping activitie.

These activities allow you to capture structured data from various parts of the screen, not just the foreground

1 Like
5

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.