Noob question about web scraping


#1

I am new, sorry if this is a dumb question.

I would like to scrape an internal webpage.
the main page contains 1000+ customer names, each name is a link to ‘contact page’

I would like to scrape the main page to capture the links, then click on each link one by one to capture the data on the ‘contact page’

I am missing something, I can use data scraping to capture the links and export to a table.
I am able to scrap the contact page to capture the data.

I am missing how to put this together.


#2

Hi,
your almost close :slight_smile:

first part of workflow (capture the links).

Once you exported to excl follow these steps:

  • Use Excel application scope to open Excel

  • Read Range to get datatable

  • For each row activity to iterate through item

  • Get row item (pass column name which contains link )

  • Open browser pass the get row item output variable here.

*Here you can put you second part of workflow(contact page to capture the data)

Reference:
scrapeLink.xaml (10.6 KB)


#3

ok, thanks.

I think I was trying to do too much in a single step.