How to scrapping data from multiple pages and keywords on Google?

Learning & Development Programs Automation Starter
1

I have 50 “keywords” that I have to google and do some data scraping to retrieve the article header and article link. what activity should i use? because so far only able to search for 1 keyword and scrapping data from that 1 keyword, how to find 39 other keywords?

image
image1468×779 50.8 KB

thanks

2

just save all your keywords in array or excel after that use for each or for each row activity for ieterate over
please follow the below video

3

image
he keeps the same data

4

image
image923×727 36.2 KB

5

once you scrapped your data which you want you can add respect column in your table and inside the for each row final use assign activity

row(columnname)=“your value”

6

Hi @Ridwan_Satrio1,

  1. Create your dataset. You can use an excel or “build datatable” activity.(inputDT)
  2. Build a datatable with the data headers you want to get when searching. (outputDT)
  3. First kill the browser and open google.
  4. Use inputDT in the loop.
  5. Search in google for each of your rows and get the data you want with datascraping.
  6. Add the extracted table to outputDT with the “merge datatable” activity.
  7. When the loop is complete, print the output to an excel with the “write range” activity.

If you are having problems with datascraping in these steps. I recommend sharing the selectors.

Regards,
MY

7

umm im sorry, what mean “respect” column?

8

thx, let me try

9

like this?

image
image735×702 25.5 KB

10

Hello @Ridwan_Satrio1

After getting the data for each keyword do you need to append to a single sheet or you need to keep separate sheet for each keyword??

I think it’s better to keep sheet for each keyword.

Then you can do all these things in a single loop.

1: keep all the keywords in an array or excel
2: read that file and get the keyword as Datatable
3: use excel application scope and open output excel
3: inside thatuse for each row in datatbale
4: search the keyword
5: Table extraction or data scrapping to extract the pattern based data
6: create sheet with the row name( keyword value)
7: use write range and write to that sheet