How to scrape the data's from the Multiple URL's?

Help
, ,
1

Hi All,

I have a question where my Multiple URL’s are processed in the for each loop and in each URL need to scrape the data’s and write it in excel sheet.

Is there any solution please let me know it as soon as possible.

2

you can store all the urls in string array and loop through all the urls using for each loop .
and navigate to the url and can data scrape and write data in excel sheet .

1 Like
3

Hi Navneetj3 Sir,

In which tool we can scrape those datas and assign to the datatable and write it in excel sheet.

4

in uipath studio , there is a option called data scraping available on home tab it can extract data and later you can write datatable using write range .

thanks!

1 Like
5

Hi Sir,

I have done that the data should have same data for second element but in that link there’s only one data. so at there the Data Scrapping won’t be useful…

Is there any other way to scrape the data’s ?

6

so the data is not on multiple pages . and the urls are completely different ? In that case you will have to write different code for all the urls .

1 Like
7

Hi Sir,

Yes Sir there are different data’s…

8

So is there any solution please let me know it as soon as possible.

9

i think you will have to write separate activities for the each url to scrape data and append the data in the excel sheet .

1 Like
10

Hi Sir,

If I use get text and assign it in variable and write it in excel sheet, it’s throwing error at assign activity because the assign is in for loop.

11

if you are using for loop for different urls . thats not going to work as the different urls will have different attributes .so dont use for loop . scrape data differently for each url .

1 Like
12

Hi Sir,

I have a website
https://tntenders.gov.in/nicgep/app

In this website I am going to tender by organization tab.

In that I am selecting one option to this link
https://tntenders.gov.in/nicgep/app?component=%24DirectLink&page=FrontEndTendersByOrganisation&service=direct&session=T&sp=SYe4m3NrWqJk%2BzEHVbe%2FBYw%3D%3D

Then I am using Data Scrapping to get all the & links and processing those links in for each loop.

  1. https://tntenders.gov.in/nicgep/app?component=%24DirectLink&page=FrontEndViewTender&service=direct&session=T&sp=SVnBSDrpYI1bDc%2BraCFz39A%3D%3D

  2. https://tntenders.gov.in/nicgep/app?component=%24DirectLink&page=FrontEndViewTender&service=direct&session=T&sp=S62gBMHr9R9NsTAlmrzofrg%3D%3D

like this still more 5 links are there…

In one link I am scrapping a data and want to write it in excel sheet once it overs it will close the link and opens other link to process another data.

So is there any solution please let me know it as soon as possible.

13

Hi Sir,

Can you send me your mobile number so that I can clearly elaborate the process?

14

can you attach your xaml over here.

1 Like
15

Hi Sir,

I will share you the screen shot of it Sir.

16

Hi Sir,

Below is the screenshot

image
image1220×744 59.5 KB

image
image1188×747 45.7 KB

image
image1165×741 24.1 KB

image
image1079×747 23.7 KB

image
image1083×749 26 KB

image
image1077×749 27.2 KB

image
image1076×746 23.3 KB

image
image1078×684 15.4 KB

So these are the screen shots Sir.

17

Hi @SOURAV_KUMAR_DAS

Data Scraping : Properties → MetaData-> insert code which is in attached text filemetaData.txt (191 Bytes)

You will get all link of each tender.

18

How many columns ITDatatable has?

19

There are two Columns Sir one is Name and URL links.

20

I think the issue is with the datatable columns.you have not defined the columns and assigning value to the same . define the columns and assign values accordingly .

1 Like