How to scrapp data in multiple pages

Help Studio
1

Hi,
i am having data data in string format like below on 100 pages where 1 page consist 30 records,
when i am scrapping data using data scrapping activity , it only gives data for 2-3 pages.
If i change job title or location, it gives nothing.

Ram Sharma
Software Engineer . XYZ Company
madhya pradesh, India

Shyam Sharma
Software Engineer . DEF Company
madhya pradesh, India

Sita Geeta
Software Engineer . IFG Company
madhya pradesh, India

Please suggest how to fix this.

can we use get text activity to fetch all the data from all pages using for each loop.

2

Hello

Try updating selectors to better target your data…for inconsistent values.

You can also fine tune your selectors using ‘*’ ,‘?’, and variables. If you ar changing job title or location you can edit them using ‘local variables’ in selectors.

Kind Regards,
Sagar Rana

3

@Sweety_Nagar

I guess you set Max number of Results to 100 because of that Bot is scraping first 100 records only. If you want to scrape the data from all pages then set 0 instead of 100.

1 Like
4

Hi All,
I am already using this steps, but i am not getting the data.
can you suggest me other solution .

5

Hi,
I am use your method , but not getting the data.

6

@Sweety_Nagar Can you share the screenshot of the code snippet where you are trying to extract the data using Data Scraping

7

Hi Sweety_Nagar,

I think when you are selecting the second item in data scraping wizard you should choose different value. For example first 2 pages only contain Job location as “Gurugram” and position as “Software Engineer” you are selecting both items on the same page that’s why its only extracting data that contains “Gurugram” &" Software Engineer".

Now what you could do is while selecting 2nd item press ‘F2’ and scroll down to another page that have different values for these sections.
Afterwards, wizard will show, what values are scrapped…check if any of the data is missing in pages and reselect if its faulty.

Best Regards,
Sagar Rana

Screenshot (96)
Screenshot (96)1362×787 237 KB

8

Hi Sagar_Rana,
i am already using this method.
can i use get text activity for scrapping the data in web application and run in loop and write to excel sheet.
image
and my data is in this format.

10

Can you provide with sample files and your existing code if it’s convenient? Our UiPath community would be able to better target your issue and also will be glad to help resolve your issue and inform you about the best practices that are implemented.

Best Regards,
Sagar Rana
(uipath practitioner)

11

Hi @Sweety_Nagar ,

We would like to have information of the Data you want to Extract and of it’s Elements :

  1. Selector Information on the Elements that you want to Extract. If Possible all Individual Element’s selector.

Check the Next Link Selector is Proper, (Maybe Post the Screenshot)

  1. Check the Maximum Number of Results Property.

  2. Check the below Post on How to Extract Individual Columns Separately.

12

Hi Sagar_Rana,
This is my workflow,
Sequence3.zip (2.1 KB)

If I have 125 records on 5 pages but robot takes only 40-50 records and does not extract proper data, how can we extract proper data.

And it does not extract the data which is done by scrolling down.

Can you help me on this topic.

14

you need to find a way to scroll down ,
something like using page down but you need to use somthing to indicate robot need to do page down

16

Hi,
how to scarp the scroll down data using data scrapping
can you help me with any workflow.
please suggest me how to scrap the proper data.

17

Hi ,
This is the Extract meta deta properties of data scrapping.

image
image390×601 91.5 KB

1 Like