Data srcraping

Help Studio
, ,
1

Hello, please your help.

I am using data scraping to extract a column of data from a page, but the page is very long and only extracts the visible data.

that is, it does not extract all the data.

What can be done in these cases?

image
image254×501 14.4 KB

2

hey

can you try with extract table data activity, and checking in limit extraction property to No Limit

image

Regards

3

no encuentro esa propiedad.

4

image
image593×751 28.4 KB

Pero creo que no extrae todos los datos por que la pagina es muy larga. y solo extrae los que se ven en front.

5

intenta poner el MaxNumberOfResults en 0 y prueba

6

@alexis.mendozHello,

Here if its not loading even with data extraction it will fetch only the visible text. If it is available on the next page we can navigate to pages by giving the navigation button.

In your case my opinion is to use either of the below 2 methods.

1- as you need to fetch only one column,
Use a while loop(provide the condition as maximum limit i<200) considering maximum you will get only 200 records

  • use get text and loop through each item ( you need to get the selector with rownum or idx which gives the element position.

-use element exists to check the existance of 2nd row item .

  • if not present use sned hotkeys- down
    -again use element exists for 2nd row
  • if presnt use a delay, else use break activity.

2ns approach- use loop along with send hotkeps and table extraction.

7

Hi

During data extraction process a PREVIEW screen will be coming
There mention the property MaxNumberOfResults as 0

This will ensure that all records are fetched

If you can see here you have mentioned only 100 change that to 0

image
image593×751 28.4 KB

Cheers @alexis.mendoza

8

hello.
The solution seems interesting to me, but I can’t understand it well. u.u I am a beginner in uipath.
I can’t visualize how to do that routine.

Could you give me a little more detail?

The page is only very long, there are no elements in the following pages, it is only one.

9

Hi @alexis.mendoza,

I think your problem is not datascraping. Your problem is mostly the loading of rows on the whole page.

For this, you can bring the scroll bar to the end with the pg dn command in the do while loop. When this process is complete, you can extract all the data with datascraping.

Regards,
MY

10

How do I do the extraction with a do while loop?

11

Can you share a screenshot of when the whole screen loads to understand this?

12

image
image1920×574 102 KB

13

The image you pull the scrollbar on the right to the bottom.

14

i can´t understand you–.

15

I wonder what is at the end of this field. We can suggest different solutions depending on the situation.

image

Regards,
MY

16

no funciono u_u

17

aaa

image
image475×643 27.3 KB

18

can you helpme?

1 Like
19

Hey @alexis.mendoza

This says you are using a responsive website right ?

When you scroll down the table rows get loaded dynamically?

Is that correct ?

Also, do you have multiple pages as well.

Thanks
#nK

20

yes it is, but it is only one very long page, there are no more pages.