Need your help here. We are working on a web application where we need to fetch the data from a section which is in the form of table. We are unable to fetch all the data using data scraping. We want only 3 column data values from the whole table.
For ex: If 200 records are present , only top 50 of them are fetched. There is only 1 page on the screen.
Also observed that when we try to scroll down the page, and try to spy and highlight the row values, then only some of the data gets fetched. We can’t keep on scrolling and do a data scraping. Seems that there are multiple tables enclosed in the div tag. How do we proceed ahead ?
@sagarjb I have faced this issue few months ago. I resolved with “Get Text Activity” for every required data by making dynamic selectors for required number of rows over loop.
you can try this one.
Thanks
Actually the thing is, i can use the dynamic selectors but it will work only for the first few records. For ex 50 records. If I try iterating for fetching the 51st record, it will fail. When I manually scroll down the page where the 51st record is visible, and again start iterating it will be able to fetch the next set of records, for ex: 51st to may be 80th . Again if i scroll down, and start the loop it will fetch the remaining one’s. But this is not a feasible option though.
Its not fetching the entire table. May be its not considering it as a table.
I can use the dynamic selectors but it will work only for the first few records. For ex 50 records. If I try iterating for fetching the 51st record, it will fail. When I manually scroll down the page where the 51st record is visible, and again start iterating it will be able to fetch the next set of records, for ex: 51st to may be 80th . Again if i scroll down, and start the loop it will fetch the remaining one’s. But this is not a feasible option though.
I have inspected the whole row from developer tool(F12) in chrome. Please find below the table values for each record. I have observed that the data-record index is getting changed for every row(Highlighted in yellow)- Screenshot 2 for reference.
But I am unable to select the whole row using Uipath. I tried to add data-record index=”0” in the selector editor, but it’s not even validating. Its just showing in the properties explorer but not in the selector editor.
There is an outerhtml property too which gives info on the whole row. But unable to use it in the selector editor. PFA Screenshot 1 for reference:
Can you get the total number of rows somewhere inthe page???
If yes, you can use that as a limiy for the loop. If not aailable you will have to make some conditions to check the element exist for next row, if not existing then use mouse scroll.
After yhat also if you are not able to find then it will be the end of the page.
I won’t be able to find the total number of rows here. I have inspected the whole row from developer tool(F12) in chrome. Please find below the table values for each record. I have observed that the data-record index is getting changed for every row(Highlighted in yellow)- Screenshot 2 for reference.
But I am unable to select the whole row using Uipath. I tried to add data-record index=”0” in the selector editor, but it’s not even validating. Its just showing in the properties explorer but not in the selector editor.
There is an outerhtml property too which gives info on the whole row. But unable to use it in the selector editor. PFA Screenshot 1 for reference:
ashokkarale
Anil_G
Yoichi
yangyq10
postwick
chandreshsinh.jadeja
aravindbalineni123
Parvathy
aya
PRASHANT_GABHANE