Data Scraping issue: Scrape all rows except the last one

Help Studio
, ,
1

Hello all,

i’m experiencing a weird issue when using the data scraping activity in a web based (google Chrome) application. I have used the scraping settings where I indicate the first column and add another column with extract correlated data. I have tried selecting the first and last row and also tried various ways of selecting other combinations but the robot always returns the same result. Example: there are 25 items available in the datatable but the robot will return 24 and ignore the last row. see the Extract MetaData below:

image
image495×503 24.6 KB

The other activity settings:
image
image219×521 11.7 KB

When I set Continueonerror on False the robot will return an error message ’ timeout exceeded’ no matter if I set the Timeout on 40 or 60 seconds.

Unfortunately I can’t share the webpage with the datatable because it contains sensitive information.

this is my first post so if information is missing please let me know.

looking forward to a response. thank you in advance :slight_smile:

2

Can you check in chrome developer tools if the last row is different than the others?
Maybe other css classes?

If yes, how does it differ?

3

Hi Tobi,

Thank you for your reply, sorry for my late response.

I have checked for a difference in the table rows but the code is not showing me any differences besides the row counter (DXDataRow5 and DXDataRow6)
image
and
image

I opened both of the codes to check for differences in the cells but they weren’t there neither.

What do you advise?

4

@efaid , I think Delay activity may work for this. If you add delay before data scraping, it can give you result.

5

@nirmalya.sarkar thanks for your input.

I have tried adding the delay activity before the robot starts scraping the datatable. unfortunately this doesn’t show any difference in results. I also make use of the delay between pages as seen in screenshots from the original question.

6

Just scrape them all then delete the last row from the datatable.

7

@postwick can you elaborate?

I have the issue that the last row is not extracted whilst I need this. If I delete the last row how would this benefit me?

8

Oh, from your title it sounded like scraping everything except the last row is your goal.

9

ah ok. It happens :slight_smile:

10

Is there a solution for this issue?
I am having the same issue, when extracting a table from a word document (Office 2016 professional) . The last row is omitted by the extraction.

I am using Studio 2020.10.2 and following are activity versions
image

Thank you in advance.