Unable to read grid values using NGetText in UIAutomationNext (Chrome)

Help Studio
1

Hi everyone,

I’m having trouble using uipath.uiautomationNext.Activities.NGetText to read values from a web page in Chrome. The page uses Material‑UI, and the grid values I need to extract are inside <p> tags that sit above corresponding <input> fields.

Here is the HTML structure for one of the grid items:

A6

There are three such grid items, with values like A6, B5, H8, and the input IDs are:

  • app-challengescreen-cell-answer-0

  • app-challengescreen-cell-answer-1

  • app-challengescreen-cell-answer-2

I tried to

  • using an anchor + strict selector:
Also tried : both failed with Could not find the UI element corresponding to this selector.

Is there a correct way to navigate from the input filed to the

element using UiAutomationNext selectors?
Any guidance would be greatly appreciated.
One more thing I wanted to mention is, this stopped working starting this week and we recevied new chrome update (version 149.0). I have seen other UiPath consumers reported this issue and I followed the commands mentioned here to see if the issue resolves but no help - UiPath Fail to Communicate with Chrome after Chrome update - #4 by ashokkarale

UiPath Studio version I’m using: 2024.10.1

2

@suni.p

If you having the issue with chrome update you may recieve different error, this issue might be selector issue, try to use UiExplorer to indicate proper selectors, select appropriate attributes.

Let me know if this works.

Happy Automation

3

Try updating the UiPath UIAutomation package to the latest 2024.10 compatible version and verify UiPath extension for Chrome is enabled or not. Use UI Explorer to confirm whether the <p> tag is being detected or not after the Chrome update.

If UI Explorer cannot identify the <p> element, this may indicate a compatibility issue between Chrome 149 and the current UIAutomation package version.

4

@suni.p

try selector like this

you need to add th window selector line as well on top

here idx=‘1’ will give first one..similar 2 and 3 can be used

<webctrl tag='INPUT' id='app-challengescreen-cell-answer-*' idx='1' />
<nav up='2' />
<webctrl tag='P' />

cheers

5

I tried all the above suggested solutions

  • @kkapula4 Updated the UiAutomation packages to latest version
  • @yedukondaluaregala Tried UiExplorer but problemn with this is it is taking the dynamic values like aaname which change and cannot rely on this
  • @Anil_G : Added the window selector as well but no luck still having the same issue
    image
    image1316×574 67.1 KB

I removed the anchor, Fuzzy selector and just tried with strict selector and window selector:
Window selector

<wnd app='chrome.exe' cls='Chrome_WidgetWin_1' title='Identity as a Service - Optum - Google Chrome' />
<webctrl tag='INPUT' id='app-challengescreen-cell-answer-*' idx='1' />
<nav up='2' />
<webctrl tag='P' />
6

If it’s a grid use Table Extraction.

7

Now I’m getting this incompatible error. I don’t even have the v6.20.0 available, latest version I have available is v6.14.3. Other versions available are preview versions.

Studio version I’m using - 2024.10.1

This version of the OCR.Activities package is incompatible with UiPath.IntelligentOCR.Activities older than v6.20.0, UiPath.PDF.Activities older than v3.20.0, UiPath.DocumentUnderstanding.ML.Activities older than v1.29.0, UiPath.OmniPage.Activities older than v1.20.0

image
image401×222 4.31 KB

8

I was able to resolve the compatiblity issues by downgrading UiPath.OCR.Activities to 3.20.3

Also solved my original issue of reading gird value. Rather than relying on p element, I’m retrieving the entire grid values and then used SubString to split the retrieved grid values. Hopefully this works consistently.

9

You should use Table Extraction. MUCH better solution than string manipulation, which is more likely not to be consistent.

10

@suni.p

Can you share the screenshot from where you are trying to extract the data.

In selector i can see the idx and some index values, those are constant in everytime. If not just remove those try to use parent id or parent calss.

Share the screenshot of the application and as well selectors.

11

Your project is using UiPath.IntelligentOCR.Activities v6.14.3, while the installed OCR.Activities package requires IntelligentOCR v6.20.0 or higher.

So you can upgrade IntelligentOCR to v6.20.0+, or Downgrade OCR.Activities to a version compatible with IntelligentOCR v6.14.3.

Also check and update related dependencies such as OmniPage, PDF Activities, and Document Understanding ML to compatible versions.

12

@suni.p

Did you try the selector in ui explorer and did it highlight?

If not then we might need to modift the selector a little based on the values from other attributes

Cheers