Clicking using Computer Vision

I’m trying to click on a particular text on my proprietary application using just computer vision as it’s the only targeting method available. (Not too sure why?)

It seems to be clicking the wrong text on the screen. Say my CV text is : A130204

On the screen there isn’t any A130204. But it clicks a text.

If i were to have the text A130204 appearing on the screen at the start of the script it runs without any issue. Recognizing the text.

How can i ensure that it does not click on the wrong text???

Hi @WilfredNg

Could you please open the window selector and show the content in the that.

Hope it helps!!

@WilfredNg

As per screenshot we can see no strict or fuzzy selectors are present

Can you please re indicate the element and make sure to use one of the selectors from strict or fuzzy …also if not identifiable then use f4 to change the spy mode which chnges to active accessibility and then try to indicate and get the selector

It would be good to use ui explorer as well

Cheers

@WilfredNg
Use Strict Selector and Ensure whether the Element is present or not With CV Element Exist Activity. This will Return True of the element is present otherwise false.

changing to active accessibility did not help. The default targeting method is still : computer vision

strict selector and fuzzy selector is not available. The default is computer vision.

Click on open in Ui Explorer to open the Ui Explorer and then send me the one more screenshot of Ui Explorer window @WilfredNg

@WilfredNg

Open ui explorer and check if you are able to indicate the element or not…this is wierd to see only cv…is the application inisde rdp?

Cheers

This is the UI Explorer @raja.arslankhan @Anil_G @mkankatala

@WilfredNg

Thsi looks like a selector with active accesibility only…

You can copy this into strict selector field of your activity and select the target method as strict selector and use it

Cheers

what do you meant by this?

@WilfredNg

You can copy the selector from ui explorer and paste the same in the strict selector property of click activity and select target method as strict selector and use it

Please try the same

Cheers

in this case where should i place my variable? My variable that determines which text to select. It changes per loop.

@WilfredNg

Did you indicate the exact element?

If so it would contain a property called name …where you can use the variable instead of name

If not from visual tree try expanding and check the elements under it which contains name

Cheers

How can I locate my target within the ui explorer?

@WilfredNg

on visual tree window in left you have a symbol at top left if selected will highlight element element in orange whatever is selected in the visual tree…you can expand each and select and check

image

cheers

Can’t seem to go further down in the ui explorer. It’s a proprietary application.

image

@WilfredNg

Try opening UiPath studio in admin mode and check

also as per screesnhot the tree sctucture might not be expanded…we need to go with key strokes or images or cv only…normal activites might not work in a tree like this

cheers

Yup it does not work. Back to square one… Any solutions for the CV method?

Images will not work considering as I’m using a variable.