Selector Issue: Expand Icon Detected Only via Computer Vision

[Dhruba_Jyoti_Kalita]

Hi everyone,

I’m facing an issue while trying to automate an expand arrow icon inside a table (row-based data).

The arrow icon is not exposing any reliable attributes, so UiPath is detecting it only via Computer Vision. However, we cannot proceed with Computer Vision since it consumes AI tokens and we want to stick to strict/fuzzy selectors only.

I’ve tried using an anchor-based approach (anchoring with nearby stable text like “Initial Evaluation”), but still the target element itself is only supported through CV. Also, there are multiple similar arrow icons (one per row), which leads to duplicate element issues.

Has anyone handled a similar scenario?
What would be the best way to reliably click this expand arrow using only selectors?

Any suggestions would be really helpful.

[adi.mehare (Aditya Mehare)]

Not sure if it will work.

Compare table row html attributes/ class before and after clicking on expand icon.
If you found any difference in class/attributes of the row then inject js to replicate it.

[iampnkz (Pankaj KUMAR)]

Hi @Dhruba_Jyoti_Kalita,

Could you please share a snapshot of the selector in UiExplorer along with the table showing the arrow icon?

Thanks!

[avejr748 (Ave Salvante Jr)]

Try looking for a selector identifiable element near the expand arrow and use that selector on your click activity then just add offset to the click. This might involve doing trial and error until you find the correct offset

[SorenB (Søren Schytz Birk)]

Hello @Dhruba_Jyoti_Kalita

I have had a similar issue, where I would have to sort a column in descending order.
For my case the downward facing arrow had a specific attribute (file name) that I could use to validate my Click activity.

To summarize:

1. Click activity with anchor on column name
2. Validation on downward facing arrow appearing
3. Retry every 10 sec if the “correct” arrow is not showing

Dummy example of selector:

"<webctrl id='react-iframe' tag='IFRAME' /><webctrl tag='TABLE'/><webctrl aaname='ColumnName' tag='SPAN' />"

Dummy example of verification selector:

"<webctrl id='react-iframe' tag='IFRAME' /><webctrl tag='TABLE' /><webctrl parentid='root' tableCol='6' tag='svg' data-testid='ArrowDownwardIcon' />"

Regards
Soren

[Dhruba_Jyoti_Kalita]

thanks @SorenB . It is working now

[Jon_Smith]

Btw, its worth noting. You can use the Computer vision local server to avoid consuming AI units. It uses more of your computers CPU, but for one off stuff like this it works great.