How to click on specific part of an application without worrying about UI element

[nmjvk]

Dear UiPathers

I have an automation task, where I need to be clicking inside of Outlook 2019. However, when using Click activity it only works once because the Click activity is looking for the UI element to click on.

My question is, is there an activity or a way to configure Click so it clicks on a sepcific (x,y) coordinate on Outlook without needen to worry about the UI element? I heard that you could configure Click activity in Options and give it specific coordinates to click on, however, that does not show up on my UiPath Studio

Here are some similar threads to mine, but outdated so I can’t use them. The core idea in these threads are the same as mine. Wanting to click on a specific location without having to worry about the UI element.

Click based on Cursor Position

I need to automate lot of clicks based on cursor position relative to a reference text. Is there any other way to identify the X and Y offset apart from manual recording? may be outside UiPath?

Activity/Command to click on mouse position and completely ignore elements/selectors

I am looking for an activity or function/expression that just lets me tell UIPath to click X,Y coordinates on screen, not depending on images/text/elements of a web page. The reason is that there is an element on a webpage that UIPath can’t detect no matter what I do, and I just want to tell it to simply click that position without a selector indicating the element. This would work since the position of this element never changes. Recording screen or adding the “Element click/Image click/Ocr te…

How to click on a specific point relative from a window title?

Hi everybody, Look at this java application section [image] I’m trying to program the robot to click always on the area corresponding with the first result (in this case AOO, but the list can scroll) but I can’t find the command to stablich this area relative to the static title (Sélection des dossiers…) Can you help me? Thanks

Have a great day/ night forward.

[postwick (Paul)]

What are you trying to do here, bring Outlook to the front or something? You can do that with the Activate activity.

Activate

[nmjvk]

Dear @postwick

That is not what I want, sorry. Imagine we have opened Outlook, now, inside Outlook I want to click on a meeting, however, you have to double click the meeting to open it up. I want to open a meeting up, delete it and repeat until all the meetings have been deleted. I have made everything work besides the clicking part. Once I have used the Click activity it keeps looking for a UI element. Is there a way to just tell UiPath to click on a specific part of Outlook without looking for the UI Element?

Also, using the Image Region Selection does not work since it still only looks for the UI element to click on.

Hope this answers your question.

[michael.zura (GuardiansFan)]

@nmjvk
If I understand your question correctly, you can use a Click Image activity, in the Properties expand Options, expand Cursor Position

There you can input X and Y coords

Regards

[nmjvk]

Dear @michael.zura

I don’t have the Click Image activity. Is that an external packgae downloaded from somewhere?

[postwick (Paul)]

@nmjvk

Once I have used the Click activity it keeps looking for a UI element. Is

Then you don’t have your selector correct. If you’re trying to click a meeting, that meeting will have a specific selector.

[postwick (Paul)]

You’re probably on modern and image click is built into the Click activity, but image click isn’t going to help you.

[nmjvk]

Dear @postwick

That is the problem. I don’t want to have to specify a selector.

I will try one more time to ellaborate my question. I just need my process to click somewhere, don’t care if there is an UI element or not. Even if it is a blank site just click on a specific part of that blank site.

[postwick (Paul)]

@nmjvk

I don’t want to have to specify a selector.

Why not? This is how UiPath works.

[michael.zura (GuardiansFan)]

@nmjvk
Are you using Classic or Modern? It is in Classic activities.
Classic/UI Automation/Image/Mouse/Click Image

[nmjvk]

Hello again, I just added more information to my message, you seem to be too fast for my fingers

[postwick (Paul)]

There can’t not be a UI Element. If you can click it, it’s a UI Element. I think you’re not understanding that literally everything on your screen is a UI Element, it’s the foundation of how Windows works.

[postwick (Paul)]

You can designate the Outlook window itself as the UI Element to click, if you want. But I still don’t get the point. If you’re trying to click a specific thing within Outlook like a meeting, email, tab, menu, etc all those things are UI Elements.

[nmjvk]

Hmmm, not quite. Your window consist of a bunch of pixels where you can specify specific UI element if you choose so. Your whole window is actually a GUI, not an element. As an example, in Python and Java they have integrated GUI’s where you can click without having to specify UI elements. Would be nice if UiPath would offer the same

[nmjvk]

Okay, forget if it is specific, I just want the process to click without having to look if what it is clicking is a elligible UI element

[nmjvk]

Dear @michael.zura

Can you perhaps guide me to see where I can find out if I am using “Classic” or “Modern”?

[michael.zura (GuardiansFan)]

@nmjvk

[nmjvk]

Dear @michael.zura

Thank you, I found it now. I will try to implement your suggestion and see if it works!

[nmjvk]

Dear @michael.zura

Your solution works perfect. I treat the whole Outlook application as an image which allows me to click anywhere without having to worry about if there is an UI element or not. Thank you so much.

Have a great day to both you and @postwick for helping me out!

[postwick (Paul)]

No, your MONITOR consists of a bunch of pixels. The things on your screen are all UI Elements.

I guess if you don’t want to explain what you’re trying to accomplish, so that I can help you with the best way to do it, then good luck to you.