How to switch application in RDP using cv vision

Help Studio
, ,
1

Hi, I’m currently working on automating a process in RDP using UiPath, leveraging computer vision for UI interactions. However, I’m encountering an issue where the bot is not switching between applications while running the automation.
Can anyone suggest any best practices how i can switch application in RPD and how i can closed application in RPD.

2

Hi Kamelesh,

Switching Between Applications in RDP

  1. Use ALT + TAB Simulation:
  • Use the “Send Hotkey” activity with "Alt + Tab" to cycle through open applications.
  • If you need to switch to a specific application, use “Send Hotkey” with "Win + Number" (e.g., "Win + 1" for the first pinned application on the taskbar).
  1. Click on Taskbar Icons:
  • Identify the application on the taskbar using Computer Vision Click or Image Click, then click to bring it to the foreground.
  1. Use Application Titles with Computer Vision:
  • Use “CV Element Exists” or “CV Screen Scope” to detect if an application window is already open.
  • If the application is not in the foreground, send a click action on its window to activate it.
  1. Use the “Activate Window” Activity:
  • If UiPath can detect windows in RDP, use the “Activate Window” activity to bring the required application to the front.

Closing Applications in RDP

  1. Send ALT + F4 Hotkey:
  • Use the “Send Hotkey” activity with "Alt + F4" to close the active window.
  1. Click on the Close Button (X):
  • Use Computer Vision Click or Image Click to find and click on the close button (X) in the application’s title bar.
  1. Use Task Manager in RDP:
  • If an application is unresponsive, simulate "Ctrl + Shift + Esc" to open Task Manager, then use Computer Vision to select and end the task.
  1. Command Line Method (If Accessible in RDP):
  • Use the “Type Into” activity to run "taskkill /IM application.exe /F" inside a command prompt (cmd).

Thanks,
Solaimalai

3

For automating RDP - the best option is to leverage computer vision only for Ui Interactions

For switching between applications - some suggestions i could think are

  1. Use CV clicks
  2. Using Hot Keys -such as ALT+TAB or WIN+TAB
  3. Image click activity and click on the application icon or tab
  4. Short cut commands. Example - Win+R and type notepad

For closing also,

  1. Send Hot keys
  2. CV / Image clicks
  3. Kill process via command line
  4. Use Task Manager Shortcut
  • Ctrl + Shift + Esc → Opens Task Manager.
  • Navigate using Computer Vision Click or Keyboard Shortcuts to end the process.
4

@kamlesh1

first thing are they not allowing you to install the citrix extension? because that would allow you to interact as a normal UI on citrix as well

If CV is the option then send hot keys with key combinations is the way

generally we do not prefer opening multiple applications at once on citrix rather have one application open complete the tasks then open the second so that switching is not needed

cheers

5

@kamlesh1
To switch the applications, try below method,

1st point check on which tab you are, for that use CV element exists
Based on result if it is different tab use hotkey Alt +Tab if it application/ if it is windows Ctrl + Tab

If you are using CV scope activities to close application you can try below methods,

  • CV click at particular close/cancel button
  • Use Hotkey to close particular window/application
  • Use task manager to close the particular application which was in opened state.

Same project i recently implemented, i followed task manager to close the opened application, it will more accurate.

First thing before closing we need ensure whether particualr application is opened or not. for this i can’t use hotkey or CV click because i need to ensure that application/window is opened or not and sometimes it was in minimize state at that time these both options wont work

so i use task manager instead of checking whether it minimized or maximized state directly i can close it.

it better to use Task Manager to close the applications

to open task manager Ctrl+Shift+esc
check application is opened or not by using CV element exists
if yes click on particular application in Task Manager and click close
to close task manager use hotkey esc

Happy Automation!!

6

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.