I am working on setting up UiPath mobile automation for iPhone, iPad, Android, and Apple Watch applications. I do not have access to the application source code, and UiPath Studio is hosted in a Cloud VDI RPA environment, not on my local PC. My goal is to execute automation using physical (local) mobile devices.
I have a few questions and would appreciate your guidance:
Physical device connectivity
How can I connect a physical (local) mobile device—via my PC—to the Cloud VDI RPA environment where UiPath Studio is hosted?
Required installations on the Cloud VDI RPA
Based on the UiPath documentation below, it appears the following components must be installed on the Cloud VDI RPA environment:
Android: Appium Server, Java, Node.js, and Android Studio
Could you please confirm whether this is accurate and let me know if anything additional is required—especially given that I do not have access to the application source code and UiPath Studio is hosted in the cloud rather than locally?
Consultation support
Would it be possible to connect with someone from your team for a brief consultation to review this setup and confirm the recommended approach?
Yes UiPath documentation steps should be good enough. connecting your physical devices is more same as how you will be doing with appium.
To get help from UiPath if you purchased UiPath Test Manager / Test Cloud License then please reach out to your Customer Success manager to facilitate a call with UiPath team to guide you.
Thank you! We got connected with the UiPath Guide.
I have a few additional questions for you:
Audio playback as test input
Is there a way to incorporate a pre-recorded audio file into a UiPath automation so that, during execution, the file is played to the mobile device and can be “heard” by it?
The goal is to automate a speech-to-text workflow where speech input normally comes from a human user, but instead the automation supplies a recorded audio file as the input source (i.e., playing the audio to the device while it is actively listening).
Audio capture and validation from the device
Similarly, can UiPath capture or “listen to” audio output from the mobile device during test execution and use that audio as an input for validation of the automated test?
Mobile automation in UiPath can be quite tricky to get right, especially when it comes to stable device connections. I have spent a good amount of time recently just trying to keep the Appium server consistent without it dropping out mid-execution.
It is one of those areas where the documentation makes it look straightforward, but the actual environment setup always has these small hurdles. I am interested to see if anyone has found a more reliable way to handle the local device mirroring lately, as that is where most of my lag seems to happen.