Automated testing on 3d apps with StudioX?

Hi.

I have been experimenting with StudioX lately. My task is to find some software/framework to automate testing our software. Said software is a 3D app, with a few OpenGL viewports. Our most basic test case is to:
1-load an object in the viewport with initial (default) position (this works)
2-left-mouse down on it
3-drag it, to rotate it in 3D space
4-left-mouse up, to set its new position
then click a button to move to next object (this works)
then click the opposite button to return to 1st object (this works)
take a snapshot of window and compare to an “expected” image, make sur images are identical (object in same position)(this works too).

From what I have seen, StudioX provides many ways to interact with a software. What I have not seen so far however is (steps 2-4): can we ask StudioX to left-mouse down at some “arbitrary pixel coordinates” with no Windows widget/feature at that location, drag to some other pixel location and mouse-up?

When creating a left-mouse down event and dragging the mouse all over the viewport, StudioX does not seem to detect anything it can latch or anchor onto. Obviously I did not expect it to possibly see the 3D object in the viewport. But can it (or any other UiPath product) at least be instructed to target a specific pixel location on mouse events? Otherwise, I do not see how it can possibly be of any use in a 3D app.

Thanks

Have you tried the all available Input Methods? One of them should work for you. I also see Cursor motion type property in Click activity try that one as well along with different Input Method.

I’m a RPA Architect and RPA Developer with experience in Architecture AutoCAD, 3D Max and similar software solutions.

I would like to volunteer to design and implement the automation from beginning to the end. Please could you share a power point / slides with the current manual process?

Best

Mauricio

Hey @M_G_C !
I am looking for a similar solution.
Is it possible to automate CAD like software specifically ‘Measure’ by RFMS using RPA, if so how will UI Path will understand image/design where we can apply logic.