Firstly, it was great discussing test suite capabilities with @Gernot_Brandl @ThomasStocker @Horea_Soanca and Balwant. Thank you for your efforts.
This feedback post is based on one particular observation I made at the Leapwork expo booth at the EuroSTAR conference.
After getting an indepth demo from Leapwork, one particular feature which stood out was the ease of debugging in their platform. I do strongly believe that such a feature can benifit both the UiPath Test Suite and UiPath Studio / Orchestrator products. Leapwork is also developed on using C#.
The feature: Simultaneous preview of executions + video + logs + state of the workflow
-
When an execution is run on a Leapwork flow, the execution gets added to a overview page with all the executions shown as the list. Much like Jobs overview in UiPath Orchestrator
-
When the test deveoper picks on one of the lines / executions. The right side of the Ui is populated with the Flow which ran, a video capture of the execution and beside it the verbose logs being logged with timestamps.
-
When test developers wants to parse / debug the test, they can either use the video, select a log message or select the flow stage and all three of these will be synced simultaneously.
I can imagine that such a feature can be a godsent in both RPA and testing projects by allowing the developers to debug at a much faster rate. The tags introduced in 22.04 does not yet support filtering robot logs. Although there are many video capture libraries in MarketPlace, the video capture features are not user friendly. UiPath orchestrator already supports the graphical representation of the packages uploaded so connecting it into the logs / error logs should be possible.
The current painpoint for a UiPath developer or test developer is to get a quick situational awareness of an automation execution via the Orchestrator or Test manager when things go wrong. An intitutive debugging feature in orchestrator / test manager may be of help in such situations.
This feature might be a tall ask but if a competitor can realize it, UiPath surely can as well maybe in a more elegant UI as well.
I wish the test suite team more success and hope to see them again!