UI Changes that Cause no Changes in the Automated Process due to AI

[StefanSchnell]

In the context of my consideration about what could happen if elements on an UI are changed I had the following idea:

When you have the situation that you must automize an UI and a field descriptor contains a spelling mistake, e.g. Lostname instead Lastname. So you automize your process and with the next release the developer corrects the spelling mistake, now it is Lastname. But now you must correct your automated process too, because the selector is different. I would prefer to have the possibility in this situation that an intelligent mechanism detects the probability: Lostname could be equal to Lastname. I have only to set a flag in my properties, e.g. Use Probability, an their amount, e.g. 75%. In this case my process doesn’t create an error. It continues to run, with an accepted probability of uncertainty.

In my opinion should it be possible to implement this feature with an AI algorithm. With this possibility, the UI can change to a certain extent and the automated processes do not have to be adapted.

[Cosin (Cosmin Voicu)]

Yes, Computer Vision does that

[StefanSchnell]

Hello @Cosin,

thank you very much for your reply. That sounds very interesting. I will try that in the next week

Thanks again and best regards
Stefan

[StefanSchnell]

Hello @Cosin,

excellent, it works

Thanks again and best regards
Stefan

[Cosin (Cosmin Voicu)]

Great, happy it helps. But as you might guess, this only works for minor changes

[StefanSchnell]

Hello @Cosin,
two questions:
As far as I can see contacts CV a web server. Do you plan to offer your full CV solution, include AI and ML, as on-premise solution?
I am not sure, but could it possible to adapt and use other AI and ML approaches with your CV solution?
Thanks and best regards
Stefan

[loginerror (Maciej Kuźmicz)]

Hi @StefanSchnell

See this post (and the thread for useful context):

On-premise version with self-hosted ML models

Hi Everyone! If you’re interested in deploying the on-prem version, please email insider-preview@uipath.com for more information.

[StefanSchnell]

@loginerror
Hello Maciej,
thank you very much for this hint
Best regards
Stefan

[loginerror (Maciej Kuźmicz)]

Hi @StefanSchnell

We now also have some fuzzy logic for selectors, see here:

#FeatureBlog - 19.10 - Using regular expression (Regex) in the selector attributes

It is now possible to use Regular Expressions in your selectors. Follow this guide to learn how! What’s new? We have added extra syntax to the Selector Editor to allow for advanced configuration of your selectors. Let’s begin As an example, I will be creating a selector that will be able to open a file whose name is dynamically changing. Let’s assume I am receiving daily list of bills via email which are saved as a text file named ‘bills mmddyy.txt’, e.g ‘’bills 101019’. Now, I want to writ…

#FeatureBlog - 19.10 - Using non-greedy search in selectors

What’s new? The Non-Greedy search makes it possible to identify the target element from a pool of similar applications, matching the attributes you specify. Let’s begin As an example, let’s assume I am automating two Calculator applications which are opened simultaneously: [image] I want that my automation spies these two Calculator applications for the entered number 100 in any of them and execute some steps afterwards. Thus, I am using the following selector: [image] With the cu…

#FeatureBlog - 19.10 - Fuzzy string matching for your selectors

What’s new? Fuzzy string matching is a technique to search strings which are not a 100% match and match the specific pattern approximately, rather than exactly. Let’s begin Let’s say I want to create a selector which needs to be resilient to user typos or similar user input with a key work I expect to be entered a search field. First, I have opened up a bing.com in my borwser and searched for ‘uipath certification‘ text: [01] When I get a selector for the input field, the ‘title’ attr…

These might even be a better choice in this scenario.

I will also mark this feature as Completed

[StefanSchnell]

@loginerror

Hello Maciej,
excellent, thank you very much
Best regards
Stefan