New & Upcoming UiPath GenAI Activities and Features

In July 2024, we released to GA the initial slate of [UiPath GenAI Activities] (Activities - About the UiPath GenAI Activities package) (announcement), a first party connector that gives Cloud users access to a variety of UiPath managed, industry leading large language models.

We have since seen some excellent early adoption with users leveling up the complexity and quality of their automations with the help of GenAI inferences. Curated prompt activities like Summarize and Generate Email have offered consistent and reliable GenAI outputs for common RPA tasks that are easy to configure and deploy via Studio Web, Studio Desktop and now Apps.

Furthermore, the ability to craft a custom prompt (via the Content Generation activity) that incorporates variables and arguments at run-time has proven to be a versatile tool for tackling a wide variety of bespoke use cases. With the recent roll-out of Context Grounding in public preview, Content Generation has become even more powerful by grounding prompts and LLM outputs in a business’ unique data assets whether those be long, complex documents or data that has been uploaded to UiPath Storage Buckets from common enterprise business applications.

We’re now excited to roll-out what we expect to be several high value curated activities tackling complex text analysis and image based tasks:

And the output is a nice structured JSON (as a string): [{“text”:“Hare”,“type”:“animal”},{“text”:“Tortoise”,“type”:“animal”},{“text”:“Plodding wins the race.”,“type”:“moral”}] (Removed multiple entries, but every entity discovered would be represented in the output :slight_smile: )

Keep a look out for upcoming improvements to help determine where in the string the entity was discovered.

  • Detect Object: By uploading an image and a list of custom objects and their definitions/attributes, users can determine if indeed those objects are present in the image. Furthermore, users can apply custom conditions for the model to consider. For example, perhaps a logistics company needs to determine whether or not a package was appropriately placed on a doorstep. With Detect Object, a photo with a custom condition for package placement could easily be set up and run with reliable results.

Other exciting activities upcoming:

  • Signature Comparison
  • Reformat (ex. JSON to CSV or malformed JSON to properly formatted JSON)
  • Semantic Similarity - string to string or string to list of strings
  • Deep Sentiment Analysis
  • Image Comparison - comparing two images with custom categories
  • Image Classification
  • Semantic Search - search your Context Grounding indices for semantically similar data

All of these activities only cost 1 AI Unit to execute. By chaining these together with other GenAI activities or UiPath products (Document Understanding, Communications Mining, Integration Service activities), the sky is the limit! Let us know your feedback!

8 Likes