Thoughts after the UiPath Hyperhack 2023

I had the honor to participate as a Jury member at the 2023 HyperHack AI Category Section. I didn’t see all the projects, but I saw the finalist 9.

I was impressed by all these, below is the list of the finalists with what their automations do.

First prize: DrSimplifAI – developed by SimplifyNext team from Singapore

This is an automation app for a healthcare use case that aims to enhance the patient experience and improve doctor-patient interactions by leveraging Specialised AI and Generative AI technologies. The scenario involves addressing common challenges faced during medical visits, such as long wait times, hurried doctor consultations, and potential human errors in diagnosis and prescription.

This process is presented through an easy-to-use app built on UiPath Apps. The main quality of this solution is its potential to significantly enhance the patient experience by saving doctors’ time on administrative tasks and improving the communication of crucial medical information. The use of various AI technologies like Voice-to-Text, Multimodal AI, and Generative AI offers a comprehensive approach to tackling common healthcare inefficiencies. The top ROI driver for this use case is identified as the improvement of customer experience in healthcare services. I hope that this will be further developed, and it can become a great product by itself.

Second Prize: Doc Robot developed by a team from the USA

Doc Robot is a GPT-powered virtual assistant integrated with UiPath Assistant and Orchestrator, enabling hands-free interaction and execution of automations. It’s designed to assist blind users in healthcare by offering text-based chat capabilities at https://callassistant.silverinc.org. This innovative solution combines language understanding with UiPath’s automation features to enhance accessibility and user experience.

This in in fact a framework that allows a now code development of an intelligent assistant for the blind, which can be used not only for medical purposes. It is an impressive application of Generative AI in combination with the UiPath Platform.

Third Prize: AI Powered Medical Assistant developed by Ebru Sarikaya, from the Boundaryless Group in Turkey

The MedicAI App combines cloud-based unattended and attended automations to provide medical information based on user inputs. It offers patients access to medicine leaflet details, relevant medical database information, and personalized answers. For doctors, it serves as an attended robot assistant, monitoring medical systems, analyzing patient-medicine suitability, and providing real-time recommendations. Benefits include quick suitability advice, identification of side effects, improved patient engagement, and efficient decision-making. This app streamlines medical processes, enhances patient safety, and empowers both patients and doctors through AI-driven insights. Ensuring data security and regulatory compliance is crucial in its development. It is a very useful app that hopefully will be further developed in Intelligent Assistants for patients and doctors that will work in tandem not only for prescription drugs. I loved the feature that the patient can take a picture of a drug box and gets the info about the drug and potential problems related to the patients health situation and other drugs that the patient is taking.

Other Finalist Projects

An interesting fact is that all three winners were related to healthcare. This proves that everyone considers healthcare as one of the fields that will benefit the most from Generative AI and AI in general. Of course, for critical applications, safeguards are absolutely necessary to avoid “malpractice situations” due to AI-based decisions and information provided to patients and doctors.

The other applications were also intriguing, and all of them were inspired by real needs.

Among the projects, there was one that stood out in the “automation for good” category. “Refugee Connect,” the project by the Brazilian team “Fifty Fifty,” addresses a very challenging global issue. Because of various critical situations worldwide such as wars, pandemics, and difficult economic conditions, there is a pressing need to assist refugees seeking a better life when they arrive in a new country. This application helps these refugees through an app that allows them to upload personal information. Subsequently, automation verifies this information by accessing different systems. Once the refugee’s identity is confirmed, they are paired with a volunteer in the same geographical area to provide immediate support. It’s a great idea, but it requires further development to be usable in any country around the world.

The “One Minute Meditations” project by the Ingram Hyper hackers team from the Philippines focuses on a pressing issue: the growing challenges of depression, anxiety, and stress worldwide. They’ve developed a solution using UiPath technology and Generative AI to create personalized meditations. This UiPath App, operated by an Attended Robot, crafts unique guided meditations in real-time based on user input, aiming to alleviate mental health struggles.

Named “OMM” (One-Minute Meditations), this solution follows UiPath’s philosophy of making technology accessible to everyone. It aims to break down the cost barrier of professional mental health support and tackle the social stigma associated with seeking help. By providing tailored meditation experiences, OMM intends to promote mindfulness and cultivate a healthy habit of meditation. Some users might even experience immediate relief after just a 1-minute session, offering a simple yet effective tool for enhancing mental well-being. In my opinion they need to work with psychologists to add more to the users context information in order to create a more personalized experience.

I’m personally impressed by Iulia Prodan’s project at Accesa, a European multinational company. Their application “From Feedback to Feed Forward” addresses a common challenge faced by Product and Customer Experience Managers.

These managers gather customer feedback to inform their business strategies, but the abundance of feedback from various sources makes manual analysis resource-intensive.

Accesa built an automated solution using RPA robots to collect feedback, AI-powered Communication Mining for insight extraction, and a UiPath App for user interaction. This allows users to request data from chosen sources, analyze it, and visualize it easily.

Automating the process offers timely feedback collection, efficient model training, real-time analysis, and access to customized reports. This effective use of UiPath’s Communication Mining could benefit others facing similar challenges. It would be great if they develop an Accelerator for broader use in this context.

The Other Projects were :

  • Stock News Sentiment Analyser by team Simplify Invest , Singapore - Automate analyses of hourly stock market news based on each investor’s watchlist
  • Pharmacy and Medical Claim Bot – Volvo Group India – efficient medical pharmaceutical orders workflow for healthcare professionals, pharmacies, and patients
  • Vyond – by team Circular Economy from Volvo Group Indi - app to support second hand car buyers

Conclusion

In conclusion, this year’s hackathon showcased an impressive quality of teams that developed highly useful and innovative applications. With a bit more refinement, these could potentially evolve into successful products or automations, benefiting a diverse range of customers.

The hackathon also demonstrated that the UiPath platform is exceptionally well-suited for rapidly deploying AI and Generative AI-powered automations, even of significant complexity. I eagerly anticipate next year’s hackathon, where I am convinced we will witness even more captivating applications.

7 Likes

Thank you George for being part of HyperHack 2023 right from the start… :trophy:

Thanks for putting this together, George! Really excited to continue pushing the boundaries of real time automation with the platform.

It’s very good to see so many Healthcare use cases as I think this field is not only the field that stands to benefit the most from gen ai, but also needs it the most! Overworked staff and underserved individuals deserve access to automation at their fingertips to improve outcomes.

1 Like

Mason, I would be intereted to see if you continue to work on your platform. It is very cool, and can be niocely further developed. Maybe you can publish it on our Marketplace and we can write jointly a blog about it.

1 Like

I’d love to, I think real time communication with the UiPath platform is a gap that isn’t addressed with the current products offered. Accessing bot capabilities during a call, during an appointment, or on demand is difficult if this capability isn’t expanded.

I have the code hosted as open source today, but it is very technical, and would be an awkward solution to put into the marketplace and use. Are there any resources on how to post this type of solution in the marketplace?

Are there product teams at UiPath today who are focusing on real-time communication similar to chatbots and call-assist agents? I’d love to talk to them about some of the strategies I’ve used to implement this solution, and where I think it could go into the future.

Please send me an email to george.roth@uipath.com