HyperHack-2023 - Dr.SimplifAI
Use Case Description
Our use case looks at leveraging the capabilities of both Specialised AI and GenAI and bring their combined power to solve a very real use case in Healthcare that has been faced by pretty much any patient who has visited a GP or a Specialist. When you as a patient visit the doctor, you reach the clinic not feeling too great, and then have to wait your turn. You eagerly wait for your number to be called and watch as the steady stream of patients go in, come out, and then nothing seems to happen for a good amount of time before the next patient’s number gets called in. Once your number finally gets called in, you meet the Doctor who barely makes eye contact with you as you start telling him what is wrong because he is so busy documenting everything you say. Finally, after the diagnosis, the doctor gives you a set of recommendations and medications of the top of his head which is susceptible to human error especially towards the end of the shift or the day as the Doctors are quite tired at this point which can lead to critical information almost being missed out as was the case for one of our teammates last month (June 2023). Finally, you leave the room trying to make sure you remember everything the Doctor told you and then wait once again while the Doctor finishes up his documentation, the medications required etc.
Our solution leverages a series of technologies to solve all the pain points above thereby hopefully improving the overall Patient experience, as well as allowing Doctors spend more time on helping patients improve their health and life and less time on documentation and administrative duties. These include
(1). Voice to Text so that the Doctor does not have to type anything and can instead have a focused, engaging conversation with the Patient;
(2). Multimodal AI to augment the Patient’s verbal feedback with analysis of lab reports and diagnostics scans (e.g., CT or MRI scans) with specialised AI models;
(3). Using Specialised AI and Generative AI to prepare the most likely illness based on all input sources and present it in an easy-to-understand manner;
(4). Leveraging on Specialised AI to summarise the recommendations and medications to ensure the Doctor does not forget to tell the patient the key points, and finally
(5). Summarise the entire interaction and email it to the patient with one click to ensure that they know exactly what they need to do and aren’t trying to remember what the Doctor said while being sick. All of this is neatly encapsulated in an easy-to-use App built on UiPath Apps.
Refer to the flow for more details.
AS-IS WORKFLOW, TO-BE WORKFLOW
HyperHack-2023 - Dr.SimplifAI_To Be Workflow.zip
Other information about the use case
Industry categories for this use case: Healthcare Pharma, Other Sector
Skill level required: Intermediate
UiPath Products that were used: UiPath Studio, UiPath Apps, UiPath Assistant, UiPath Data Services, UiPath Communications Mining, UiPath Document Understanding, UiPath Orchestrator
Other applications that were used: Microsoft Dictate, OpenAI ChatGPT, BiomedCLIP (Via HuggingFace)
Other resources: -
What is the top ROI driver for this use case?: Improve customer experience