OCR Workflow Extracting Incorrect and Duplicate Values from the Form

[Vrmk]

Main.xaml (287.5 KB)

Hi Team,

I have created a UiPath workflow that extracts data from a biodata form (left side) and enters it into the corresponding fields on the right side.

The workflow is working for most fields, but I am facing the following issues:

1. Some values are not extracted correctly by OCR.
2. Some fields return incorrect text due to OCR recognition errors.
3. Certain values are extracted multiple times.
4. Dropdown fields such as Diet, Religion, Education, Height, and Weight sometimes receive incorrect values.

I have attached:

• Main.xaml
• Screenshot of the application
• using UiPath screen engine
• 2024.10.4

Could you please review the workflow and suggest improvements for OCR extraction and regex validation?

Thank you.

[yedukondaluaregala (YK)]

@Vrmk

Did you tried with get text activity instead get ocr text, if you have chance to use get text activity, or table extraction activity,

Let me know if that works.
Happy Automation

[iampnkz (Pankaj KUMAR)]

Hi @Vrmk,

Try extracting the value from one of those blocks using Get Text, especially the left block. If you’re able to retrieve the text, you can then use Regex or string manipulation to extract the specific values you need.

Thanks

[golla.sandeep]

1st question.. : why OCR? the application looks like a windows based application. why not extract using get attribute (like “text”) of that UI Element?

when there are native ways of extraction, one should always stick to native.
OCR might sound advanced but its BS sometimes(irrespective of the engine)… there’s always a degree of wrong interpretation.

SG.