Receipt and Invoice AI - Now available in Public Preview!

Our new Receipt and Invoice AI is now available in Public Preview!

Note: The Receipt and Invoice AI Extraction ML model is a Cloud Platform offering and is currently not available for on-premise ML model deployments.

This new AI capability gives your UiPath Robots the ability to read both invoices and receipts and will help streamline your automations around accounts payable and expense compliance processes.

All the details you’ll need to get started are below, including an overview of this new activity, how it works, and how to install and use.

:bulb: How to provide feedback

Have suggestions, questions, or issues? We want to hear it!

  1. Simply go to the Receipt and Invoice AI category
  2. And then click New Topic

Key Benefits

  • Templateless approach to processing invoices and receipts - Our AI can automatically determine the location of critical information that needs to be extracted from the document, even if the format changes. It is no longer necessary to create multiple layouts manually.
  • High accuracy for even ‘noisy’ documents - We are continuously improving our AI to handle the complexities found in real world documents that make them hard to read, such as noise or low resolution from printing and scanning.
  • Integrated with our IntelligentOCR Solution - Drag-and-drop our new Machine Learning Extractor seamlessly into our existing document processing infrastructure provided by the IntelligentOCR activity package. Same infrastructure, new supercharged brain. :slight_smile:

How to Install in Studio

Note that starting Aug. 28th 2019, you need to create an account in cloud.uipath.com and use a License key from the Licenses page for these features to work. The key must be pasted in API-Key property of the activities.

To get started in minutes with almost no configuration, use the Extract Semi-structured document activity available in UiPath Go! This activity integrates well with Taxonomy Manager and Validation Station, but will work without them if you don’t need them.

For advanced or complex scenarios, you may also use UiPath.MachineLearningExtractor activity via the Beta feed. In order to do this, please follow the instructions below.

You must first install the UiPath.IntelligentOCR.Activities activity package:

  1. Open the ‘Manage Packages’ window
  2. Click ‘All Packages’ in the left navigation, then search for “UiPath.IntelligentOCR.Activities”
  3. Select the result, make sure version 2.2 is selected, then click the ‘Install’ button in the right pane

Next, you need to install the UiPath.MachineLearningExtractor activity via the Beta feed:

  1. If you haven’t already, add the UiPath Beta Feed (See instructions to add feed) to your Manage Packages window
  2. In the Beta feed, check ‘Include Prerelease’, then search for “ UiPath.MachineLearningExtractor”
  3. Select the result and click the ‘Install’ button in the right pane
    *:exclamation: Important - We must reiterate, make sure you check the ‘Include Prerelease’ checkbox :slight_smile:

The Machine Learning Extractor activity should be visible now in UiPath Studio, as shown below:

How to Use

Please watch our demo video here:

Additionally, here are step-by-step instructions to help you get started:

  1. If you haven’t yet defined a taxonomy for the documents you intend to process, you can do so using the Taxonomy Manager
  2. Drag in the Load Taxonomy activity and store the taxonomy in a variable
  3. Drag in the Digitize Document activity
    • Drag-and-drop an OCR Engine inside the Digitize Document activity
    • Define variables for both outputs: DocumentObjectModel and DocumentText
  4. Drag in the Data Extraction Scope activity
    • Populate input variables DocumentObjectModel, DocumentText, Taxonomy and DocumentTypeId. The DocumentTypeId is a string you can see in TaxonomyManager if you click on the Document Type you need to extract.
    • Define variable for output: ExtractionResults
    • Drag in Machine Learning Extractor and drop it inside the Data Extraction Scope
    • Populate Endpoint input property with the URL of the endpoint you would like to use:
  5. Click the “Configure Extractors” link within the Data Extraction Scope activity
  6. Expand the Document Type you are interested in and populate, on the right side column, the names of the fields which correspond to the fields in your taxonomy. See below for the full field names you need to fill in on the right side.

Invoice available field names:

  • “name”
  • “vendor-addr”
  • “billing-name”
  • “billing-addr”
  • “shipping-addr”
  • “invoice-no”
  • “payment-terms”
  • “due-date”
  • “po-no”
  • “date”
  • “net-amount”
  • “tax”
  • “total”
  • “currency”
  • “items”
    • “line-no”
    • “description”
    • “item-po-no”
    • “quantity”
    • “unit-price”
    • “line-amount”

Receipt model available field names:

  • “name”
  • “total”
  • “vendor-addr”
  • “date”
  • “phone”
  • “currency”
  • “expense-type”
  • “items”
    • “description”
    • “line-amount”
    • “unit-price”
    • “quantity”

Invoices model supports English and Spanish languages.
Receipts model supports English and Romanian languages.
Maximum request size: 4MB or 2 document pages. Maximum 10 requests per minute.
Models cannot be customized/optimized/retrained, they are pre-trained.

InvoicesReceipts Extractor - Demo workflows.zip (29.7 KB)

87 Likes

That’s a great addition to the UiPath. :slight_smile:

14 Likes

Woah! Awesome addition, UiPath!

This is something that will be extremely useful for me considering the fact that I am automating Finance processes.

Maybe in the future, we can add fields that can be extracted.

Thanks, UiPath! You never fail to amaze us! :slight_smile:

13 Likes

It’s an amazing feature to have. Great work!!!

10 Likes

This sounds awesome!
We’ll try this feature out for sure and give our feedback - but out of the box integrated in UiPath this feature sounds amazing!

10 Likes

I’m not able to see that machine learning extractor activities.

8 Likes

Awesome :clap::clap:

8 Likes

Happy to see this…

8 Likes

Happy to hear this one…
Is there any script for checking this feature now?
So that we can recommend this one instead of going to some other 3rd party tools like Rosssum, etc…

8 Likes

This is the ONE :blue_heart: great work team

10 Likes

Hi @ganesh_rajan,

I was successfully able to install Machine Learining Extractor activity.

Please follow the below steps.

  1. Install UiPath.IntelligentOCR.Activities (version 2.2)
  2. Configure Beta feed, Check Include Prerelease check box
  3. Install Uipath.VMware.activities package from beta feed.
  4. Install UiPath.MachineLearningExtractor from beta feed

image

10 Likes

Can we use it for Production? is it still available in Beta versions?

5 Likes

This is in public preview as of now it is not available in production environment. It is there in community edition only

7 Likes

Excellent feature to have. Thanks UiPath

4 Likes

Thanks Jan! What fields do you need? Can you show me some examples?

Thanks,
Alex.

6 Likes

We don’t offer a script, but you can use the Machine Learning Extractor activity together with the IntelligentOCR activity pack to try it out!

Thanks,
Alex.

7 Likes

Hi Pankit,

We will release it for On Premises deployment too. In the meantime you can still try is as part of Early Access Program. Can you please contact me directly at alexandru.cabuz@uipath.com and give me more details about your production usecase?

Thank you,
Alex.

8 Likes

Is there any sample workflow file that I can use to get started?

7 Likes

@alexcabuz: can you give to me sample file…
Thanks bro. :star_struck::star_struck::star_struck:

8 Likes

Hi @anhtt47 I will post a sample workflow on Monday,

Thanks for your interest in this,
Alex.

8 Likes