Evaluation pipeline getting failed

Help AI Center
1

Evaluation pipeline is getting failed

I have run with different datasets

But is is failing every time

2

I am getting error like

Evaluation dataset schema is not a subset of the trained model schema

3

check evaluation and training data set it should be same

if mismatch happen then Eva pipeline will failed

4

Hi @anusha2 ,

Could you please share the error logs ?

Thanks,
Aman

5

IMG20240117181049
IMG202401171810491920×1440 480 KB

6

If I need to use same dataset

Then if I want to test some new data

How to use that

7

Hi @anusha2 ,

In Data Manager

  1. While loading data in DM, load data by enabling evaluation data set
  2. And add some data without evaluation
  3. Label all the documents
  4. Then Export evaluation data individually
  5. Then export remaining data individually
  6. Now while building the pipeline, select full and in input dataset text box select exported package(not the evaluation dataset)
  7. In evaluation text box select the evaluation exported package.

Now you run the pipeline and check.

Hope it will help.

Thanks
Muthu

8

Thankyou for your reply

If I want to run only evaluation one then

9

Can we directly send some documents to evaluation without labelling

10

You can mark documents as Evaluation dataset but not without labelling

11

After evaluation pipeline success

How to check the data accuracy

Other than pipeline score

12

@anusha2 In UiPath I don’t think you have any other option to check the accuracy.

Instead you can check manually, by randomly extract 10 document using DU and check the result field wise and document wise.

So in the end you can calculate the percentage for field level and document level accuracy.

Thank
Muthu