AI Center - Error in Evaluation Pipeline

Hi,

I am trying to create a Evaluation Pipeline. However on running it is giving the following error:

I have created a dataset and uploaded 3 pdfs there and am calling this dataset in the pipeline.

Pls can someone let me know what the issue can be.

@nanmishra

What skill are you usingb?

And did you check if it has any folder structure and did you mark the dataset as evaluation

Cheers

I have created a ML Skill Invoice. I have created a evaluation set only and exported it. However in the dataset folder which got created after export there are only pdf documents. I read in the forums that there should be images folder also which is not there. Can you help. One thing that I have not done is labeled the evaluation set in the Data Manager. Does this step need to be done?

@nanmishra

Evaluation step need not be labeled

First did you train?

Only aftet that you can do evaluation

Cheers

1 Like

You mean if I trained on the same document set?
No I had loaded two batches of data : Batch1 with 12 documents which I labelled and then ran the training pipeline with. This was successful.
Batch2 had 2 documents and this was marked as Evaluations set. I did not do anything this. Just exported that and tried to run the Evaluation pipeline.

Hi @nanmishra ,

Could you show us how you have configured the Evaluation Pipeline ?

Have you selected only the evaluation dataset or both the Training and Evaluation dataset ?

Also make sure you have chosen the trained/updated minor version when configuring.

1 Like

Thanks a lot. I am able to run the evaluation pipeline successfully now. The issue was with the minor version. I had to update it to the latest version.

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.