I have trained my custom ML Skill for Invoices by retraining Out of Boxes Packages, Document Understanding for Invoices. So I have deployed my ML Skill and currently in monitoring how well the performance of the ML Skill. Now, I have implemented the Validation Action to Action Centre. After validating the documents in Action Centre,
how can I use the validated data to retrain my ML Skill?
The end to end process (after validation of document until the deployed new ML Skill)
Yes, thank you for this. This is what I canât connect between the two dots. Since the validation action for the document is being sent to Action Centre. So human validated it on Action Centre. So, how can I get the output of validated result from Action Centre, to be the input, Human Validated Data in Train Extraction Scope
Its not totally connected up, which is actually a good thing.
I think the name of the activity can be misleading as it is called âTrain Extractorsâ.
What it is actually doing is adding data to your dataset, you should be familiar with this if you say you have already retrained the skill, you will have used a dataset to train it on.
The dataset will be populated with data from each human validated action.
At a later date, as you choose, you can train the ML skill again on this dataset and have it continue its learning based on the human validated data.
Edit:
I just saw the below post and he accurately points out that you shouldnât pass extracted data immediately back to the dataset as it is not human validated. You need to use âPresent Validation Stationâ to get a human to validate the data and use the result of that in the Train Extractors scope.
If I understand your question correctly, you are concerned that youâre using the same extractedResults for training, which is no good because it doesnât contain the values that were updated/corrected during the manual validation in Action Centre.
And thatâs accurate, it wonât help your training set at all. But youâre missing an important step, according to the image youâve posted here.
The Create Document Validation Action is a persistence-supported activity, which sends an action to the Action Centre, to be completed by a human.
This needs to be followed by a Wait for Document Validation Action and Resume activity. This activity automatically makes the job wait in a âSuspendedâ state and resumes as soon as an action is completed in Action Centre.
As you can see from the image above, the latter activity returns a validatedExtractionResults object which contains the user-corrected data.
This is the object of type ExtractionResults that you want to use in your Train Extractors Scope.
To use the code above, create a project with this template: