Hi,
I have IXP configured with a Generative Extraction.
Action Center is used for the users to review / amend extracted values.
The IXP documentation talks about “Feedback” but I cannot find how that is actually implemented.
Does every document that passes through Action Center automatically impact the IXP Measure statistics?
If not, how does IXP get its feedback?
Any suggestions?
@DavidMartin Action Center reviews do not impact the IXP Measure Statistics or the model’s performance at all. If you want to improve the model performance, you need to adjust/edit the field level prompts manually. There is no automatic configuration for this.
Hi @DavidMartin
In IXP with Generative Extraction, documents reviewed in Action Center do not automatically affect the model. Feedback is only recorded if the corrected values are explicitly submitted back to IXP using a feedback activity. Measure statistics are updated after this feedback is processed. Make sure your workflow collects reviewed values and submits them to IXP for improvements.
Thanks for the response.
I have UiPath.IntelligentOCR.Activities 6.27.2 installed.
I cannot see any “Feedback” activity under Document Understanding or Action - is there another package that needs to be installed?
Collecting reviews - Is that a case of comparing the data sent to Action Center and that data available afterwards? I have not seen any “Reviews” data structure nor any Activity to “upload” any such data to IXP. Please could you elaborate?
I agree that was my understanding from the initial IXP configuration.
However, some of the IXP documentation talks about model drift, fine tuning, etc. - these references suggest an updating of the model.
Please see IXP - Frequently asked questions - Questions about Monitoring.
It would seem a very backward step if IXP does not provide a mechanism for automating the update with a feedback loop.
Hopefully the facility exists even if the documentation does not fully reflect the capability.
currently for IXP documents there is no feedback loop as such
changing the prompt is the only way
its in pipeline but no Private preview is announced yet
cheers
Thanks for the response.
Good to hear that the issue is at least being recognised.
As AI is normally associated with constant learning and improvement. It will make the usage of IXP a more difficult “Sell” to business users.
So as of now only the model is being retrained broadly by UiPath team so it would be incremental but it would not use our data or creating local fine tuning for our specific document is not present yet…hope to get it soon
Cheers
There is no separate “Feedback” activity and no extra package to install. In IXP with Generative Extraction, feedback is captured automatically when users correct data in Action Center and submit the task. The corrected ExtractionResults returned to the workflow are what IXP uses to update Measure statistics and improve the model. You don’t need to manually compare values or upload reviews.
Thanks for the clarification.
If it’s helpful please mark as solution.
Thanks
@DavidMartin To clarify how feedback works with IXP and Generative Extraction: documents reviewed in Action Center do not automatically feed back into IXP. You need to explicitly include a “Present Validation Station” or the feedback submission step in your workflow that sends the corrected/validated values back to IXP. The Measure statistics are updated only when feedback is explicitly submitted through the workflow. Make sure your workflow includes the feedback activity after the Action Center validation step so that the corrected values are sent back to IXP for continuous improvement.
Thanks for response.
I am slightly confused as I cannot locate a “Feedback” activity in the UiPath packages that I have installed.
Please see earlier messages.
When “Create Validation Task” activity is used, it creates a task in Action Center.
The access to Action Center is performed independently from Robot activity.
In such a scenario the “Present Validation Station” activity is not used.
Another response has suggested that Action Center automatically updates the IXP statistics. Are you thinking of a different scenario?
Hi Monali_Vekariya,
You have kindly made two responses in this thread but they seem to contradict each other.
Perhaps there is a difference that I am not understanding.
It would not be appropriate to mark a single message as a “Solution” in such circumstances.
Hi Karen,
Thanks for the response. Please could you provide the URL to the document that contains that FAQ?
I have looked here IXP - Frequently asked questions but cannot see that question and answer.
Here is the link- https://docs.uipath.com/ixp/automation-cloud/latest/user-guide/faq
Its under Runtime section.
Hi @DavidMartin
Action Center response won’t impact the model score. You have to add more files, annotate them and validate predictions and you can fine tune your prompts.
Cheers
Hi Karen,
Thanks. The FAQ section of the User Guide rather than the FAQ section of the Overview.
This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.
