subject–
Incorrect Confidence Score (1.0) in Generative Classifier for Invalid Prompts
description:-
When using the Generative Classifier activity in UiPath’s Document Understanding framework, the confidence score is returned as 1.0, even when the prompt provided is incorrect or irrelevant to the document. This behavior misrepresents the actual confidence level of the classifier, leading to unreliable results and potentially misclassified documents.
Steps to Reproduce:
- Set up a Document Understanding workflow using the Generative Classifier activity.
- Provide an incorrect or irrelevant prompt for a document classification.
- Observe the confidence score in the output.
Actual Result:
The classifier returns a confidence score of 1.0, regardless of the accuracy or relevance of the prompt.
Expected Result:
The classifier should return a confidence score reflective of the prompt’s accuracy and relevance, with lower confidence for incorrect or irrelevant prompts.
Impact:
This issue undermines the reliability of the Generative Classifier, potentially leading to misclassification and errors in downstream processes relying on accurate document classification.
Environment Details: