Hi team,
We’d like to share some feedback and feature requests that we believe would improve both Communications Mining and Document Understanding (DU). These changes would have a positive impact on model performance, delivery workflows, and client adoption.
- Reasoning and Explainability Across Products
One challenge across both DU and Communications Mining is the lack of clear reasoning or explainability behind model predictions. This makes it difficult to:
- Identify areas of underperformance
- Explain model behaviour to stakeholders
- Build trust and drive adoption with clients
Request: Please consider introducing features that explain why a particular classification or extraction was made. This would help delivery teams debug and refine models more effectively.
- Email Thread Quality and Content Filtering
In Communications Mining, we’ve noticed that email threads often vary in quality. The first email usually contains the most context, while replies are often short acknowledgements like “Thanks” or “Noted”, which add little value and can reduce training quality.
Request: Implement a way to filter out low-value messages and prioritise higher-context communications during training and inference.
- Visibility into Model Confusion and Misclassifications
Currently, the product does not offer visibility into model confusion or misclassification patterns. This makes it hard to:
- Understand where labels are overlapping
- Identify areas for targeted retraining
- Improve models in a structured way
Request: It would be very helpful to have:
- A confusion matrix showing which labels are commonly confused
- A breakdown of misclassifications at the individual communication or document level
- Diagnostic Views and Future Enhancements
In other tools, we’ve found value in having detailed diagnostic insights – such as confusion views and misclassified example tracking. These have helped us fine-tune models and communicate more effectively with clients.
Question: Are there plans to include this level of diagnostic detail in future updates to Communications Mining or DU?