How can data be extracted from engineering diagrams containing labels, while also classifying the diagrams - DU

I have this diagrams

attachments.zip (739.0 KB)

i want to get data from lables of the diagrams while also identifying which diagram it belongs too

the probablity of extracting data with just du components looks a little bit off due to variation of diagrams and the diagrams are not always same so classifying and make a taxanomy to cliassify is also a bit doubtfull

so for that reasons im using this Infrrd - Engineering Drawing Data Extractor - RPA Component | UiPath Marketplace

acitivy which is specialized in data extraction in engeniering diagrams

well we have contacted the team for api access we are still waiting for the response so i thought may be it will be a good option to have a second option ready

so on that point im asking if we use only DU how will u extract data from this , what u think

or should I go with OpenCV for this as it is also been tried and data is being extracted but there is bunch of garbage data which is not necessary and extracting required data from that 900 lines of data for a single diagram is looking like a tedious task

if possible i will provide that Open CV output data in some moment

Edit:- here is the OpenCV Zip File containg all the data from image we worked on to the code and the extracted data

OpenCV.zip (65.8 KB)