Screenscraping JAVA Apps / GUI Failure "HRESULT E_FAIL has been returned from a call to COM component"

Help
1

Hi there,

we want to use UiPath for Screen Scraping. Our detected Java App using JRE 1.4 or older. Is there a way to use the UIP Scraping Tool or no way ?

Somebody knows a solution ?

Greetings from Germany, Frankfurt

2

Hope this will give some info on the post.
https://github.com/cbladd/UiPath/wiki/Java-screen-scraping#Supporting_old_JRE_15

1 Like
3

Hi, i edit the post, cause we now got new Problems with the same App.

First i detected this thread UiPath and Java - #11 by Thiago. The problem is there also explanied, but i hope get some more Infos, of course other UiPath developer got same issues.

We are using a java app that is now about 10 years old, it’s updated to JRE8.

Two Errors are available:
"HRESULT E_FAIL has been returned from a call to COM component”
“Step was not recorderd successfully”

hresult

Error part of the logfile:

12:15:06.0260 Error {“message”:“Select item ‘tree’ : Error HRESULT E_FAIL has been returned from a call to a COM component.”,“level”:“Error”,“timeStamp”:“2017-08-09T12:15:06.0250488+02:00”,“windowsIdentity”:“HOST\USRXXXXX”,“agentSessionId”:“00000000-0000-0000-0000-000000000000”,“processName”:“bsp_test”,“fileName”:“Main”,“jobId”:“00eb3076-3cd0-44cc-b9c0-590f6082e2eb”}
12:15:06.0260 Info {“message”:“bsp_test execution ended”,“level”:“Information”,“timeStamp”:“2017-08-09T12:15:06.0330488+02:00”,“windowsIdentity”:“HOST\USRXXXXX”,“agentSessionId”:“00000000-0000-0000-0000-000000000000”,“processName”:“bsp_test”,“fileName”:“Main”,“jobId”:“00eb3076-3cd0-44cc-b9c0-590f6082e2eb”,“totalExecutionTimeInSeconds”:0}
12:27:11.2270 Info {“message”:“bsp_test execution started”,“level”:“Information”,“timeStamp”:“2017-08-09T12:27:11.2050488+02:00”,“windowsIdentity”:“HOST\USRXXXXX”,“agentSessionId”:“00000000-0000-0000-0000-000000000000”,“processName”:“bsp_test”,“fileName”:“Main”,“jobId”:“3f88b655-a6d8-442c-a029-c580e2875ba6”}
12:27:11.6700 Error {“message”:“Select item ‘tree’ : Error HRESULT E_FAIL has been returned from a call to a COM component.”,“level”:“Error”,“timeStamp”:“2017-08-09T12:27:11.6700488+02:00”,“windowsIdentity”:“HOST\USRXXXXX”,“agentSessionId”:“00000000-0000-0000-0000-000000000000”,“processName”:“bsp_test”,“fileName”:“Main”,“jobId”:“3f88b655-a6d8-442c-a029-c580e2875ba6”}
12:27:11.6800 Info {“message”:“bsp_test execution ended”,“level”:“Information”,“timeStamp”:“2017-08-09T12:27:11.6790488+02:00”,“windowsIdentity”:“HOST\USRXXXXX”,“agentSessionId”:“00000000-0000-0000-0000-000000000000”,“processName”:“bsp_test”,“fileName”:“Main”,“jobId”:“3f88b655-a6d8-442c-a029-c580e2875ba6”,“totalExecutionTimeInSeconds”:0}
12:30:37.2100 Info {“message”:“bsp_test execution started”,“level”:“Information”,“timeStamp”:“2017-08-09T12:30:37.1900488+02:00”,“windowsIdentity”:“HOST\USRXXXXX”,“agentSessionId”:“00000000-0000-0000-0000-000000000000”,“processName”:“bsp_test”,“fileName”:“Main”,“jobId”:“ed56fc26-601d-4698-a670-39b98d0632ed”}
12:30:37.6050 Error {“message”:“Select item ‘tree’ : Error HRESULT E_FAIL has been returned from a call to a COM component.”,“level”:“Error”,“timeStamp”:“2017-08-09T12:30:37.6040488+02:00”,“windowsIdentity”:“HOST\USRXXXXX”,“agentSessionId”:“00000000-0000-0000-0000-000000000000”,“processName”:“bsp_test”,“fileName”:“Main”,“jobId”:“ed56fc26-601d-4698-a670-39b98d0632ed”}
12:30:37.6050 Info {“message”:“bsp_test execution ended”,“level”:“Information”,“timeStamp”:“2017-08-09T12:30:37.6130488+02:00”,“windowsIdentity”:“HOST\USRXXXXX”,“agentSessionId”:“00000000-0000-0000-0000-000000000000”,“processName”:“bsp_test”,“fileName”:“Main”,“jobId”:“ed56fc26-601d-4698-a670-39b98d0632ed”,“totalExecutionTimeInSeconds”:0}

The target App using JRE 1.8.0_73, UiPath Studio is using System JRE/JDK 1.8.0_131. The Java App got a own JRE.

Process Explorer is showing these DLLs:
C:\java_app\jre1.8.0_73\bin\JavaAccessBridge-64.dll
C:\java_app\jre1.8.0_73\bin\JAWTAccessBridge-64.dll
The UiPathJavaBridgeV8.dll seems not to be started !

In the Java App and System JRE:
accessibility.properties → “assistive_technologies=UiPathV8.UiPathBridge”
…\lib\ext → “UiPathV8.jar” and “access-bridge-64.jar” are available

The Java Bridge seems to be installed, but it wont start ! UIExplorer cant access the GUI-Tree completly, some elements are detected, by other one occures the failures. It doesnt show the selectors but if we Highlight the failed target element it is absolut correctly highlithed in the App.

Any ideas ?

4

Did you fix this, I have an almost identical issue?

5

Hi @deka.student

If possible, I recommend you to use a mixed strategy of image recognition, hot keys, and UiElements mapping. It seems that some Java applications aren’t friendly enough to expose its visual elements or components to RPA tools, making it very hard to use the recorder.

But please, if you find any solution to your problem, share with us here in the forum.

Regards

1 Like