Screen scraping using MOUSE actions

Help
1

Recently, I had to scrape text from screen and unfortunately the application was not recognized by UiPath.I used another tool which had three functions - Mouse down,Move,Mouse Up . Using the nearest images to the text, I was able to get the desired text.

For example purpose-
I am trying to highlight “Principal” in the string as displayed -
image
Logic used-
Click after image “Monthly”
Mouse+down
Move
Click before “&Interest”
Mouse+up

This selected the required text.
I tried mouse+down, hover, mouse+up in UiPath did not work.

This is very helpful, when scraping is required but the application is not recognized. User can use image+mouse actions to capture text.

2

what exactly didn’t work UIP’s mouse+down, hover, mouse+up?

3

The text was not selected . Mouse+down was after “Monthly”,then it hovered on"&Interest" and then the execution was complete without selecting the text.

4

this is one way to do, might help others.

http://www.bbc.co.uk/accessibility/guides/keyboard_mouse/computer/win/win7/#setup1

5

Hmm, not sure what didn’t work for you, it worked for me with just 2 clicks (one UP and one DOWN).

image
image929×889 51 KB

Try it and let me know if if doesn’t work for you.

6

Still not able to do. Could you please share the xaml.
Thanks

7

Is your file Image or Editable Text?

If its editable text, @Cosin example works. I don’t think it works for an Image.

For the second click you need to change the KeyModifiers to Shift.

image

8

Thanks , it worked !

9

and the xaml, in case somebody needs it. I didn’t use the shift key, but it should work too.

selectText.zip (2.5 KB)

10

I have a similar problem and I have to make it work on an image. Is this possible?