Data Scraping image color identification

[renjutom]

Hi,

I’m trying to identify image(flag) color in a web page. I’m using data scraping method to read the data from web page. Each row of data contains a flag with red or green color. I have used element exist activity in for each loop to identify image color in each row. But it is taking more time to pass element exist activity if its having green color flag(if I’m checking for red color flag). How can I reduce time for it? Can anyone suggest any solution for this please?

Kind Regards,
Renju

[ppr (Peter Preuss)]

@renjutom
can you share some screenshot for this.

In a lot of cases it was possible to add information on css classes, img sources … to the scraping definition, then this info was retrieved as well

[renjutom]

Hi @ppr,

Please find attached screenshot

[ppr (Peter Preuss)]

@renjutom
on the first look it looks fine
now in the next analysis we have inspect if the flag is data scrapping ready via image, classes or others

here a screenshot from UiExplorer along with selectors and expanded Property explorer helps. Also a right click on a flag and clicking inspect element (eg. FireFox) wil give us more details to the html structure

In general the data scrapping will be configured as mentioned here

Scrape whole table with data scrapping issue

@Jayesh_678 as it is a private site I have to give some suggestions on a public site refer to DataTables example - Form inputs a similar case [grafik] now instead of telleing data scraper scrapping the entire table (as you had done) indicate column by column. for the textfield later you have to change the attribute from text to value: [grafik] [grafik] give a try and let us know the feedback

[renjutom]

Hi @ppr,

I’m extracting entire table instead of extracting each column. I tried to extract individual columns. But it is missing some rows while extracting the values. Thats the reason I tried to use element exist activity in for each loop after extracting the remaining values.

Kind Regards,
Renju

[ppr (Peter Preuss)]

@renjutom
if something fails on the first try so will get it within the next try. can you share some details to the webpage. which system it is about or sharing a link

[renjutom]

Hi @ppr,

I’m trying to automate remedyforce(incident management tool).

Kind Regards,
Renju

[ppr (Peter Preuss)]

@renjutom

a small summary of our steps:

We had the strategy:

• Doing it with datscrapping in one go
• retrieving the flag color info from its picture src attribute

Steps done:

• quickly doing in the datscrapping configurator the config on two columns
  • this generates for us the row selector and the column selectors
• post editing manually the metadataExtract XML
  • removing unneeded class informations to get all rows and columns
  • for the flag we changed the retrival attribute from text to src

et Voila it was working