I had a query and the scenario is mentioned below:
I have a list of url s of websites and when the webiste opens , i should scrape details from the site.(like an email id). The position of this email keeps changing depending on the website. Is there any method of automating this search?
The problem lies there.
The websites differ ,
Some of them have drop downs for selecting contact info, others have contact info at the bottom, some have a hyperlink and buttons are all in various positions and types
Can you suggest any other method?
May I know, the website URL list you get, does it change time to time? or is it the same set of URL’s?
I mean, in other words, at once given instance, lets say you get 10 URLS of different sites. and on another instance, do you get the same set of urls? or a completely different set or urls?