Hello, we have a long list of companies for acquisition screening every month. part of the research includes going to each website and read their news releases (most recent ones). is there a way to check if the website (random, unique websites) has such a section, and if so, navigate to that section and extract the contents from each news release?
Hi, you would have to find a common denominator that all websites have which indicates it has a news section.
I would recommend using a “find text” and have it search the entire website, and search for words such as “news” “press”, or any other keyword that points to it being a news section.
Make sure to add the words as OR, otherwise the search results will be strict and it wont return your desired results.
I ended up scraping all links from the main page then using keyword to find the news link.
This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.