I am trying to create a bot that navigates to various utility company websites and downloads all relevant tariff pdf files. See two links below as an example:
As you can see, each website has a different number of links that are formatted slightly different. I’ve been able to run an instance of one download from one website, but I can’t figure out how to have the bot identify all the links on a given webpage and then run it through a loop of downloading and saving the files.
Any help or suggestions on tools to use would be greatly appreciated!