Hey! Im attempting to use the http client activity for quickly retrieving html content for links. I am currently trying to reduce the amount of 403 http statuses and also Ive noticed in the bots working directory that some attachments are getting download for some reason. I tried adding these two parameters:
But I may be doing something wrong here, because instead of getting less error and no attachments, I am still seeing attachments after a test run in the working directory and I am now seeing a bunch of 400 http statuses.
Here is the string im using for the user agent: “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.6723.92 Safari/537.36”
Thanks in advance for any insight.