Robots.txt

Does UIPath honor robots.txt files by default or does that need to be programmed into each script