I’m sure someone must have suggested this but could we get Orchestrator to automatically handle re-boots? This would work as follows:
- Process not responding - attempt to automatically kill after X minutes of no logs.
- Reboot the VM (required to ensure all apps are closed down).
- Automatically restart the process that was originally running
- Pick up the next queue item
This would cover situations where the process is just hanging OR the machine itself is not responding. Maybe a max number of 3 reboots a day should be permitted before someone should investigate the machine manually?