You should include the Terminate Workflow activity to ensure the workflow stops immediately and cleanly after an error preventing any further execution. It gives you control over the termination process, ensuring no unwanted actions occur after an error is handled.