You probably need to keep the power on while replacing the battery if you want to preserve User Programs or Settings. If you don't need this, you can do it with the power off and disconnected.