Best to remove the big plug, so as to reduce electric stress.

But, probably does not matter. You can also leave it on for a long time.

My suggestion is to power all your gear from the same place, so you can turn it off with a single switch. This also reduces the risk of ground loops and encourages common grounding which is safer.

.