The Natural Philosopher wrote:

It's not great on the mains side capacitors and rectifiers...a bit of
inductance in series will help.

Thanks. Or presumably I could go with my original idea and put the
operational switch after the PSU, leaving that switched on for a whole
session.