"BTW this never happens when you disconnect the battery. Only if you
connect it while you're using it. Lenny "

AHA ! There are regulators all over the place and most depend on electrolytic capacitors.

See where I am going with this ?