I was wrong: the battery can come out the top. My
friend's husband gripped the battery with a hemostat
and used a penknife to push back the holding clip.
With a little jiggling the battery came out. It
was 0.7v, so it was bad.

Thanks for your help.