A heat gun should soften the old stuff but I wonder what I could use to
remove it?

I have a number of leaks at joints that I have tried to fix but there is
so much old sealant already there that applying more just doesn't work.

Any suggestions?

John