It's not a check valve, it's the high temp/press relief valve. Did you
try opening it and letting a gallon or so of water out? Sometimes they
don't reseat correctly, there may some debris lodged in it, etc. If
that doesn't work, it sounds like it's bad and needs to be replaced,
which fortunately, is easy.