Nah, it's definately chatter since it also does it with the water off.

I'll replace the entire unit, costs less than the repair parts. Since
it's controlling the water supply for my heat pump I don't want to risk
it failing when it gets to -30C outside.