Tape some squeezably soft Charmin toilet tissue over the hole in the
peizo buzzer. lol

Actually, just find the peizo buzzer. If it is not one that has the
adjustable top on it to close off the hole, get some sticky back loose
rubber foam and stick it over the hole. DO NOT completely block off the
outlet to the buzzer as it will over time damage the peizo element.