Four people in the house - one big whirlpool tub, one regular tub/shower,
and one freestanding shower stall.

The whirlpool tub will easily drain the HWH. If you need to fill this tub
regularly I'd suggest getting a larger HWH, or plumbing an on demand heater
for the tub.