In general, capacitors are relatively inexpensive such that if one is in any doubt at all, replace them. All and at the same time, an ESR meter is a helpful - but NOT absolute - screening tool.

Yes, those caps appear to be bulging Further, the shrink covering on them has pulled down from the top. A typical cap has that covering turning onto the top by some amount greater than what you show.

https://media.rs-online.com/t_large/F7152707-01.jpg

My guess is that they have gotten very hot, one or more times. Which would explain both the shrinkage of the covering and the bulge.

Peter Wieck
Melrose Park, PA