A couple of light switches in my house have visible rough edges in the
wall around one or more sides of the switch cover.

What's a good way of covering those up? Someone I know suggested
caulk, but when I imagine the result it doesn't look too good.

One switch is in drywall, the other plaster.

TIA,

S