4" is plenty, just be ready and Slide the heel of your hand along the
fence and anticipate where your weight is bearing, should anything go
wrong.

Crosscutting with a miter gauge and a rip fence is about the most
dangerous thing you can do.