Stay with the 4 ". You should be able to get enough suction so that
while the saw is running most of the airborne dust will get collected.
You can also consider building some internal collector that covers the
under side of the blade with an outlet facing the dust collection.