The right way to do this, particularly if tolerances are high, is to
use a drill bit ground specifically for acrylic and other plastics.
It has a much steeper tip angle, usually 90 degrees, zero rake, and is
kept razor sharp. You can get them at a plastics supplier for a few
bucks, or make them yourself if you can grind drill bits.