Sort of. . . I think. But it would be a kluge and only worth it for
one or two holes...not a whole buncha them.

First, find a drill bit that's the right size but with a ¼ - inch
shank. Chuck it in your router (with the power cord unplugged.)

Keeping the power cord unplugged, turn the bit, by hand, using the
router to obtain the absolute vertical alignment you need.

Another ploy would be to find a friend or a shop with a drill press.
Have them drill a clean hole through a block of hardwood (oak or hard
maple) and then use it as a drill guide.

Others may have better ideas.

Pixmaker in FLL
==========================
It's not the heat, it's the humidity!
==========================
(...Think the humidity's bad?
You should watch us vote!)