blueman wrote:

My concern is that I need to keep the drilling & chiselling "plumb" or
otherwise I will "poke" through the door.

Drill through a hardwood block and use it as a guide when drilling into
the door. Handheld doweling jigs also make great drill guides if you
don't have a drill press or other accurate way to make the guide block.