glue the part to a pc of plywood and clamp it to the drill press table
and go slow and work your way down using the extension on your bit, blow
it out to keep it clean and cool and it should work out, I have done
this in the past, good luck