A simple CAT 40 Vise might suffice?

There are several brands and types for holding CAT taper tooling when off the machine.

They are used to tighten tools in CAT 40 holders. I have a cast iron one that I mounted on a bench near the mill.

This was my first trial. I'm getting +/- .003 this way. I need more
accuracy.

Karl