Sprydle writes:

I can't find collets in these sizes - or should I be trying to get
metric collets?

Can you broach those square holes into machinable ("emergency") collets?