Am I missing something? Ideally I'd have a foot switch to release the
vacuum pressure, but as far as I can tell it should work. Thoughts?

This is exactly what we had set up once upon a time for
routing with a hand held router. Your thinking is flawless.

UA100