I am looking for a push button switch that turns on when it is pressed down,
stays on while it stays depressed and turns off when it is released.

I am running into "momentary pushbutton" switches such as this candidate:

http://www.allelectronics.com/make-a...-switch/1.html

Do switches like this meet my qualifications?