In most cases, apply household bleach, diluted 50/50 with water. Brush it
in with a broom, and just let it dry out normally. I have cleaned concrete
like this for years.

Yes, the power washers are also great. In fact, if you have an extremely
mildewed sidewalk, putting bleach on about 30 minutes before washing will do
an even better job.

--James--