I just noticed that in one of the potted plants, there are some bugs in
the dirt.

The bugs are tiny, white...looks almost like lice.

Any ideas what they could be?

Thanks

No but here's a website worth reading.

http://www.whatsthatbug.com/springtails.html

scroll down about three screens to get to the bit about white bugs.