My suspicion is that oil isn't a good enough insulator, especially in
practice with a pinch of dirt and water in it.

This could be true. I need to find figures for the resistivity of used transformer oil. I can make sure it's visually clean, but clean room standards won't apply.