Probably a wasp of some kind. At this time of year any occupants will be
dead. Wasps do not re-use their nests but start a new one in the spring.

Peter Crosland