Orv wrote:

I had a similar problem with an old, light fixture hole that was covered up
with a shutter. Yellow jackets (or variant) had made a nice home in there. I
used the expanding foam and it worked like a charm!

Caution: Use rubber gloves (kitchen type) when using this stuff..I managed
to get some on my hands the first time I used it and nothing would get it
off. I tried everything from alcohol to gasoline!
-Orv

Acetone or nail polish remover will take off the foam, it will even get
it out of your hair. Also cleans up Liquid Nails.

For the bugs I usually use Brake Kleen (shoots as far as wasp spray) or
carb cleaner (drops them from the sky). Brake Kleen works best for me,
any auto store or K/Wal mart will have it. Always have a can in my
pouch when on the ladder.

The foam will probably work but will look like crap when you are done.
Spray something in the hole to kill or stun them, stuff in some
newspaper, mortar over paper.