You should always keep the beer in the fridge. It's better cold and you never know when you might want another cold one.
You have a valid point about stuffing for the sake of stuffing, but if
you have a case of juice or beer, better to put it in to fill the space
rather than put a bottle at a time. You'll be using the same amount of
energy to get it down to temperature anyway, but get less air loss each
time the door is opened.