Is it worth my time to apply poly to the sides, or would just plain paste
wax be fine?

Not sure I fully understand but a common rule of film finishes is to
cover all surfaces equally so moisture absorbtion and experation are
equal at all sides to avoid cupping.

So if the insides of the drawers have a poly finish, then the outside
should also.