your idea of screwing some plywood is a good way to go. you could also
use a chunk of 2x material. if you use 3" drywall screws, you can
screw from the top and draw the backing tight to the bottom the
existing plywood. better check the insulation in the rim joist area
and make sure everything is dry and in good shape.