In a similar situation I would either (as you suggested) fix the old
adjusted board with screws or use plasterboard