Screw the drywall to studs on each side of the bricks and use
contstruction adhesive on the brick to drywall areas...it will be fine.