I'd say you can leave a vertical surface exposed to sun and rain for a few
months. Eventually you need to fill and seal, having excavated any crumbly
stuff.