The lip is on the outer face, i.e at bearing end and due to only being
8" hubs ... would not be able to get in with a grinder.


It can't be a very wide lip, so why not remove some of the brake shoe? Even if you make the shoe 6mm narrower the braking won't be noticeably affected.