I just ordered two 6mm carbide cutters. Maybe I'll try grinding the flutes on one of them. I did notice that my 3mm carbide mill cuts brass with way less effort than the HSS Co. Maybe the combination of carbide and a larger radius will be enough. Two finishing passes too? I don't need a mirror finish, but it's gotta be better than it is now!
Thanks everyone.