Now if you had only taken the advice to use lime mortar instead of
cement...
And when you get a bit better at bricklaying you won't get any mortar
on the brick faces. But for now you'll have to get some brick cleaner.
Ask at your local builders' merchant. It comes in various forms but is
based on hydrchloric acid. It disolves cement (and a few other things
so take care).