But it never annoyed me - as I said there's more noise from outside

I think it's mainly at night, when all is quiet. You have to be
conscious of the
neighbours if they've gone to bed etc. You dont feel as "free" as in a
detached
house. Unless you couldn't care less, in which case they may do the
same back !
Simon.