If its only 6" its not much but you pay taxes and some areas taxes are
alot, a few years wont establish adverse possession , but you are not
even sure yet on lines, get his survey look at yours, offer to sell him
the 6"