You might want to surrepeticiously (sp?) video record his actions when yo confront him the next time about the fence. Maybe have someone staznding nearby pretending to talk on their cellphone while actually doing the video recording. His calling you sweetheart might make for an interesting story on your local tv news program. Wouldn't hurt to ask the local tv station human interest reporter if they would like to do an expose'.