When you buy the house, you should receive your property survey which would show the fence position(in your property or not). If you can’t find, then go to town office, they should have copy.