If there is no such

restrictive covenant in the deed, I guess your neighbor cannot do anything to you.

try to do a search of the chain of title of your house, see if there is any covenant running with the land relating to the color of the house filed with the county clerk. If none, I don't think you have to worry about it.