If your bird feeders are close to the neighbor's property, the neighborly thing to do would be to move the feeders to a portion of your property that does not adjoin his. Unless there are local ordinances that prohibit feeding birds, you are within your rights to continue to feed the birds. Bird droppings can damage vehicle paint jobs. This may be why the neighbor becomes upset about the birds.