Greetings Tim,
Well, without pictures and without an on-site evaluation, it is often extremely difficult, if not impossible, to give expert advice regarding insect and disease problems on trees.
Sorry I can't be of more assistance, but I liken many (not all) insect and disease questions to a patient calling the doctor's office and asking the medical doctor whether or not the patient should amputate his own foot because it doesn't appear to look healthy :-) No doctor would ever give that recommendation over the phone or via email :-)
Therefore, your only recourse is to secure the services of a local certified arborist or possibly contact a Master Gardener from your county Extension office.