Always a good practice to wash your hands thoroughly. I'm not aware of the squirrel mange mite colonizing non-squirrel hosts (such as people, dogs, or cats), but a few bites could occur if you had close contact (i.e., handling the squirrels as opposed to just feeding them).