Hi Wendi:
This is a pretty popular question and my answer is almost always the same: Move the planting location if you can; however, if you can't move the planting location, then make sure you excavate the previous stump completely including any wood-debris or chips left in the hole.
You don't want to plant your new ornamental tree in a hole with residual wood debris, sawdust, or wood chips. The ultimate goal is to give this new tree a rooting-medium that contains quality mineral soil.
Best of luck!