You can remove dead branches at any time. They are non productive and may harbor insects or disease. Depending on condition, They may be cut to the soil line for rejuvenation after they have gone dormant. You can also thin the plant out by removing several of the older stems, a few a season by cutting them at the base of the plant.