Many things can accelerate the decline of hormone levels in both sexes. Stress levels, diet, nutrition and lifestyles all contribute to hormone imbalance. Currently, one of the main culprits is stress. This is true because the stress hormone, cortisol, is built with the same building blocks as our sex hormones, DHEA, testosterone and estrogen. The more stress we have, the more cortisol we demand and the fewer building blocks we have to make our sex hormones.