When your testosterone levels decrease, your desire for sex also decreases. Decreasing testosterone is a normal part of aging. However, a drastic drop in testosterone can lead to decreased libido. Talk to your doctor if you think this might be an issue for you. You may be able to take supplements or gels to increase your testosterone levels.