Switch to decaf. The high levels of caffeine that are present in coffee can worsen anxiety symptoms in both the short and long run. Caffeine is a stimulant which makes your body and nervous system wired and alert, which increases your risk of worsening or developing depression and anxiety throughout the day.