Same here, my afternoon anxiety from daily coffee consumption (1-2 cups typically) got really bad on some days. I was heavily addicted to coffee and nicotine for years but I managed to quit both of those after realizing that they weren't doing me any favors. I continued to have cravings until I got on ADHD medication then they practically disappeared overnight and never came back.

I think more people should give green or black tea a try, I found them to provide similar effects to coffee but with fewer side effects.