Most people don't have that experience. I'm AuDHD and I really like weed, personally. But I found it demotivated me, so I decided to quit it, and I cold turkey put it down about a month ago. When I start working again, I'll probably start smoking again because it helps with the day-to-day stressors that cause me an undue amount of, well, chronic anxiety.
You know what really messed me up? Vyvanse. I got some really intense anxiety, even after being on it for a few months. Decided it wasn't for me.
Swear to god managers do that shit on purpose.