Stimulant meds are correlated with a reverted risk in dimentia compared to unmedicated ADHD pop, which itself has 3x the risk of genpop.
I was a little hesitant to take meds for a while thinking I could just overcome it with effort and whatnot, but there are some things like that you can't will yourself through.
They also have negligible risk as a whole. Yeah, you'll probably have a heart attack if you start them with elevated risk, but you probably would anyway in that situation, too. On another hand if they help you work out regularly, you'll probably lower your risk overall.
It's your right to decide what's best for you. Your treatment, whether it includes meds or not, should help you live the life YOU want.