To alleviate your concerns - unlike fission, in a fusion reactor the only radiation comes from the active fusion process, and chamber lining that's been bombarded by radiation. The worst case is a brief spike of neutron and gamma radiation from where the chamber breaches before the plasma collapses, a small amount of short-lived radioisotopes from the chamber debris, and a bit of tritium.

The radiation from the debris would be at background levels in a year or two, since there's no transuranic decay chains (once decay event, and it's stable again). The tritium would disperse to background levels in minutes, and the radiation burst would only be a hazard in the immediate vicinity.

Not free from issues at all, but compared to a fission reactor the worst-case scenario isn't bad at all.