That's bad, but at the same time, there's public data aggregators that sell your info, and you could go out right now and find your name, phone numbers you've had, former and current addresses, people you've lived with, former and current jobs, etc. It's kind of terrifying what's "public information," and yet they continue to be allowed to operate with virtual impunity.
I'm not saying we should just accept things, but cutting off this "training data" would be a great start, and if companies can't, then they should be forced to cease operations (including AI chatbots).