Yeah, I could imagine the word "fewer" disappearing from the english language over the next century or so.
But as you already said, language is always changing, there's no point in trying to hold on to the "right" way to say anything. As long as you can understand what the other person is saying, the language is fulfilling its purpose.
Plus, people don't usually like having their language corrected. Doing so only leads to people disliking you, and for what? It's fighting windmills.