Don't we kinda already have them?

that's why they do it: karma farming. And that's why I'm totally opposed to have Lemmy display user's karma anywhere

I don't think that's the problem. I think it's mostly because it still has way less people (easier to mod), and also it doesn't show user karma, so there's no incentive to karma farm.