Give it time. What's important is that lemmy has hit critical mass and has many great clients that are far better than the Reddit ones. It will grow and not shrink. It's the long game, doesn't matter that it's not big enough to support sports communities yet, it will get there and it's still very early days on this platform.

Lemmy is already significantly more active than when I first joined, and that was only 2 months ago.