128
submitted 2 years ago* (last edited 2 years ago) by Averrin@lemmy.world to c/selfhosted@lemmy.world

Correct me if I'm wrong. I read ActivityPub standards and dug a little into lemmy sources to understand how federation works. And I'm a bit disappointed. Every server just has a cache and the ability to fetch something from another known server. So if you start your own instance, there is no profit for the whole network until you have a significant piece of auditory (e.g. private instances or servers with no users). Are there any "balancers" to utilize these empty instances? Should we promote (or create in the first place) a way how to passively help lemmy with such fast growth?

you are viewing a single comment's thread
view the rest of the comments
[-] halictuz@lemmy.one 6 points 2 years ago

Matrix suffers extremely of this issue. It feels like 95% or more are on matrix.org instance. And all major chat rooms are hosted there too.

I think something like a weekly cap for new registrations as an option would be good. With a hint to other instances.

It's kinda the same issue that some games have, like MMOs. People tend to make new accounts on the biggest and overloaded servers because there is the most activity even though stability could be an issue, or login queues.

But that doesn't make sense on matrix or Lemmy. Because you can still access all content no matter where you are.

[-] themoonisacheese@sh.itjust.works 3 points 2 years ago

Amen on matrix. Federating with most popular rooms on matrix.org basically brings my server to it's knees for a week trying to play catch up between federating users and their profile pictures and decrypting years of chat history. On my first go I made the mistake of trying to join #matrix:matrix.org and I had to wipe the entire server clean to get it back.

[-] Averrin@lemmy.world 2 points 2 years ago* (last edited 2 years ago)

> Because you can still access all content no matter where you are.

If you know how and want to do it. Unfortunately, it isn't the way how most people think.

And fortunately, there's still time for people's minds to change. Federation and decentralization are things that aren't really advertised or mainstream yet so people still don't have a clue what it is. However, we do know how those things work, so I guess it's kind of up to us to help people know about how said things work.

[-] Averrin@lemmy.world 1 points 2 years ago

I'd like to help with this improvement. Do you know any plans for it? Honestly, looks like that there is no "lemmy committee" and even lemmy's developers cannot organize something like this. Any ideas?

[-] zergling_man@lemmy.perthchat.org 4 points 2 years ago

Nothing good can come out of a federation committee. Invite whoever you want wherever you want and give a little bias to smaller instances, and it should balance itself out.

[-] Averrin@lemmy.world -1 points 2 years ago

I dont suggest adding a centralization =) I see two possible and actionable directions:

  1. Create tech solution to balance load through available resources
  2. Spread the word that there are better ways to spend your money and passion helping lemmy. I know, my "engineering manager" bias tends to see process problems in places where are no problems. But I dont want to see how the awesome idea is dying because of lack of basic management and foreseeing.
[-] ericjmorey@lemmy.world 3 points 2 years ago* (last edited 2 years ago)

I'm confused about what you want. Why should I care about lemmy.ml being over run because they didn't put enough resources into their instance?

[-] Averrin@lemmy.world -1 points 2 years ago

Because we are here because of content, made by users. I'm thinking about whole "lemmy-verse". If users encounter issues, they just stop using the service. You as an instance owner can choose to not participate. But if somebody already thinks rhat they helps, why not use it?

[-] Ataraxia@lemmy.world 1 points 2 years ago

I'm getting plenty of content. Not sure what the issue is.

[-] Amby@dataterm.digital 1 points 2 years ago

It’s kinda the same issue that some games have, like MMOs. People tend to make new accounts on the biggest and overloaded servers because there is the most activity even though stability could be an issue, or login queues.

It's funny you mention MMOs, because FFXIV has a system that i'm now realizing feels like federated websites.

You have your home world(server) where your character was created and is stored server side, but you can matchmake within your data center as well as visit other servers in your data center.

And then you can also temporarily transfer to different data centers (though the implementation is clunky and has a few restrictions)

[-] zergling_man@lemmy.perthchat.org 1 points 2 years ago

And all major chat rooms are hosted there too. That's not how matrix works. Rooms are fully replicated to all participating servers, no single server acts as a point of failure. It also has a resolution system for divergent states; no server has authority over any other. You can add local aliases for any room you're in on your local server without permission from room admins. (... Actually I'd have to doublecheck that. It might be one of the permissions.) You don't even need an alias, the room ID (eg. !BZVTUuEiNmRcbFeLeI:matrix.org) and a server that's currently participating in the room (ie. has that room ID) is enough to join. That's really what aliases are; mapping a name to a room ID on a particular server that is known to be participating. Room IDs include a server name as an anti-collision mechanism, it has no other significance.

It feels like 95% or more are on matrix.org instance. I think it's a bit lower than that. midov is actually pretty big. So's T-AC. (And then there's joe's room directory, which I think is bigger than morg's.) But it's well over 50%, which is disgustingly high. morg should close registrations, and purge dormant accounts/aliases.

a weekly cap for new registrations as an option Extremely good idea.

like MMOs. Funny you mention that, I had a laugh on Witch Weapon when I discovered that my server was frequently getting 10-100x more points in ranking events than other servers (and I was frequently placing top 50 without any of the busted characters). I'd simply chosen the recommended server, which I had assumed was the smallest at the time. Turns out it was just a static value so it had like 50x the population of the other two.

I still miss that game.

[-] halictuz@lemmy.one 2 points 2 years ago

About Matrix and federation/rooms etc.

I know. My point was more like, what if matrix.org goes down tomorrow? My understanding is, nobody can login into their matrix.org accounts, right? But rooms and their admins are tied to that matrix.org account? So even if rooms will still be there because of alias/replicated to other federated instances. Who is gonna maintain it and moderate it then? My guess is, bigger rooms have set admins from different instances because of that?

I mean, I am not so much into matrix, I am more of a XMPP person. I hosted a public matrix synapse. And tbh, it was a real PITA compared to xmpp hosting. But ok, XMPP has other issues, too. So there is that.

[-] taladar@sh.itjust.works 2 points 2 years ago

Trying to host my own Synapse server once for my own use and seeing how it was chewing through every bit of resources on my server while providing an unusable slow experience has pretty much ruined Matrix as a whole for me as well as contributed significantly to my dislike for Python.

[-] sam@lemmy.ca 0 points 2 years ago

How long ago was this? Its in a much better state now.

[-] taladar@sh.itjust.works 1 points 2 years ago

A few years ago (3-4 maybe). It wasn't just a bit slow either, more like the server using the full 16 gigabytes of RAM and constantly at 100% CPU and channels not even being usable to read them 20 minutes after joining.

[-] sam@lemmy.ca 1 points 2 years ago

That was my experience as well, and I completely wrote it off. After having gone back to it, and after watching the matrix 2.0 preview on youtube, things are a lot better than they were, and looking a lot better in the future.

[-] taladar@sh.itjust.works 2 points 2 years ago

Maybe I will give it another try one of these days when I have some time.

this post was submitted on 12 Jun 2023
128 points (89.5% liked)

Selfhosted

40480 readers
687 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS