236
submitted 1 year ago* (last edited 1 year ago) by DaughterOfMars@beehaw.org to c/technology@beehaw.org

In my opinion, there are two big things holding Lemmy back right now:

  1. Lemmy needs DIDs.

    No, not dissociative identity disorder, Decentralized Identities.

    The problem is that signing up on one instance locks you to that instance. If the instance goes down, so does all of your data, history, settings, etc. Sure, you can create multiple accounts, but then it's up to you to create secure, unique passwords for each and manage syncing between them. Nobody will do this for more than two instances.

    Without this, people will be less willing to sign up for instances that they perceive "might not make it", and flock for the biggest ones, thus removing the benefits of federation.

    This is especially bad for moderators. Currently, external communities that exist locally on defederated instances cannot be moderated by the home-instance accounts. This isn't a problem of moderation tooling, but it can be (mostly*) solved by having a single identity that can be used on any instance.

    *Banning the account could create the same issue.

  2. Communities need to federate too.

    Just as instances can share their posts in one page, communities should be able to federate with other, similar communities. This would help to solve the problem of fragmentation and better unify the instances.

Obviously there are plenty of bugs and QoL features that could dramatically improve the usage of Lemmy, but these two things are critical to unification across decentralized services.

What do you think?

EDIT: There's been a lot (much more than I expected) of good discussion here, so thank you all for providing your opinions.

It was pointed out that there are github issues #1 and #2 addressing these points already, so I wanted to put that in the main post.

top 50 comments
sorted by: hot top controversial new old
[-] meteokr@community.adiquaints.moe 35 points 1 year ago

Just as instances can share their posts in one page, communities should be able to federate with other, similar communities. This would help to solve the problem of fragmentation and better unify the instances.

On this point specifically, I think this idea is good. Multiple communities sharing a pool of aggregates that can moderators opt into. Great, I don't know how feasible that is with ActivityPub, but I hope it can be worked out once the dust has settled.

However, "fragmentation" is neither a problem, nor do I feel exists as things currently stand. If different servers want to host communities around a similar topic, that's not a bad thing. On Reddit, you had Gaming, Games, Truegaming, etc. They're all about playing games, video or otherwise, yet if you look at them at all you'll see they cater to almost completely different audiences. I don't NOT want ultra dominate monolithic groups. I think if their existed a single "Technology" community then that would be a failure of the fediverse.

Right now is a period of extremes, so don't evaluate communities too harshly. In the long run, I want to see dozens, maybe hundreds of small communities that maybe don't get a huge amount of traffic, but are none the less, active and interesting.

load more comments (1 replies)
[-] noodlejetski@kbin.social 26 points 1 year ago

Lemmy needs two things to be successful:

  1. users
  2. users

and it's already getting more and more of each of those.

[-] DaughterOfMars@beehaw.org 16 points 1 year ago

It won't get more users if it continues to be difficult to use.

[-] bumbly@readit.buzz 12 points 1 year ago
  1. Create account
  2. interact with community
  3. ???
  4. Profit

Terribly difficult

[-] DaughterOfMars@beehaw.org 9 points 1 year ago

Thank you for that insightful comment. You've really addressed my point in its entirety, and thoroughly proven me to be a dullard. I submit to your vast intelligence.

[-] Spzi@lemmy.click 10 points 1 year ago

I mean ...

That's active users last month. Roughly +50% or +10k in less than a week.

So the data seems to strongly speek against it; lemmy gets more users just fine despite being so difficult.

One question is how many of those will leave again. And obviously, we should strive to make it more user friendly. I fully support your proposals. I just don't think it's right to paint them as a necessity for growth, they evidently aren't.

[-] DaughterOfMars@beehaw.org 6 points 1 year ago

The reality is that reddit still exists, and is still more user-friendly (and that's a low bar). It's great that lemmy is getting this bump, but it won't last unless we make it easy to switch for most people. If lemmy was good enough to be a reddit alternative already, it would be. But it's not, and the only reason people are here is because of the protest.

[-] ondoyant@beehaw.org 6 points 1 year ago

I think I'm just not that worried about making it easy for "most people" right now. The nature of open source projects means that enthusiastic users can and do contribute to infrastructure, and as more people come along, more people will start working on making things better. There's a reason reddit decided to fuck over third party API calls, and its because open source projects became better than their own shit, and they apparently think that they're losing potential money because of it. Projects like Apollo would not be getting cut off if they weren't seen as a threat to reddit's business model. If lemmy survives, the breadth and depth of community driven infrastructure will outpace reddit eventually. If it doesn't, well... then somebody will try something else. No biggie. Cool shit takes time to build.

load more comments (2 replies)
load more comments (6 replies)
[-] JWBananas@startrek.website 5 points 1 year ago

Twelve of those are mine, due partly to the very shortcomings being discussed here.

[-] noodlejetski@kbin.social 7 points 1 year ago

people kept saying similar stuff about Mastodon, and yet, miraculously, its user base somehow keeps growing.

load more comments (4 replies)
[-] Mindless_Enigma@beehaw.org 14 points 1 year ago* (last edited 1 year ago)

Personally I don't know if Lemmy needs these to be successful. Depending on your viewpoint, Lemmy already is successful. Lemmy instances existed long before the current Reddit influx and seemed to be doing okay even if things were a bit slow.

Maybe I'm wrong about this, but it feels to me like most people coming over from Reddit are viewing federation as multiple people helping run parts of a larger single site instead of viewing each Lemmy instance as its own entire community and site with the great benefit of federation allowing direct access and communication to other sites running in the fediverse. Identities and communities are specific to an instance because that instance is an independent community. In that frame of mind, having a different account on different instances and overlapping community topics between instances makes sense. Same way multiple forums have boards about the same topic and joining multiple forums meant multiple accounts. Federation just makes it easier to see across that gap.

[-] Deestan@beehaw.org 11 points 1 year ago

Maybe I’m wrong about this, but it feels to me like most people coming over from Reddit are viewing federation as multiple people helping run parts of a larger single site instead of viewing each Lemmy instance as its own entire community and site

I think you are right, and I think a major contributor to this is how Lemmy is communicated. We are inviting people to a concept when they expect to be invited to a place.

"Join Lemmy!" indicates Lemmy is the site. A site. One coherent system. Then "and pick a federated server" just seems like random frustration.

"Join ! It's on Lemmy so you can easily contribute to the communities on Beehaw, lemmy.ml, toupoli, ... without creating separate accounts there." is how I think we should go about it.

load more comments (1 replies)
[-] anji@lemmy.anji.nl 14 points 1 year ago

100% agreed with both. Especially DIDs just need to happen on all ActivityPub platforms. It will not only free users from being locked to an instance, but it will also allow instances to be much more flexible in scaling their capacity. Lemmy.ml is overloaded because they have too many users, and anyone who signed up there can no longer use their account. DID would allow them to immediately use their account from any small or large instance with spare capacity without changing the experience. The same would go for Mastodon.

[-] Butterbee@beehaw.org 6 points 1 year ago

It sounds like a moderation nightmare having people come over to your instance with a whole lot of content they've created that are now being hosted by your servers. You've got to look through the whole thing to make sure it is not breaking TOS of your instance. Doesn't sound great to me.

[-] anji@lemmy.anji.nl 6 points 1 year ago* (last edited 1 year ago)

There’s many different ways DID could be implemented on top of ActivityPub. I don’t think full content replication (what you’re mentioning) is likely as that’s a fundamentally different style of protocol.

But I can imagine signing in to a different instance with my ID, at which point I subscribe to all my communities from this instance and get notifications if someone replies to one of my comments etc. Just as if I had created an account on this instance and had posted from there. It just means “your” instance can go down and you can continue future interactions mostly uninterrupted from another instance.

load more comments (1 replies)
load more comments (2 replies)
load more comments (2 replies)
[-] CasualTee@beehaw.org 13 points 1 year ago

I like the idea of aggregating communities. Especially if the modding tools are powerful enough. This could lead to communities being essentially curated lists of other communities. Which is great for new users to discover new communities without being overwhelmed by the unordered list of communities on the instance.

Another feature that I'd like to see is an equivalent to the mastodon's lists, a way to aggregate communities for yourself. So that you could browse the content of communities sharing a same theme in a dedicated view.

load more comments (1 replies)
[-] this_is_router@feddit.de 12 points 1 year ago

I don't see the big problem in 1. Compare it to e-mail. If you want to switch provider you have to backup and restore your emails if you want to.

Nobody bats an eye that amiladresses contain a maildomain but with Lemmy everyone is used to the reddit way. Give it some time, people will get used to it.

The syncing and federation problems we are experiencing right now will get solved in the future, people will get used to the new naming scheme.

Point 2 is a great idea btw.

[-] DaughterOfMars@beehaw.org 8 points 1 year ago

Notice how everyone pretty much uses gmail? If gmail goes down you lose access to everything, but it won't because it's google and they have money to throw at problems. That's not true for Lemmy (and we don't want that because it leads to Reddit 2.0 where all power is centralized).

[-] JohnEdwa@sopuli.xyz 5 points 1 year ago* (last edited 1 year ago)

There is also the additional issue of defederation, not just your instance stability. Like if you happen to be one of the 30k users on lemmy.world, or any of the smaller ones that got cut off from Beehaw because you trusted the "it doesn't matter where you make your account, it's all shared in the fediverse!" - if there's a constant risk Gmail decides to block all Hotmail users one day, creating a Gmail account in the first place seems like the safer bet.

load more comments (2 replies)
[-] someguy3@lemmy.ca 5 points 1 year ago

Email providers aren't likely to shut down. But from what I know instances may.

load more comments (1 replies)
load more comments (4 replies)
[-] BobQuasit@beehaw.org 12 points 1 year ago

I agree completely! And thanks for clearing up the disassociative identity disorder question, because I actually was wondering for a second. 😆

But if #1 is too hard, the ability to download all of your data from a login and possibly upload it to another account would be a good stopgap.

load more comments (2 replies)
[-] catastrophicblues@lemmy.ca 12 points 1 year ago

These are good points. It sucks that as a PhD student in CS, I still don't understand the workings of federation and other important Internet concepts. I hope someone smarter will work on this stuff, though.

[-] deedasmi@lemmy.timdn.com 9 points 1 year ago

You don’t need an upfront detailed understanding of everything to get started. Contributing to projects like this is a research project like any other.

load more comments (1 replies)
load more comments (2 replies)
[-] reid@beehaw.org 11 points 1 year ago

I think there's a third big thing: really good UX. I don't have an Android phone, so I don't know about Jerboa, but the web interface ... could use some work. I know the bug with new posts pushing the feed down is on track to be fixed soon, but wow, it can be really quite bad. iOS apps are getting way better quickly, too, but overall they're nascent.

I can't quite put my finger on it, but additionally, I think the ranking algorithm(s) could use some work. I can see there's tons of content, if I sort by new, but sorting by active results in stale posts, and sorting by hot doesn't seem to quite hit the sweet spot on tenured/good quality content vs. newness. The recent ranking bug(s) haven't helped matters there either.

[-] IncidentalIncidence@feddit.de 7 points 1 year ago

but sorting by active results in stale

yep, the default sorting makes it looks like nothing has been posted for 3 days

load more comments (2 replies)
[-] retronautickz@beehaw.org 11 points 1 year ago

1- You mean something along the lines of Hubzilla's nomadic identities? or how?

Nomadic Identity: The ability to authenticate and easily migrate an identity across independent hubs and web domains. Nomadic identity provides true ownership of an online identity, because the identities of the channels controlled by an account on a hub are not tied to the hub itself. A hub is more like a "host" for channels. With Hubzilla, you don't have an "account" on a server like you do on typical websites; you own an identity that you can take with you across the grid by using clones. Channels can have clones associated with separate and otherwise unrelated accounts on independent hubs. Communications shared with a channel are synchronized among the channel clones, allowing a channel to send and receive messages and access shared content from multiple hubs. This provides resilience against network and hardware failures, which can be a significant problem for self-hosted or limited-resource web servers. Cloning allows you to completely move a channel from one hub to another, taking your data and connections with you.

2- This is a good Idea. But I'm not sure how posible it is as of now

load more comments (5 replies)
[-] Ragoo@feddit.de 10 points 1 year ago

For the second one there is an issue on github discussing it.

load more comments (3 replies)
[-] ipkpjersi@lemmy.one 10 points 1 year ago

Point 1 is part of why I'm gonna start self-hosting a Lemmy instance at some point. If I host my own instance then I can back up my data and ensure it's never lost.

[-] sphere_au@reddthat.com 10 points 1 year ago

I think these are "nice to have" features rather than absolutely essential, but:

For 1. I could deal with just being able to download my list of subscriptions and upload it to another server. That's the only bit that's really slow to copy over by hand.

For 2. I think the main thing that really would benefit is the ability to search all active communities on all servers. The way it is now is alright if there are only half a dozen really active instances whose communities I might be interested in, but it doesn't scale if there are hundreds of servers to check out. Probably the more important of the two IMHO in the long run.

load more comments (2 replies)
[-] darkmugglet@lemm.ee 8 points 1 year ago

I think point two is interesting, but only if the communities choose too. One of the interesting promises of federation is that you can have competing communities with different interests. I can completely see commerical interests hosting a server (e.g the NBA or NFL) that has strong brand identity as a place to interact with stars, and then the un-branded fan sites. IMO, the competition is what makes the Fediverse interesting, and seeing that play out is fascinating.

load more comments (2 replies)
[-] furrowsofar@beehaw.org 7 points 1 year ago

A few points about #1 I did not see talked about. First global ID is of a lot less value on Forums then on things like Mastodon. At least the way I use forums I have no interest in building a persona. Frankly would prefer totally different IDs on different servers and frankly I think we should encourage people to be subject focused not persona focused on Lemmy anyway. There's to much of this ego stuff that goes on on other platforms.

The second thing is logging into multiple systems is a solved problem. If you do not have a password manager get one. Bitwarden or one of the LastPass versions depending on your platform for example. Another better way is SQRL or U2F. There is also a more recent thing, maybe PassKeys (?), cannot remember. In particular central authentication servers are nuts. Not even LastPass that specializes in them could do it correctly. Just NO. More then that let us not rebuild Reddit. We do not want central infrastructure.

load more comments (2 replies)
[-] CookieJarObserver@feddit.de 7 points 1 year ago

DID are kinda against the idea itself also a lot less private.

[-] Manbart@beehaw.org 7 points 1 year ago

Just to add a little more context, here’s the W3C recommendation for DID:

https://www.w3.org/TR/did-core/

[-] sxan@midwest.social 7 points 1 year ago

The Fediverse in general needs federated identities, preferrably self-sovereign. Something like nostr, with validation signatures. E.g., you own your ID, and validate it with some mechanism of your preference. If midwest.social trusts your validator, it creates a space for your ID.

I don't think this is conceptually or implementationally difficult, but it would require a well written standard and consider both privacy issues (for users) and protections against spammers and bad actors (for hosting providers). I don't thing PGP's web-of-trust model would be a bad one. I think using the nostr network (quasi online chain) would be a great idea, and all of the parts are there; it would need a decent UI and support in each Fedi server implementation - which would be the biggest hurdle.

This would address the DID issue, and I agree with you that this is issue #1. Right now, users don't own their identities: their hosting service does. If midwest.social chose to, they could nuke my account and the canonical source of truth for all my posts. I run my own ActivityPub server and so own the account I use for Mastodon; and, perhaps, someday Fediverse federation will evolve to the point where I can use that account for everything. But it's an expensive node for me to operate, and not everyone can run their own server. Better, self-sovereign, and truly federated DIDs is incredibly important.

[-] Skelectus@suppo.fi 6 points 1 year ago* (last edited 1 year ago)

I don't think these are such a big deal at least for short term. Point 2 is cool, and sounds somewhat feasible if there's will, but I'd like to hear how you'd go and implement the first one. It's a lot of work, and I don't think it would affect flocking that much.

[-] BitOneZero@beehaw.org 6 points 1 year ago

Obviously there are plenty of bugs and QoL features that could dramatically improve the usage of Lemmy

Federation is not reliably delivering comments and other Lemmy content between servers. People need to be looking for such problems, so far there isn't any tool to observe or track this problem.

https://github.com/LemmyNet/lemmy/issues/3101

[-] xtremeownage@lemmyonline.com 6 points 1 year ago

Regarding point 1- if people would just stop signing up on lemmy.world, lemmy.ml, and beehaw.org, because they have the most people-

Things would go much smoother!

Pick an instance based on uptime, or hell, create your own instance.

Piling all of the eggs into a single basket is destined to result in failure.

[-] DaughterOfMars@beehaw.org 7 points 1 year ago

That's the issue though. Without a locked identity on an instance, people will naturally choose the option they think is least likely to disappear in a few weeks.

[-] this_is_router@feddit.de 6 points 1 year ago

Instances won't appear and disappear weekly. Maybe right now, but not in a few weeks or months from now. The dust just needs to settle.

Every service with open protocols that isn't centralized does the same and nobody has a problem with it, be it bulletin boards, IRC server or mail. You have multiple instances and can't use a service when your instance is down. Thats why we are using the bigger ones and don't run mailservers on our own. It is important that we could though.

We might disagree but I feel this is more a problem of getting used to it. In the end, we all want a decentralized solution, don't we? Having multiple instances is just a part of the fediverde., that's a pro not a con in my book.

load more comments (4 replies)
load more comments (28 replies)
[-] jcb2016_@mastodon.social 5 points 1 year ago* (last edited 1 year ago)

@DaughterOfMars That’s why you do your research and create an account on a successful instance so you don’t have that problem. I have a lemmy account and mastodon. I have lemmy because of the blackout but didn’t know what I was doing. I note know how to use lemmy and mastodon from the user side of things. Lemmy for my subs and general looking at the sub home page and communities. Mastodon to chitchat and everything else

[-] DaughterOfMars@beehaw.org 10 points 1 year ago

You're pointing out the exact problem that I am describing: Users will naturally flock to the largest, most stable instances, thus centralizing lemmy and removing the benefit of federation.

load more comments (5 replies)
load more comments (1 replies)
[-] utg@mander.xyz 5 points 1 year ago

Been exploring, setting up my account, learning to use lemmy since 2am, this is the fundamental issue in facing, one that I cannot seem to wrap my head around.

I'm not sure (someone can correct me if I'm wrong) if my account is in certain instance, I can subscribe to communities in that instance, or other external instances. However, subscribing to communities in other instances is pretty tedious. I still don't know how to reliably do it on PC let alone mobile. It's a toss up for me if it'll open in my account or a new page asking me to log in to that instance.

Hopefully in the coming months lemmy can take off and we can have something amazing on our hands

[-] Isildun@beehaw.org 5 points 1 year ago

You can subscribe to any content anywhere as long as neither instance is on the other's block list. If your instance hasn't federated with the other instance yet, then you need to do that thing where you search for "!community@instance" and wait a few minutes. Otherwise, you just go to that community while on your home instance (e.g. for you, "mander.xyz/c/community@instance") and click subscribe.

[-] redcalcium@c.calciumlabs.com 5 points 1 year ago* (last edited 1 year ago)

Heck, you don't even need to enter the community in the !community@instance format. Simply copy pasting the community url like https://lemmy.world/c/communityname to the search field works as well.

load more comments (1 replies)
[-] AskThinkingTim@kbin.social 5 points 1 year ago

Lemmy needs me to be able to login.....Let's start with the basics.

[-] someguy3@lemmy.ca 5 points 1 year ago

I like your points.

Short term they need to work on the "all front page". It doesn't seem to give me popular posts from all instances, it's full of 2 to 3 to 4 day old posts that were never very popular. I have to manually go around (like to this community) to find content.

[-] lightingnerd@kbin.social 5 points 1 year ago* (last edited 1 year ago)

I think #1 is a great idea, but it would take a lot of work and would probably be a pain to phase-in and phase-out across all platforms, but I do think it's a good idea, at least to offer as an option. While I am loathe to mention anything cryptocurrency and NFT-related, creating a simplified distributed ledger and smart contract system that would propagate through federated communities seems like an interesting idea. Alternatively, creating a way for users to specify their other usernames on other servers in a small bio in a profile page could be a possible compromise.

Your point #2 also sounds great, but I don't think this should be allowed between communities on defederated instances, because there's laws in many countries that can classify the act of hosting/providing certain content to be criminal. Therefore, if say if server_a resides in country_a, and country_a allows piracy, and server_b in country_b, and country_b considers it a criminal act to propagate certain information about piracy, the server_a/piracy and server_b/piracy might have different restrictions to discuss piracy. However, a less-informed mod may attempt to federate server_a/piracy and server_b/piracy, and insodoing accidentally make the owner/host of server_a unknowingly complicit in a criminal act.

I'm not a lawyer, and of course this is not intended to be legal advice, but I think that the effort would better be spent on implementing a solution to the decentralized identity problem, than the de-fragmentation of similar communities.

One other nugget to consider, assuming we were to replace Reddit, and the sum of the users on the fediverse were to achieve similar numbers to Reddit's glory days--we would definitely be scraped for AI training data. By keeping the communities fractured, that makes it far more difficult for a company to easily scrape all the information needed. While it might be trivial right now, in the ideally decentralized structure that the fediverse would take, it would take a lot more requests for a server to chase out every strand on every network.

Perhaps in this sense, it might be wise for instances to allow specific community defederation(ie, where server_a and server_b are federated, but server_a does not allow server_b/piracy to propagate(this may already be possible, IDK), but I do not think it would be wise to allow community to community federation.

TL;DR: #1 is a great idea, OP, and it could be implemented in a simplified distributed ledger that propagates through federated communities, and uses a simplified smart-contract--or the problem could be solved by a compromise that allows users to specify their usernames for other instances in a small public bio. Addressing #2, this could cause legal problems in specific scenarios, rather it is more important for any instance to be able to disallow the propagation of specific communities from a federated server (if this isn't already possible).

load more comments
view more: next ›
this post was submitted on 17 Jun 2023
236 points (100.0% liked)

Technology

37443 readers
88 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS