81
submitted 1 year ago by grant@toast.ooo to c/technology@beehaw.org
top 37 comments
sorted by: hot top controversial new old
[-] tgxn@lemmy.tgxn.net 38 points 1 year ago

Aha, I am doing the exact same thing 😂 https://lemmyverse.net

[-] grant@toast.ooo 13 points 1 year ago

It looks really good! When I saw it on my feed my first response was “oh shoot someone beat me” 😂

[-] tgxn@lemmy.tgxn.net 10 points 1 year ago

Hehe they do look quite similar so great minds right 😁 I had the same thourght when I saw yours! I'll add a link to yours to the list on my about page if you want 😀

[-] grant@toast.ooo 7 points 1 year ago

that would be great, i'll make sure you add yours as well 😀

[-] PolarShred@beehaw.org 8 points 1 year ago

Excuse me, this is a capitalist society. Please compete to the death

[-] Comrat@lemmy.world 3 points 1 year ago

I wanna give both of you props for your work on these. It's pretty cool to see the community jump on things like this. I've been half considering an attempt to whip up an android app just for a personalized experience, but I'm worried I'll be too ambitions lol

[-] snaggen@programming.dev 4 points 1 year ago

For both of you, wouldn't it be nice to let me add my home instance so you could provide quick links to subscribe (and open the community in my home instance).

[-] tgxn@lemmy.tgxn.net 6 points 1 year ago

I have a feature planned so you can login and one click subscribe/unsubscribe all on one page. Stretch goal though I've gotta patch some bugs first 😁

[-] ojmcelderry@lemmy.one 3 points 1 year ago

Potentially dumb question, but I've seen lots of people linking to this website:

https://browse.feddit.de

What's new/different about https://browse.toast.ooo or https://lemmyverse.net?

Is it because they also show instances, not just communities? Or is it more just a hobby project (nothing wrong with that, I'm 💯 on board with building things for the sheer enjoyment of it - even if it's already a 'solved' problem)

[-] tgxn@lemmy.tgxn.net 9 points 1 year ago

I can only speak for myself, but I started work on mine since the Feddit one is fixed wide mode and the searching/filtering is less than ideal, I wanted to be able to see more details. Feddit one doesn't show instance stats iirc. There are also other lists, but I didn't find any of them super user-friendly.... If Lemmy is gonna succeed Reddit there needs to be some super friendly tools to assist community discovery.

[-] ojmcelderry@lemmy.one 1 points 1 year ago

Nice! I sort of hope these community discovery tools & improvements eventually make their way back 'upstream' into Lemmy's UI over time. Imagine not needing a separate discovery app because Lemmy's built-in one is already the best one available 😄

[-] tgxn@lemmy.tgxn.net 2 points 1 year ago

I hope so too! The current problem is that new Lemmy instances start with no communities and you have to search to get federation started. If there was an easier way to do a global search within a fresh Lemmy instance that'd be nice!

[-] dudeami0@lemmy.dudeami.win 4 points 1 year ago

For me these two community browsers linked here are a little more usable then the browse.feddit.de version (I am on desktop). Everyone is just trying to help grow the community in whatever way they can, and redundancies and choices never hurt. There is talks of each instance hosting a community browser over on the github issues, so this likely will be implemented in some form for each server as well.

[-] LUHG_HANI@lemmy.world 1 points 1 year ago

Saw yours last night and prefer it. But wow, the communities have gone from 6k to over 10k overnight by your stats. Is that true?

[-] tgxn@lemmy.tgxn.net 1 points 1 year ago

Yeah they really shot up! I'm pretty sure it's an accurate number. I did an crawl last night and picked up another ~3000 communities. A lot might be from instances that are under high load/timing out so might not have been picked up previously. Imma do some more analysis with my data in the future.

[-] Irisos@lemmy.umainfo.live 1 points 1 year ago

Probavly the best one I have found so far.

By the way, do you have any plan to expose an API or daily extract of the data you have?

While those websites are useful for manual searches, I think it would benefit the feddiverse much more if there was a way to integrate all those lists into an app. At least without resorting to web scrapping.

[-] tgxn@lemmy.tgxn.net 2 points 1 year ago
[-] Irisos@lemmy.umainfo.live 1 points 1 year ago

Thank you for the information I'll definitely check that out.

[-] Die4Ever@programming.dev 0 points 1 year ago* (last edited 1 year ago)
[-] tgxn@lemmy.tgxn.net 1 points 1 year ago

Odddddd, I'll have to check it out.

[-] Die4Ever@programming.dev 1 points 1 year ago

I think I figured it out actually, the one from lemmit.online was marked as suspicious and you have an option to show/hide those

the other one is from my little instance that no one knows about :(

[-] tgxn@lemmy.tgxn.net 1 points 1 year ago

I added lemmy.mods4ever.com to the list ;)

[-] tezoatlipoca@lemmy.ca 5 points 1 year ago

Cool!

Cans has source? I've been hacking on a per-instance community scraper (that pulls a list of communities from the community directory page) for !lemmy411!lemmy411@lemmy.ca, in an attempt to have a regularly published community list, but I'm a bit bogged.

[-] tgxn@lemmy.tgxn.net 5 points 1 year ago

I have links to the source for my crawler (written in nodejs with redis task queuing) on https://lemmyverse.net (GitHub link top right) 🤗 It's a bit messy at the moment but has all the community crawling stuff.

[-] tezoatlipoca@lemmy.ca 1 points 1 year ago

Wow. Stickied THAT to !lemmy411@lemmy.ca thanks!

[-] grant@toast.ooo 3 points 1 year ago

I’m probably going to put the source up shortly but how I decided to find communities is by scraping my instances “federated with” list from https://toast.ooo/api/v3/site

Then going through the /.well-known/nodeinfo -> /nodeinfo/v2.0.json (or whatever url the well-known gives) to check the software to make sure it’s a Lemmy instance

Then using the Lemmy rest API to paginate through the open communities for that instance

[-] UnexampledSalt@lemmy.ko4abp.com 4 points 1 year ago

How are you adding instances? I have a few communities I'd love to have listed.

[-] grant@toast.ooo 5 points 1 year ago

In my other comment I described how I find communities but with this alpha I have a set list of instances to use

Are your communities listed on your current instance (lemmy.ko4abp.com)? I can add that to the temporary list if you’d like

[-] UnexampledSalt@lemmy.ko4abp.com 2 points 1 year ago

They are! I would like that and I will be involved with your project if you decide to take the source public!

[-] Skelectus@suppo.fi 1 points 1 year ago

I'm operating a small instance, nothing here seems to be listed. They always appeared on browse.feddit.de after some time, so I suppose it searches for subs actively. Think you can do something like that in the future?

[-] grant@toast.ooo 1 points 1 year ago

For this alpha I used a set list of servers but for the full release I plan to include as many servers as I can

Im currently rewriting the instance/community discovery system to make it more efficient

[-] DammN 2 points 1 year ago

Thanks for sharing !

[-] crisisingot@beehaw.org 1 points 1 year ago

Nice work! I already found a couple I hadn't seen before.

[-] user@lemmy.one 1 points 1 year ago

Is it better than jerboa android app?

[-] palitu@lemmy.perthchat.org 1 points 1 year ago

@tgxn@lemmy.tgxn.net are you keeping stats over time?

I would love to sort by growing, or new. A lot of the time when you search by popilar, comments, etc the main ones are always at the top. I would like to see some of those up and coming ones that are growing at the moment.

This is especially important as i am on a small lemmy, and I wont get a heap of new lems as there wont be a lot of people adding new subscriptions, i need to find them myself.

[-] grant@toast.ooo 1 points 1 year ago

for browse.toast i am planning to have something similar to that -- attempting to bring the light to smaller communities

discovery of new communities is a high priority rn

[-] palitu@lemmy.perthchat.org 1 points 1 year ago

@grant@toast.ooo , that is cool. I will have a look at toast

You are right that discovery is a big issue to using lemmy in a distributed fashion (ie, using your local, small lemmy instance).

I am getting interesting content, but obviously the critical mass is still coming to get a heap of content, as well as the discovery type of thing.

this post was submitted on 14 Jun 2023
81 points (100.0% liked)

Technology

37702 readers
377 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS