33
submitted 1 year ago by beerd@beehaw.org to c/chat@beehaw.org

I did a couple of searches with duckduckgo and google, finding that unlike reddit it doesnt really suggest posts on lemmy, just whole communities. Im curious if this is unavoidable with this number of users or if there is a way to make search engines suggest better lemmy results and make the resources accumulating here useful for a broader audience.

top 11 comments
sorted by: hot top controversial new old
[-] halendos@lemmy.pt 17 points 1 year ago

For results to appear in search engines they need to be indexed by their crawlers (bots that check webpages and analyse their content, following up any links they find in that page) so it takes time. As a Lemmy instance becomes more popular, more links will show up for it in other websites and by consequence more crawlers will index its pages.

[-] nivenkos@lemmy.ml 2 points 1 year ago

Isn't another issue that it requires Javascript for the content to be visible?

[-] halendos@lemmy.pt 1 points 1 year ago

Not that i'm aware, I think sites without Javascript should be indexed even better since they are easier to parse by the crawlers.

[-] nivenkos@lemmy.ml 3 points 1 year ago

Yeah that's my point - Lemmy requires JavaScript whereas Reddit will still show the comments without it (at least on old Reddit IIRC).

[-] themobyone@beehaw.org 10 points 1 year ago

You can also do a site search on google, I guess the problem remain that you have do this for every server.

"site:beehaw.org"

[-] hib 4 points 1 year ago

I have been thinking about this. For other sites it is super easy to google e.g. "bifl socks reddit" but with federated services the information is scattered across many domains/services that the search engines do not know are federated. There either needs to be a site that archives everything in real time that search engines can crawl, or a robust search engine specifically designed for searching posts on all known instances.

Full disclosure I am not an expert on the topic these are just my thoughts.

[-] Spzi@lemmy.click 2 points 1 year ago

it is super easy to google e.g. “bifl socks reddit” but with federated services

I also guess that's the issue. Many lemmy instances do not have 'lemmy' in their URL. So if someone searches for "bifl socks lemmy", they might not see results from these lemmy instances with non-lemmy names.

[-] Enclose0314@discuss.tchncs.de 2 points 1 year ago

You're kinda right? It'll be harder for links to be considered authoritative by google since they'll be across a bunch of smaller websites with fewer references to them (unlike reddit, which is 1 website with billions of links to it).

But maybe it'll work somewhat anyway since every page has "Join Lemmy" text in the bottom & google might be able to link them together.

On the other hand I have no idea and I'm just going off my vague understanding of how the google algorith m works.

[-] BobQuasit@beehaw.org 4 points 1 year ago

I suspect that Google could do it, but won't. When they ditched "Don't be evil" as their corporate motto, they went all the way. Alphabet is as evil as they come. The Fediverse isn't a giant corporation, and Reddit is. So Google won't be doing us any favors. It's that simple.

[-] WhoRoger@lemmy.world 4 points 1 year ago

90% of the content has been made in like, the last 4 days. Search engines probably weren't even aware of Lemmy before. Give it time.

That said, the federated nature may cause results to always be deprioritized, as the exact same thing may be available on dozens to hundreds of servers with different domains and policies. Search engines don't like that.

[-] RealAndGay@beehaw.org 3 points 1 year ago

Is there a way to get a live feed of all submissions to all of Lemmy? Cause I'll make a searchable index of everything.

load more comments
view more: next ›
this post was submitted on 12 Jun 2023
33 points (100.0% liked)

Chat

7500 readers
23 users here now

Relaxed section for discussion and debate that doesn't fit anywhere else. Whether it's advice, how your week is going, a link that's at the back of your mind, or something like that, it can likely go here.


Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS