lemmy.ml meta

1551 readers

11 users here now

Anything about the lemmy.ml instance and its moderation.

For discussion about the Lemmy software project, go to !lemmy@lemmy.ml.

founded 5 years ago

MODERATORS

nutomic@lemmy.ml

Something’s up with federation from multiple instances (lemmy.ml)

submitted 1 day ago by Trying2KnowMyself@lemmy.ml to c/meta@lemmy.ml

24 comments fedilink hide all child comments

I have posts and comments on Hexbear from 4 hrs ago that don’t show up

I have a comment on Lemmygrad from 4 hrs ago that doesn’t show up

A recent series of posts from ml to other instances have almost no interaction locally. When viewed remotely, they have higher vote counts (no more comments to compare).

I haven’t extensively looked at the new feed to see if posts are outright missing, but I see the same general pattern spot checking posts that do appear: vote totals much lower than elsewhere, missing comments

I don’t see issues reported on https://phiresky.github.io/lemmy-federation-state/site

you are viewing a single comment's thread
view the rest of the comments

[–] Trying2KnowMyself@lemmy.ml 1 points 21 hours ago (2 children)

internet-delenda-est

Yep. I checked that site and it definitely doesn’t show any issues, clearly everything is working.

Plenty of other folks are chiming in with the same experiences. It’s very clearly not just Hexbear. Is every other instance broken? Why are they federating just fine with each other, then?

https://lemmy.world/post/47958962

https://lemmy.ml/post/48512217

https://discuss.online/post/40968502

https://lemmy.ml/post/48508670

https://aussie.zone/post/33509821

https://lemmy.ml/post/48507829

https://piefed.blahaj.zone/c/womensstuff/p/792979/thoughts-on-this

https://lemmy.ml/post/48509886

https://startrek.website/post/40652133

https://lemmy.ml/post/48504964

https://lemmy.dbzer0.com/post/70286030

https://lemmy.ml/post/48512741

https://lemmy.ca/post/66154822

https://lemmy.ml/post/48503190

And yeah, that doesn’t even get into the posts that haven’t federated at all. I only went through a few pages of /new and I’m on posts that are hours old.

[–] nutomic@lemmy.ml 4 points 20 hours ago* (last edited 20 hours ago) (1 children)

Found the problem, I had commented out the Host header in nginx thinking it would not be necessary. Turns out I was wrong. Adding the header back in fixed the problem.

Big thanks for notifying about this!

[–] Trying2KnowMyself@lemmy.ml 2 points 16 hours ago

Thanks for fixing it!

[–] nutomic@lemmy.ml 4 points 20 hours ago

You're right, its also really noticable if you just compare the All feed, on lemmy.ml almost everything from local users. Most posts from other instances are missing. In the server logs are a lot of errors like this:

lemmy-1  |    0: lemmy_server::root_span_builder::HTTP request
lemmy-1  |            with http.method=POST http.scheme="http" http.host=0.0.0.0:10633 http.target=/inbox otel.kind="server" request_id=780b6573-2672-4361-87c2-6ece46e272ee
lemmy-1  |              at src/root_span_builder.rs:16
lemmy-1  | 2026-06-09T17:34:25.537123Z  WARN lemmy_server::root_span_builder: Unknown: Incoming activity has invalid signature

I thought at first that it would be related to the new 0.19.19 release, but downgrading to 0.19.18 doesnt fix the problem.

Issue link: https://github.com/LemmyNet/lemmy/issues/6581