brucethemoose

joined 1 year ago
[–] brucethemoose@lemmy.world 3 points 12 hours ago* (last edited 11 hours ago)

Tinycorp generates these headlines every once in awhile, but as far as I can tell no one uses tinygrad. At least not in the tinkerer space I can see.

It’d be cool if they can eat away at PyTorch, XLA and whatever else… Some day… But we also have things like Mojo (and other MLIR stuff), GGML and TVM with similar (though not even close to identical) ambitions.

[–] brucethemoose@lemmy.world 13 points 15 hours ago

No, we think you’re pirating something. We’re going to lock your system and make it entirely unusable.

Microsoft would 100% do this with Windows if they had the technical competence, heh.

Apple’s just closing off practical workarounds.

[–] brucethemoose@lemmy.world 2 points 16 hours ago

I liked this read, though I hate there’s not a good solution that seemingly going to happen.

[–] brucethemoose@lemmy.world 6 points 16 hours ago

Nintendo be Nintendo.

[–] brucethemoose@lemmy.world 1 points 16 hours ago

The warthog has a purely electric transmission, right?

[–] brucethemoose@lemmy.world 11 points 16 hours ago* (last edited 16 hours ago)

LLMs, in fact, have slop profiles (aka overused tokens/phrases) common to the family/company, often from “inbreeding” by training on their own output.

Sometimes you can tell if new model “stole” output from another company this way. For instance, Deepseek R1 is suspiciously similar to Google Gemini, heh.

This longform writing benchmark tries to test/measure this (click the I on each model for infographics):

https://eqbench.com/creative_writing_longform.html

As well as some some disparate attempts on GitHub (actually all from the eqbench dev): https://github.com/sam-paech/slop-forensics

https://github.com/sam-paech/antislop-vllm

[–] brucethemoose@lemmy.world 3 points 17 hours ago

A pretty long time.

Niche models are tons of fun though.

[–] brucethemoose@lemmy.world 1 points 17 hours ago

Yeah. I am probably posting this in the wrong community, but I use Cromite over Firefox because its adblocker is native (hence much faster than FF, especially on Android), and it’s more “hardened” for security/privacy in a multitude of ways, like anti-fingerprinting spoofing/tricks, an internal firewall, strict default policies, things like that.

There are variants of FF that lean in that direction as well, though I am less familiar with them.

[–] brucethemoose@lemmy.world 8 points 17 hours ago* (last edited 17 hours ago) (3 children)

Has Hungary’s government made noise about leaving the EU?

I wouldn’t think Orban wants to be a Russian vassal like Belarus, so perhaps the EU needs to wave the threat of kicking them out around more.

[–] brucethemoose@lemmy.world 0 points 20 hours ago (2 children)

You could have a video playback issue in FF itself. Try installing FF nightly (alongside FF) and see if it works.

Alternatively, there are stripped versions of Chrome like Cromite that you can try.

[–] brucethemoose@lemmy.world 10 points 20 hours ago* (last edited 20 hours ago)

The root cause is billionaires.

There’s no stopping trolls completely, but they were self limiting when the internet was more disaggregated and a little less accessible. It’s greedy Big Tech, led by a few people, that weaponized them into world-scale attention farms.

Advertising is a huge enabler yeah, but I have to wonder if they could’ve leveraged other schemes back then, like the Patreon/Onlyfans model, crypto, or whatever.

[–] brucethemoose@lemmy.world 102 points 20 hours ago (2 children)

Don’t feed the trolls

  • Long forgotten adage, internet
 
  • The IDF is planning to displace close to 2 million Palestinians to the Rafah area, where compounds for the delivery of humanitarian aid are being built.
  • The compounds are to be managed by a new international foundation and private U.S. companies, though it's unclear how the plan will function after the UN and all aid organizations announced they won't take part
 

Qwen3 was apparently posted early, then quickly pulled from HuggingFace and Modelscope. The large ones are MoEs, per screenshots from Reddit:

screenshots

Including a 235B/22B active and a 30B/3B active.

Context appears to 'only' be 32K unfortunately: https://huggingface.co/qingy2024/Qwen3-0.6B/blob/main/config_4b.json

But its possible they're still training them to 256K:

from reddit

Take it all with a grain of salt, configs could change with the official release, but it appears it is happening today.

 

This is one of the "smartest" models you can fit on a 24GB GPU now, with no offloading and very little quantization loss. It feels big and insightful, like a better (albeit dry) Llama 3.3 70B with thinking, and with more STEM world knowledge than QwQ 32B, but comfortably fits thanks the new exl3 quantization!

Quantization Loss

You need to use a backend that support exl3, like (at the moment) text-gen-web-ui or (soon) TabbyAPI.

 

"It makes me think that maybe he [Putin] doesn't want to stop the war, he's just tapping me along, and has to be dealt with differently, through 'Banking' or 'Secondary Sanctions?' Too many people are dying!!!", Trump wrote.

 

The U.S. expects Ukraine's response Wednesday to a peace framework that includes U.S. recognition of Crimea as part of Russia and unofficial recognition of Russian control of nearly all areas occupied since the 2022 invasion, sources with direct knowledge of the proposal tell Axios.

What Russia gets under Trump's proposal:

  • "De jure" U.S. recognition of Russian control in Crimea.
  • "De-facto recognition" of the Russia's occupation of nearly all of Luhansk oblast and the occupied portions of Donetsk, Kherson and Zaporizhzhia.
  • A promise that Ukraine will not become a member of NATO. The text notes that Ukraine could become part of the European Union.
  • The lifting of sanctions imposed since 2014.
  • Enhanced economic cooperation with the U.S., particularly in the energy and industrial sectors.

What Ukraine gets under Trump's proposal:

  • "A robust security guarantee" involving an ad hoc group of European countries and potentially also like-minded non-European countries. The document is vague in terms of how this peacekeeping operation would function and does not mention any U.S. participation.
  • The return of the small part of Kharkiv oblast Russia has occupied.
  • Unimpeded passage of the Dnieper River, which runs along the front line in parts of southern Ukraine.
  • Compensation and assistance for rebuilding, though the document does not say where the funding will come from.

Whole article is worth a read, as it’s quite short/dense as Axios usually is. For those outside the US, this is an outlet that’s been well sourced in Washington for years.

 

Seems there's not a lot of talk about relatively unknown finetunes these days, so I'll start posting more!

Openbuddy's been on my radar, but this one is very interesting: QwQ 32B, post-trained on openbuddy's dataset, apparently with QAT applied (though it's kinda unclear) and context-extended. Observations:

  • Quantized with exllamav2, it seems to show lower distortion levels than nomal QwQ. Its works conspicuously well at 4.0bpw and 3.5bpw.

  • Seems good at long context. Have not tested 200K, but it's quite excellent in the 64K range.

  • Works fine in English.

  • The chat template is funky. It seems to mix up the and <|think|> tags in particular (why don't they just use ChatML?), and needs some wrangling with your own template.

  • Seems smart, can't say if it's better or worse than QwQ yet, other than it doesn't seem to "suffer" below 3.75bpw like QwQ does.

Also, I reposted this from /r/locallama, as I feel the community generally should going forward. With its spirit, it seems like we should be on Lemmy instead?

 

So I had a clip I wanted to upload to a lemmy comment:

  • Tried it as an (avc) mp4... Failed.
  • OK, too big? I shrink it to 2MB, then 1MB. Failed.
  • VP9 Webm maybe? 2MB, 1MB, failed. AV1? Failed.
  • OK, fine, no video. Lets try an animated AVIF. Failed. It seems lemmy doesn't even take static AVIF images
  • WebP animation then... Failed. Animated PNG, failed.

End result, I have to burden the server with a massive, crappy looking GIF after trying a dozen formats. With all due respect, this is worse than some aging service like Reddit that doesn't support new media formats.

For reference, I'm using the web interface. Is this just a format restriction of lemmy.world, or an underlying software support issue?

 

53% of Americans approve of Trump so far, according to a newly released CBS News/YouGov poll conducted Feb. 5 to 7, while 47% disapproved.

A large majority, 70%, said he was doing what he promised in the campaign, per the poll that was released on Sunday.

Yes, but: 66% said he was not focusing enough on lowering prices, a key campaign trail promise that propelled Trump to the White House.

44% of Republicans said Musk and DOGE should have "some" influence, while just 13% of Democrats agreed.

 

Here's the Meta formula:

  • Put a Trump friend on your board (Ultimate Fighting Championship CEO Dana White).
  • Promote a prominent Republican as your chief global affairs officer (Joel Kaplan, succeeding liberal-friendly Nick Clegg, president of global affairs).
  • Align your philosophy with Trump's on a big-ticket public issue (free speech over fact-checking).
  • Announce your philosophical change on Fox News, hoping Trump is watching. In this case, he was. "Meta, Facebook, I think they've come a long way," Trump said at a Mar-a-Lago news conference, adding of Kaplan's appearance on the "Fox and Friends" curvy couch: "The man was very impressive."
  • Take a big public stand on a favorite issue for Trump and MAGA (rolling back DEI programs).
  • Amplify that stand in an interview with Fox News Digital. (Kaplan again!)
  • Go on Joe Rogan's podcast and blast President Biden for censorship.
 

Taboola's data, shared exclusively with Axios, shows Musk has outpaced his closest peers — Jeff Bezos and Mark Zuckerberg — for years, but the gap widened dramatically in 2024.

The spam is already exponential. :(

372
submitted 4 months ago* (last edited 4 months ago) by brucethemoose@lemmy.world to c/politics@lemmy.world
 

Reality check: Trump pledged to end the program in 2016.

Called it. When push comes to shove, Trump is always going to side with the ultra-rich.

 

Trump, who has remained silent thus far on the schism, faces a quickly deepening conflict between his richest and most powerful advisors on one hand, and the people who swept him to office on the other.

All this is stupid. But I know one thing:

Trump is a billionaire.

And I predict his followers are going to learn who he’ll side with when push comes to shove.

Also, Bannon’s take is interesting:

Bannon tells Axios he helped kick off the debate with a now-viral Gettr post earlier this month calling out a lack of support for the Black and Hispanic communities in Big Tech.

view more: next ›