technology

24389 readers
144 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 5 years ago
MODERATORS
1
9
Hexbear Code-Op (hexbear.net)
submitted 1 year ago* (last edited 1 year ago) by RedWizard@hexbear.net to c/technology@hexbear.net
 
 

Where to find the Code-Op

Wow, thanks for the stickies! Love all the activity in this thread. I love our coding comrades!


Hey fellow Hexbearions! I have no idea what I'm doing! However, born out of the conversations in the comments of this little thing I posted the other day, I have created an org on GitHub that I think we can use to share, highlight, and collaborate on code and projects from comrades here and abroad.

  • I know we have several bots that float around this instance, and I've always wondered who maintains them and where their code is hosted. It would be cool to keep a fork of those bots in this org, for example.
  • I've already added a fork of @WhyEssEff@hexbear.net's Emoji repo as another example.
  • The projects don't need to be Hexbear or Lemmy related, either. I've moved my aPC-Json repo into the org just as an example, and intend to use the code written by @invalidusernamelol@hexbear.net to play around with adding ICS files to the repo.
  • We have numerous comrades looking at mainlining some flavor of Linux and bailing on windows, maybe we could create some collaborative documentation that helps onboard the Linux-curious.
  • I've been thinking a lot recently about leftist communication online and building community spaces, which will ultimately intersect with self-hosting. Documenting various tools and providing Docker Compose files to easily get people off and running could be useful.

I don't know a lot about GitHub Orgs, so I should get on that, I guess. That said, I'm open to all suggestions and input on how best to use this space I've created.

Also, I made (what I think is) a neat emblem for the whole thing:

Todos

  • Mirror repos to both GitHub and Codeberg
  • Create process for adding new repos to the mirror process
  • Create a more detailed profile README on GitHub.

Done

spoiler

  • ~~Recover from whatever this sickness is the dang kids gave me from daycare.~~
2
3
4
 
 

cross-posted from: https://hexbear.net/post/8768696

I visited the largest electric truck charging site I have ever seen, located in Beichuan, Sichuan, around 150 km north of Chengdu, China.

The site is planned for 100 MW scale. In stage one, around 51 MW is already installed from 72 Huawei 720 kW power units. I counted 108 charging spots with dual dispensers, meaning 216 plugs, plus 18 megawatt charging positions. Stage two is planned to add 33 more 1.44 MW charging systems, bringing the site close to 100 MW.

5
 
 

This information is 7 days old but I didn't see any info posted here or in c/libre about it, so here we are.

Also, I don't know who Vincent Lapierre is, so can someone here more in the know school us on this person?

6
7
8
 
 

It's a Chinese Wi-Fi module for a PC! With Linux drivers!

9
10
 
 

There’s a really interesting quirk in modern architecture that a lot of people have been noticing lately referred to as the Curse of Depth in the paper. Basically if you look at popular models like Llama or Qwen or DeepSeek you will find that the deeper layers are surprisingly useless. You can completely prune away huge chunks of the later transformer blocks without actually hurting the performance of the model. The representations in these deep layers end up looking practically identical to each other, and it’s a massive waste of GPU hours because we are training billions of parameters that end up doing almost nothing.

The authors trace the root cause directly to Pre-Layer Normalization. Pre-LN makes training massive transformers way more stable than the old Post-LN setups, but the catch is that as you pass data through more and more Pre-LN layers the output variance explodes exponentially. Because of how the math works out this exploding variance forces the derivatives in deep blocks to essentially become an identity matrix turning the layer into a pass-through filter that cannot learn any meaningful new transformations.

And turns out that the problem can be fixed using a remarkably simple tweak called Layer Norm Scaling. They literally just scale the output of the layer norm inversely by the square root of the layer depth. This completely stops the variance from blowing up as you go deeper into the network. Because the variance stays under control the deep layers actually wake up and start contributing to the representation learning.

They tested this trick on models ranging from tiny 130M parameter setups all the way to 7B parameter models. In every case Layer Norm Scaling beat out standard Pre-LN and other normalization tricks. The pre-training loss drops significantly and those gains carry right over into supervised fine-tuning tasks. Best of all it requires zero new hyperparameters or learnable weights. It is just a clean mathematical fix to a fundamental architectural flaw.

11
 
 

They're really getting desperate. porky-scared

12
13
14
15
 
 

The anger and anxiety over electricity in America is palpable. You can see it in packed utility commission hearings, in protests against companies, and in furious reactions on social media.

And you can see it in the polling. Across poll after poll, more people are saying that they can’t afford their bills and they think utilities need to change how they make money. And they are also very cynical about data centers.

So will this be the push utilities need to finally change the way utilities pay for infrastructure?

This week, we dig into three indicators. First: 75% of Americans say their home energy costs have gone up, and a quarter of Americans now consider utility bills unaffordable. Second: 86% of California voters said executive pay should be tied to affordability. And third: 71% of Americans would now oppose a data center being built near their home, a 49-point swing in less than a year.

16
17
 
 

A Colorado State University researcher didn't plan to study rooftop agrivoltaics. She was furious when solar panels appeared over her research plots without warning. What her data showed next changed the direction of her career — and quietly launched a new field of urban agriculture.

Denver alone has an estimated 5,000 acres of flat rooftop space sitting largely unused above a city that needs both clean energy and local food.

18
 
 

cross-posted from: https://hexbear.net/post/8761674

Two Bit da Vinci's Ricky Roy partners with Elliot Richards (Everything Electric, Fully Charged) — who's lived in China for 18 years — to lay out exactly how China quietly built the world's most powerful auto industry, why every legacy brand is bleeding share in China, what their export wave is doing to Europe and Russia, why the US tariff wall is more of a stall than a strategy, and what it all means for Detroit and the American consumer.

19
20
 
 

Western drug companies are pouring tens of billions of dollars into China, to develop medicines that can be resold at premium prices in Europe and the United States.

China dominates all phases of the pharmaceutical industry, from new drug development, testing, and mass production.

21
22
23
24
 
 
25
view more: next ›