this post was submitted on 21 Jun 2026
158 points (98.8% liked)

Technology

85615 readers
3286 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] y0kai@anarchist.nexus 28 points 9 hours ago (5 children)

What's the most expensive thing one can do with AI and how do we do it on a mass scale to one company at at time?

[–] CaptDust@sh.itjust.works 18 points 8 hours ago (1 children)

I know a company that burned $100k in tokens after they they let like 50 worker bees using general AI for OCR, simply converting images and PDFs to text.

They didn't bother to create a skill, or teach the AI how to reuse a shared script so every request resulted in it writing a new python project, pulling libraries, using a frontier model rather than offloading a dumb one etc.

Basically find a business process that happens often and let em at it inefficiently, it'll happily chew through the budget.

[–] bridgeenjoyer@sh.itjust.works 21 points 7 hours ago (1 children)

Thats pretty much what people freaked out about llms doing at my work and all they use it for. I'm here like...we have had OCR for over 20 years.

People are duuumb.

[–] Grimy@lemmy.world 7 points 7 hours ago (1 children)

There has been some serious leaps in terms of quality. It couldn't read human writing or half the fonts for that matter like 5 years ago, let alone 20.

[–] CaptDust@sh.itjust.works 6 points 6 hours ago* (last edited 3 hours ago) (1 children)

OCR libraries have undoubtedly improved but LLMs are using the same open source libraries and tools available to anyone... there's few cases where sending the work through general models is worth it for text conversion. Employees just needed a front end to upload, run something like tesseract behind the scenes, and spit out the result. It's an egregiously stupid use of resources.

[–] Blue_Morpho@lemmy.world 5 points 6 hours ago (1 children)

have undoubtedly improved but LLMs are using the same open source libraries and tools available to anyone..

I read a surprising article on Lemmy just a week ago that explained that that is not how LLM's do OCR. LLM's convert images into tokens and then treat them like text input. I can't see how it works but it does. It's why they are better than classic OCR neural nets but at the trade off of enormously larger computation cost.

[–] ThanksObama@sh.itjust.works 23 points 9 hours ago (1 children)

Maybe 16k image/video upscaling of super low quality shitposts?

[–] Zen_Shinobi@lemmy.world 7 points 8 hours ago (1 children)

File sizes are going to be huge! 2K is already a lot to upload, couldn't imagine 16K right now.

[–] tal@lemmy.today 4 points 6 hours ago* (last edited 6 hours ago) (1 children)

Just expend some more compute time on doing compression and we'll get those filesize numbers to a workable level.

$ stat -c %s enhance.png 
276773
$ convert enhance.png enhance.avif
$ identify enhance.avif
enhance.avif AVIF 1164x558 1164x558+0+0 8-bit sRGB 14391B 0.000u 0:00.000
$ stat -c %s enhance.avif
14391
$

zoom and enhance

$ identify enhance2x.avif
enhance2x.avif AVIF 2328x1120 2328x1120+0+0 8-bit sRGB 32448B 0.010u 0:00.000
$ stat -c %s enhance2x.avif 
32448
$

zoom and enhance

$ identify enhance4x.avif 
enhance4x.avif AVIF 4656x2232 4656x2232+0+0 8-bit sRGB 50758B 0.000u 0:00.000
$ stat -c %s enhance4x.avif
50758
$

Okay, that last one took 17 minutes to upscale on my GPU, so I'm not going further. But I'm using SD Ultimate Upscale, which is tile-based, so in theory that could be farmed out over a collection of GPUs and parallelized. Just need more compute hardware.

But as to filesize, that's under 50kiB.

[–] Zen_Shinobi@lemmy.world 2 points 4 hours ago

Whoah! Nice effort! Yeah a cluster could cut the time down a lot.

[–] naeap@sopuli.xyz 10 points 8 hours ago

https://token-burner.tech/

Burn your AI tokens and get promoted for using more AI!

I sadly don't find the GitHub repo with the bash script anymore, but that thing seems to do the same thing
(Maybe I've misread though, I'm just going to sleep)

Edit: ha! Found it!
https://github.com/dtnewman/burn-baby-burn

[–] rozodru@piefed.world 7 points 9 hours ago

have it end to end build a fully featured web browser that works on Windows, MacOS, and Linux from scratch.

[–] zeppo@lemmy.world 3 points 9 hours ago (4 children)

Thus transferring their money to openAI, Anthropic etc? How does that help?

[–] Ilovethebomb@sh.itjust.works 14 points 9 hours ago

They actually lose money as well, because they're proving those tokens at below cost price.

[–] FartMaster69@lemmy.dbzer0.com 9 points 8 hours ago

It’s all going to Nvidia

[–] y0kai@anarchist.nexus 4 points 8 hours ago (1 children)

those companies arent profitable either and they have same problems in which it costs them more to run their products than they are currently charging people to use it.

[–] zeppo@lemmy.world 1 points 4 hours ago (1 children)

What do you mean by either? Walmart and Amazon make tens of billions in profit a year if not a quarter.

[–] y0kai@anarchist.nexus 2 points 2 hours ago

i thought we were talking about OpenAI, antrhropic, etc, not Walmart?

[–] DarkCloud@lemmy.world 4 points 9 hours ago* (last edited 8 hours ago)

More companies with less money is better than a few companies with all the money.

Ultimately distributed power has to be more democratic, and centralized power has to be more fascistic.

That's part of why governments having large distributed bureaucracies each with their own authority and independent ability to intervene is better than say; a single executive office/president controlling everything directly.

Distribution also leads to stability though (making it harder to challenge the status quo), so it's a double edged sword.