Do they use much electricity/processing power when they are idle, or only really when they’re being queried?
this post was submitted on 16 Jun 2025
151 points (96.3% liked)
Memes
10774 readers
1076 users here now
Post memes here.
A meme is an idea, behavior, or style that spreads by means of imitation from person to person within a culture and often carries symbolic meaning representing a particular phenomenon or theme.
An Internet meme or meme, is a cultural item that is spread via the Internet, often through social media platforms. The name is by the concept of memes proposed by Richard Dawkins in 1972. Internet memes can take various forms, such as images, videos, GIFs, and various other viral sensations.
- Wait at least 2 months before reposting
- No explicitly political content (about political figures, political events, elections and so on), !politicalmemes@lemmy.ca can be better place for that
- Use NSFW marking accordingly
Laittakaa meemejä tänne.
- Odota ainakin 2 kuukautta ennen meemin postaamista uudelleen
- Ei selkeän poliittista sisältöä (poliitikoista, poliittisista tapahtumista, vaaleista jne) parempi paikka esim. !politicalmemes@lemmy.ca
- Merkitse K18-sisältö tarpeen mukaan
founded 2 years ago
MODERATORS
Only when they're being queried, when idle it consumes memory to keep them running to be ready to answer a query, but thats about it
Memory probably, but not processing power.
The electricity needed to store data in memory is relatively miniscule next to doing any sort of processing on it
you should just give it a thinking loop that runs 24/7 that just prompts it with "nothing is happening" over and over again. and give it memory of its responses along with a counter that counts how many times nothing has happened, so that it is fully aware that it is stuck in an endless loop of boredom.
Are we anywhere near being able to run this in a car? I want to hook it up to loads of stuff in my car and have a computer control it like Star Trek.
On a car without modification, likely not, at least not a decently good model. You could technically install a powerful enough computer in your car to run on it
Divert all the power from life support to the thrusters!
Car: turns off the AC while going uphill.
Engage engine cooling! Heat turns on full blast
But don’t blast me with hot air!
I’m sorry! As a large-language model, I have no capabilities to blast hot air at you. Would you like to talk about something else?
sure, you can run them on a phone, a laptop even a raspberry pi. depending on what size and speed you want of course
Played around with a tiny 1.5b deepseek model, it was thinking for a loooong while before finally answering my question.
By then it had completely forgotten what the original question was and had instead hallucinated a new question which it then gave me an answer for
I give it a perfect 7/10
yeah I wouldn't bother with anything below 4-7b for this exact reason.
So how do you go about training a local ai?
boomer: "You can turn it into an ai girlfriend just by getting it to nag you to do stuff"