858
answer = sum(n) / len(n)
(lemmy.eco.br)
A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.
Rules
This is a science community. We use the Dawkins definition of meme.
Moore's law died a long time ago, and AI models aren't getting any more power efficient from what I can tell.
Then you haven't been paying attention. There's been huge strides in the field of small open language models which can do inference with low enough power consumption to run locally on a phone.
Yeah, and improvements will require paradigm changes. I don't see that from GPT.
GPT is not the end all be all of LLMs
Are there LLMs with different paradigms?
GPT is not a paradigm it's a specific model family developed by openAI. You're thinking of the transformers architecture. Check out a project like RWKV if you want to see a unique approach.