30
Llama-2, GPT-4, or Claude-2; Which Artificial Intelligence Language Model Is The Best?
(www.marktechpost.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 23 Jul 2023
30 points (94.1% liked)
Technology
59066 readers
4390 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
Llama-2 because you can run it on your own hardware. For the big GPU on a rented instance: Falcon 70b. OpenAI and Google can have turns playing proprietary asshat jack in the box.
How expensive would it be to run on a rented server?
For the bigger ones you could do it under $.50 / hr. I run llama 2 13b-8 bit on my 3090 no problem, which can be rented for $.20/hr.
https://vast.ai/#pricing
Some of the lower pricing I've seen.
How do you get into doing this? Like, are you a data scientist? AI Engineer? Hobbyist?
I want to be able to use tools like this, and I want a formal education in it, but I'm not sure what path to take. (I don't necessarily want a career in it...my current career is pretty fantastic, but I think understanding tools like this is extremely important in understanding the modern world. That's my main motivation.)
I'm a software engineer by trade, but a hobbyist when it comes to LLMs.
https://github.com/AUTOMATIC1111
This is a good place to start. Loads of YouTubers with setup videos. I like this guy https://youtube.com/@Aitrepreneur he covers LLM and Image generation too.
Hugging face is a good place to get the actual LLM.
Unless it's changed recently, I don't think automatic1111 deals with LLMs. It uses stable diffusion based technologies for text-to-image, image-to-image etc. But yes, it's a good entry point for dinking around with ai/machine learning
You're right, I'm on mobile driving home.
I meant this one: https://github.com/oobabooga/text-generation-webui
And this YouTube video specifically for setup:
https://youtu.be/lb_lC4XFedU