projectmoon

What are the benefits of EXL3 vs the more normal quantizations? I have 16gb of VRAM on an AMD card. Would I be able to benefit from this quant yet?

@onlinepersona@programming.dev https://earthly.dev/blog/shutting-down-earthfiles-cloud/

Tried one of the universal blue images on a Chromebook. It was nice. But it didn't contain the scripts/configs to make the audio work. So that was that!

I like the concept, though.

@szicari@programming.dev it should be noted that they're shutting down the open source project. However, a fork is apparently forming. But it's good to know.

@smokeydope@lemmy.world I was using it like a year and a half ago. With the web UI that looks like it's from 2008 lol. But I think at this point, I'd use it for the OpenAI compatible endpoint anyway.

Is the KoboldCPP UI a bit better these days? Or maybe it's best to hook it up as an OpenAI connection via OpenWebUI... I mostly use it with ollama.

@llama@lemmy.dbzer0.com Depends on the inference engine. Some of them will try to load the model until it blows up and runs out of memory. Which can cause its own problems. But it won't overheat the phone, no. But if you DO use a model that the phone can run, like any intense computation, it can cause the phone to heat up. Best not run a long inference prompt while the phone is in your pocket, I think.

If you have a wireless card (or don't need wireless) capable of working with Linux Libre, then by all means use it. There is no technological advantage to using Linux-Libre. There are principle advantages. I say this as someone who uses Linux-Libre on my Gentoo laptop (and maintains an overlay with an ebuild for Linux-Libre).

@saltarello@lemmy.world funnily enough, I switched from Linkwarden to Hoarder. I like the smart lists. Just bookmark everything, check it later.

@hendrik@palaver.p3x.de no. I use the app service one. It works well, but it's basically for bridging public channels. The Mautrix bridges all work very well. I've used the Facebook one in the past. It's just the limits those platforms put on the bridge (e.g. banning or locking account) that can be a problem. If your bridge is connecting from the same place as you normally connect to Discord from, you should be fine.

@hendrik@palaver.p3x.de which discord bridge? For Matrix? The one that operates as a Discord bot works perfectly. Don't know about the ones that want your login token.

@donuts@lemmy.world don't got any of those.

We just moved some months ago. Still gotta put things in the proper place. A pile of boxes in the shed isn't "organized." 🫠