TechLich

I want to know what the 3 minutes of mind blowing entertainment on Mel Croucher's Computer Fun Line was.

Also "Thou mayest blame" and "Canst thou say"

Hurts my brain a little.

You could do this with logprobs. The language model itself has basically no real insight into its confidence but there's more that you can get out of the model besides just the text.

The problem is that those probabilities are really "how confident are you that this text should come next in this conversation" not "how confident are you that this text is true/accurate." It's a fundamental limitation at the moment I think.

I feel like this isn't quite true and is something I hear a lot of people say about ai. That it's good at following requirements and confirming and being a mechanical and logical robot because that's what computers are like and that's how it is in sci fi.

In reality, it seems like that's what they're worst at. They're great at seeing patterns and creating ideas but terrible at following instructions or staying on task. As soon as something is a bit bigger than they can track context for, they'll get "creative" and if they see a pattern that they can complete, they will, even if it's not correct. I've had copilot start writing poetry in my code because there was a string it could complete.

Get it to make a pretty looking static web page with fancy css where it gets to make all the decisions? It does it fast.

Give it an actual, specific programming task in a full sized application with multiple interconnected pieces and strict requirements? It confidently breaks most of the requirements, and spits out garbage. If it can't hold the entire thing in its context, or if there's a lot of strict rules to follow, it'll struggle and forget what it's doing or why. Like a particularly bad human programmer would.

This is why AI is automating art and music and writing and not more mundane/logical/engineering tasks. Great at being creative and balls at following instructions for more than a few steps.

Yeah, I think quite a lot of people on Lemmy have similar social media habits (or lack of) to some degree. We also tend to associate with other people like us. Especially people in tech tend to talk to other tech people, or friends and family of tech people which is a limited demographic.

It's a very different perspective to most people. The average person on the train has vastly different media consumption and likely very different opinions.

There are a lot of people who consult LLMs in most aspects of their lives.

Yeah, it's a shame because some of those OSM-based ones are really close to being perfect. It just seems like it's really difficult for the open source devs to reconcile OSM data with GTFS and timetables for some reason.

Often the "local app" is basically a proprietary wrapper around Google maps.

I dunno about that... Very small models (2-8B) sure but if you want more than a handful of tokens per second on a large model (R1 is 671B) you're looking at some very expensive hardware that also comes with a power bill.

Even a 20-70B model needs a big chunky new graphics card or something fancy like those new AMD AI max guys and a crapload of ram.

Granted you don't need a whole datacenter, but the price is far from zero.

Only one source of social media? That kinda sounds like the definition of a social media bubble...

I oughta know, I'm also in the Lemmy only bubble and am completely out of touch with most people.

I want to like this, but because there's no GTFS/public transport timetables, it makes it kinda impossible to use it to get around cities that publish their transport data.

PT is the one thing I'm still stuck on Google maps for. I REALLY want an open source alternative.

They also force you to pay a 99USD yearly fee just for the privilege of being a developer.

I feel like that would make them much harder to get running on different things. No compiled code means you would have to rewrite the whole game for different instruction sets. Very difficult for anything that isn't x86.

Agreed, but it's not the applicants' accounts that was compromised.

That's the password for the admin panel that lets you see every single application and all their conversations with the stupid hiring bot. An order of magnitude more silly.