"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
I just don't understand how this is a metric now. With programmers, I can at least see how someone who doesn't know any better might think lines of code is a good metric. But this?
And it gets worse: The company now has to pay both for its employees(' brain) and the damn text-completion machine.
> Company sets token usage as performance metric
> I build an "agent" that uses browser automation to navigate company's entire website and verify it for correctness on every code change
> Set it to use top model on highest effort
> Rack up thousands of dollars of usage daily
> Suddenly we all have tokens caps and it's no longer tracked as a performance metric