50
Has Generative AI Already Peaked? - Computerphile
(www.youtube.com)
Rumors, happenings, and innovations in the technology sphere. If it's technological news or discussion of technology, it probably belongs here.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
In 30 years, we’re going to look back at this headline like we look back at articles about the internet or smart phones being fads.
They are discussing a very specific approach and a paper that lays out the issues with pursuing this one specific type of generative AI. It's not about AI in general. The headline is a bit click-baity.
While the paper demonstrated strong diminishing returns in adding more data to modern neural networks in terms of image classifers, the video host is explaining how the same may effect apply to any nureal network based system with modern transformers.
While there are technically methods of generative AI that don’t use a neural network, they haven’t made much progress in recent decades and arn’t what most people mean when they hear or say generative AI, and as such I would say the title is accurate enough for a video meant for a general audience, though “Is there a fundamental limit to modern neural networks” might be more technically correct.