This is the stuff that makes me really excited for AI. Sure, having a personal assistant is nice. Generating images and music is also very cool. Optimizing software and hardware though, this is where things get amazing.

Modern software is pretty abysmal when you think about it. In the last 20 years we've focused more on making things faster rather than making more optimized things. We ended up with ultra bloated operating systems, regularly 100mb+ apps, RAM sucking programs like web browsers and background apps that make even 8 gigabytes of RAM not enough, and so on.

I'm waiting for a point where AI can start optimizing legacy code and say "Wait, this is really dumb and wastes so much energy". Imagine Windows running on only 100mb of ram. Imagine apps and websites being 10x more efficient than they are now. It's not that crazy of a concept, only a matter of time.

This write up talks about sequences of 3 and 4 items… does their full paper generalize to variable sized lists?

That is 70% faster on sequences of five elements. Using this for handling the end of the recursion in LLVMs current std::sort implementation results in a 1.7% speedup on sequences exceeding 250k elements.