I'm assuming that this would primarily be used on a headless system, but I'm curious if this would be feasible for use with a desktop environment as well.

If the performance isn't hit too bad and it's not too buggy, I could see myself potentially doing something like that on Silverblue or MicroOS. That way if my userspace ever becomes too cluttered or broken, I can just spin up a new container without completely reinstalling.