Honestly, even if you believe transformer-based LLMs running on GPUs are the end-all, datacenters are still such a rapidly depreciating asset just with incremental improvements in processing technology. Add in the possibility of ASICs or a different computing substrate entirely, as you mentioned, and you're looking at these multi-billion dollar investments becoming obsolete in a few years.
Honestly, even if you believe transformer-based LLMs running on GPUs are the end-all, datacenters are still such a rapidly depreciating asset just with incremental improvements in processing technology. Add in the possibility of ASICs or a different computing substrate entirely, as you mentioned, and you're looking at these multi-billion dollar investments becoming obsolete in a few years.
Exactly, the whole build out is a phenomenally short sighted venture.