In case anyone else is wondering, there's pretty modern Amiga machines available, which could run GPT-4 offline at some speed, and the biggest Commodore Amiga (the plain A4000, I can't find more than connector information for the T variant) had 120MB of disk space, which corresponds to something like the smallest Cerebras GPT.