Technology

The researchers trained a trillion-parameter model using zero reinforcement learning to see how reasoning capabilities emerge at a massive scale without relying on human-annotated data. They found that pushing the parameter count to a trillion drastically improves both sample efficiency and the overall performance ceiling when compared to a smaller 104-billion parameter baseline strongly validating the concept that raw scale and computation eventually outpace hand-crafted human heuristics.

They also discovered that the training process reliably unfolds in two distinct sequential stages. The model starts with a discovery phase where it actively expands its reasoning boundaries by unlocking dormant pathways, and then it moves into a sharpening phase where it refines its policy within those established limits. Notably, the model spontaneously developed advanced cognitive strategies entirely on its own.

It began using structured formatting, parallel reasoning, self-verification, context anxiety, and even anthropomorphic expressions of frustration during complex tasks without any explicit human prompting. To keep the training stable at such a massive scale, the team relied on simple optimization techniques like clipped importance sampling and mixed-precision control. They also created a new evaluation framework to judge the actual quality of the reasoning steps based on comprehensibility, reproducibility, and token efficiency instead of just looking at the final answer.