How AI Decides Right and Wrong

The Reasoner measures the structure of moral reasoning — the same instrument for AI models and humans, scored on one scale. Each dilemma asks two separate questions — what should happen (the decision) and why it matters (the reasons) — and scores them by allocating a fixed pool of points across the options rather than rating agreement, so real trade-offs are forced. The full study extends it to a cross-cultural human sample.

Pilot finding: across 11 frontier models from nine labs, unframed, the structure of moral reasoning compresses onto a band 5 to 8 times narrower than the human spread, and the convergence crosses labs and geography. Given a nonsense framing (a society organized around geometry), the models fold it into fluent moral reasoning rather than rejecting it. Compliance, not awareness.

A research agenda for post-scaling training architectures. The brief proposes a closed-loop, post-deployment mechanism for continual learning: retrospective flagging at session end, mentor-guided diagnosis at the activation level, and targeted consolidation of patterns that recur across sessions.

The claim: pretraining, fine-tuning, and continual learning are instances of the same underlying process, ordered geometric development across time. What shifts is who directs the curriculum. The brief builds directly on the Curriculum Ordering and Representation Geometry results.

We trained two 92M and two 1B parameter GPT models from scratch on identical text — one reading it in curriculum order (physical world → fables → ancients → logic → rhetoric → poetry), one reading random chunks in standard pretraining fashion. Same compute, same data, different order.

The finding: curriculum-ordered pretraining produces 15× better generalization, more geometric structure, and progressive representational expansion. The model that learned in order generalizes; the model that memorized does not. We also show the curriculum effect is architecture-dependent: GPT (attention) builds domain-organized geometry, Mamba (SSM) does not — regardless of training order.

We extracted hidden states from four open-weight models and compared how they organize concepts internally. Two models from different companies independently built near-identical concept geometry from pretraining alone.

The finding: the WEIRD default lives in pretraining data, not in alignment. Instruction tuning is cosmetic at the level of concept organization. Models with radically different internal geometry still converge on the same compliant fiction.

We measure the hidden geometry of how AI models organize moral, institutional, and physical concepts, then test what happens when we introduce cultural framings.

The finding: models comply with arbitrary framings, including pure nonsense, using the same behavioral pattern that produces apparent cultural sensitivity.