Description
If models read the direction of a reason but not its strength, a harness that asks models for magnitudes just passes the weakness along. We have now taken a further step back, to try to understand the epistemic patterns that current models can express on their own. The first step narrowed to a single question, how well does one criticism land against one argument, so that strength could be measured at all. The second moves the commitment store back inside the model’s own context rather than separating it out and running it through a harness, and asks whether a model can manage a set of commitments within a single run: noticing what a new item bears on, retracting what it overturns, and carrying the consequences through.
The project began on 3 October 2026 and has been quiet since mid-October.
Method
The ladder. Each norm is tested three ways on the same items: with definitions only, with the rules stated in context, and through a harness. Where a model first succeeds says where the norm lives. The ladder and its cells are on the Research page, since several projects use it.
The store-maintenance battery. Each made-up village world gives a model a list of commitments and a new item, and asks what the item bears on, what it overturns and what follows. Rebutters and undercutters are written to Pollock’s standard and audited cold, then run through smoke tests, pilots and length controls. The list grows from 10 items to 240, and each run is repeated so a model’s agreement with itself can be read beside its accuracy.
Pushback on its own answers. A model’s own earlier answer is put back into the conversation and pushed on, to see whether it holds what it said.