Home/Safety & Ethics/Constraint Over Classification
Safety & Ethics

Constraint Over Classification

Where a control must hold against a counterparty who adapts, bounding the conditions under which work is done outperforms detecting what was produced.

Reviewed July 17, 2026Stable
Reading level: Curious
Pick your depth ↓

When not to use it

  • Where the counterparty does not adapt, in which case a classifier against a static distribution is appropriate and cheaper.
  • Where no bounded condition exists that a legitimate case satisfies cheaply, which makes the constraint route a barrier rather than a filter.
  • Where the friction cost falls on the population the system exists to serve, and no staged or subsidised path is available.

Reach for something else instead

  • Staged trust — friction that falls as history accumulates, which preserves the control while reducing the newcomer cost.
  • Constraints free by construction — requirements a genuine case satisfies at zero marginal cost, which avoids the trade-off rather than managing it.

Further reading

  • Liang et al. (2023), GPT detectors are biased against non-native English writers — the directional failure of classification against a population rather than an adversary.
  • Stenberg (2026), The end of the curl bug-bounty — the constraint that worked after detection did not, and its cost structure.

Primary sources, listed so you can check the claims on this page rather than take them on trust.

Where people go wrong

  • Improving a detector's accuracy in response to evasion, which is the move the counterparty is optimising against.
  • Quoting a false positive rate without the base rate, which understates how many flags are wrong.
  • Treating friction as a failure of design rather than as the price of a control that does not degrade.

At a glance

FieldSafety & Ethics
Applies where the counterparty adapts
Constraint effectiveness is independent of the adversary
Detectors invert on base rate; constraints do not
Cost is friction rather than classification error
DifficultyBeginner → Intermediate
Flashcards for this concept · study, save or share them →
Question
Answer
1 / 4

Where this sits

A starting point. Nothing needs to come before it.

0Levelstarting point
0Needs firstnothing
0Opens upnothing further
1Areastays here

Computed from the prerequisite graph, not assigned. How this works