Commissioned Framing
Which question gets measured at all, determined by who was willing to pay for an answer, so a subject's evidence base takes the shape of its buyers rather than its importance.
Reviewed July 16, 2026Stable
When not to use it
- Where publicly funded or independent research covers the question adequately, which removes the gap the concept describes.
- As a reason to dismiss commissioned work, since it is frequently the only measurement of anything and the alternative is silence.
- Where several buyers with opposing interests fund the same question, which produces a contested but reasonably complete literature.
Reach for something else instead
- State the missing question — the cheapest available correction, and the one a reader can perform alone.
- Mandated underlying disclosure — publishing the quantities beneath a headline so outside parties can answer questions nobody commissioned.
- -
Read more on the blog
- Nine subjects, and the model was almost never the blockerTerritory 10 closes. Across nine enterprise deployment subjects the binding constraint was organisational in every one, the evidence was commissioned in almost all of them, and the reconciling study exists nowhere.
- The pilot failed and the staff deployed it anywayEnterprise AI is measured by what organisations sanctioned. A separate literature measures what their employees actually use, and the two describe the same companies without ever being set against each other.
- Twenty-four hours of silence is a billable resolutionCustomer service AI has moved from per-seat to per-resolution pricing. The corpus already established that deflection and resolution count different events, and now that distinction sets an invoice.
- 61% flagged for non-native writers, 3% for nativeThe tool that would answer how much text is machine-written does not work, and its errors concentrate on a specific group for a reason that is structural rather than fixable by tuning.
Further reading
- Liang et al. (2023), GPT detectors are biased against non-native English writers — an independent finding on a question the vendors measuring the same tools were not asking.
- Wong et al. (2021), External Validation of a Widely Implemented Proprietary Sepsis Prediction Model — a validation nobody was commercially motivated to run, performed independently.
Primary sources, listed so you can check the claims on this page rather than take them on trust.
Where people go wrong
- Averaging incompatible figures from different buyer types as though they measured one quantity.
- Treating the absence of a finding as evidence about the world rather than about funding.
- Discounting an interested source without asking what would replace it.
At a glance
FieldFoundations
Upstream of publication bias and selective transmission
Signalincompatible confident headlines, or an obvious unasked question
Defencename the missing measurement rather than discounting the funded one
DifficultyBeginner → Intermediate
Where this sits
A starting point. Nothing needs to come before it.
0Levelstarting point
0Needs firstnothing
0Opens upnothing further
1Areastays here
Computed from the prerequisite graph, not assigned. How this works