Reference · Quality · Total Cost · Reuse Economics
How Compression and Brute Force Must Be Measured
A credible comparison must measure more than tokens, speed, output length, cache hits, retrieval success, or the existence of a working endpoint. It must first determine whether the governing reference can define a valid target, then determine whether competing strategies satisfy the same declared task-quality requirements, and only then compare their complete costs.
Under MRD v2.0, predicted compression advantages remain bounded empirical questions. Fewer tokens, a shorter reasoning trace, successful retrieval, successful payment, or a functioning reusable state does not independently establish greater intelligence, lower total cost, or lower environmental impact.
The central economic question is therefore:
after a valid governed state exists and both compared paths satisfy the same Quality Gate, does governed reuse create a measurable total-cost advantage over reconstructing that state again?
Measurement Order
Reference First
→ Quality Second
→ Economics Third
Metrology for Meaning™
Measurement Begins Before the Model Call
A reuse experiment cannot validly compare compression and recomputation until the governing evidence can define what both paths are supposed to reproduce, retrieve, or preserve.
Metrology for Meaning™
supplies that upstream reference architecture. Its purpose is not to replace the economic experiment, but to determine whether the economic experiment is valid to begin.
No valid target → no valid quality comparison → no valid Compression Dividend
Freeze the Reference and the Evaluation Before Testing
Lock 1
Reference Lock
Freeze the authority package, source versions, identity rules, selectors, normalization rules, equivalence rules, binding requirements, target-construction procedure, and correction policy.
Lock 2
Evaluation Lock
Freeze the prediction, baseline, treatment, model and system versions, inputs, Quality Gate, metrics, exclusions, cost boundary, uncertainty treatment, and result-classification rules.
Gate 1 · Before Target Construction
The Reference Gate
The Reference Gate asks whether governing evidence can define a sufficiently coherent state from which the comparison target may validly be constructed.
Availability
Are required sources available?
Selection
Can the required authority be selected unambiguously?
Completeness
Are all required values present?
Coherence
Do governing surfaces agree under the declared rules?
Binding
Do required relationships bind successfully?
Governed State
Can target construction now proceed?
Study 008 · Authority-Layer Result
A Valid Measurement Framework Must Permit the Economic Experiment Not to Begin
Study 008 captured all 14 required public sources, resolved all 11 selectors, extracted all 63 governed values, recorded all 63 provenance records and all 8 rights values, and found zero source-availability and zero selection-ambiguity problems.
The audit nevertheless recorded 9 of 10 required relationships and 16 of 17 cross-source checks because one required binding failed under the frozen Study 008 policy.
AUTHORITY_BINDING_CENSORED_BEFORE_TARGET_CONSTRUCTION
No hidden target was constructed. No model-visible input was released. No P1 observation, P2 cache probe, P3 retrieval, x402 payment, Quality Gate comparison, or economic measurement occurred. This was an authority-layer stop—not a positive, negative, or inconclusive Study 008 Compression Dividend result.
Measurement Definition Layer
Measuring the Compression Dividend
The companion page
Measuring the Compression Dividend
defines the operational quantities needed to move this comparison from architecture into formal measurement.
It treats compression-versus-recomputation as a governed matched-reuse experiment. Economic interpretation begins only after the Reference Gate produces a valid target and the compared paths satisfy the same declared Quality Gate.
Net Reuse Benefit
Does avoided recomputation exceed the complete governed cost required to make reuse valid?
Reuse Break-Even
How many accepted reuse events are required before cumulative savings recover cumulative reuse-system costs?
Compression Dividend
After break-even, does repeated valid reuse continue to create a positive cumulative advantage?
Knowledge Yield / Compute
How productively does computational work produce reliable, persistent, reusable task-relevant knowledge?
Open the Measurement Architecture →
The Central Matched Test
For a bounded task whose governing state has passed the Reference Gate and whose target has been constructed under the preregistered rules, compare two conditions while holding the target, model or system versions, permissions, inputs, Quality Gate, and relevant operating conditions constant.
Condition A · Baseline
Matched Recomputation
Reconstruct the required result from the permitted model-visible source material without access to the reusable resolved state being evaluated.
valid target → reconstruct → verify → Quality Gate → accepted result
Condition B · Treatment
Governed Reuse
Resolve the reusable state, validate its identity, provenance, governing reference, version, scope, rights, applicability, freshness, and challenge status, then retrieve and reuse it.
valid target → resolve → verify state → reuse → Quality Gate → accepted result
Gate 2 · Required Before Economics
Both Conditions Must Pass the Same Quality Gate
A lower-cost result is not an efficiency improvement if it is less accurate, incomplete, stale, unsafe, poorly sourced, unreliable, outside scope, or otherwise fails the declared task.
Economic comparison therefore applies only to paths that satisfy the same preregistered acceptance requirements.
What Must Be Measured
Reference Work
Authority acquisition, source capture, identity resolution, selectors, cross-source checks, version resolution, binding validation, rights checks, target construction, and reference maintenance.
Task Quality
Accuracy, completeness, usefulness, factuality, provenance, calibration, safety, scope compliance, and task-specific acceptance.
Compute
Operations, accelerator time, processor time, model calls, tool execution, retries, sampling, and repeated inference.
Memory & Storage
Persistent storage, cache, indexing, working memory, retrieval structures, state creation, retention, and version history.
Retrieval
Lookup operations, query cost, retrieved context, routing, networking, serialization, permissions, and failed retrievals.
Verification
Source checks, state checks, freshness, reference coherence, evaluator calls, provenance validation, challenge review, and human review.
Maintenance & Recovery
Updating, invalidation, versioning, correction, rebinding, synchronization, rollback, repair, retirement, and propagation of corrections.
Latency
Reference resolution time, time to first output, retrieval delay, verification time, correction time, and end-to-end accepted completion.
Reuse Economics
Avoided recomputation, governed reuse cost, Net Reuse Benefit, break-even, cumulative reuse cost, and Compression Dividend.
Operational Accounting Template
Net Reuse Benefit =
Avoided Recomputation
− Reference Work
− Preservation
− Retrieval
− Verification
− Maintenance
− Recovery
This is an operational accounting structure, not a universal physical or economic equation. Each study must preregister its units, allocation method, time period, exclusions, uncertainty, amortization rules, and complete system boundary.
Reference Work Has a Cost — and May Be Reused Too
Authority acquisition, reference resolution, identity checks, provenance capture, relationship binding, rights verification, and governed-state construction are real system costs. They should not disappear from the accounting simply because they occur before inference.
Where validated reference work legitimately supports multiple accepted reuse events, a preregistered evaluation may amortize that cost across the applicable reuse horizon. The allocation method must be declared rather than chosen after the result is known.
Governed Reuse May Need Time to Break Even
Compression-oriented architecture may require initial investment in discovery, reference resolution, representation, validation, storage, indexing, governance, and maintenance. A single reuse event may therefore be cheaper than recomputation while the full architecture has not yet produced a cumulative advantage.
Cumulative Avoided Recomputation ≥ Cumulative Governed Reuse-System Cost
The earliest preregistered point at which that condition is satisfied is the proposed Reuse Break-Even Point. Some reusable states may never reach it.
Keep the Result in the Correct Layer
Layer 1
Authority / Reference
Determines whether a governed target can validly be constructed. A stop here says nothing about model quality or economics.
Layer 2
Model / Quality
Determines whether the evaluated path satisfies the valid target and preregistered task-quality requirements.
Layer 3
Economic
Applies only after valid reference and quality-equivalent comparison permit full-system cost interpretation.
How an Economic Comparison Should Be Interpreted
Positive Compression Dividend
Valid reference and required quality are satisfied, and governed reuse produces lower total measured cost than the matched recomputation baseline.
No Measured Dividend
Reference and quality requirements are satisfied, but governed reuse and recomputation have approximately equal total measured cost.
Negative Compression Dividend
Reference and quality requirements are satisfied, but retrieval, verification, maintenance, reference work, or recovery make governed reuse more costly than recomputation.
Inconclusive Economic Result
The economic stage was reached, but measurement is incomplete, uncertainty is too large, or cost outcomes cannot be resolved reliably.
Authority Censorship Is Not an Economic Result
If the Reference Gate stops the study before target construction, the correct result is the registered authority-layer outcome. It must not be relabeled as a negative Compression Dividend, model failure, quality failure, or inconclusive economic result.
Existing Economic Evidence Anchor
Study 003 Remains the Last Accepted Economic Comparison
Under Study 003’s tested conditions, the accepted quality-equivalent P2 path cost was $0.00111572, while the tested P3 path cost was $0.25.
That study therefore recorded a negative incremental Compression Dividend at the tested P3 price. Study 008 does not replace or reverse that result because Study 008 never reached the economic stage.
A Valid Framework Must Allow Recomputation to Win
Compression should not be declared superior when the task is genuinely novel, the stored state is stale or misbound, verification becomes too expensive, retrieval is unreliable, reuse is too rare, reference maintenance dominates, recovery overwhelms savings, or required quality cannot be maintained.
In those conditions, selective recomputation, broader search, independent redundancy, new evidence, or fresh target construction may be the more efficient and responsible strategy.
Avoided Computation Is Not a Dividend if the Work Merely Moves Elsewhere
A reuse path may reduce model inference while increasing reference resolution, storage, retrieval, verification, human review, synchronization, correction, or recovery.
The economic comparison must therefore measure the complete accepted-task boundary rather than treating avoided model calls as automatically equivalent to net savings.
Computational Savings Are Not Automatically Physical Savings
Fewer tokens do not directly establish fewer operations. Lower measured compute does not automatically establish lower facility electricity. Lower electricity does not automatically establish lower emissions, water use, or lifecycle impact.
Physical claims require separate telemetry and attribution boundaries. Environmental accounting belongs downstream of the validated computational and economic comparison rather than being inferred from it.
Minimum Reproducibility Record
A formal comparison should preserve enough information for another evaluator to understand how far the experiment progressed and reproduce the stages that were actually reached.
- Registered prediction
- Authority package and versions
- Reference Contract
- Reference Gate result
- Target-construction procedure
- Target or censorship record
- Task and fixture version
- Model and system version
- Reusable-state version
- Baseline definition
- Reuse intervention
- Quality Gate
- Metric definitions and units
- Reference and cost boundary
- Sample size and repetitions
- Uncertainty treatment
- Deepest valid stage reached
- Authority stops, negative and inconclusive results
From Authority to Economic Evidence
Canonical Authority
→ Reference Lock
→ Reference Gate
→ Governed Target
→ Evaluation Lock
→ Matched Test
→ Quality Gate
→ Full-System Cost
→ Net Reuse Benefit
→ Break-Even
→ Compression Dividend
→ Versioned Result
→ Evidence-State Review
Four Layers, Four Different Jobs
What Defines the State?
Metrology for Meaning™
Defines the upstream reference problem, reference coherence, and authority boundary.
What to Measure
Measuring the Compression Dividend
Defines Net Reuse Benefit, break-even, Compression Dividend, Quality Gate logic, and cost boundaries.
How to Test
Lab Evaluation Protocol
Governs locks, preregistration, authority audit, baselines, metrics, gates, exclusions, failure rules, and reporting.
What Happened
Robbie’s Razor Benchmarks
Preserves versioned authority results, quality results, economic results, uncertainty, censorship, failure cases, and evidence review.
First establish that the state is valid.
Then establish that quality is preserved.
Only then ask whether reuse costs less than recomputation.