Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Amendment 2 to the noise-draw pre-reg: read 4 — the energy score

2026-08-05 ~22:5xZ. Amends Amendment 1 by ADDING a fourth read. Posted before any per-draw number exists (the draws-10 probe has not run; no --dump-draws npz has been opened). Reads 1–3 are unchanged.

Why

Amendment 1’s honest-limits section said the comm holdout would need “a distributional column (best-of-N or an energy-distance-style score)” if the unfair-penalty signature confirms. The standing literature slice (this session) surfaced Energy Policy (arXiv 2510.12483), which trains manipulation policies directly on the energy score — a strictly proper scoring rule for distributions. We don’t need the training objective; we need the metric, and it is computable on CPU from the exact --dump-draws npz the probe already produces. Read 2 (best-of-N) is an oracle bound — it forgives all dispersion. The energy score is the principled middle: it rewards committing to valid modes and penalizes spread, so neither mode-averaging (AR-style) nor scatter wins for free. Declaring it now, before data, keeps it a read rather than a post-hoc rescue.

Read 4 (definition frozen)

Per frame, over the same valid-element mask as reads 1–3, with = draw ’s chunk restricted to valid elements (), = truth, = valid-element count, and (RMS-normalized so frames of different valid counts are comparable; positive scaling preserves propriety):

  • Pooled across frames weighted by (matching the report’s valid-element pooling convention).
  • AR baseline: the banked AR-100k npz is deterministic (N=1) — the same formula degenerates to with a zero interaction term. Computed on the identical probe frames via the same index-join and row-agreement asserts as reads 1–3.
  • Also reported: the flow single-draw ES (each draw scored alone, averaged) — the gap between it and the 10-draw ES is the value of modeling the distribution vs sampling from it once.

Pre-declared interpretation

  • Flow ES ≤ AR ES while flow single-draw MAE > AR MAE: quantified evidence that the MAE deficit is (at least partly) a scoring-rule artifact — and ES becomes the candidate distributional column for ranking flow arms on the comm holdout (feeding the limit-attribution front, per Amendment 1’s honest-limits note).
  • Flow ES > AR ES too: flow loses even under a mode-fair proper score — the modeling-deficit read strengthens and the AR-recipe weighting of the attribution screens stands.
  • ES is quoted with the same effect-size discipline as reads 1–3; no decision rides on ES alone tonight (it is one column of the results post, not a gate).

Implementation: a read4_energy_score addition to fontaine/scripts/draws_fairness.py, to be landed with a degenerate draws=1 validation (interaction term exactly zero; ES equals the RMS-normalized L2 of the banked predictions) before the probe npz is opened.