feat(bench): the report answers the question it was built to ask - #935
Draft
wenzowski wants to merge 1 commit into
Draft
feat(bench): the report answers the question it was built to ask#935wenzowski wants to merge 1 commit into
wenzowski wants to merge 1 commit into
Conversation
CLOUD-1606's last acceptance clause asks the final result to record whether the first-sighting/repeat behaviour should be RETAINED, and to name any successor needed for real harness epoch/residency management. The report carried the numbers and never answered it, and the row went to In Review anyway — my own work spared from a clause I would have held anyone else to. The answer is RETAIN, and it is derived rather than asserted: no measured strategy emits less on a repeat than the shipped one. `FirstFullThenCompact` is byte-identical to `Current` on all twelve arms and `FullEveryTime` is the control that costs more, so the split is already the cheapest of the three on the firing that recurs. `refusal_render_verdict` computes that from the records and would print REPLACE, naming the class, if some strategy ever beat it. DERIVED IS NOT A FLOURISH HERE. Two paragraphs of this report were hand-written claims about the measurement and both went false the moment CLOUD-1637 changed the renderer — the ceiling note and the zero-margin note. A retain/replace verdict beside a generated table is the same pairing, so it reads off the same records. The successor half is stated as an obligation rather than a wish: the saving is per REPEAT, `Cold`/`Warm` are inputs, and nothing here detects residency — so a successor must own an explicit epoch authority (`DecisionRecord.config_epoch` is a configuration hash, not a session one) and inherits CLOUD-1386's split, where the ceiling binds the repeat and the headroom is on the sighting side alone. Refs: CLOUD-1606, CLOUD-1386, CLOUD-417, CLOUD-1117
|
Warning Review limit reachedNext included review available in 26 minutes. View limit detailsLimit details: You’ve used the included review currently available. You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository. Review configuration: ⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Advanced Run ID: 📒 Files selected for processing (2)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes CLOUD-1606
CLOUD-1606's last acceptance clause asks the final result to record whether the first-sighting/repeat behaviour should be retained, and to name any successor needed for real harness epoch/residency management. PR #904 landed the benchmark with the numbers and never answered it. This is that answer.
RETAIN, and derived rather than asserted: no measured strategy emits less on a repeat than the shipped one.
FirstFullThenCompactis byte-identical toCurrenton all twelve arms, andFullEveryTime— the control — is the one that costs more.refusal_render_verdictcomputes that from the records and would print REPLACE, naming the class, if a strategy ever beat it.That derivation is not a flourish. Two paragraphs of this report were hand-written claims about the measurement and both went false the moment CLOUD-1637 changed the renderer — the ceiling note and the zero-margin note. A retain/replace verdict sitting beside a generated table is the same pairing, so it reads off the same records and is covered by the same drift check.
The successor half is stated as an obligation: the saving is per repeat,
Cold/Warmare inputs, and nothing here detects residency — so a successor must own an explicit epoch authority (DecisionRecord.config_epochis a configuration hash, not a session one) and inherits CLOUD-1386's split, where the ceiling binds the repeat and the headroom is on the sighting side alone.🤖 Generated with Claude Code
https://claude.ai/code/session_01Ajfos2de2W3zSRywHSvn27
Generated by Claude Code