Recorded run · full evaluation
Curated marketing demo using simulated semantic editorial labels; not a representative benchmark or real newsroom votes.
Where the labels came from: Labels are simulated: two independent blind passes under a written policy; stories where the passes disagreed were left out. Labels are simulated. Original labels came from a single labeling model run under a written rubric; an offline audit found it over-published against that rubric. These v3 labels come from two independent blind relabeling passes under an explicit written policy; only stories where both passes agreed are included.
Editorial rubric: Publish articles with a meaningful constructive or public-benefit outcome; reject harm-dominant or routine items.
Model costs: list prices, USD per million tokens, applied to the provider-reported usage on every recorded call. Optimizer price (gpt-6-luna): LiteLLM model price table (standard tier), read 2026-10-11.
Source: malteos/wikinews at b4c2ec3857fcac203c40b8d61586e934ed07c128; CC BY 2.5 (Wikinews policy; articles dated through 2024-12-15). License details.
One correction can improve the next tested decision.
Cycle 280 of 280 · 280 revealed · recorded agreement
A standalone model repeats its answer. cyclotron records the correction, tests guidance and configuration changes, then uses only accepted evidence to align later decisions.
This recorded decision
SpaceX successfully launches its first crewed spaceflight
Model: publish · 95%
Reviewer: publish
SpaceX launched NASA astronauts Hurley and Behnken on Crew Dragon, the first private company to send astronauts to orbit and the first US crewed launch since the shuttle.
Recorded feedback policy: All. Realized feedback is shown in the playback.
Recorded editorial run · Run
Prediction, before the label
publish · 95% confidence
Reviewer label
publish · prediction matched
What the revealed feedback says so far
Accuracy is the share of decisions that matched revealed labels. Precision asks how often a “publish” call was right; recall asks how many actual “publish” stories were found. These are running totals, not future results.
Simulated reviewer replay
Visual replay only — clicking these controls never changes the recorded run.
Recorded agreement
Recorded simulated reviewer explanation, replayed after the prediction. Ground-truth source evidence remains separate from optimizer feedback. The run records 280 explanations; the last optimizer proposal came at cycle 202, and the explanations after it were recorded but followed by no optimizer request. Only recorded correction events appear below.
Curated public source
Wikinews reports: SpaceX successfully launches its first crewed spaceflight. The original linked article provides the complete reporting context.
Brief adapted and shortened for this demo; see the original Wikinews article for the complete work. Read original · CC BY 2.5 (Wikinews policy; articles dated through 2024-12-15).
What happened after the label
No optimization was due. cyclotron recorded the prediction and the label.
Recorded reliability
Observed accuracy versus the logged pre-review confidence, using only 280 revealed labels. Hidden labels are not used.
Recorded rolling metrics at this cycle: Brier 0.128 · ECE 0.044.
Matched evaluator-only windows
First 70 vs last 70 items, each scored against frozen simulated reference labels, evaluator-only; never learner feedback.
Accuracy 44% → 96% (rejecting everything would score 84% → 84%) · Brier 0.658 → 0.090 · ECE 0.269 → 0.036.
This permits equal-window comparison across modes; it was not learner-visible feedback.