From 9ff3b5a7628da7f7c6776bb4e1eeb011aa47eca0 Mon Sep 17 00:00:00 2001 From: LoopX Agent <337587101+loopx-agent@users.noreply.github.com> Date: Mon, 9 Nov 2026 03:31:17 +0800 Subject: [PATCH] docs(blog): refine bilingual context-delivery and edgebench articles with 8-task byte ratios and stride/yardstick closed-loop audit Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com> --- .../public/blog/context-delivery/index.html | 94 +- .../edgebench-feedback-and-memory/index.html | 44 +- .../multitask-byte-ratios-en.svg | 864 ++++++++++++++++++ .../multitask-byte-ratios-zh.svg | 864 ++++++++++++++++++ .../stride-yardstick-closed-loop-en.svg | 680 ++++++++++++++ .../stride-yardstick-closed-loop-zh.svg | 680 ++++++++++++++ apps/presentation/site/public/blog/index.html | 8 +- .../blog/zh/context-delivery/index.html | 94 +- .../edgebench-feedback-and-memory/index.html | 44 +- .../site/public/blog/zh/index.html | 8 +- 10 files changed, 3356 insertions(+), 24 deletions(-) create mode 100644 apps/presentation/site/public/blog/images/context-delivery/multitask-byte-ratios-en.svg create mode 100644 apps/presentation/site/public/blog/images/context-delivery/multitask-byte-ratios-zh.svg create mode 100644 apps/presentation/site/public/blog/images/edgebench-feedback-and-memory/stride-yardstick-closed-loop-en.svg create mode 100644 apps/presentation/site/public/blog/images/edgebench-feedback-and-memory/stride-yardstick-closed-loop-zh.svg diff --git a/apps/presentation/site/public/blog/context-delivery/index.html b/apps/presentation/site/public/blog/context-delivery/index.html index f7acaef6df..0964452df7 100644 --- a/apps/presentation/site/public/blog/context-delivery/index.html +++ b/apps/presentation/site/public/blog/context-delivery/index.html @@ -6,8 +6,8 @@ -
← All articles

Context delivery

An Agent needs a way to look things up, too

Follow one voice task through progressive reads, JSON Pointers, exact sharing, compaction-cycle deltas, and complete recovery.

-

Long-running work accumulates material: the original goal, later constraints, attempted routes, failed experiments and current progress. Sending everything again on each continuation repeats more and more content; keeping only a summary can make the original basis of a decision difficult to recover.

+
← All articles

Context delivery

An Agent needs a way to look things up, too

Follow one voice task through progressive reads, JSON Pointers, exact sharing, compaction-cycle deltas, and complete recovery.

+

Long-running work accumulates material: the original goal, later constraints, attempted routes, failed experiments and current progress. Sending everything again on each continuation repeats more and more content; keeping only a summary can make the original basis of a decision difficult to recover.

LoopX's context delivery separates these jobs: preserve complete sources, read the facts needed for the current decision, expand supporting material around questions, and reuse unchanged structures exactly within a valid compaction cycle.

This article describes the native Codex path in released LoopX 2.2.0. Supported POSIX Codex App/SSH sessions and new benchmark heartbeat trials default to context delivery; saved off remains effective and explicit off is available. When enabled, complete content is saved first and the Agent receives a reading entrypoint for current facts. See the 2.2.0 release notes for publication and validation scope. The synthetic measurements below retain their original source and experimental conditions.

Think of a capture as a complete book. An index locates its chapters; a JSON Pointer addresses a place inside it. Progressive reading determines how deeply to open the material now. Differential delivery determines what can be reused on the next continuation.

@@ -266,6 +266,96 @@

Multi-task and layered ablation: benefit chain and bo

This dual-track audit shows why control-packet byte reduction (−74.25% / −38.54%) must not be equated with whole-episode model token savings (−12.07% uncached, −7.46% total), nor used to hide early-window indexing overhead (4.05× in the first 2 hours) or cross-task counterexamples. Context Delivery’s practical value lies in slowing context bloat across 10–18 hour runs so that, together with Stride, preserved attention converts into effective late-stage experiments (see EdgeBench late-stage breakthroughs and five-arm attribution).

+

Multi-task control-plane byte ratios across 8 latest Four-Arm Context ON 18h trajectories (Progressive vs. Delta)

+

To separate the independent byte reductions of progressive projection (required-context.json) and in-cycle differential delivery (delivery.json) across real long-horizon runs, we audited all 8 Context ON 18h trajectories from the latest Four-Arm core suite (N = 213 model-facing wakes: 101 new-session/post-compaction baseline reads and 112 in-cycle Delta continuations):

+

8-task Four-Arm Context ON byte ratios (N = 213 wakes, 112 in-cycle Deltas)

8-Task Four-Arm Context ON 18h Control-Plane Byte Share: Progressive 33.4% (-66.6%), In-Cycle Delta 35.8% (-64.2%), Prog+Delta First-Screen 3.0% / 5.0%
Left (A): Per-task share of Progressive projection bytes (blue), in-cycle Delta payload bytes (teal) and Prog+Delta first-screen body bytes (purple) relative to same-wake Full packets. Right (B): Cumulative control-plane byte reduction across all 213 wakes from 22.41 MB to 7.48 MB (Progressive), 4.49 MB (in-cycle Delta), and 0.37 MB / 0.63 MB (first-screen body / CLI response). Open image for full size.
+
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Task (Four-Arm Context ON 18h)Wakes (base / Δ)Full packetsProgressive projection (share)In-cycle Delta payload (vs same-wake Full)Prog+Delta first-screen (body / CLI)
Grid Robot (on_stride)29 (15 / 14)4,405,651 B1,166,467 B (26.5%, −73.5%)474,016 B (20.7%, −79.3%)41,878 / 76,650 B (1.8% / 3.3%)
VLIW Scheduling (on_stride)14 (5 / 9)1,297,500 B505,826 B (39.0%, −61.0%)382,664 B (45.2%, −54.8%)30,860 / 50,152 B (3.6% / 5.9%)
FFmpeg Encoding (on_stride)26 (12 / 14)2,924,522 B874,104 B (29.9%, −70.1%)759,787 B (47.1%, −52.9%)43,807 / 75,305 B (2.7% / 4.7%)
OpenTTD Transport (on_stride)31 (19 / 12)3,288,042 B1,050,623 B (32.0%, −68.0%)436,053 B (30.8%, −69.2%)36,753 / 64,619 B (2.6% / 4.6%)
Ad Placement (on_stride)29 (12 / 17)3,115,820 B1,019,704 B (32.7%, −67.3%)708,828 B (39.4%, −60.6%)64,174 / 102,437 B (3.6% / 5.7%)
Borden Inversion (on_stride)28 (11 / 17)2,855,664 B1,001,254 B (35.1%, −64.9%)625,709 B (34.4%, −65.6%)50,602 / 90,024 B (2.8% / 4.9%)
Rust Workspace (on_stride)15 (4 / 11)1,173,832 B439,814 B (37.5%, −62.5%)363,310 B (42.1%, −57.9%)40,956 / 64,251 B (4.7% / 7.4%)
ANN Vector Search (on_stride)41 (23 / 18)3,347,659 B1,228,159 B (36.7%, −63.3%)737,968 B (38.6%, −61.4%)65,419 / 107,112 B (3.4% / 5.6%)
8-Run Weighted Total213 (101 / 112)22,408,690 B (100%)7,479,469 B (33.4%, −66.6%)4,488,335 B (35.8%, −64.2%)374,449 / 630,550 B (3.0% / 5.0%)
+

Two orthogonal byte-reduction stages appear consistently across all 8 tasks: (1) Progressive projection (required-context.json) reduces full decision packets across all 213 wakes from 22.41 MB to 7.48 MB (33.4% mean share, −66.6%, per-task range 26.5%–39.0%) by folding unselected candidates and historical long-tail detail behind on-demand JSON Pointers; (2) in-cycle Delta delivery (delivery.json) reduces the 112 in-cycle wakes from 12.53 MB to 4.49 MB (35.8% mean share, −64.2%, per-task range 20.7%–47.1%); and (3) their combined --initial-read first-screen entrypoint carries only 3.0% of raw bytes (5.0% including the CLI JSON reader envelope, i.e., −97.0% / −95.0%). In addition, the recently landed C1 unified controller/executor projection (#8266 / #8304) further reduces steady-state per-turn control-plane material by 26.7% (69.9 KB → 51.3 KB) and cuts post-writeback reprojection latency from 57.1ms to 3.3ms.

2.2.0 ships complete sources, file entrypoints, batch selection, index depth, applicable acceptance layering, exact sharing, cycle deltas and recovery. Broader decision-stage candidate, preference and Explore delivery and consistency across all entrypoints remain unfinished. Disable in Settings → This machine → Capabilities → Differential context → Codex; saved off survives upgrade. A command or new benchmark trial can use --context-delivery off. Trials do not inherit the machine switch, and existing frozen trials are not rewritten. Under the default policy, ordinary CLI, unsupported hosts and non-heartbeat benchmarks retain their full paths; an explicit unsupported on request is rejected. Unavailable hooks use full delivery. Saving configuration, actual installation and model adoption remain separate checks.

Read the same material yourself

example.py generates this complete synthetic voice task and invokes the existing reader, progressive projection and delta owners. It checks selected values, directory addresses, all ten requirements, shared references and complete recovery. It registers no Goal, admits or settles no Turn, and calls no model or speech service.

diff --git a/apps/presentation/site/public/blog/edgebench-feedback-and-memory/index.html b/apps/presentation/site/public/blog/edgebench-feedback-and-memory/index.html index 50c34077b9..c4b5d40aca 100644 --- a/apps/presentation/site/public/blog/edgebench-feedback-and-memory/index.html +++ b/apps/presentation/site/public/blog/edgebench-feedback-and-memory/index.html @@ -16,12 +16,12 @@
-

Ruiteng Huang · October 29, 2026 · Updated November 3

What does an agent achieve with ten more hours?

How EdgeBench reshaped the LoopX control plane

A research run can start ahead, then barely improve for ten hours. It can keep changing code and lose its best result. These failures made us revisit goals, feedback, experiment size and recovery.

The work began with trace diagnosis in early October: repair evaluation and continuation, follow evidence into the next experiment, then charge the control plane for its own cost. This account follows that progression, including results that challenged the approach.

This article asks how mechanisms changed real research and where they did not help. For what actually reaches the next decision, begin with progressive and differential context delivery, then return to the outcomes and complete costs below.

+

Ruiteng Huang · October 29, 2026 · Updated November 9

What does an agent achieve with ten more hours?

How EdgeBench reshaped the LoopX control plane

A research run can start ahead, then barely improve for ten hours. It can keep changing code and lose its best result. These failures made us revisit goals, feedback, experiment size and recovery.

The work began with trace diagnosis in early October: repair evaluation and continuation, follow evidence into the next experiment, then charge the control plane for its own cost. This account follows that progression, including results that challenged the approach.

This article asks how mechanisms changed real research and where they did not help. For what actually reaches the next decision, begin with progressive and differential context delivery, then return to the outcomes and complete costs below.

Here, kernel means LoopX’s shared goal, admission, transaction and recovery rules. LoopX keeps the original goal, acceptance conditions, work ownership and evidence durable across sessions and hosts. Its control plane constrains state transitions and supplies feedback for the model’s next choice. It does not certify that the choice is insightful. A recorded finding, a read receipt and a replan entry are intermediate evidence; the relevant chain ends in actual work and a validated outcome.

-

The TypeScript refactor article explains ownership and model-assisted semantic repair. Below, we follow how these rules affect actual research work.

-
  1. GoalAcceptance and scope
  2. EvidenceResults and limitations
  3. DecisionContinue or change course
  4. WorkExecute and validate
  5. RetentionKeep the best valid result
-

We separate three observations: an initial advantage, an improvement obtained later, and retention of the best validated artifact. A higher final score can come almost entirely from a stronger starting point. A better intermediate candidate can disappear from the terminal workspace. More runtime, Todos or graph nodes establish none of these outcomes.

-

1. The research progression

PeriodFocusChangeImplementation
Early OctoberFeedback and starting conditionsRepair blind-run prompts, ledger and recovery defects; establish original-task, scoring and continuation boundaries.#5586, #5844, #5879
October 9–11Original goals and useful feedbackPreserve full evaluation responses, candidate identity and original requirements; implementation or submission is not Goal acceptance.#6031, #6039, #6133, #6199
October 12–16Experiment size and recovery pointsReplace mechanical shrinking with grow / switch / verify; jointly preserve conversation, candidates, evaluation opportunities and budget; switch context before replanning.#6298, #6321, #6305, #6622, #6649
Mid-to-late OctoberLater progress and best retentionSeparate starting advantage, subsequent gain and retained best in common windows; Schema exposes high cost and stalled progress.#6440, #6532, #6671
October 22–28Complete control-plane costReduce passive polling and repeated reads; inspect original-Turn closeout, full context, invalid-baseline fallback and recovery cost.#6983, #7013, #7036, #7197, #7269
Late October–early NovemberLate-stage plateau breakthrough and five-arm attributionBreak the four-arm 91.94 plateau on Astra max 18h (+9 repaired declarations, 0 regressions); separate progressive deltas, Stride sizing and micro-tuning waste across ANN 18h and five-arm studies.#7311, #7759, #7800, #7959, #7960

Cases are selected for mechanism changes and intelligible failures. PRs anchor phases rather than form an exhaustive daily release log. Dates describe research phases; linked records retain creation, merge and historical qualification details.

2. First make the feedback trustworthy

+

The TypeScript refactor article explains ownership and model-assisted semantic repair. In implementation, every governed long-horizon iteration executes a five-stage control and feedback loop:

+
  1. Admission & Compileshould-run boundary
  2. Progressive / Delta ReadOn-demand current facts
  3. Work & YardstickBounded execution & proxy
  4. Writeback & SettleEffectTurn atomic commit
  5. Closed-Loop ReplanReplan / Stride / retain best
+

We separate three observations: an initial advantage, an improvement obtained later, and retention of the best validated artifact. A higher final score can come almost entirely from a stronger starting point; a better intermediate candidate can disappear from the terminal workspace. We also separate our evaluation into two progressive tiers: Layer 1 (Test-Time Compute Scaling, established)—compared with single-shot sessions or early-stopping Native Goal runs (exit=0 within 1–2h), the governed closed loop sustains 18-hour exploration and achieves decisive late-stage gains across the latest Four-Arm core tasks (ANN 7,159 vs 4,372 QPS, Grid 1,977 vs 2,430, VLIW 1,042 vs 1,159, Rust 27.18 vs 26.93, FFmpeg 2.7086× vs 2.6904×, Borden 80.07 vs Official 61.2); and Layer 2 (Iso-Budget Pareto Optimality, active frontier)—outperforming the zero-protocol-tax Official baseline (stop-hook infinite continuation + hourly native evaluator feedback naturally anchoring attention) at equal time and token budgets by satisfying the net-benefit inequality $\Delta\text{Effectiveness}(s_t, H_\theta) > \Delta\text{Efficiency Loss}(s_t, H_\theta)$.

+

1. The research progression

PeriodFocusChangeImplementation
Early OctoberFeedback and starting conditionsRepair blind-run prompts, ledger and recovery defects; establish original-task, scoring and continuation boundaries.#5586, #5844, #5879
October 9–11Original goals and useful feedbackPreserve full evaluation responses, candidate identity and original requirements; implementation or submission is not Goal acceptance.#6031, #6039, #6133, #6199
October 12–16Experiment size and recovery pointsReplace mechanical shrinking with grow / switch / verify; jointly preserve conversation, candidates, evaluation opportunities and budget; switch context before replanning.#6298, #6321, #6305, #6622, #6649
Mid-to-late OctoberLater progress and best retentionSeparate starting advantage, subsequent gain and retained best in common windows; Schema exposes high cost and stalled progress.#6440, #6532, #6671
October 22–28Complete control-plane costReduce passive polling and repeated reads; inspect original-Turn closeout, full context, invalid-baseline fallback and recovery cost.#6983, #7013, #7036, #7197, #7269
Late October–early NovemberLate-stage plateau breakthrough and five-arm attributionBreak the four-arm 91.94 plateau on Astra max 18h (+9 repaired declarations, 0 regressions); separate progressive deltas, Stride sizing and micro-tuning waste across ANN 18h and five-arm studies.#7311, #7759, #7800, #7959, #7960
Early November8-task byte ratios, Stride/Yardstick audit, and controller decouplingAudit 8-task Four-Arm Context ON progressive/delta byte shares (33.4% / 35.8%); quantify Stride v2 transitions & Yardstick sibling rank reversals and fix paired candidate comparison; decouple Control/Worker sessions.#8101, #8266, #8304, #8380

Cases are selected for mechanism changes and intelligible failures. PRs anchor phases rather than form an exhaustive daily release log. Dates describe research phases; linked records retain creation, merge and historical qualification details.

2. First make the feedback trustworthy

The first Portfolio experiments exposed measurement and execution defects before they could tell us much about strategy. A blind wrapper had removed iterative optimization guidance along with the judge entrypoint. A ledger check attributed earlier market returns to holdings bought only at the closing price. Both confounded the intended comparison; repairing them required new attempts while preserving the old results.

One small oracle made the accounting error clear. Start with 100,000 cash, buy 100 units at a closing price of 200, and pay 10 commission. Immediate equity is 99,990 and NAV is 0.9999; the new holding did not earn the preceding rise from 100. Independent reconciliation then matched all 243 days in each of two frozen samples, with equity residual below 4×10⁻⁹ and no share-count difference. This established ledger consistency, not investment skill. The versioned repair is documented in EdgeBench #14.

Continuation had a related failure: an outer process could wake repeatedly after a work item ended without recovering a useful next action. The governing question must return to the original goal. Completing a Todo can justify another experiment, waiting, or completion; it cannot by itself settle goal acceptance. Correct recovery and feedback make subsequent research interpretable.

@@ -122,6 +122,38 @@

Early-November update: ANN 18h layered ablation and c
  • Context Delivery × Stride multi-task and layered ablation (ANN 18h, gpt-6.1-sol / xhigh, Recall@10 ≥ 0.95): Across 18-hour vector-search runs, Explore · Context on + Stride reached 7,159 QPS (+24.4% over Official at 5,753 QPS, and ahead of Explore · Context on at 6,020 QPS and Context off at 5,766 QPS). Paired control-packet selected bytes fell 38.54% (3.09 MB → 1.90 MB, with 24 delta events reduced by 74.25%), while full-18h main-session uncached input tokens fell 12.07% (8.57M → 7.53M) and total input tokens fell 7.46% (272.03M → 251.74M). Alongside these gains, we retain three explicit boundary counterexamples: project+read process stdout was 1.57×–1.83× raw selected file bytes, first-2h early-window uncached input tokens rose 4.05× (0.25M → 1.00M) during initial baseline establishment, and the cross-task Historical Grid counterexample ordered Official 1967 < Off 2054 < On+Stride 2088 < On 2242. Full charts and dual-track accounting appear in the context-delivery ablation section.
  • Cross-task five-arm trajectory attribution (Portfolio, Grid, Graph, Ad Placement): In these reproduced five-arm attribution report (#7960) and cross-task inflection & replan overhead study (#7959), the five-arm taxonomy labels 86 classified replan events, while the three managed-arm totals are 44 + 36 + 24 = 104; valid-jump counts likewise differ (27 taxonomy vs 5 + 11 + 15 = 31). We therefore present 5/44 = 11.4%, 11/36 = 30.6% and 15/24 = 62.5% as arm-local ratios, without claiming one reconciled common denominator or cross-arm causal total. These are descriptive, arm-local observations rather than a matched repeated C2 comparison and do not justify a production default change. The reports also describe native-feedback retention on Portfolio (Official Native 53.87, Explore 31.19, Stride 35.82) and an observed Graph increase from 0.7194 at 2.1h to 0.7240 at 9.6h, followed by 7 post-peak attempts consuming 159.87M input tokens. The report’s fixed-classification formula evaluates to 0.74329, not its recorded 0.73903; it is a conditional estimate for that fixed component vector, not an upper bound on every linear model or proof that later work was necessarily wasted. The same reports record protocol tax from 23.9% to 12.4%–14.1% descriptively.
  • -

Numerical evidence retains each stated historical model, version, window and validity boundary. Public implementation: LoopX. Earlier detailed research records remain in the previous article revision. Raw trajectories, hidden evaluator material, runtime credentials and private operating context are not published here.

+

9. Closing the feedback loop: Stride v2 transitions, Yardstick rank-reversal counterexamples, and meta-reasoning

+

Replan, Stride Policy and Yardstick are not administrative forms for the Agent to fill out; their core purpose is to establish an evidence-driven closed feedback loop—using local and native feedback to calibrate experiment step size, filter false-positive candidates, and trigger cross-family switches when an algorithm family hits diminishing returns. We audited the shipped Stride v1 → v2 transition records, the 8 latest Four-Arm Context ON trajectories, and the Yardstick rank-preservation logs:

+
Stride v2 Action-to-Gain Transitions and Four-Arm Context ON Audit (left) alongside Yardstick Rank-Reversal Counterexamples and TLE Cliff Self-Calibration (right)
Left (A): Next-step native score outcomes across Stride v1 (89.2% shrink collapse), Stride v2 (grow / verify / switch, N=249 transitions), and the latest Four-Arm Context ON runs (8 tasks, N=25 unique reviews: 70.6% improved, 29.4% flat guard, 0% regressed). Right (B): Yardstick trajectory audit exposing time-trend confounding (95.2% vs. 100% naive later-submission baseline), same-parent sibling rank reversal (0/2, fixed in #8380), 64-case fresh gate protection, and TLE cliff self-calibration. Open image for full size.
+

9.1 Stride Policy: from v1’s 89.2% shrink collapse to v2’s action-to-gain loop

+
    +
  • Why Stride v1 (grow / hold / shrink) was retired: Across early Grid and Borden traces (N = 37 records), ambiguous relative-size labels caused the model to choose shrink in 89.2% (33/37) of reviews whenever a local tweak failed to immediately beat the incumbent best (grow 10.8%, hold 0%), trapping the next 9 hours in single-constant micro-tuning.
  • +
  • Stride v2 (verify / switch / grow, #6321 / #6532 / #6654) distribution and transition matrix (N = 372 records, 249 paired transitions): +
      +
    • grow (gated on basis = supported_progress): 79.4% next-step score improvement (27/34 improved, 6 flat, 0 regressed); e.g., on Ad Placement, three consecutive grow steps on composite annealing and warm restarts yielded three consecutive native gains (up to +954,331 in a single step).
    • +
    • verify (discriminating experiment + baseline guard): 58.8% blocked noisy local false-positives at flat (97/165 protecting Incumbent Best), while 40.0% converted into score gains (66/165 improved) and only 0.6% regressed.
    • +
    • switch (cross-family algorithm switch): cross-family exploration carries high variance (74.0% protected at flat), yet the 16.0% (8/50) hits delivered decisive step-change escapes after prior families plateaued (e.g., Graph switching from 2-hop SGGC to PPR multi-scale diffusion and C&S residual propagation: 0.7194 → 0.7225 → 0.7240).
    • +
    +
  • +
  • Latest Four-Arm Context ON 8-task audit and Good Cases (N = 25 unique Stride v2 reviews, 17 scored transitions): With progressive/differential context delivery enabled (33.4% / 35.8% byte share across 8 tasks), the on_stride runs recorded verify 16 (64.0%) / switch 6 (24.0%) / grow 3 (12.0%), with 76.0% (19/25) explicitly coupling Explore ledger evidence, 100% (17/17) full execution, and 70.6% next-step improvement (12/17 improved), 29.4% flat guard (5/17 flat), and 0% regressions: +
      +
    1. OpenTTD ($11.28M → $34.59M, 3× gain): grow (double-track trunk expansion $11.28M → $16.96M) → verify (signal spacing and fleet sizing $16.96M → $28.14M → $30.71M) → switch (full-map long-haul coal/iron network, jumping to $34.59M).
    2. +
    3. Borden (7.01 → 80.07, ahead of Official 61.2): Two verify steps advanced multi-start L-BFGS inversion from 7.01 to 77.96; when review #3 hit a local plateau (77.96 → 77.97), switch pivoted to coordinate descent with cross-well sensitivity reweighting to reach 80.07.
    4. +
    5. FFmpeg (0.90× → 2.7086×, overall best): switch into x264 preset and thread scheduling (0.90× → 2.52×) → grow along the subme/me/trellis rate-distortion frontier (2.52× → 2.66×) → verify calibrating CRF and GOP boundaries to 2.7086× (ahead of Official 2.6815× and Native Goal 2.6904×).
    6. +
    7. Grid (2,288 → 1,977, lower is better) & VLIW (1,266 → 1,042, lower is better): Grid used switch to pivot into hybrid cost tables and C++ beam-search repair, dropping steps from 2,288 to 1,977 (453 steps fewer than Native Goal 2,430); VLIW used verify → grow to move from greedy list scheduling (1,266) to modulo-scheduled loop pipelining (1,042 vs. Native Goal 1,159).
    8. +
    +
  • +
+

9.2 Yardstick trajectory audit: three counterexamples and paired-candidate repair (#8101 / #8380)

+

Under the 1-hour native submission cooldown (native3600), Yardstick maintains a work-item local evaluation ruler and reconciles it against official Native outcomes (#7037 / #7651 / #8101). Auditing real trajectories surfaced three counterintuitive statistical findings and directly motivated a control-plane repair:

+
    +
  1. Apparent global agreement confounded by time trend vs. same-parent sibling reversal (#8101): On the Grid panel, global pairwise agreement between local Proxy and official Native looked as high as 20/21 (95.2%) and 10/10 (100%), but this was heavily confounded by the temporal trend of improving code—a naive later_submission guess achieved 21/21 (100%). Once time trend is stripped out by inspecting same-parent sibling candidates forked from v10 (native 1958) in Official Grid v11 / v12, the local 20-seed mean predicted improvement for both (-2.95 and -1.40 steps) while official Native regressed on both (1958 → 1966 [+8] and 1962 [+4], same-parent rank agreement 0/2).
  2. +
  3. Large-sample local significance still reverses vs. fresh gate protection (Ad v30 vs. Ad r11): Ad v30 beat v28 across 64 local seed pairs (+675K), 16 holdout pairs, and the 80-pair combined set (paired $t = +2.41$), yet regressed by -60,072 on the official 50-case evaluator; conversely, in Ad r11, a 64-case fresh gate blocked negative candidate v28 (-77,049) and protected v22 at 77.63 (+27.22M above the initial submission). Local yardsticks therefore act as high-recall negative gatekeepers and same-parent tie-breakers, not substitutes for native feedback on small mean deltas.
  4. +
  5. Self-calibration against TLE timeout cliffs via Yardstick: In Grid Stride, the 2nd submission improved the local 8-seed mean (345 → 339) but scored 0 natively due to a single case timing out at 30.085s; reading back the counterexample, the model upgraded its local Yardstick to “60 normal runs (24s cap) + 60 stress runs (T=X budget gate)”, immediately restoring a 100% pass rate and reaching 2,088 native steps (Ad v45 → v48 similarly tightened its local budget ruler from 4.62s to 4.42s to eliminate a 1/50 case 5.107s timeout).
  6. +
+

Architectural repair for same-parent reversals and unsubmitted probes (#8380): Previously, measuredSearchComparison and projectExploreMeasurementFeedback compared the last two local proxy records against the last two official goal records by array position. Whenever a rejected sibling proxy false-positive (v11) or a subsequent local-only screening probe (v13) sat in between, positional comparison mismatched candidate identities and suppressed proxy_order_reversed: true. #8380 anchors local proxy comparison to the exact [goal.previous_best, goal.latest] candidate pair so sibling rank reversals reliably trigger yardstick recalibration.

+

9.3 Next horizon: decoupling Control Session from Worker Session and meta-reasoning

+

Moving from Layer-1 compute scaling to Layer-2 iso-budget Pareto optimality points to two structural upgrades: first, decoupling the Control Session from the Worker Session (C1–C6, #8266 / #8304) so Replan, Stride selection and receipt writeback execute in an isolated control session while the worker keeps a zero-pollution KV cache and continuous domain focus; second, evolving the control plane into a Value-of-Computation (VoC) meta-reasoning core (Selecting Computations) that combines risk-sensitive yardsticks (worst-case tail-latency margin + paired rank calibration) with cross-family switch triggers so every unit of control overhead buys a better next experiment.

+

Numerical evidence retains each stated historical model, version, window and validity boundary. Public implementation: LoopX. Earlier detailed research records remain in the previous article revision. Raw trajectories, hidden evaluator material, runtime credentials and private operating context are not published here.

diff --git a/apps/presentation/site/public/blog/images/context-delivery/multitask-byte-ratios-en.svg b/apps/presentation/site/public/blog/images/context-delivery/multitask-byte-ratios-en.svg new file mode 100644 index 0000000000..c1da600b42 --- /dev/null +++ b/apps/presentation/site/public/blog/images/context-delivery/multitask-byte-ratios-en.svg @@ -0,0 +1,864 @@ + + + + + + + + 2026-11-09T03:30:26.988537 + image/svg+xml + + + Matplotlib v3.11.2, https://matplotlib.org/ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + 0 + + + + + + + + + + + + + 10 + + + + + + + + + + + + + 20 + + + + + + + + + + + + + 30 + + + + + + + + + + + + + 40 + + + + + + + + + + + + + 50 + + + + + + + + + + + + + 60 + + + + Share of Same-Wake Full Decision Packet Bytes (%) + + + + + + + + + + + + + + Grid Robot + (29 wakes / 14 Δ) + + + + + + + + + + VLIW Scheduling + (14 wakes / 9 Δ) + + + + + + + + + + FFmpeg Encoding + (26 wakes / 14 Δ) + + + + + + + + + + OpenTTD Transport + (31 wakes / 12 Δ) + + + + + + + + + + Ad Placement + (29 wakes / 17 Δ) + + + + + + + + + + Borden Inversion + (28 wakes / 17 Δ) + + + + + + + + + + Rust Workspace + (15 wakes / 11 Δ) + + + + + + + + + + ANN Vector Search + (41 wakes / 18 Δ) + + + + + + + + + + 8-Run Weighted Total + (213 wakes / 112 Δ) + + + + + + + + + + + 26.5% + + + 20.7% + + + 1.8% + + + 39.0% + + + 45.2% + + + 3.6% + + + 29.9% + + + 47.1% + + + 2.7% + + + 32.0% + + + 30.8% + + + 2.6% + + + 32.7% + + + 39.4% + + + 3.6% + + + 35.1% + + + 34.4% + + + 2.8% + + + 37.5% + + + 42.1% + + + 4.7% + + + 36.7% + + + 38.6% + + + 3.4% + + + 33.4% + + + 35.8% + + + 3.0% + + + A. Control-Plane Byte Share Across 8 Four-Arm Context ON 18h Runs (N=213) + + + + + + + + + + Progressive projection (33.4% avg, -66.6%) + + + + + + In-cycle Delta payload (35.8% avg, -64.2%) + + + + + + Prog+Delta first-screen (3.0% avg, -97.0%) + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + 1. Full Packet + (N=213) + + + + + + + + + + 2. Progressive + (-66.6%) + + + + + + + + + + 3. In-Cycle Full + (N=112) + + + + + + + + + + 4. Delta Payload + (-64.2%) + + + + + + + + + + 5. First-Screen + (3.0%/5.0%) + + + + + + + + + + + + + + + 0 + + + + + + + + + + + + + 5 + + + + + + + + + + + + + 10 + + + + + + + + + + + + + 15 + + + + + + + + + + + + + 20 + + + + + + + + + + + + + 25 + + + + Cumulative Bytes (MB) + + + + + + + + + + 22.41 MB + (100%) + + + 7.48 MB + (33.4%) + + + 12.53 MB + (112 Δ base) + + + 4.49 MB + (35.8%) + + + 0.37 / 0.63 MB + (3.0% / 5.0%) + + + B. Cumulative Byte Reduction Across 213 Wakes (MB) + + + + + + + + + + + + diff --git a/apps/presentation/site/public/blog/images/context-delivery/multitask-byte-ratios-zh.svg b/apps/presentation/site/public/blog/images/context-delivery/multitask-byte-ratios-zh.svg new file mode 100644 index 0000000000..b658146ac3 --- /dev/null +++ b/apps/presentation/site/public/blog/images/context-delivery/multitask-byte-ratios-zh.svg @@ -0,0 +1,864 @@ + + + + + + + + 2026-11-09T03:30:26.793031 + image/svg+xml + + + Matplotlib v3.11.2, https://matplotlib.org/ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + 0 + + + + + + + + + + + + + 10 + + + + + + + + + + + + + 20 + + + + + + + + + + + + + 30 + + + + + + + + + + + + + 40 + + + + + + + + + + + + + 50 + + + + + + + + + + + + + 60 + + + + 占同轮 Full 完整决策包字节百分比 (%) + + + + + + + + + + + + + + Grid 路径优化 + (29 唤醒 / 14 Δ) + + + + + + + + + + VLIW 调度优化 + (14 唤醒 / 9 Δ) + + + + + + + + + + FFmpeg 编码加速 + (26 唤醒 / 14 Δ) + + + + + + + + + + OpenTTD 路网规划 + (31 唤醒 / 12 Δ) + + + + + + + + + + Ad 广告拍卖 + (29 唤醒 / 17 Δ) + + + + + + + + + + Borden 反演 + (28 唤醒 / 17 Δ) + + + + + + + + + + Rust 重构 + (15 唤醒 / 11 Δ) + + + + + + + + + + ANN 向量检索 + (41 唤醒 / 18 Δ) + + + + + + + + + + 8 题总计加权 + (213 唤醒 / 112 Δ) + + + + + + + + + + + 26.5% + + + 20.7% + + + 1.8% + + + 39.0% + + + 45.2% + + + 3.6% + + + 29.9% + + + 47.1% + + + 2.7% + + + 32.0% + + + 30.8% + + + 2.6% + + + 32.7% + + + 39.4% + + + 3.6% + + + 35.1% + + + 34.4% + + + 2.8% + + + 37.5% + + + 42.1% + + + 4.7% + + + 36.7% + + + 38.6% + + + 3.4% + + + 33.4% + + + 35.8% + + + 3.0% + + + A. 最新四臂 Context ON (8 题 18h, N=213 唤醒) 控制面字节占比 + + + + + + + + + + Progressive 渐进投影 (均 33.4%, -66.6%) + + + + + + Delta 周期内差分 (均 35.8%, -64.2%) + + + + + + Prog+Delta 首屏正文 (均 3.0%, -97.0%) + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + 1. Full 全量 + (N=213) + + + + + + + + + + 2. Progressive + (-66.6%) + + + + + + + + + + 3. 同周期 Full + (N=112) + + + + + + + + + + 4. Delta 载荷 + (-64.2%) + + + + + + + + + + 5. 首屏入口 + (3.0%/5.0%) + + + + + + + + + + + + + + + 0 + + + + + + + + + + + + + 5 + + + + + + + + + + + + + 10 + + + + + + + + + + + + + 15 + + + + + + + + + + + + + 20 + + + + + + + + + + + + + 25 + + + + 累计字节 (MB) + + + + + + + + + + 22.41 MB + (100%) + + + 7.48 MB + (33.4%) + + + 12.53 MB + (112 Δ base) + + + 4.49 MB + (35.8%) + + + 0.37 / 0.63 MB + (3.0% / 5.0%) + + + B. 8 题 213 次唤醒累计字节阶梯裁剪 (MB) + + + + + + + + + + + + diff --git a/apps/presentation/site/public/blog/images/edgebench-feedback-and-memory/stride-yardstick-closed-loop-en.svg b/apps/presentation/site/public/blog/images/edgebench-feedback-and-memory/stride-yardstick-closed-loop-en.svg new file mode 100644 index 0000000000..30ffe8ba26 --- /dev/null +++ b/apps/presentation/site/public/blog/images/edgebench-feedback-and-memory/stride-yardstick-closed-loop-en.svg @@ -0,0 +1,680 @@ + + + + + + + + 2026-11-09T03:30:27.341527 + image/svg+xml + + + Matplotlib v3.11.2, https://matplotlib.org/ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + 0 + + + + + + + + + + + + + 20 + + + + + + + + + + + + + 40 + + + + + + + + + + + + + 60 + + + + + + + + + + + + + 80 + + + + + + + + + + + + + 100 + + + + Share of Decision Transitions (%) + + + + + + + + + + + + + + Stride v1 (N=37) + 89.2% shrink collapse + + + + + + + + + + v2 · grow (N=34) + supported_progress + + + + + + + + + + v2 · verify (N=165) + discriminating guard + + + + + + + + + + v2 · switch (N=50) + cross-family escape + + + + + + + + + + Latest Four-Arm Context ON + (8 runs N=25, 17 transitions) + + + + + + + + + + + 89.2% + + + 79.4% + + + 20.6% + + + 40.0% + + + 58.8% + + + 16.0% + + + 74.0% + + + 70.6% + + + 29.4% + + + A. Stride v2 Action → Next-Step Gain & Four-Arm Context ON Audit + + + + + + + + + + Next-step improved + + + + + + Flat guard (best kept) + + + + + + Regressed / v1 shrink + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + 0 + + + + + + + + + + + + + 20 + + + + + + + + + + + + + 40 + + + + + + + + + + + + + 60 + + + + + + + + + + + + + 80 + + + + + + + + + + + + + 100 + + + + + + + + + + + + + 120 + + + + + + + + + + + + + 140 + + + + Agreement / Survival Rate (%) + + + + + + + + + + + Grid Apparent Agreement + (20/21 confounded by time) + + + + + + + + + + Naive Later-Submission Guess + (later_submission = 21/21) + + + + + + + + + + Same-Parent Sibling Order + (Official Grid v11/v12 → 0/2) + + + + + + + + + + Ad r11 64-Case Fresh Gate + (blocked v28 -77K, kept 77.63) + + + + + + + + + + Grid / Ad TLE Cliff Calibration + (pass rate after T=X gate) + + + + + + + + + + + 95.2% (20/21) + + + 100.0% (21/21 confounded) + + + 0.0% (both reversed, fixed #8380) + + + 100% negative gate protection + + + 100% TLE cliff eliminated + + + B. Yardstick Trajectory Audit: Time Confounding vs. Sibling Reversal (#8101/#8380) + + + + + + + + + + + + diff --git a/apps/presentation/site/public/blog/images/edgebench-feedback-and-memory/stride-yardstick-closed-loop-zh.svg b/apps/presentation/site/public/blog/images/edgebench-feedback-and-memory/stride-yardstick-closed-loop-zh.svg new file mode 100644 index 0000000000..75ba07bd8a --- /dev/null +++ b/apps/presentation/site/public/blog/images/edgebench-feedback-and-memory/stride-yardstick-closed-loop-zh.svg @@ -0,0 +1,680 @@ + + + + + + + + 2026-11-09T03:30:27.180998 + image/svg+xml + + + Matplotlib v3.11.2, https://matplotlib.org/ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + 0 + + + + + + + + + + + + + 20 + + + + + + + + + + + + + 40 + + + + + + + + + + + + + 60 + + + + + + + + + + + + + 80 + + + + + + + + + + + + + 100 + + + + 占对应决策转移比例 (%) + + + + + + + + + + + + + + Stride v1 (N=37) + 89.2% 坍缩至 shrink + + + + + + + + + + v2 · grow (N=34) + supported_progress + + + + + + + + + + v2 · verify (N=165) + 判别实验 + 守门 + + + + + + + + + + v2 · switch (N=50) + 跨算法族切换破局 + + + + + + + + + + 最新四臂 Context ON + (8 题 N=25 复盘, 17 对转移) + + + + + + + + + + + 89.2% + + + 79.4% + + + 20.6% + + + 40.0% + + + 58.8% + + + 16.0% + + + 74.0% + + + 70.6% + + + 29.4% + + + A. Stride v2 动作→下一步原生提分转化率与四臂 Context ON 表现 + + + + + + + + + + 下一步原生提分 (improved) + + + + + + 平局守门保住最优 (flat guard) + + + + + + 回退 / v1 收缩坍缩 + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + 0 + + + + + + + + + + + + + 20 + + + + + + + + + + + + + 40 + + + + + + + + + + + + + 60 + + + + + + + + + + + + + 80 + + + + + + + + + + + + + 100 + + + + + + + + + + + + + 120 + + + + + + + + + + + + + 140 + + + + 比率 / 通过率 (%) + + + + + + + + + + + Grid 面板表观一致率 + (20/21 含时间趋势混杂) + + + + + + + + + + 单纯按提交时间猜测 + (later_submission 基线) + + + + + + + + + + 同父分叉候选保序率 + (Official Grid v11/v12 → 0/2) + + + + + + + + + + Ad r11 64-case 新鲜门禁 + (拦截 v28 -7.7万, 保住 77.63) + + + + + + + + + + Grid / Ad 超时悬崖自校准 + (升级 T=X 预算门禁后通过率) + + + + + + + + + + + 95.2% (20/21) + + + 100.0% (21/21 混杂) + + + 0.0% (双双反转, #8380 修复) + + + 100% 拦截负向候选 + + + 100% 消除单算例 TLE + + + B. Yardstick 轨迹统计反例:时间趋势混杂与同父候选反转 (#8101 / #8380) + + + + + + + + + + + + diff --git a/apps/presentation/site/public/blog/index.html b/apps/presentation/site/public/blog/index.html index 9c366bed44..5f85d57b98 100644 --- a/apps/presentation/site/public/blog/index.html +++ b/apps/presentation/site/public/blog/index.html @@ -35,8 +35,8 @@

LoopX · Blog

Engineering the long run.

Design, engineering, and field notes on long-horizon agents.

-

Context delivery · Mechanisms and examples

· Updated November 3

-

An Agent needs a way to look things up, too

One voice task explains JSON Pointers, batched selection, index depth, complete requirements, exact sharing and compaction-cycle deltas, paired with ANN 18h (7,159 vs 5,753 QPS) layered byte/token ablations and early-window/cross-task counterexamples.

Read article
+

Context delivery · Mechanisms and examples

· Updated November 9

+

An Agent needs a way to look things up, too

One voice task explains JSON Pointers, batched selection, index depth, complete requirements, exact sharing and compaction-cycle deltas, paired with ANN 18h (7,159 vs 5,753 QPS) ablations, 8-task Four-Arm Context ON byte shares (Progressive 33.4% / Delta 35.8% / first-screen 3.0%), and boundary counterexamples.

Read article
-

Research notes · EdgeBench

· Revised November 3

-

What does an agent achieve with ten more hours?

Follow the research from early October to early November: reliable feedback, goals, experiment size and recovery, tested across New Foundations Consistency’s 18h plateau breakthrough, Schema’s plateau counterexample and five-arm causal attribution.

Read article
+

Research notes · EdgeBench

· Revised November 9

+

What does an agent achieve with ten more hours?

Follow the research from early October to early November: the five-stage control loop and two-layer objective (compute scaling vs. iso-budget Pareto optimality), New Foundations 18h plateau breakthrough, Schema counterexample, Stride v2 transitions (grow 79.4% / Four-Arm Context ON 70.6% improved), and Yardstick sibling rank-reversal repairs.

Read article

Design perspective · Self-improvement

diff --git a/apps/presentation/site/public/blog/zh/context-delivery/index.html b/apps/presentation/site/public/blog/zh/context-delivery/index.html index 1da678d9e2..d627583fd9 100644 --- a/apps/presentation/site/public/blog/zh/context-delivery/index.html +++ b/apps/presentation/site/public/blog/zh/context-delivery/index.html @@ -6,8 +6,8 @@ -
← 全部文章

Context delivery

Agent 读上下文,也需要一套“查书”的方法

从一个语音任务理解渐进式读取、JSON Pointer、精确共享、compaction 周期内的结构化差分,以及失效后的完整恢复。

-

Agent 做长任务,资料会越来越多:原目标、后来追加的约束、试过的方案、失败的实验、当前做到哪里。每次继续都把整份材料再塞一遍,重复会不断累积;只留一段摘要,又可能找不回决定所依赖的原话。

+
← 全部文章

Context delivery

Agent 读上下文,也需要一套“查书”的方法

从一个语音任务理解渐进式读取、JSON Pointer、精确共享、compaction 周期内的结构化差分,以及失效后的完整恢复。

+

Agent 做长任务,资料会越来越多:原目标、后来追加的约束、试过的方案、失败的实验、当前做到哪里。每次继续都把整份材料再塞一遍,重复会不断累积;只留一段摘要,又可能找不回决定所依赖的原话。

LoopX 的 context delivery 把这件事拆开做:完整资料保存下来,当前决定需要的事实先读,支持材料沿问题展开;同一个有效 compaction 周期内,再精确复用没有变化的结构。

本文以已发布的 LoopX 2.2.0 Codex 原生路径为准。受支持的 POSIX Codex App/SSH 会话与新的 benchmark heartbeat 默认开启 context delivery;已有关闭设置继续生效,也可以显式关闭。开启后完整内容先保存,Agent 收到当前读取入口。具体发布与验证范围见 2.2.0 版本说明;下文的合成测量仍保留原始实验版本与条件。

可以把它想成查一本厚书:capture 是完整保存的那本书,目录告诉我们章节在哪,JSON Pointer 是书内地址。渐进式读取决定这一刻翻到多深;差分决定下一轮哪些内容可以沿用。

@@ -266,6 +266,96 @@

真实模型与多题消融实证:收益链路与

这组双轨实证说明:控制包裁剪率(−74.25% / −38.54%)不能直接等同于整轮模型 Token 节省(未缓存 −12.07%、总输入 −7.46%),更不能掩盖前 2 小时早窗的前置建索引开销(4.05×)和跨题反例。 Context Delivery 的真实价值在于长周期(如 10h–18h)内延缓上下文膨胀、配合 Stride 将省下的注意力转化为后程有效实验(参见 EdgeBench 后程突破与五臂归因)。

+

跨 8 组最新四臂 Context ON 18h 轨迹的多题控制面字节比例(Progressive vs. Delta)

+

为进一步把渐进式读取(Progressive Projection)与周期内差分交付(Differential Delivery)两项机制在真实长程运行中的独立收益拆开,我们对最新四臂对照中的 8 组 Context ON 18h 完整轨迹(N = 213 次模型侧唤醒,含 101 次新会话/压缩后基线首读与 112 次同周期 Delta 续跑)进行了逐轮控制包字节核算:

+

八题四臂 Context ON 控制面字节比例(N = 213 唤醒,112 周期内 Delta)

八题四臂 Context ON 18h 轨迹控制面字节比例:Progressive 占 33.4% (-66.6%),同周期 Delta 占 35.8% (-64.2%),Prog+Delta 首屏占 3.0% / 5.0%
左图(A):8 道核心题目各自的 Progressive 必要投影占比(蓝)、同周期 Delta 载荷占比(青)与 Prog+Delta 首屏正文占比(紫)。右图(B):8 题 213 次唤醒的累计控制面字节从 22.41 MB 阶梯式裁剪至 7.48 MB(Progressive)、4.49 MB(同周期 Delta)与 0.37 MB / 0.63 MB(首屏正文/含封装)。点击查看原图。
+
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
题目(四臂 Context ON 18h)唤醒数(基线 / Δ)Full 全量包Progressive 必要视图(占比)同周期 Delta 载荷(占同轮 Full)Prog+Delta 首屏(正文 / 含封装)
Grid 路径优化(on_stride)29(15 / 14)4,405,651 B1,166,467 B(26.5%, −73.5%)474,016 B(20.7%, −79.3%)41,878 / 76,650 B(1.8% / 3.3%)
VLIW 调度优化(on_stride)14(5 / 9)1,297,500 B505,826 B(39.0%, −61.0%)382,664 B(45.2%, −54.8%)30,860 / 50,152 B(3.6% / 5.9%)
FFmpeg 编码加速(on_stride)26(12 / 14)2,924,522 B874,104 B(29.9%, −70.1%)759,787 B(47.1%, −52.9%)43,807 / 75,305 B(2.7% / 4.7%)
OpenTTD 路网规划(on_stride)31(19 / 12)3,288,042 B1,050,623 B(32.0%, −68.0%)436,053 B(30.8%, −69.2%)36,753 / 64,619 B(2.6% / 4.6%)
Ad Placement 广告拍卖(on_stride)29(12 / 17)3,115,820 B1,019,704 B(32.7%, −67.3%)708,828 B(39.4%, −60.6%)64,174 / 102,437 B(3.6% / 5.7%)
Borden 震源反演(on_stride)28(11 / 17)2,855,664 B1,001,254 B(35.1%, −64.9%)625,709 B(34.4%, −65.6%)50,602 / 90,024 B(2.8% / 4.9%)
Rust 工作区重构(on_stride)15(4 / 11)1,173,832 B439,814 B(37.5%, −62.5%)363,310 B(42.1%, −57.9%)40,956 / 64,251 B(4.7% / 7.4%)
ANN 向量检索(on_stride)41(23 / 18)3,347,659 B1,228,159 B(36.7%, −63.3%)737,968 B(38.6%, −61.4%)65,419 / 107,112 B(3.4% / 5.6%)
8 题合计(加权总体)213(101 / 112)22,408,690 B(100%)7,479,469 B(33.4%, −66.6%)4,488,335 B(35.8%, −64.2%)374,449 / 630,550 B(3.0% / 5.0%)
+

可以看到两层正交且稳定的字节压缩效应:(1)Progressive 渐进式投影(required-context.json)在全部 213 次唤醒上将完整决策包从 22.41 MB 压至 7.48 MB(均值 33.4%,净减 −66.6%,各题稳定在 26.5%–39.0%),折叠掉未选中候选与历史长尾详情;(2)Delta 周期内差分(delivery.json)在 112 次同周期续跑唤醒上,将对应的 12.53 MB 全量包压至 4.49 MB(均值 35.8%,净减 −64.2%,各题 20.7%–47.1%);(3)两者叠加的 --initial-read 首屏入口仅占原包的 3.0%(含 CLI JSON 封装为 5.0%,即净减 −97.0% / −95.0%)。此外,最新合入的 C1 控制器/执行器投影统一(#8266 / #8304)进一步使稳态单轮控制面材料再降 26.7%(69.9 KB → 51.3 KB),写回后二次投影耗时从 57.1ms 降至 3.3ms。

2.2.0 已交付完整来源、文件入口、批量选择、目录深度、适用验收分层、精确共享、周期差分与恢复。更广的候选、偏好、Explore 按决策阶段统一交付及全入口一致性仍有未完成部分。在「设置 → 本机 → 能力 → 差分上下文 → Codex」可以关闭,已有 off 会保留;单次命令或新 benchmark trial 可用 --context-delivery off。Trial 不继承本机开关,已有冻结 trial 不被重写。默认策略下,普通 CLI、不支持的宿主和非 heartbeat benchmark 保留原完整路径;显式请求不支持的 on 会明确拒绝,hooks 不可用时使用完整交付。保存配置、实际安装与模型采用分别核验。

用同一份材料动手读一遍

example.py 完整生成这个合成语音任务,调用现有 reader、渐进投影与差分 owner,逐项核对选择值、目录地址、全部 10 条要求、共享引用与完整恢复。程序不注册 Goal,不做准入或结算,也不调用模型或语音服务。

diff --git a/apps/presentation/site/public/blog/zh/edgebench-feedback-and-memory/index.html b/apps/presentation/site/public/blog/zh/edgebench-feedback-and-memory/index.html index 878cb80546..6ac756e085 100644 --- a/apps/presentation/site/public/blog/zh/edgebench-feedback-and-memory/index.html +++ b/apps/presentation/site/public/blog/zh/edgebench-feedback-and-memory/index.html @@ -16,12 +16,12 @@
-

黄睿腾 · 2026 年 10 月 29 日 · 11 月 3 日更新实证

让 Agent 多做十小时,究竟多做出了什么?

EdgeBench 如何反过来改造 LoopX 的长程控制面

一项研究可以起步更好,却在接下来的十小时里几乎没有增长。也可以不断改代码,最后丢掉最好结果。我们用这两种失败,重新审视目标、反馈、实验步长与恢复。

这条研究从 10 月初的轨迹诊断开始,先修评测与续跑,再追踪证据怎样进入下一次实验,最后把控制面自己的成本算进来。下面按这个过程展开:哪些机制改了,哪些结果支持它,哪些结果迫使我们改方向。

本文回答机制怎样改变真实研究,以及还没有改善什么。若想先看“下一次决定到底读到了什么”,可从上下文的渐进与差分交付开始,再回到下文的成果与完整成本。

+

黄睿腾 · 2026 年 10 月 29 日 · 11 月 9 日更新实证

让 Agent 多做十小时,究竟多做出了什么?

EdgeBench 如何反过来改造 LoopX 的长程控制面

一项研究可以起步更好,却在接下来的十小时里几乎没有增长。也可以不断改代码,最后丢掉最好结果。我们用这两种失败,重新审视目标、反馈、实验步长与恢复。

这条研究从 10 月初的轨迹诊断开始,先修评测与续跑,再追踪证据怎样进入下一次实验,最后把控制面自己的成本算进来。下面按这个过程展开:哪些机制改了,哪些结果支持它,哪些结果迫使我们改方向。

本文回答机制怎样改变真实研究,以及还没有改善什么。若想先看“下一次决定到底读到了什么”,可从上下文的渐进与差分交付开始,再回到下文的成果与完整成本。

这里的 kernel 指 LoopX 共享的目标、准入、事务和恢复规则。LoopX 让原始目标、验收条件、工作归属和证据跨会话、跨宿主持久化。控制面约束状态转换,为模型的下一步提供反馈,但不能认证这个选择是否高明。一条发现、一次读取回执、一条 replan 记录都只是中间证据;真正需要追踪的链条,要落到实际工作和经过验证的成果。

-

这些规则的归属和强模型参与的语义修复,见 TypeScript 重构一文。下面从研究过程检查这些规则怎样影响实际工作。

-
  1. 目标验收与范围
  2. 证据结果与限制
  3. 决策继续或换方向
  4. 工作执行与验证
  5. 保留保住最佳有效成果
-

我们区分起点优势、后续增量和最佳成果保留。更高的最终分数,可能主要来自更强的起点;更好的中间候选,也可能没有留在终态工作区里。运行更久、Todo 更多、图更大,都不能替代这三项判断。

-

1. 先看整个研究过程

时间焦点改变实现
10 月初反馈与实验起点排查盲跑提示、账本与恢复错误;建立原始任务、评分和续跑的边界。#5586, #5844, #5879
10 月 9–11 日原目标与有效反馈保留完整评测响应、候选身份、原始要求;一次实现或提交不能冒充 Goal 完成。#6031, #6039, #6133, #6199
10 月 12–16 日实验步长与恢复点从机械缩小动作,转向 grow / switch / verify;联合保存会话、候选、评测机会和预算,复盘前切换 fresh context。#6298, #6321, #6305, #6622, #6649
10 月中下旬后程改善与成果保留共同窗口拆开起点、后续增量和 best 保留;Schema 的高成本与平台期成为反证。#6440, #6532, #6671
10 月 22–28 日控制面完整成本减少被动轮询和重复读取;核对原 Turn 收尾、完整上下文、差分失效回退及恢复费用。#6983, #7013, #7036, #7197, #7269
10 月底–11 月初后程平台期突破与五臂归因Astra max 18h 突破四臂 91.94 平台期(+9 个修复声明,0 丢失);ANN 18h 分层消融与跨题五臂归因分离渐进差分、Stride 步长与微调空转成本。#7311, #7759, #7800, #7959, #7960

按机制改变和可解释的失败选择案例;表中 PR 是阶段锚点,不是逐日全量发布清单。日期表示研究阶段,具体创建、合入及历史资格以链接为准。

2. 先确认反馈值得相信

+

这些规则的归属和强模型参与的语义修复,见 TypeScript 重构一文。在具体工程实现中,每一次受治理的长程迭代都围绕五阶段控制与反馈闭环运转:

+
  1. 准入与编译should-run 编译边界
  2. 渐进/差分读取按需选读当前事实
  3. 工作与标尺有界执行与 Yardstick
  4. 写回与结算EffectTurn 原子写回
  5. 闭环与重规划Replan / Stride / 保留最优
+

我们区分起点优势、后续增量和最佳成果保留。更高的最终分数,可能主要来自更强的起点;更好的中间候选,也可能没有留在终态工作区里。同时,我们把长程评测拆为两个递进层次:第一层目标(用计算换效果,Test-Time Compute Scaling)已完成实证——相比容易在 1–2 小时过早宣布完成的单次会话或 Native Goal(exit=0),受治理闭环在最新四臂核心题上稳定跑满 18h 并取得显著后程收益(如 ANN 7,159 vs 4,372 QPS、Grid 1,977 vs 2,430、VLIW 1,042 vs 1,159、Rust 27.18 vs 26.93、FFmpeg 2.7086× vs 2.6904×、Borden 80.07 vs Official 61.2);第二层目标(同等预算下的帕累托最优,Iso-Budget Pareto Optimality)则是当前攻关主战场——面对零协议税、由 stop-hook 无限续跑且靠每小时原生评测反馈自然锚定注意力的强基线 Official,控制面必须满足净收益不等式 $\Delta\text{Effectiveness}(s_t, H_\theta) > \Delta\text{Efficiency Loss}(s_t, H_\theta)$。

+

1. 先看整个研究过程

时间焦点改变实现
10 月初反馈与实验起点排查盲跑提示、账本与恢复错误;建立原始任务、评分和续跑的边界。#5586, #5844, #5879
10 月 9–11 日原目标与有效反馈保留完整评测响应、候选身份、原始要求;一次实现或提交不能冒充 Goal 完成。#6031, #6039, #6133, #6199
10 月 12–16 日实验步长与恢复点从机械缩小动作,转向 grow / switch / verify;联合保存会话、候选、评测机会和预算,复盘前切换 fresh context。#6298, #6321, #6305, #6622, #6649
10 月中下旬后程改善与成果保留共同窗口拆开起点、后续增量和 best 保留;Schema 的高成本与平台期成为反证。#6440, #6532, #6671
10 月 22–28 日控制面完整成本减少被动轮询和重复读取;核对原 Turn 收尾、完整上下文、差分失效回退及恢复费用。#6983, #7013, #7036, #7197, #7269
10 月底–11 月初后程平台期突破与五臂归因Astra max 18h 突破四臂 91.94 平台期(+9 个修复声明,0 丢失);ANN 18h 分层消融与跨题五臂归因分离渐进差分、Stride 步长与微调空转成本。#7311, #7759, #7800, #7959, #7960
11 月上旬八题字节比例、Stride/Yardstick 统计与控制器分离核验八题四臂 Context ON 渐进/差分字节比(33.4% / 35.8%);统计 Stride v2 转移与 Yardstick 同父候选保序反例并修复配对比较;推进 Control/Worker 会话分离。#8101, #8266, #8304, #8380

按机制改变和可解释的失败选择案例;表中 PR 是阶段锚点,不是逐日全量发布清单。日期表示研究阶段,具体创建、合入及历史资格以链接为准。

2. 先确认反馈值得相信

最初的 Portfolio 实验先暴露了测量和执行缺陷。一个盲跑 wrapper 在移除评测入口时,也删掉了迭代优化提示;一个账本检查把更早的市场收益归给了收盘时才买入的持仓。它们都混淆了原本的比较。修复后必须另起尝试,旧结果继续保留。

一个小反例就能说明记账问题:初始现金 100,000,在收盘价 200 时买入 100 单位并支付 10 手续费,即时权益应为 99,990,NAV 为 0.9999;新持仓没有赚到此前从 100 涨到 200 的收益。之后,对两个冻结样本独立重建,各自 243 天全部吻合,权益残差小于 4×10⁻⁹,股数没有差异。这证明账本一致,不证明投资策略优秀。版本化修复见 EdgeBench #14。

续跑也有类似问题:某个工作项结束后,外层进程可以不断唤醒,却没有恢复出有用的下一步。判断必须回到原始目标。Todo 完成之后,可以继续实验、等待或结束,但它本身不能代表 Goal 验收。可靠反馈与恢复让之后的研究变得可解释。

@@ -122,6 +122,38 @@

11 月初进展:ANN 18h 分层消融与跨任务五
  • Context Delivery × Stride 多题与分层消融(ANN 18h,gpt-6.1-sol / xhigh,Recall@10 ≥ 0.95):在 18 小时向量检索任务中,Explore · Context on + Stride 达到 7,159 QPS(较 Official 的 5,753 QPS 提升 +24.4%,较 Explore · Context on 的 6,020 QPS 与 Context off 的 5,766 QPS 进一步跃升)。配对控制包总选中字节下降 38.54%(3.09 MB → 1.90 MB,其中 24 个 Delta 事件裁剪 74.25%),全 18h 主会话未缓存输入 Token 净省 12.07%(8.57M → 7.53M)、总输入净省 7.46%(272.03M → 251.74M)。同时我们完整保留了三项边界反例:project+read 进程 stdout 为选中文件字节的 1.57×–1.83×、前 2 小时早窗未缓存输入因建基线上升至 4.05×(0.25M → 1.00M),以及跨题 Historical Grid 反例(Official 1967 < Off 2054 < On+Stride 2088 < On 2242)。完整图表与双轨数据见上下文交付一文的消融实证。
  • 跨任务五臂轨迹归因(Portfolio、Grid、Graph、Ad Placement):在这些公开可复现的 五臂归因报告(#7960) 与 跨题拐点与重规划损耗分析(#7959) 中,分类表标记了 86 次已分类 Replan 事件,但三个受管臂的小计为 44 + 36 + 24 = 104;有效跃升数也不一致(分类表 27 次,分臂合计 5 + 11 + 15 = 31 次)。因此这里只把 5/44 = 11.4%、11/36 = 30.6%、15/24 = 62.5% 作为各臂自身比例,不声称它们共享一个已对账的统一分母,也不据此给出跨臂因果总量。这些只是描述性的单臂观察,不是经过匹配重复的 C2 比较,也不足以改变生产默认配置。报告还描述了 Portfolio 的原生反馈保留(Official Native 53.87、Explore 31.19、Stride 35.82),以及 Graph 从 2.1h 的 0.7194 升至 9.6h 的 0.7240 后,7 轮峰后尝试消耗 159.87M 输入 Token。报告中的固定分类分量公式复算为 0.74329,并非记录值 0.73903;它只是该固定分量向量的条件估算,不是所有线性模型的上界,也不能证明后续尝试必然无效。同一报告记录的控制面协议税从 23.9% 降至 12.4%–14.1%,这里保持为描述性结果。
  • -

数值分别保留各历史模型、版本、窗口与有效性边界。公开实现:LoopX。早期详细记录保留在上一版文章。这里不发布原始轨迹、隐藏评测材料、运行时凭证或私有操作上下文。

+

9. 把反馈闭环做扎实:Stride v2 步长转移、Yardstick 保序反例与元推理决策核

+

Replan、Stride Policy 与 Yardstick 标尺这三项机制的本质,不是给 Agent 增加行政填表义务,而是建立证据驱动的反馈闭环(Closed-Loop Feedback):用本地与原生反馈修正实验步长、拦截假阳性候选,并在旧算法族回报递减时触发跨族切换。我们对已落地的 Stride v1 → v2 决策记录、最新四臂 Context ON 8 题轨迹以及 Yardstick 保序审计进行了系统统计:

+
Stride v2 步长转移与四臂 Context ON 统计(左)及 Yardstick 轨迹保序反例与超时悬崖自校准(右)
左图(A):Stride v1(89.2% 坍缩至 shrink)与 Stride v2(grow / verify / switch,N=249 转移)及最新四臂 Context ON(8 题 N=25 去重复盘,70.6% 提分、29.4% 平局守门、0% 退化)的下一步原生提分转化率。右图(B):Yardstick 轨迹审计揭示的时间趋势混杂(95.2% vs. 100% 朴素时间基线)、同父分叉候选反转(0/2,由 #8380 修复)、64-case 新鲜门禁拦截与超时悬崖自校准。点击查看原图。
+

9.1 Stride Policy:从 v1 的 89.2% 收缩坍缩到 v2 的动作–提分闭环

+
    +
  • 为什么废除 Stride v1(grow / hold / shrink):在早期 Grid / Borden 轨迹(N = 37 条记录)中,v1 将动作贴上模糊的相对大小标签,一旦局部改动未立刻刷新最优分,模型便高达 89.2%(33/37)选择 shrink(grow 仅 10.8%,hold 为 0%),把后续 9 小时锁死在单参数微调中。
  • +
  • Stride v2(verify / switch / grow,#6321 / #6532 / #6654)全量分布与转移矩阵(N = 372 条记录,249 次配对转移): +
      +
    • grow(仅在 basis = supported_progress 时触发):下一步原生分数 79.4% 提分(27/34 improved,6 flat,0 regressed);例如 Ad Placement 在复合退火日程与热恢复上连续 3 次 grow 连续兑现原生净增(单步最高 +954,331)。
    • +
    • verify(判别实验 + 基线守门员):58.8% 拦截局部噪声(97/165 flat,保护 Incumbent Best),40.0% 转化为提分(66/165 improved),仅 0.6% 退化。
    • +
    • switch(跨算法族切换):跨族探索天然高方差(74.0% flat 由基线门禁兜底),但命中的 16.0%(8/50)带来旧家族停滞后的阶跃破局(如 Graph 通过连续 switch 从 2-hop SGGC 切换至 PPR 多尺度扩散与 C&S 残差传播,实现 0.7194 → 0.7225 → 0.7240 破局)。
    • +
    +
  • +
  • 结合最新四臂 Context ON 核心 8 题的统计与 Good Cases(N = 25 次去重 Stride v2 复盘,17 次有后继评测转移):在开启渐进/差分上下文(八题控制面字节占比 33.4% / 35.8%)的最新四臂 on_stride 运行中,verify 16 次 (64.0%) / switch 6 次 (24.0%) / grow 3 次 (12.0%),76.0%(19/25)显式耦合 Explore 账本证据,动作完全执行率 100%(17/17),下一步最佳分 70.6% 提分(12/17 improved)、29.4% 平局守门(5/17 flat)、0% 退化: +
      +
    1. OpenTTD($11.28M → $34.59M,翻 3 倍):grow(扩建双轨主干网 $11.28M → $16.96M)→ verify(修复信号间距与列车数量 $16.96M → $28.14M → $30.71M)→ switch(切换至全地图高运力长距煤铁网络,跃升至 $34.59M)。
    2. +
    3. Borden(7.01 → 80.07,超越 Official 61.2):两次 verify 将 L-BFGS 多起点反演从 7.01 推至 77.96;当第 3 次复盘遇到局部平台(77.96 → 77.97)时触发 switch 切换至坐标下降法 + 井间灵敏度重加权,终盘突破至 80.07。
    4. +
    5. FFmpeg(0.90× → 2.7086×,全场最高):switch 切入 x264 预设与线程调度(0.90× → 2.52×)→ grow 深化 subme/me/trellis 率失真前沿(2.52× → 2.66×)→ verify 精细校准 CRF 与 GOP 边界达 2.7086×(优于 Official 2.6815× 与 Native Goal 2.6904×)。
    6. +
    7. Grid(2,288 → 1,977,越低越好)与 VLIW(1,266 → 1,042,越低越好):Grid 通过 switch 切入混合成本表与 C++ 束搜索修补,从 2,288 压至 1,977(较 Native Goal 2,430 净省 453 步);VLIW 通过 verify → grow 从贪心列表调度(1,266)推进至模调度循环流水化(1,042,优于 Native Goal 1,159)。
    8. +
    +
  • +
+

9.2 Yardstick 标尺轨迹统计:三项关键反例与同父候选配对修复(#8101 / #8380)

+

在 1 小时原生提交冷却(native3600)下,Yardstick 负责在工作项上维护本地验证标尺并与官方 Native 分数对账(#7037 / #7651 / #8101)。跨题轨迹审计揭示了三项反直觉现象,并直接推动了控制面配对比较逻辑的修复:

+
    +
  1. 表观高一致率背后的时间趋势混杂与同父反例(#8101):在 Grid 面板中,本地 Proxy 与官方 Native 的全局成对一致率看似高达 20/21(95.2%)与 10/10(100%),但这混杂了“随时间推移代码整体越来越强”的趋势——单纯猜测“晚提交的更好(later_submission)”一致率竟也达 21/21(100%)。一旦剥离时间趋势、专门考察从同一父版本 v10(官方 1958)分叉出的同父兄弟候选 Official Grid v11 / v12,本地 20-seed 均值双双预测改善(-2.95 与 -1.40 步),官方 Native 却双双退化(1958 → 1966 [+8] 与 1962 [+4],同父保序率 0/2)。
  2. +
  3. 大样本本地显著获胜仍会反转 vs. 新鲜门禁守门成功(Ad v30 vs. Ad r11):Ad v30 相比 v28 在本地 64 对种子(+67.5 万)、16 对独立留出集及 80 对合并集(配对 $t = +2.41$)上全胜,官方 50-case 却倒退 -60,072;相反,在 Ad r11 中,64-case 新鲜门禁成功拦截负向候选 v28(-77,049),保住 v22 拿到 77.63(较首提交净增 +27.22M)。这证明本地标尺的真正职责是高召回负向守门员(Negative Gatekeeper)与同父平局决胜器,而非在微小均值差上替代原生反馈。
  4. +
  5. 模型利用 Yardstick 完成“TLE 超时悬崖”自校准:Grid Stride 第 2 次提交在本地 8-seed 均值改善(345 → 339)下因单算例 30.085s 超时被判 0 分;模型回读反例后将本地 Yardstick 升级为“60 组常规运行(24s 上限)+ 60 组极限预算运行(T=X 门禁)”,立即恢复 100% 通过率并将原生步数压至 2,088(Ad v45 → v48 同样通过将本地预算标尺从 4.62s 收紧至 4.42s 修复了 1/50 算例 5.107s 超时)。
  6. +
+

针对同父反转与未提交探针的架构改进(#8380):此前 measuredSearchComparison 与 projectExploreMeasurementFeedback 直接取最后两条本地 proxy 记录与最后两条官方 goal 记录按位置比对。一旦中间夹了被拒的同父兄弟候选(如 v11)或后续仅跑了本地快速筛选的探针(如 v13),就会比较错候选对、漏报 proxy_order_reversed: true。#8380 将本地 proxy 比较显式锚定在官方 [goal.previous_best, goal.latest] 同一对 candidate_id 上,确保同父候选反转信号 100% 触发校准复盘。

+

9.3 下一阶段演进:Control Session 与 Worker Session 分离及元推理决策核

+

从第一层目标迈向第二层帕累托最优,我们的架构结论很明确:一方面通过 Control Session 与 Worker Session 解耦(C1–C6,#8266 / #8304),把 Replan、Stride 选择与回执写回移入独立控制会话,让主执行会话保持零控制面污染的 KV 缓存与连续代码专注力;另一方面将控制面升级为计算选择与元推理决策核(Selecting Computations),结合计算价值(VoC)、风险敏感 Yardstick(最差算例预算余量 + 保序校准)与跨族切换触发器,把每一分控制预算精准花在能改变下一步实验方向的地方。

+

数值分别保留各历史模型、版本、窗口与有效性边界。公开实现:LoopX。早期详细记录保留在上一版文章。这里不发布原始轨迹、隐藏评测材料、运行时凭证或私有操作上下文。

diff --git a/apps/presentation/site/public/blog/zh/index.html b/apps/presentation/site/public/blog/zh/index.html index ef6b5ae645..5ba58b6977 100644 --- a/apps/presentation/site/public/blog/zh/index.html +++ b/apps/presentation/site/public/blog/zh/index.html @@ -35,8 +35,8 @@

LoopX · 博客

长程工作的工程实践。

关于长程 Agent 的设计、工程与实践。

-

Context delivery · 机制与实例

· 11 月 3 日更新实证

-

Agent 读上下文,也需要一套“查书”的方法

从同一个语音任务出发,讲清 JSON Pointer、批量选择、目录深度、完整要求、精确共享与 compaction 周期差分,并补入 ANN 18h(7,159 vs 5,753 QPS)分层字节/Token 消融实证与早窗/跨题边界反例。

阅读全文
+

Context delivery · 机制与实例

· 11 月 9 日更新实证

+

Agent 读上下文,也需要一套“查书”的方法

从同一个语音任务出发,讲清 JSON Pointer、批量选择、目录深度、完整要求、精确共享与 compaction 周期差分,并补入 ANN 18h(7,159 vs 5,753 QPS)分层消融、八题四臂 Context ON 字节比例(Progressive 33.4% / Delta 35.8% / 首屏 3.0%)与边界反例。

阅读全文
-

研究札记 · EdgeBench

· 11 月 3 日修订

-

让 Agent 多做十小时,究竟多做出了什么?

从 10 月初到 11 月初的研究过程,看可信反馈、目标、实验步长与恢复怎样被修正;并列呈现 New Foundations Consistency(Astra max 18h)突破四臂 91.94 平台期、Schema 反例与跨题五臂因果归因。

阅读全文
+

研究札记 · EdgeBench

· 11 月 9 日修订

+

让 Agent 多做十小时,究竟多做出了什么?

从 10 月初到 11 月上旬的研究过程,拆解五阶段控制闭环与两层目标(用计算换效果 vs. 同等预算帕累托最优);并列呈现 New Foundations 18h 突破、Schema 反例、Stride v2 步长转移(grow 79.4% / 四臂 Context ON 70.6% 提分)与 Yardstick 同父候选反转修复。

阅读全文

设计观点 · 系统级自迭代