Skip to content

eval: desk9 .rx reference grades 0; fix keyed refresh; tighten R-8; two guide patterns - #58

Merged
ryansolid merged 6 commits into
mainfrom
claude/project-thread-xp2irv
Nov 13, 2026
Merged

ryansolid merged 6 commits into
mainfrom
claude/project-thread-xp2irv

Conversation

@ryansolid

@ryansolid ryansolid commented Nov 13, 2026 •

Copy link
Copy Markdown
Member

Requested by Ryan · project thread

What

A hand-written .rx reference for desk9 that grades 0 defects on Solid next cd4de287: hidden 77/77, overlap 38/38, 0 of 20 fuzz seeds. Round 7's hand-written chain4 app, which has the same features, grades 3 on the same build (fuzz seeds 8, 11 and 12). The full write-up is in eval/results/desk9-reference-2026-11-13/README.md. This was prompted by Exact's bench/reactivescript, which grades their hand-written Contract reference at 0 using this harness.

Commits

  1. Reference and runtime fix.
    • eval/reference/desk9/rx/: issue data and its writes live in an app-level module. Every write in flight is a guess on its own constant-question list, laid over each answer by rows and heading. Accepted writes end with a re-ask; declined writes revert at once.
    • refresh of a keyed equation re-asked nothing in ref/compile/rt.ts, rt-web.ts and ref/oracle/lower.ts, so an action ending in one dropped its guesses. The new scenarios/S-keyed-refresh.md passes on all three runners.
  2. R-8 tightened (ruled by Ryan, 2026-11-13). An errored region, or a disabled, covers a handler's read of a failing value only when it reads the value itself. pending? x takes no failure (seed 11). This is implemented in the crate, which is where R-8 has always been checked, with a unit test. The spec R-8 text, guide/reference.md and guide/diagnostics.md are updated. Five references with the old labels.rx are fixed; the labels and chain4 tasks still pass every visible, hidden and overlap test.
  3. Guide (guide/async.md): two patterns from the reference, using a generic example with no task code:
    • "Every view of a write: lay it over the answer"
    • "A write that outlives its page". This is narrowed to that one case: server data otherwise stays with its page.

Tests

  • Scenario suites on cd4de287: oracle and compiled show 123 pass, 4 fail. Without this change they show 122 pass, 5 fail: the same 4 failures plus the new scenario. The interpreter passes.
  • cargo test: passes.
  • Crate vs ref: they agree on 353/353 programs.

🤖 Generated with Claude Code

https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt

… equations

The round 7 chain4 app graded 3 defects on desk9 (fuzz seeds 8, 11, 12). The new
reference keeps issue data in an app-level module and lays every write in flight
over each answer through guessed sources, and grades 77/77, 38/38, 0/20.

refresh of a keyed equation re-asked nothing in the compiled runtime and the
oracle; S-keyed-refresh pins the fix.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt
@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Nov 13, 2026 •

Copy link
Copy Markdown

🚀 Deploying Preview to Cloudflare 🚀

Preview Deployments by commit

Status Deployment URL Commit Updated (UTC) See this deployment's details
  • Build: Failed ❌

View logs ↗
b78e9ff 2026-11-13T07:27:42.838Z View logs ↗
  • Build: Failed ❌

View logs ↗
c51eea5 2026-11-13T07:26:09.844Z View logs ↗
  • Build: Failed ❌

View logs ↗
af4e9b2 2026-11-13T07:29:05.931Z View logs ↗
  • Build: Failed ❌

View logs ↗
9b0dd12 2026-11-13T07:23:01.825Z View logs ↗
  • Build: Failed ❌

View logs ↗
a0f24dd 2026-11-13T07:21:29.903Z View logs ↗
  • Build: Failed ❌

View logs ↗
58024f5 2026-11-13T07:06:21.204Z View logs ↗

…s the value

Ruled 2026-11-13: pending? x takes no failure, so a region whose content reads x
only under pending? never shows its fallback, and the click throws (desk9 fuzz
seed 11). rxc refuses it as UNGUARDED_SNAPSHOT; the five references with the old
labels.rx are fixed (labels and chain4 tasks still pass all their tests).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt
Two patterns from the desk9 reference, with a generic example: writes in flight as
guess lists laid over the answer by one equation every view reads, and server data
plus its actions in a module so a write outlives its page.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt
@ryansolid ryansolid changed the title eval: hand-written desk9 .rx reference grades 0; fix refresh of keyed equations eval: desk9 .rx reference grades 0; fix keyed refresh; tighten R-8; two guide patterns Nov 13, 2026
@ryansolid
ryansolid merged commit 7e5bc81 into main Nov 13, 2026
14 of 15 checks passed
ryansolid pushed a commit that referenced this pull request Nov 13, 2026
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_0117BoWLtkg281f1NkGEDjCt
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants