8000 test: qualify the #841 nightly candidates (#863) by adityamukho · Pull Request #876 · project-minigraf/minigraf · GitHub
[go: up one dir, main page]

Skip to content

test: qualify the #841 nightly candidates (#863) - #876

Merged
adityamukho merged 5 commits into
v3from
test/863-nightly-candidates
Nov 7, 2026
Merged

adityamukho merged 5 commits into
v3from
test/863-nightly-candidates

Conversation

@adityamukho
@adityamukho adityamukho commented Nov 6, 2026 •
Copy link
Copy Markdown
Collaborator

Refs #863.

Qualifies the six #841 shape-sweep nightly candidates; all six qualify (evidence; spec docs/superpowers/specs/2026-11-06-863-nightly-candidates-design.md, plan docs/superpowers/plans/2026-11-06-863-nightly-candidates.md).

  • test-hooks-only path events (ancestor_alternative_selected, bound_value_avet_range) via minigraf::__path_events, and Cursor::__memory_peak. The dist binary is unchanged (1,301,592 B at base 921b3935 and head, local stable).
  • benches/helpers/shape.rs: trimmed port of the Bench: large-scale shape sweeps and recursive optimization isolation #841 fixtures, queries and oracles, checked against the database by a non-ignored test.
  • Six Criterion IDs under ^window/, ^query/, ^recursion/, picked up by the existing nightly filters (bench.yml unchanged).
  • tests/nightly_candidates_acceptance_test.rs: six ignored tests pinning answer, path and charged memory, plus the held-cursor churn (N6, acceptance only).
  • Qualification: a temporary workflow, now removed, ran six runner jobs at ad326585. The bar was amended twice by decision (see the README): spread is judged after dividing each run by its speed factor, because runners shift ~1.46× on every case at once, also within one CPU model (Benchmark regression: insert (main) #678). Normalized spread is 3.5–13.1%; max cost is 204 s per candidate.

Counts (alt bench host, 2026-11-06): default 2,087 passed / 21 ignored; test-hooks 2,125 / 30.

Follow-ups after merge (spec §5): smoke.yml nightly-candidates acceptance entry and .github/acceptance/verify.py, as identical PRs to v3 then main.

Codex review skipped (quota out until 2026-11-11).

🤖 Generate 8000 d with Claude Code

https://claude.ai/code/session_01H2a7QoYX6tc5G3sKVzvLjD

adityamukho and others added 4 commits November 6, 2026 17:03
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01H2a7QoYX6tc5G3sKVzvLjD
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01H2a7QoYX6tc5G3sKVzvLjD
Thread-local path events (ancestor_alternative_selected,
bound_value_avet_range) and Cursor::__memory_peak, compiled only in test
and test-hooks builds, for the #863 nightly acceptance tests.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01H2a7QoYX6tc5G3sKVzvLjD
…#863)

benches/helpers/shape.rs ports the #841 harness's fixtures, queries and
oracles for the six candidates; nightly_candidates.rs times five of them
under the existing window/query/recursion routes; the ignored acceptance
test pins their answers, paths and charged memory, and the held-cursor
churn. Temporary qualify-863.yml and scripts/qualify_863.py measure cost
and spread on three runners.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01H2a7QoYX6tc5G3sKVzvLjD
@codecov
codecov Bot commented Nov 6, 2026
Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

Six runner runs of qualify-863.yml at ad32658 qualify all six #841
candidates under the amended bar (spread after per-run speed
normalization, 3.5-13.1%; max cost 204 s). Evidence, summary script,
checksums, bench-coverage-v3 follow-up, counts and pointers. The
temporary qualify-863.yml is removed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01H2a7QoYX6tc5G3sKVzvLjD
@adityamukho
adityamukho marked this pull request as ready for review November 7, 2026 04:14
@adityamukho
adityamukho merged commit c2197fd into v3 Nov 7, 2026
23 checks passed
@adityamukho
adityamukho deleted the test/863-nightly-candidates branch November 7, 2026 04:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

0