8000 ci: preserve independent v3 benchmark history (#840) by adityamukho · Pull Request #853 · project-minigraf/minigraf · GitHub
[go: up one dir, main page]

Skip to content

ci: preserve independent v3 benchmark history (#840) - #853

Merged
adityamukho merged 1 commit into
mainfrom
ci/840-preserve-history-main
Nov 5, 2026
Merged

adityamukho merged 1 commit into
mainfrom
ci/840-preserve-history-main

Conversation

@adityamukho
Copy link
Copy Markdown
Collaborator

Native nightly uploads pass --start-point main on every v3 run. When main advances, Bencher replaces the shared v3 head: the November 4 schedule placed the C binding report on the old head and the other 29 reports on the new one. All 244 native and 26 binding comparison baselines were still null after three audited v3 runs.

Keep main and v3 on their own existing histories; retain main inheritance for ad hoc comparison branches. This preserves the 0.999 t-test boundary and 30-sample maximum. It does not restore replaced history or claim baseline accumulation is complete.

Validation: the new test executes the workflow upload shell with a capture-only Bencher function. The v3 case failed before the fix; all three argument tests and both existing reporting test files pass afterward. git diff --check passes.

Separate production review for #840. Do not close #840: fresh independent runs and controlled live notification checks remain required.

@codecov
codecov Bot commented Nov 5, 2026
Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@adityamukho
adityamukho marked this pull request as ready for review November 5, 2026 03:19

@adityamukho
adityamukho merged commit 25fd6fb into main Nov 5, 2026
17 checks passed
@adityamukho
adityamukho deleted the ci/840-preserve-history-main branch November 5, 2026 03:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Bench: establish regression baselines and verify scheduled reporting

1 participant

0