You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
ci(bench): regression alerts have been muted since #301; fix alerting and noisy thresholds #393
.github/workflows/bench.yml skips filing a regression issue when any issue titled "Benchmark regression" is open. Benchmark regression - 2026-06-30 #301 has been open since 2026-06-30, so no regression reported after it has filed an issue.
Proof: in run 36106225599 (2026-09-25), Bencher flagged 6 alerts on insert_file/*. The job log says Skipping: open regression issue already exists (#301).
The Bencher upload step is continue-on-error: true, so the run still shows green.
insert_file results are very noisy on shared runners (95% CI such as 594 µs to 1.33 ms), so these alerts may be false. Nobody is triaging them either way.
The suite takes 75 minutes to 6 hours each night. insert_file alone took 3h20m, and 6 runs since August were cancelled.
Remove duplicates per benchmark group, not per repo: add to an open issue for the same group instead of skipping. Or post one summary issue per run that lists every alert.
Move file-backed and fsync-heavy groups (insert_file, concurrent_file/*, checkpoint, open) to looser thresholds or a separate testbed. Better: use a dedicated or bare-metal runner for them.
Cut insert_file run time (fewer sizes or samples) so the suite finishes within one runner session.
Make a suppressed alert visible in the job summary.
Update pinned actions that GitHub warns run on deprecated Node 20 (actions/checkout@v4, actions/cache@v4, actions/github-script@v6).
Activity
docs(roadmap): make v2.0.2 the final v2.x release, split v3.0.0/v3.1.0 (
ci(bench): report regressions per suite, show muted alerts, cut inser…
release: v2.0.2 — final planned v2.x release
ci(bench): fsync the copied file fixture before measuring (#426) (#481)