8000 Benchmark regression: insert (main) · Issue #678 · project-minigraf/minigraf · GitHub
[go: up one dir, main page]

Skip to content

Benchmark regression: insert (main) #678

Closed as not planned
Closed as not planned

Description

@github-actions

Bencher flagged these benchmarks in the nightly run (insert, main) on two runs in a row:

  • insert/batch_100/100k

Branch: main
Run: https://github.com/project-minigraf/minigraf/actions/runs/39559734592
Previous run: https://github.com/project-minigraf/minigraf/actions/runs/39385015408

Please review the Bencher dashboard to confirm the regression.

Activity

  1. adityamukho commented on Oct 21, 2026

    @adityamukho
    Collaborator

    Not a regression: runner noise.

    A/B on an idle dedicated machine, insert/batch_100, dcbc19e (last fast nightly) vs e434148 (v2.0.9), run in parallel and swapped each round, 4 rounds:

    scale dcbc19e e434148 Δ
    1k 525 µs 523 µs −0.4%
    10k 542 µs 543 µs +0.1%
    100k 579 µs 580 µs +0.1%
    1m 575 µs 573 µs −0.2%

    Criterion found no change in 30 of 32 comparisons; the other two were single 1m rounds on e434148, +8.8% and −7.0%, which cancel.

    Bencher history agrees:

    🤖 Generated with Claude Code

    https://claude.ai/code/session_01PtCdzbJMSS1V8qEPaJ4jXz

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    performanceBenchmark performance regressions

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions

      0