8000 Run selected regression suites on pull requests by DimensionWieldr · Pull Request #2835 · Altinity/ClickHouse · GitHub
[go: up one dir, main page]

Skip to content

Run selected regression suites on pull requests - #2835

Open
DimensionWieldr wants to merge 3 commits into
antalya-26.8from
ci/antalya-26.8/selected-regression
Open

DimensionWieldr wants to merge 3 commits into
antalya-26.8from
ci/antalya-26.8/selected-regression

Conversation

@DimensionWieldr
@DimensionWieldr DimensionWieldr commented Nov 12, 2026 •
Copy link
Copy Markdown
Collaborator

Pull request regression no longer starts the fixed suite list in regression.yml. After the binary builds exist, one job checks out clickhouse-regression at release, runs select_pr_regression.py, and starts only the suites in that plan on x86 and arm64. The suite jobs still install the pull request binary through regression-reusable-suite.yml.

The plan is remembered at s3://altinity-build-artifacts/PRs/<number>/regression-selection.json. A later commit adds tests. It does not drop tests already chosen for that pull request.

A manual dispatch of this workflow still calls regression.yml. The regression job checkboxes in the pull request template do not apply to pull_request runs. ci_exclude_regression still skips regression, and ci_exclude_aarch64 still skips the arm64 suite jobs.

Selection reads the binary build reports, the same builds the suite jobs install. It does not wait for the release builds. The repository secret CURSOR_API_KEY must be set or the select job fails.

Changelog category (leave one):

  • CI Fix or Improvement (changelog entry is not required)

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Pull request CI runs the regression suites chosen for the changed files instead of the full regression list.

Documentation entry for user-facing changes

None.

CI/CD Options

Exclude tests:

  • Fast test
  • Integration Tests
  • Stateless tests
  • Stateful tests
  • Unit tests
  • Performance tests
  • Aarch64 tests
  • All with ASAN
  • All with TSAN
  • All with MSAN
  • All with UBSAN
  • All with Coverage
  • All Regression
  • Disable CI Cache

Regression jobs to run:

  • Fast suites (mostly <1h)
  • Aggregate Functions (2h)
  • Alter (1.5h)
  • Benchmark (30m)
  • CAS (content-addressed storage; Antalya only)
  • ClickHouse Keeper (1h)
  • Iceberg (2h)
  • LDAP (1h)
  • OAuth (5m)
  • Parquet (1.5h)
  • RBAC (1.5h)
  • SSL Server (1h)
  • S3 (2h)
  • S3 Export (2h)
  • Swarms (30m)
  • Tiered Storage (2h)

DimensionWieldr and others added 3 commits November 12, 2026 14:11
Pull request CI asks clickhouse-regression for a suite plan and runs only those jobs. A manual dispatch of the PR workflow still uses the full regression list.

Co-authored-by: Cursor <cursoragent@cursor.com>
The suite jobs install that binary. Waiting for the release builds as well held the job until a second pair of builds finished.

Co-authored-by: Cursor <cursoragent@cursor.com>
GitHub rejects the workflow file when the job if references matrix. The select job now chooses x86, or x86 and arm64, and the suite matrix uses that list.

Co-authored-by: Cursor <cursoragent@cursor.com>
@github-actions
Copy link
Copy Markdown

Workflow [PR], commit [41a5e2e]

@svb-alt svb-alt added antalya antalya-26.8 Session label (releasy session config) labels Nov 16, 2026
@DimensionWieldr
DimensionWieldr marked this pull request as ready for review November 16, 2026 17:39

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

antalya antalya-26.8 Session label (releasy session config)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

0