Skip to content

Multi-stage distributed queries - #106020

Merged
davenger merged 336 commits into
masterfrom
multistage_distributed_queries
Jun 9, 2026
Merged

Multi-stage distributed queries#106020
davenger merged 336 commits into
masterfrom
multistage_distributed_queries

Conversation

@davenger

@davenger davenger commented May 28, 2026

Copy link
Copy Markdown
Member

Changelog category (leave one):

  • Experimental Feature

Changelog entry (a user-readable short description of the changes that goes into CHANGELOG.md):

Multi-stage distributed query execution: the planner splits the query plan into stages connected by scatter / broadcast / gather / shuffle exchanges and dispatches the plan fragments to worker nodes. The data between stages is streamed via TCP or passed via temporary files in shared object storage, the path supports distributed shuffle and broadcast hash joins, shuffle aggregation, and distributed sort. The feature is experimental and is disabled by default.

Version info

  • Merged into: 26.6.1.571

davenger and others added 30 commits April 23, 2025 19:24
huldarchen pushed a commit to huldarchen/ClickHouse that referenced this pull request Jun 15, 2026
huldarchen pushed a commit to huldarchen/ClickHouse that referenced this pull request Jun 15, 2026
…vert-106020-multistage-distributed

Revert "Revert "Multistage distributed queries" (ClickHouse#106020) — fixes ASan heap corruption on master"
groeneai added a commit to groeneai/ClickHouse that referenced this pull request Jun 17, 2026
…ted queries) and ClickHouse#107056

The prior CI run executed on a merge-base ~980 commits behind these fixes,
so it inherited the master-wide ASan heap corruption from ClickHouse#106020 (segfaults
during String serialization in DistributedSink / MergeTask / MergeMutate,
STIDs 1288-3bd5, 2046-50c3, 0988-1d81) plus the known-flaky
02865_tcp_proxy_query_packet_validation. Both are fixed on current master.
No conflicts; CREATE OR REPLACE size-check changes are unaffected.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
zvonand added a commit to Altinity/ClickHouse that referenced this pull request Jul 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-experimental Experimental Feature pr-synced-to-cloud The PR is synced to the cloud repo

Projects

None yet

Development

Successfully merging this pull request may close these issues.