feat: support Apache Celeborn remote shuffle service - #5467

Closed

pingzh wants to merge 12 commits into

apache:mainfrom

pingzh:pingzh-support-celeborn-rss

Commits on Aug 25, 2026

feat: add RSS partition writer and JNI callback
pingzh
committed
f3706cd
feat: add partition writer to shuffle plans
pingzh
committed
895e82b
feat: add destination-aware native shuffle execution
pingzh
committed
e05541a
feat: bind task-owned Java pushers to native shuffle planning
pingzh
committed
fe9c819
feat: add Celeborn shuffle manager and partition pusher
pingzh
committed
b08351b
feat: complete Celeborn native shuffle map-side push lifecycle
pingzh
committed
db51df0
fix: handle Celeborn push cancellation, retries, and nested batches
pingzh
committed
413edb6
feat: add native Celeborn shuffle reader
pingzh
committed
e62f4ca
feat: enable native-only Celeborn shuffle planning
pingzh
committed
26b1024
fix: make Celeborn remote shuffle compatible with upstream Apache releases
pingzh
committed
6422794

Commits on Aug 26, 2026