Repository navigation

feat: support Spark HyperLogLog sketch functions (hll_sketch_agg, hll_union_agg, hll_sketch_estimate, hll_union) - #4802

Merged

andygrove merged 20 commits into

apache:mainfrom

andygrove:feat/hll-sketch-functions

Sep 28, 2026

Merged

feat: support Spark HyperLogLog sketch functions (hll_sketch_agg, hll_union_agg, hll_sketch_estimate, hll_union)#4802
andygrove merged 20 commits into
apache:mainfrom
andygrove:feat/hll-sketch-functions

Commits on Jul 2, 2026
Commits on Jul 3, 2026
- feat: add native hll_sketch_agg accumulator and planner arm
  andygrove
  committed
  5dc29b0
- feat: add hll_sketch_agg Scala serde for Spark 4.x
  andygrove
  committed
  a52944d
- feat: add hll_sketch_estimate scalar function
  andygrove
  committed
  f31cbf8
- feat: mark HLL expressions incompatible and add opt-in end-to-end test
  andygrove
  committed
  4f0f289
- feat: add native and serde for hll_union_agg
  andygrove
  committed
  342bd6e
- feat: add hll_union scalar function
  andygrove
  committed
  a9f8893
- test: add hll_union end-to-end and error tests, apply formatting
  andygrove
  committed
  93dedb3
- fix: HLL empty-group returns empty sketch and size() accounts for sketch heap
  andygrove
  committed
  ad39ec5
- ci: run CI for HLL sketch functions
  andygrove
  committed
  df37620
Commits on Sep 7, 2026
- Merge remote-tracking branch 'apache/main' into feat/hll-sketch-functions
  andygrove
  committed
  b332f1b
Commits on Sep 9, 2026
Commits on Sep 10, 2026
- test: keep the HLL lgConfigK rejection test native on Spark 4.2
  test
  committed
  e70c3d4
Commits on Sep 25, 2026