Skip to content

TPC-DS Q4 decompression failure with ZstdBuffers #8549

Description

@myrrc

When using Zstdbuffers instead of Zstd in #8542, TPC-DS fails to decompress data on Q4.

Other error: query 4 failed: External error: Failed to read Vortex file: 
home/runner/_work/vortex/vortex/vortex-bench/data/tpcds/1.0/vortex-compact/customer.vortex:
  Expected bool dtype, got Utf8(Nullable)
Backtrace:
   0: <vortex_array::arrays::bool::vtable::Bool as vortex_array::array::vtable::VTable>::validate
   1: vortex_array::array::typed::Array<V>::try_from_parts
   2: <V as vortex_array::array::plugin::ArrayPlugin>::deserialize
   3: vortex_array::serde::SerializedArray::decode
   4: <vortex_array::serde::SerializedArrayChildren as vortex_array::serde::ArrayChildren>::get
   5: <vortex_zstd::zstd_buffers::ZstdBuffers as vortex_array::array::vtable::VTable>::deserialize
   6: <V as vortex_array::array::plugin::ArrayPlugin>::deserialize
   7: vortex_array::serde::SerializedArray::decode
   8: vortex_layout::layouts::flat::reader::FlatReader::array_future::{{closure}}
<...>
  18: <vortex_layout::layouts::struct_::reader::StructReader as vortex_layout::reader::LayoutReader>::projection_evaluation::{{closure}}
<...>

https://github.com/vortex-data/vortex/actions/runs/28017432583/job/82925156252?pr=8542#step:17:96

Metadata

Metadata

Assignees

Labels

bugA bug issue

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions