File partitioning for ListingTable - #1141

Merged

alamb merged 18 commits into

apache:masterfrom

rdettai:file-partitioning

Nov 1, 2021

Commits on Oct 28, 2021

[feat] adding partition_values to PartitionedFile
rdettai
committed
c184efa
[wip] implementing pruned_partition_list
rdettai
committed
2e82902
[feat] implement pruned_partition_list
rdettai
committed
cbbf347
[fix] outdated comment
rdettai
committed
f74ee67
[fix] adding extra partitioning col for csv avro json
rdettai
committed
fb15b3b
[fix] houqp's review
rdettai
committed
95216d8
[fix] ListingTable takes schema without partition cols
rdettai
committed
26bf105
[feat] added partition columns for parquet
rdettai
committed
c34193d
[feat] specify supports_filter_pushdown
rdettai
committed
32c5bf6
[fix] parquet rowgroup pruning not kicking in
rdettai
committed
10b52eb
[test] added proper integration tests
rdettai
committed
f207b92
[test] check output schemas
rdettai
committed
dfa6d0e
[test] add integ tests for partitioned parquet
rdettai
committed
f8edb38
[fix] wrong schema passed to get_statistics_with_limit
rdettai
committed
c5cfcfb

Commits on Oct 29, 2021

[fix] improvements following review
rdettai
committed
cb0789e

Commits on Nov 1, 2021

Merge remote-tracking branch 'apache/master' into file-partitioning
alamb
committed
0303913
Add GetIndexedField to the list of exprs that can be in predicates
alamb
committed
5d34be6
Update datafusion/src/datasource/listing/helpers.rs

rdettai
and
jimexist
authored
a4ec801