You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Plan file scan task according scan file size. #128
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
Activity
rahull-p commentedon Aug 10, 2024
Can I work on this ? Additionally is the expectation here is to add multiple FileScanTask based on the split size and the scan file size
liurenjie1024 commentedon Aug 13, 2024
Hi, @rahull-p Thanks for your interest, and welcome to contribute! In the basic version, we need to take the split size into account. In advanced version, we also need to take the file open cost into account. Java's reference implementation is here: https://github.com/apache/iceberg/blob/ab6391767e75357a9a12691513d9f83a4180f7e4/core/src/main/java/org/apache/iceberg/BaseTableScan.java#L43
github-actions commentedon Oct 21, 2025
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
liurenjie1024 commentedon Oct 21, 2025
This is a missing feature, we should use this issue to track it.
github-actions commentedon Apr 20, 2026
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
blackmwk commentedon Apr 20, 2026
Don't close it, it's missing feature.
docs(datafusion): note count-based bucketing limitation