Repository navigation
Review names of configuration settings #2601
Description
Activity
This was done ahead of 1.0.0 under #4978. #4986 moved every shuffle config under spark.comet.shuffle.*, the hyphenated and dot-separated keys no longer exist, and #4979 added withAlternative so the old names keep working as deprecated aliases. The naming rules are now written down in the Configuration Conventions page of the contributor guide.
What is the problem the feature request solves?
The configuration settings have many inconsistencies.
For example, we have many different prefixes for shuffle-related configs:
spark.comet.columnar.shufflespark.comet.exec.shufflespark.comet.native.shufflespark.comet.shuffleThere are also differences in convention for naming within configs:
mergeRanges(Camel Case)thread-pool(Hyphenated)read.parallel.io(dot separated)Renaming any of these configs will be disruptive to users. If we do rename them, I suggest we do it for the 1.0.0 release.
We could also consider introducing a capability to support the old deprecated names for some period of time.
Describe the potential solution
No response
Additional context
No response