Skip to content

HDDS-16631. Fix chooseRandom for rack names with common prefixes - #11401

Merged
peterxcli merged 2 commits into
apache:masterfrom
adwetojha:HDDS-16631
Oct 4, 2026
Merged

peterxcli merged 2 commits into
apache:masterfrom
adwetojha:HDDS-16631

Conversation

@adwetojha

@adwetojha adwetojha commented Oct 3, 2026 •

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

InnerNodeImpl#getLeaf used a raw string-prefix comparison to determine
whether an excluded scope belonged to a child subtree. As a result, an
excluded path under /r10 was also treated as belonging under /r1,
reducing both subtrees' available leaf counts and causing chooseRandom
to return null even when an eligible node existed.

The change uses Node#isAncestor(String) for topology-aware path
comparison. This preserves exact-node and genuine-descendant exclusions
while respecting path-component boundaries.

A regression test creates nodes under /r1 and /r10, excludes the node
under /r10, and verifies that the node under /r1 is selected.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-16631

How was this patch tested?

  • Focused regression test:
    mvn -ntp -pl :hdds-server-framework test '-Dtest=TestNetworkTopologyImpl#testChooseRandomWithExcludedScopePrefix' -DskipShade -DskipRecon -DskipDocs
  • Full affected module:
    mvn -ntp -pl :hdds-server-framework clean test -DskipShade -DskipRecon -DskipDocs
    (646 tests, 0 failures, 0 errors, 1 skipped)
  • Checkstyle:
    ./hadoop-ozone/dev-support/checks/checkstyle.sh
  • Fork build-branch workflow:
    https://github.com/adwetojha/ozone/actions/runs/37128788136

@adoroszlai
adoroszlai requested a review from peterxcli October 4, 2026 06:19

@peterxcli peterxcli left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@adwetojha Thanks!

@peterxcli
peterxcli merged commit 77d5829 into apache:master Oct 4, 2026
85 of 88 checks passed
@adwetojha
adwetojha deleted the HDDS-16631 branch October 4, 2026 14:34
errose28 added a commit that referenced this pull request Oct 6, 2026
* master: (64 commits)
  HDDS-16716. Add description for ozone.scm.ec.pipeline.per.volume.factor (#11415)
  HDDS-16008. PutBlocks from Flushes also go without Raft (#11356)
  HDDS-16666. Flush SCM transaction in memory during apply transaction (#11409)
  HDDS-15749. Run specific JUnit tests if possible (#10671)
  HDDS-16362. GetObjectAttributes ObjectParts should return Part entries for FSO buckets (#11242).
  HDDS-16643. Remove CleanupTableInfo mechanism (#11365)
  HDDS-16721. StreamBlockInputStream.read() returns a negative value for bytes 0x80 to 0xFF (#11411)
  HDDS-16241. gRPC deadline kills long-lived block streams after 30 seconds and the client never recovers (#11080)
  HDDS-15991. Speed up deleted table scans in quota repair (#11386)
  HDDS-16674. Bump awssdk to 2.55.6 (#11407)
  HDDS-16673. Avoid redundant ListBuckets RPCs when S3 bucket listing reaches the end (#11397)
  HDDS-16708. Let dependabot ignore iceberg minor version upgrades (#11398)
  HDDS-16713. Bump develocity-maven-extension to 2.6.0 (#11405)
  HDDS-16300. Allow OM to dynamically reconfigure its SCM node list without a restart (#11218)
  HDDS-15089. Support S3 per request read consistency (#11252)
  HDDS-16704. ReadBlock fails with IllegalStateException when a response is shorter than responseDataSize (#11402)
  HDDS-16631. Fix chooseRandom for rack names with common prefixes (#11401)
  HDDS-16654. Replace usage of deprecated finalize() in OM (#11376)
  HDDS-16658. Reuse source key details when opening input stream in S3 CopyObject (#11396)
  HDDS-16711. Bump moment to 2.31.0 (#11373)
  ...

Conflicts:
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/HealthyReadOnlyNodeHandler.java
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/NodeStateManager.java
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/SCMNodeManager.java
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/ha/TestSCMStateMachine.java
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/node/TestDeadNodeHandler.java
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/node/TestNodeStateManager.java
hadoop-ozone/client/src/test/java/org/apache/hadoop/ozone/client/rpc/TestRpcClient.java
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OmUtils.java
hadoop-ozone/common/src/test/java/org/apache/hadoop/ozone/om/ha/TestHadoopRpcOMFollowerReadFailoverProxyProvider.java
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/shell/TestOzoneShellHA.java
hadoop-ozone/interface-client/src/main/proto/OmClientProtocol.proto
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerStateMachine.java
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/upgrade/OMCancelPrepareResponse.java
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/upgrade/OMCompleteFinalizeUpgradeResponse.java
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/upgrade/OMPrepareResponse.java
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/protocolPB/OzoneManagerRequestHandler.java
hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/ratis/TestOzoneManagerStateMachine.java
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants