Skip to content

HDDS-16066. replicas after re-replication should span at least 2 racks - #10944

Open
hevinhsu wants to merge 2 commits into
apache:masterfrom
hevinhsu:HDDS-16066
Open

HDDS-16066. replicas after re-replication should span at least 2 racks#10944
hevinhsu wants to merge 2 commits into
apache:masterfrom
hevinhsu:HDDS-16066

Conversation

@hevinhsu

@hevinhsu hevinhsu commented Aug 4, 2026

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

This pull request addresses the flaky rack-aware placement test reported in HDDS-16066 and removes obsolete FindBugs exclusions for the nested tests in TestRackAwarePlacement.

The rack-aware placement test previously waited only for the container replica count to reach three after shutting down a datanode. Since the original replica set already contained three replicas, this condition could be satisfied before the dead datanode replica was removed and before re-replication completed.

The test now waits until:

  • At least three replicas are present.
  • The stopped datanode is no longer included in the replica set.

This prevents the test from checking rack placement while the container is temporarily under-replicated.

The obsolete SIC_INNER_SHOULD_BE_STATIC FindBugs exclusions for the nested test classes are also removed. The affected helper methods are made non-static to match their usage by the nested test classes.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-16066

How was this patch tested?

https://github.com/hevinhsu/ozone/actions/runs/30880442815

@adoroszlai adoroszlai left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @hevinhsu for the patch, LGTM. Can you please run 10x10 flaky-test-check for TestRackAwarePlacement*?

@hevinhsu

hevinhsu commented Aug 4, 2026

Copy link
Copy Markdown
Contributor Author

Thanks @adoroszlai for the reviews!

The flaky-test-check run is here:
https://github.com/hevinhsu/ozone/actions/runs/30899377348

PTAL when you have time. Thanks!

@adoroszlai

Copy link
Copy Markdown
Contributor

https://github.com/hevinhsu/ozone/actions/runs/30899377348

Thanks for triggering it, but the parameters seem wrong. It should be:

  • Test Class = TestRackAwarePlacement* (instead of NA)
  • Number of Iterations per split = 10 (instead of org.apache.hadoop.hdds.scm.TestRackAwarePlacement)

@hevinhsu

hevinhsu commented Aug 4, 2026

Copy link
Copy Markdown
Contributor Author

Oops, my bad 😅 I mixed up the fields. I’ll retrigger it with the correct parameters. Thanks!

@adoroszlai

Copy link
Copy Markdown
Contributor

Thanks @hevinhsu for triggering the test. There are 5 failures without the fix (on master) and 4 with the fix. So there may be another source of the problem left?

@yandrey321 yandrey321 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants