HDFS-17850. Reject append when new generation stamp equals or is less… by deepujain · Pull Request #8334 · apache/hadoop

deepujain · 2026-03-09T15:41:52Z

Summary

When using a third-party HDFS client, if the client does not update the generation stamp (GS) correctly on append, the DataNode previously accepted newGS == currentGS, which can lead to corrupted replica state. This change requires the new generation stamp to be strictly greater than the replica's current generation stamp: append now rejects both newGS < currentGS (existing) and newGS == currentGS (new), so misbehaving clients cannot silently corrupt replica state.

Change

FsDatasetImpl.java: In append(ExtendedBlock b, long newGS, long expectedBlockLen), change the validity check from newGS < b.getGenerationStamp() to newGS <= b.getGenerationStamp(), so that equal generation stamps are also rejected with the same IOException message.
TestFsDatasetImpl.java: Add testAppendRejectsSameOrLowerGenerationStamp(): create a file, get the finalized block, then assert that append(block, block.getGenerationStamp(), blockLen) and append(block, block.getGenerationStamp() - 1, blockLen) throw IOException with "should be greater than the replica", and that append(block, block.getGenerationStamp() + 1, blockLen) succeeds (HDFS-17850).

JIRA

Fixes HDFS-17850

For code changes:

The title starts with the corresponding JIRA issue ID.
Object storage integration tests and endpoint declaration: Not applicable: this PR does not change an object-store connector.
No new dependencies are introduced.
No LICENSE or NOTICE updates are needed for this diff.

AI Tooling

Contains content generated by Codex.

AI-generated content is disclosed.
Use follows https://www.apache.org/legal/generative-tooling.html.

How was this patch tested?

Earlier commands above are historical evidence, where present. Current rebase validation passed git diff --check; fresh hosted CI is running. Focused Java validation is reported separately when complete.

Validated repair head `bc2fe171` (2026-09-19)

TestFsDatasetImpl#testAppendRejectsSameOrLowerGenerationStamp passed: 1 test, 0 failures, 0 errors, 0 skipped. The selected reactor finished successfully in a Java 17/Maven 3.9.15 container with GNU stat and bounded memory (MAVEN_OPTS=-Xmx1024m, test heap 1536 MB).

mvn -B -ntp -pl hadoop-hdfs-project/hadoop-hdfs -am -Dtest=TestFsDatasetImpl#testAppendRejectsSameOrLowerGenerationStamp -Dsurefire.failIfNoSpecifiedTests=false -Dmaven.test.failure.ignore=false "-Dmaven-surefire-plugin.argLine=-Xmx1536m -Xss4m" test

Full TestFsDatasetImpl class first attempt was killed by Docker OOM (exit137), narrowed to direct regression under bounded heap. Full-class success is not claimed.

hadoop-yetus · 2026-03-10T13:33:24Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 34s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+0 🆗	detsecrets	0m 1s		detect-secrets was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	40m 20s		trunk passed
+1 💚	compile	1m 45s		trunk passed with JDK Ubuntu-21.0.10+7-Ubuntu-124.04
+1 💚	compile	1m 50s		trunk passed with JDK Ubuntu-17.0.18+8-Ubuntu-124.04.1
+1 💚	checkstyle	1m 45s		trunk passed
+1 💚	mvnsite	1m 58s		trunk passed
+1 💚	javadoc	1m 31s		trunk passed with JDK Ubuntu-21.0.10+7-Ubuntu-124.04
+1 💚	javadoc	1m 32s		trunk passed with JDK Ubuntu-17.0.18+8-Ubuntu-124.04.1
+1 💚	spotbugs	4m 9s		trunk passed
+1 💚	shadedclient	30m 46s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	1m 20s		the patch passed
+1 💚	compile	1m 14s		the patch passed with JDK Ubuntu-21.0.10+7-Ubuntu-124.04
+1 💚	javac	1m 14s		the patch passed
+1 💚	compile	1m 17s		the patch passed with JDK Ubuntu-17.0.18+8-Ubuntu-124.04.1
+1 💚	javac	1m 17s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	1m 17s		the patch passed
+1 💚	mvnsite	1m 26s		the patch passed
+1 💚	javadoc	0m 58s		the patch passed with JDK Ubuntu-21.0.10+7-Ubuntu-124.04
+1 💚	javadoc	1m 2s		the patch passed with JDK Ubuntu-17.0.18+8-Ubuntu-124.04.1
+1 💚	spotbugs	3m 52s		the patch passed
+1 💚	shadedclient	30m 10s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	217m 50s		hadoop-hdfs in the patch passed.
+1 💚	asflicense	0m 45s		The patch does not generate ASF License warnings.
		345m 19s

Subsystem	Report/Notes
Docker	ClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/1/artifact/out/Dockerfile
GITHUB PR	#8334
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname	Linux 312fb1560ce1 5.15.0-164-generic #174-Ubuntu SMP Fri Nov 14 20:25:16 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `b40483d`
Default Java	Ubuntu-17.0.18+8-Ubuntu-124.04.1
Multi-JDK versions	/usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.10+7-Ubuntu-124.04 /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.18+8-Ubuntu-124.04.1
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/1/testReport/
Max. process+thread count	3473 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/1/console
versions	git=2.43.0 maven=3.9.11 spotbugs=4.9.7
Powered by	Apache Yetus 0.14.1 https://yetus.apache.org

This message was automatically generated.

deepujain · 2026-05-27T15:59:50Z

CI is green on the current head, and this one still has not had a human review. @Hexiaoqiao @ZanderXu, when you have a moment, could you please take a look? Happy to make any follow-up changes.

deepujain · 2026-06-14T16:17:41Z

CI is still green on the current head, and this one is still waiting on human review. @hfutatzhanghb @Hexiaoqiao, when you have a moment, could you please take a look? Happy to make any follow-up changes.

hfutatzhanghb · 2026-06-15T05:46:23Z

@deepujain Thanks for your work! Could you rebase this PR onto the latest trunk branch ? Will review later. Thanks.

deepujain · 2026-06-15T07:07:51Z

Rebased this onto the latest apache/trunk and force-pushed the refreshed single commit. Local validation passed with JAVA_HOME=/opt/homebrew/opt/openjdk@17/libexec/openjdk.jdk/Contents/Home ./mvnw -Dmaven.repo.local=/tmp/codex-m2 test -pl hadoop-hdfs-project/hadoop-hdfs -am -Dtest=TestFsDatasetImpl -DskipTests=false. Ready for review whenever you get a chance.

hadoop-yetus · 2026-06-15T11:37:49Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	6m 35s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+0 🆗	detsecrets	0m 1s		detect-secrets was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	26m 30s		trunk passed
+1 💚	compile	0m 57s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	compile	1m 0s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	checkstyle	0m 58s		trunk passed
+1 💚	mvnsite	1m 5s		trunk passed
+1 💚	javadoc	0m 47s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 49s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 8s		trunk passed
+1 💚	shadedclient	18m 9s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 45s		the patch passed
+1 💚	compile	0m 39s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 39s		the patch passed
+1 💚	compile	0m 40s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 40s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 39s		the patch passed
+1 💚	mvnsite	0m 45s		the patch passed
+1 💚	javadoc	0m 33s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 37s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 3s		the patch passed
+1 💚	shadedclient	18m 29s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	185m 1s		hadoop-hdfs in the patch passed.
+1 💚	asflicense	0m 30s		The patch does not generate ASF License warnings.
		269m 8s

Subsystem	Report/Notes
Docker	ClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/2/artifact/out/Dockerfile
GITHUB PR	#8334
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname	Linux af2380a1079e 5.15.0-181-generic #191-Ubuntu SMP Fri May 22 19:09:02 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `261c748`
Default Java	Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Multi-JDK versions	/usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.11+10-1-24.04.2-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/2/testReport/
Max. process+thread count	4193 (vs. ulimit of 10000)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/2/console
versions	git=2.43.0 maven=3.9.15 spotbugs=4.9.7
Powered by	Apache Yetus 0.14.1 https://yetus.apache.org

This message was automatically generated.

deepujain · 2026-06-26T15:00:15Z

The rebase request is addressed and CI is green on the current head. @hfutatzhanghb, when you have a moment, could you please take another look? Happy to make any follow-up changes.

deepujain · 2026-07-06T10:36:46Z

The requested rebase is already addressed and CI is still green on the current head. @hfutatzhanghb, when you have a moment, could you please take another look? Happy to make any follow-up changes.

deepujain · 2026-07-09T07:54:04Z

Rebased this on current trunk and force-pushed the refreshed head. Ran JAVA_HOME=/opt/homebrew/opt/openjdk@17/libexec/openjdk.jdk/Contents/Home PATH=/opt/homebrew/opt/openjdk@17/libexec/openjdk.jdk/Contents/Home/bin:$PATH ./mvnw test -pl hadoop-hdfs-project/hadoop-hdfs -am -Dtest=TestFsDatasetImpl -DskipTests=false -Dmaven.repo.local=/private/tmp/hadoop-m2 locally, and it passed. Ready for another look.

hadoop-yetus · 2026-07-09T12:13:32Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 21s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	26m 25s		trunk passed
+1 💚	compile	1m 0s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	compile	1m 0s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	checkstyle	1m 5s		trunk passed
+1 💚	mvnsite	1m 8s		trunk passed
+1 💚	javadoc	0m 57s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 57s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 18s		trunk passed
+1 💚	shadedclient	17m 30s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 44s		the patch passed
+1 💚	compile	0m 41s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 41s		the patch passed
+1 💚	compile	0m 44s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 44s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 41s		the patch passed
+1 💚	mvnsite	0m 46s		the patch passed
+1 💚	javadoc	0m 38s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 36s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 1s		the patch passed
+1 💚	shadedclient	16m 43s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	182m 57s		hadoop-hdfs in the patch passed.
+1 💚	asflicense	0m 31s		The patch does not generate ASF License warnings.
		259m 12s

Subsystem	Report/Notes
Docker	ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/3/artifact/out/Dockerfile
GITHUB PR	#8334
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname	Linux 3b75c4585723 5.15.0-181-generic #191-Ubuntu SMP Fri May 22 19:09:02 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `2f536d1`
Default Java	Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Multi-JDK versions	/usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.11+10-1-24.04.2-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/3/testReport/
Max. process+thread count	4433 (vs. ulimit of 10000)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/3/console
versions	git=2.43.0 maven=3.9.15 spotbugs=4.9.7
Powered by	Apache Yetus 0.14.1 https://yetus.apache.org

This message was automatically generated.

deepujain · 2026-07-09T23:48:37Z

Reran the existing Build workflow on the current head. No code changes here. The previous GitHub Build failure was in the unrelated TestDSWithMultipleNodeManager shard, while Apache Yetus and pr-merge on this head are already green.

deepujain · 2026-07-10T03:05:20Z

Reran the existing workflow on the current head again. The latest fork-side rerun hit the shared lane, while and on this head are green. No code changes in this update.

deepujain · 2026-07-10T03:05:34Z

Reran the existing Build workflow on the current head again. The latest fork-side rerun hit the shared Run / Test hdfs-rbf (Java 17) ubuntu_24-trunk lane, while Apache Yetus and pr-merge on this head are green. No code changes in this update.

deepujain · 2026-07-11T03:40:08Z

No code changes here. I reran the existing fork-side Build workflow on the current head again, so the stale red GitHub Actions lane is being refreshed now.

hadoop-yetus · 2026-07-11T08:18:55Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 21s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	26m 35s		trunk passed
+1 💚	compile	0m 59s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	compile	1m 2s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	checkstyle	0m 56s		trunk passed
+1 💚	mvnsite	1m 5s		trunk passed
+1 💚	javadoc	0m 48s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 57s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 13s		trunk passed
+1 💚	shadedclient	17m 11s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 44s		the patch passed
+1 💚	compile	0m 42s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 42s		the patch passed
+1 💚	compile	0m 45s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 45s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 42s		the patch passed
+1 💚	mvnsite	0m 50s		the patch passed
+1 💚	javadoc	0m 34s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 37s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 0s		the patch passed
+1 💚	shadedclient	16m 25s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	183m 33s		hadoop-hdfs in the patch passed.
+1 💚	asflicense	0m 28s		The patch does not generate ASF License warnings.
		259m 7s

Subsystem	Report/Notes
Docker	ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/4/artifact/out/Dockerfile
GITHUB PR	#8334
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname	Linux 134707958de6 5.15.0-181-generic #191-Ubuntu SMP Fri May 22 19:09:02 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `39d8560`
Default Java	Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Multi-JDK versions	/usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.11+10-1-24.04.2-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/4/testReport/
Max. process+thread count	3871 (vs. ulimit of 10000)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/4/console
versions	git=2.43.0 maven=3.9.15 spotbugs=4.9.7
Powered by	Apache Yetus 0.14.1 https://yetus.apache.org

This message was automatically generated.

deepujain · 2026-07-13T00:32:37Z

No code changes here. I reran the current head again on July 12, 2026 to refresh the fork-side red GitHub Actions lane. On that rerun, the only failing shard was Run / Test hdfs-rbf (Java 17) ubuntu_24-trunk, where Surefire reported a forked-VM crash around org.apache.hadoop.hdfs.server.federation.security.token.TestZKDelegationTokenSecretManagerImpl. Apache Yetus and pr-merge on this head are already green.

If the patch looks reasonable, @hfutatzhanghb @Hexiaoqiao, could you please take a look when you have a moment? Happy to make any follow-up changes.

deepujain · 2026-07-20T11:33:21Z

No code changes here. Apache Yetus and pr-merge on this head are still green, and this one is still waiting on human review as of July 20, 2026. @hfutatzhanghb @Hexiaoqiao, when you have a moment, could you please take a look? Happy to make any follow-up changes.

deepujain · 2026-07-21T07:19:20Z

No code changes here. I reran the existing fork-side Build workflow on the current head again on July 21, 2026, so the stale red GitHub Actions lane is being refreshed now.

deepujain · 2026-07-21T13:56:15Z

No code changes here. I reran the fork-side Build workflow on July 21, 2026, and the rerun still failed in the shared Run / Test hdfs-rbf (Java 17) ubuntu_24-trunk lane, specifically org.apache.hadoop.yarn.applications.distributedshell.TestDSWithMultipleNodeManager. That still looks outside this HDFS append-generation-stamp patch.

deepujain · 2026-07-26T05:06:58Z

No code changes here. Apache Yetus and pr-merge on this head are still green, and the remaining red GitHub Actions lane is still the unrelated shared failure path already called out on July 21, 2026. If the patch itself looks good, @hfutatzhanghb @Hexiaoqiao, could you please take another look when you have a moment? Happy to make any follow-up changes.

deepujain · 2026-08-04T13:27:57Z

Rebased this branch onto current apache/trunk on August 4, 2026 and force-pushed the refreshed single commit. I also retried JAVA_HOME=/opt/homebrew/opt/openjdk@17/libexec/openjdk.jdk/Contents/Home PATH=/opt/homebrew/opt/openjdk@17/libexec/openjdk.jdk/Contents/Home/bin:$PATH ./mvnw -Dmaven.repo.local=/private/tmp/hadoop-m2 test -pl hadoop-hdfs-project/hadoop-hdfs -am -Dtest=TestFsDatasetImpl -DskipTests=false on the rebased head, but it timed out in this environment during the long reactor rebuild before it reached a test result. No source changes beyond the rebase in this update.

deepujain · 2026-08-05T05:24:12Z

Pushed a no-code Trigger CI commit on August 5, 2026 to refresh the stale pending checks on the current head. The previous fork-side GitHub Build had already passed, so this update is only to give continuous-integration/jenkins/pr-merge and the Apache-side check view a fresh event.

hadoop-yetus · 2026-08-05T09:41:49Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 22s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	25m 37s		trunk passed
+1 💚	compile	0m 56s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	compile	0m 56s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	checkstyle	1m 2s		trunk passed
+1 💚	mvnsite	1m 8s		trunk passed
+1 💚	javadoc	0m 52s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 52s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 14s		trunk passed
+1 💚	shadedclient	17m 29s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 46s		the patch passed
+1 💚	compile	0m 43s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 43s		the patch passed
+1 💚	compile	0m 44s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 44s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 43s		the patch passed
+1 💚	mvnsite	0m 46s		the patch passed
+1 💚	javadoc	0m 37s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 36s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 6s		the patch passed
+1 💚	shadedclient	17m 1s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	181m 6s	/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt	hadoop-hdfs in the patch passed.
+1 💚	asflicense	0m 27s		The patch does not generate ASF License warnings.
		256m 24s

Reason	Tests
Failed junit tests	hadoop.hdfs.TestBlockRecoveryCauseStandbyNameNodeCrash

Subsystem	Report/Notes
Docker	ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/6/artifact/out/Dockerfile
GITHUB PR	#8334
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname	Linux cf218c60348e 5.15.0-181-generic #191-Ubuntu SMP Fri May 22 19:09:02 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `07d80aa`
Default Java	Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Multi-JDK versions	/usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.11+10-1-24.04.2-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/6/testReport/
Max. process+thread count	4392 (vs. ulimit of 10000)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/6/console
versions	git=2.43.0 maven=3.9.15 spotbugs=4.9.7
Powered by	Apache Yetus 0.14.1 https://yetus.apache.org

This message was automatically generated.

deepujain · 2026-08-06T09:12:00Z

No code changes here. Yetus on the August 5, 2026 head failed only in TestBlockRecoveryCauseStandbyNameNodeCrash, but that test passes locally on the current branch with JAVA_HOME=/opt/homebrew/opt/openjdk@17/libexec/openjdk.jdk/Contents/Home PATH=/opt/homebrew/opt/openjdk@17/libexec/openjdk.jdk/Contents/Home/bin:$PATH ./mvnw -Dmaven.repo.local=/private/tmp/hadoop-m2 test -pl hadoop-hdfs-project/hadoop-hdfs -am -Dtest=TestBlockRecoveryCauseStandbyNameNodeCrash -DskipTests=false (1 test, 0 failures). I pushed a no-code Trigger CI commit to give Yetus and pr-merge a fresh run.

deepujain · 2026-08-09T14:00:23Z

Quick status refresh as of August 9, 2026: I reran the fork-side GitHub Build for the current head. The rerun completed with a failure in only the Run / Test hdfs - slow (Java 17) ubuntu_24-trunk shard, with TestObserverNode.testGetListingForDeletedDir and TestObserverNode.testSimpleReadEmptyDirOrFile both failing under java.lang.ClassCastException: class java.lang.Long cannot be cast to class java.lang.Boolean. That still looks outside this append generation-stamp change, so I have not pushed any code change here.

deepujain · 2026-08-10T05:09:03Z

No code changes in this update. I pushed a no-code Trigger CI commit on August 10, 2026 so continuous-integration/jenkins/pr-merge and the Apache-side status view can refresh on a new head. The latest direct local HDFS signal on this branch is still the focused TestBlockRecoveryCauseStandbyNameNodeCrash pass from August 6, 2026.

hadoop-yetus · 2026-08-10T09:27:31Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 20s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	27m 31s		trunk passed
+1 💚	compile	0m 57s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	compile	1m 3s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	checkstyle	1m 3s		trunk passed
+1 💚	mvnsite	1m 10s		trunk passed
+1 💚	javadoc	0m 56s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 57s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 16s		trunk passed
+1 💚	shadedclient	17m 11s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 46s		the patch passed
+1 💚	compile	0m 43s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 43s		the patch passed
+1 💚	compile	0m 44s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 44s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 41s		the patch passed
+1 💚	mvnsite	0m 48s		the patch passed
+1 💚	javadoc	0m 34s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 37s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 6s		the patch passed
+1 💚	shadedclient	17m 6s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	180m 38s		hadoop-hdfs in the patch passed.
+1 💚	asflicense	0m 30s		The patch does not generate ASF License warnings.
		257m 52s

Subsystem	Report/Notes
Docker	ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/8/artifact/out/Dockerfile
GITHUB PR	#8334
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname	Linux 0327649d04c7 5.15.0-181-generic #191-Ubuntu SMP Fri May 22 19:09:02 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `1e3a042`
Default Java	Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Multi-JDK versions	/usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.11+10-1-24.04.2-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/8/testReport/
Max. process+thread count	3653 (vs. ulimit of 10000)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/8/console
versions	git=2.43.0 maven=3.9.15 spotbugs=4.9.7
Powered by	Apache Yetus 0.14.1 https://yetus.apache.org

This message was automatically generated.

deepujain · 2026-08-11T04:45:25Z

No code changes in this update. On the August 10, 2026 head, Apache Yetus and continuous-integration/jenkins/pr-merge are green; the only remaining red signal was the fork-side GitHub Build, where the failing shard was Run / Test common (Java 17) ubuntu_24-trunk with TestZKDelegationTokenSecretManager.testNodesLoadedAfterRestart failing and TestHttpServer.testHttpServer2Metrics showing up as a flake. That still looks outside this append-generation-stamp patch, so I reran the existing fork-side Build workflow on August 11, 2026 for a fresh signal.

deepujain · 2026-08-11T14:37:31Z

No code changes here. The August 11, 2026 fork-side Build rerun for the current head ended cancelled after most shards had already gone green, while Apache Yetus and continuous-integration/jenkins/pr-merge on this head remain green. I reran the existing fork-side Build workflow again for a fresh signal on the same head.

deepujain · 2026-08-12T06:54:10Z

All checks are green on the current head now, including the refreshed fork-side Build. @hfutatzhanghb @Hexiaoqiao, when you have a moment, could you please take another look? Happy to make any follow-up changes if needed.

deepujain · 2026-08-15T21:37:07Z

All checks are green on the current head. @hfutatzhanghb @Hexiaoqiao, could you please take another look when convenient? I am happy to address any follow-up.

hadoop-yetus · 2026-09-01T20:34:57Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 23s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	28m 37s		trunk passed
+1 💚	compile	0m 56s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	compile	1m 1s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	checkstyle	0m 58s		trunk passed
+1 💚	mvnsite	1m 0s		trunk passed
+1 💚	javadoc	0m 52s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 51s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 19s		trunk passed
+1 💚	shadedclient	18m 13s		branch has no errors when building and testing our client artifacts.
-0 ⚠️	patch	18m 31s		Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 56s		the patch passed
+1 💚	compile	0m 50s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 50s		the patch passed
+1 💚	compile	0m 50s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 50s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 43s		the patch passed
+1 💚	mvnsite	0m 49s		the patch passed
+1 💚	javadoc	0m 36s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 36s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 4s		the patch passed
+1 💚	shadedclient	17m 57s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	188m 21s	/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt	hadoop-hdfs in the patch passed.
+1 💚	asflicense	0m 31s		The patch does not generate ASF License warnings.
		268m 56s

Reason	Tests
Failed junit tests	hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes
	hadoop.hdfs.server.namenode.TestNameNodeMXBean

Subsystem	Report/Notes
Docker	ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/9/artifact/out/Dockerfile
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname	Linux a27341bed38c 5.15.0-190-generic #200-Ubuntu SMP Fri Aug 7 15:06:04 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `abbc78d`
Default Java	Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Multi-JDK versions	/usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.11+10-1-24.04.2-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/9/testReport/
Max. process+thread count	3945 (vs. ulimit of 10000)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/9/console
versions	git=2.43.0 maven=3.9.15 spotbugs=4.9.7
Powered by	Apache Yetus 0.14.1 https://yetus.apache.org

This message was automatically generated.

deepujain · 2026-09-01T21:30:08Z

Hi @ZanderXu @slfan1989 @Hexiaoqiao, HDFS-17850 has been open since March and is rebased on trunk. Same Jenkins flake on the last run. Happy to retrigger CI. A review would really help move this along.

hadoop-yetus · 2026-09-02T10:06:40Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 22s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	27m 37s		trunk passed
+1 💚	compile	1m 0s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	compile	1m 0s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	checkstyle	1m 2s		trunk passed
+1 💚	mvnsite	1m 2s		trunk passed
+1 💚	javadoc	0m 48s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 49s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 14s		trunk passed
+1 💚	shadedclient	18m 24s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 50s		the patch passed
+1 💚	compile	0m 44s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 44s		the patch passed
+1 💚	compile	0m 43s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 43s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 47s		the patch passed
+1 💚	mvnsite	0m 51s		the patch passed
+1 💚	javadoc	0m 33s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 36s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 8s		the patch passed
+1 💚	shadedclient	18m 8s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	195m 44s	/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt	hadoop-hdfs in the patch passed.
+1 💚	asflicense	0m 30s		The patch does not generate ASF License warnings.
		275m 32s

Reason	Tests
Failed junit tests	hadoop.hdfs.server.datanode.TestDataNodeLifeline
	hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes

Subsystem	Report/Notes
Docker	ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/10/artifact/out/Dockerfile
GITHUB PR	#8334
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname	Linux 2fd59d1cb9d5 5.15.0-190-generic #200-Ubuntu SMP Fri Aug 7 15:06:04 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `3e5c795`
Default Java	Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Multi-JDK versions	/usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.11+10-1-24.04.2-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/10/testReport/
Max. process+thread count	4311 (vs. ulimit of 10000)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/10/console
versions	git=2.43.0 maven=3.9.15 spotbugs=4.9.7
Powered by	Apache Yetus 0.14.1 https://yetus.apache.org

This message was automatically generated.

deepujain · 2026-09-04T02:20:21Z

Jenkins build 12 timed out after nearly three hours and exited 143 while running the HDFS module tests, with no patch-specific failure in the console. I pushed a no-code CI refresh on e15a4e2. Ready for the new CI run.

hadoop-yetus · 2026-09-04T06:46:50Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 22s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	31m 43s		trunk passed
+1 💚	compile	0m 56s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	compile	1m 2s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	checkstyle	1m 3s		trunk passed
+1 💚	mvnsite	1m 4s		trunk passed
+1 💚	javadoc	0m 55s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 52s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 16s		trunk passed
+1 💚	shadedclient	17m 30s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 46s		the patch passed
+1 💚	compile	0m 43s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 43s		the patch passed
+1 💚	compile	0m 45s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 45s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 41s		the patch passed
+1 💚	mvnsite	0m 47s		the patch passed
+1 💚	javadoc	0m 33s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 37s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 1s		the patch passed
+1 💚	shadedclient	16m 55s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	184m 16s	/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt	hadoop-hdfs in the patch passed.
+1 💚	asflicense	0m 30s		The patch does not generate ASF License warnings.
		265m 55s

Reason	Tests
Failed junit tests	hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes

Subsystem	Report/Notes
Docker	ClientAPI=1.56 ServerAPI=1.56 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/13/artifact/out/Dockerfile
GITHUB PR	#8334
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname	Linux 286b9a4b9d03 5.15.0-190-generic #200-Ubuntu SMP Fri Aug 7 15:06:04 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `e15a4e2`
Default Java	Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Multi-JDK versions	/usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.11+10-1-24.04.2-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/13/testReport/
Max. process+thread count	4384 (vs. ulimit of 10000)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/13/console
versions	git=2.43.0 maven=3.9.15 spotbugs=4.9.7
Powered by	Apache Yetus 0.14.1 https://yetus.apache.org

This message was automatically generated.

deepujain · 2026-09-04T16:01:39Z

Rebased cleanly onto current trunk at 706d4dcb. git diff --check apache/trunk...origin/HDFS-17850-append-reject-same-generation-stamp passes. This host currently has no Java runtime or Maven, so I could not rerun the focused Maven test here; fresh Build and Jenkins checks are queued on 24100703. Ready for CI.

hadoop-yetus · 2026-09-04T20:23:15Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 22s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	28m 0s		trunk passed
+1 💚	compile	0m 56s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	compile	1m 0s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	checkstyle	1m 0s		trunk passed
+1 💚	mvnsite	1m 3s		trunk passed
+1 💚	javadoc	0m 54s		trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 50s		trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 13s		trunk passed
+1 💚	shadedclient	18m 17s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 52s		the patch passed
+1 💚	compile	0m 51s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 51s		the patch passed
+1 💚	compile	0m 47s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	javac	0m 47s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 42s		the patch passed
+1 💚	mvnsite	0m 52s		the patch passed
+1 💚	javadoc	0m 34s		the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu
+1 💚	javadoc	0m 39s		the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
+1 💚	spotbugs	2m 3s		the patch passed
+1 💚	shadedclient	17m 42s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	184m 11s		hadoop-hdfs in the patch passed.
+1 💚	asflicense	0m 31s		The patch does not generate ASF License warnings.
		263m 51s

Subsystem	Report/Notes
Docker	ClientAPI=1.56 ServerAPI=1.56 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/14/artifact/out/Dockerfile
GITHUB PR	#8334
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname	Linux 1385ba92937a 5.15.0-190-generic #200-Ubuntu SMP Fri Aug 7 15:06:04 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `2410070`
Default Java	Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Multi-JDK versions	/usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.11+10-1-24.04.2-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.19+10-1-24.04.2-Ubuntu
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/14/testReport/
Max. process+thread count	4874 (vs. ulimit of 10000)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/14/console
versions	git=2.43.0 maven=3.9.15 spotbugs=4.9.7
Powered by	Apache Yetus 0.14.1 https://yetus.apache.org

This message was automatically generated.

… than replica. Signed-off-by: Deepak Jain <deepujain@gmail.com>

Signed-off-by: Deepak Jain <deepujain@gmail.com>

deepujain · 2026-09-19T05:04:50Z

Rebased onto trunk a3febb25 and pushed bc2fe171 to the fork. TestFsDatasetImpl#testAppendRejectsSameOrLowerGenerationStamp passes in the Java 17/Maven 3.9.15 container (1 test, no failures or errors), and git diff --check passes. The full TestFsDatasetImpl run exceeded the Docker memory limit; the focused regression passed with bounded heaps, so no full-class pass is claimed. Fresh hosted CI is running.

hadoop-yetus · 2026-09-19T09:16:09Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 22s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	28m 53s		trunk passed
+1 💚	compile	0m 52s		trunk passed with JDK Ubuntu-21.0.12+8-1-24.04-Ubuntu
+1 💚	compile	1m 0s		trunk passed with JDK Ubuntu-17.0.20+8-1-24.04-Ubuntu
+1 💚	checkstyle	0m 58s		trunk passed
+1 💚	mvnsite	1m 1s		trunk passed
+1 💚	javadoc	0m 49s		trunk passed with JDK Ubuntu-21.0.12+8-1-24.04-Ubuntu
+1 💚	javadoc	0m 50s		trunk passed with JDK Ubuntu-17.0.20+8-1-24.04-Ubuntu
+1 💚	spotbugs	2m 21s		trunk passed
+1 💚	shadedclient	19m 16s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 52s		the patch passed
+1 💚	compile	0m 46s		the patch passed with JDK Ubuntu-21.0.12+8-1-24.04-Ubuntu
+1 💚	javac	0m 46s		the patch passed
+1 💚	compile	0m 45s		the patch passed with JDK Ubuntu-17.0.20+8-1-24.04-Ubuntu
+1 💚	javac	0m 45s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 45s		the patch passed
+1 💚	mvnsite	0m 50s		the patch passed
+1 💚	javadoc	0m 36s		the patch passed with JDK Ubuntu-21.0.12+8-1-24.04-Ubuntu
+1 💚	javadoc	0m 39s		the patch passed with JDK Ubuntu-17.0.20+8-1-24.04-Ubuntu
+1 💚	spotbugs	2m 23s		the patch passed
+1 💚	shadedclient	19m 5s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	181m 37s		hadoop-hdfs in the patch passed.
+1 💚	asflicense	0m 31s		The patch does not generate ASF License warnings.
		264m 15s

Subsystem	Report/Notes
Docker	ClientAPI=1.56 ServerAPI=1.56 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/15/artifact/out/Dockerfile
GITHUB PR	#8334
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname	Linux 827b8ec94755 5.15.0-190-generic #200-Ubuntu SMP Fri Aug 7 15:06:04 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `bc2fe17`
Default Java	Ubuntu-17.0.20+8-1-24.04-Ubuntu
Multi-JDK versions	/usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.12+8-1-24.04-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.20+8-1-24.04-Ubuntu
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/15/testReport/
Max. process+thread count	4118 (vs. ulimit of 10000)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/15/console
versions	git=2.43.0 maven=3.9.15 spotbugs=4.9.7
Powered by	Apache Yetus 0.14.1 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2026-09-23T09:39:43Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 23s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 1s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	27m 1s		trunk passed
+1 💚	compile	0m 55s		trunk passed with JDK Ubuntu-21.0.12+8-1-24.04-Ubuntu
+1 💚	compile	0m 55s		trunk passed with JDK Ubuntu-17.0.20+8-1-24.04-Ubuntu
+1 💚	checkstyle	1m 5s		trunk passed
+1 💚	mvnsite	1m 0s		trunk passed
+1 💚	javadoc	0m 46s		trunk passed with JDK Ubuntu-21.0.12+8-1-24.04-Ubuntu
+1 💚	javadoc	0m 50s		trunk passed with JDK Ubuntu-17.0.20+8-1-24.04-Ubuntu
+1 💚	spotbugs	2m 23s		trunk passed
+1 💚	shadedclient	18m 56s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 54s		the patch passed
+1 💚	compile	0m 46s		the patch passed with JDK Ubuntu-21.0.12+8-1-24.04-Ubuntu
+1 💚	javac	0m 46s		the patch passed
+1 💚	compile	0m 45s		the patch passed with JDK Ubuntu-17.0.20+8-1-24.04-Ubuntu
+1 💚	javac	0m 45s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	0m 45s		the patch passed
+1 💚	mvnsite	0m 48s		the patch passed
+1 💚	javadoc	0m 36s		the patch passed with JDK Ubuntu-21.0.12+8-1-24.04-Ubuntu
+1 💚	javadoc	0m 36s		the patch passed with JDK Ubuntu-17.0.20+8-1-24.04-Ubuntu
+1 💚	spotbugs	2m 1s		the patch passed
+1 💚	shadedclient	17m 47s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	182m 3s		hadoop-hdfs in the patch passed.
+1 💚	asflicense	0m 30s		The patch does not generate ASF License warnings.
		261m 11s

Subsystem	Report/Notes
Docker	ClientAPI=1.56 ServerAPI=1.56 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/16/artifact/out/Dockerfile
GITHUB PR	#8334
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname	Linux 7a81041d4845 5.15.0-190-generic #200-Ubuntu SMP Fri Aug 7 15:06:04 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `6ed1ada`
Default Java	Ubuntu-17.0.20+8-1-24.04-Ubuntu
Multi-JDK versions	/usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.12+8-1-24.04-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.20+8-1-24.04-Ubuntu
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/16/testReport/
Max. process+thread count	4080 (vs. ulimit of 10000)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8334/16/console
versions	git=2.43.0 maven=3.9.15 spotbugs=4.9.7
Powered by	Apache Yetus 0.14.1 https://yetus.apache.org

This message was automatically generated.

deepujain · 2026-10-17T04:57:23Z

Checks are green on the latest commit. Could a maintainer review this when you have a chance?

github-actions Bot added HDFS trunk labels Mar 9, 2026

deepujain force-pushed the HDFS-17850-append-reject-same-generation-stamp branch from b40483d to 261c748 Compare June 15, 2026 07:07

deepujain force-pushed the HDFS-17850-append-reject-same-generation-stamp branch from 261c748 to 2f536d1 Compare July 9, 2026 07:53

deepujain force-pushed the HDFS-17850-append-reject-same-generation-stamp branch from 2f536d1 to 39d8560 Compare July 11, 2026 03:58

deepujain force-pushed the HDFS-17850-append-reject-same-generation-stamp branch from 39d8560 to 8886e2d Compare August 4, 2026 13:25

deepujain force-pushed the HDFS-17850-append-reject-same-generation-stamp branch from 1e3a042 to 9f7b2fc Compare September 1, 2026 16:05

deepujain force-pushed the HDFS-17850-append-reject-same-generation-stamp branch from ef049ad to 930dd1c Compare September 3, 2026 17:58

deepujain force-pushed the HDFS-17850-append-reject-same-generation-stamp branch from e15a4e2 to 2410070 Compare September 4, 2026 15:58

deepujain added 7 commits September 18, 2026 21:47

HDFS-17850. Reject append when new generation stamp equals or is less…

1528fef

… than replica. Signed-off-by: Deepak Jain <deepujain@gmail.com>

Trigger CI

c55c9f3

Signed-off-by: Deepak Jain <deepujain@gmail.com>

Trigger CI

9ef7db4

Signed-off-by: Deepak Jain <deepujain@gmail.com>

Trigger CI

7bfa571

Signed-off-by: Deepak Jain <deepujain@gmail.com>

HDFS-17850. Trigger CI refresh.

5373a4c

Signed-off-by: Deepak Jain <deepujain@gmail.com>

Trigger CI: Yetus unit timeout/flake on unrelated hdfs tests

b8cd9c0

Signed-off-by: Deepak Jain <deepujain@gmail.com>

HDFS-17850. Retrigger CI after Jenkins timeout.

6ed1ada

Signed-off-by: Deepak Jain <deepujain@gmail.com>

deepujain force-pushed the HDFS-17850-append-reject-same-generation-stamp branch from 2410070 to bc2fe17 Compare September 19, 2026 04:50

deepujain force-pushed the HDFS-17850-append-reject-same-generation-stamp branch from bc2fe17 to 6ed1ada Compare September 23, 2026 05:17

Conversation

deepujain commented Mar 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Change

JIRA

For code changes:

AI Tooling

How was this patch tested?

Validated repair head bc2fe171 (2026-09-19)

Uh oh!

hadoop-yetus commented Mar 10, 2026

Uh oh!

deepujain commented May 27, 2026

Uh oh!

deepujain commented Jun 14, 2026

Uh oh!

hfutatzhanghb commented Jun 15, 2026

Uh oh!

deepujain commented Jun 15, 2026

Uh oh!

hadoop-yetus commented Jun 15, 2026

Uh oh!

deepujain commented Jun 26, 2026

Uh oh!

deepujain commented Jul 6, 2026

Uh oh!

deepujain commented Jul 9, 2026

Uh oh!

hadoop-yetus commented Jul 9, 2026

Uh oh!

deepujain commented Jul 9, 2026

Uh oh!

deepujain commented Jul 10, 2026

Uh oh!

deepujain commented Jul 10, 2026

Uh oh!

deepujain commented Jul 11, 2026

Uh oh!

hadoop-yetus commented Jul 11, 2026

Uh oh!

deepujain commented Jul 13, 2026

Uh oh!

deepujain commented Jul 20, 2026

Uh oh!

deepujain commented Jul 21, 2026

Uh oh!

deepujain commented Jul 21, 2026

Uh oh!

deepujain commented Jul 26, 2026

Uh oh!

deepujain commented Aug 4, 2026

Uh oh!

deepujain commented Aug 5, 2026

Uh oh!

hadoop-yetus commented Aug 5, 2026

Uh oh!

deepujain commented Aug 6, 2026

Uh oh!

deepujain commented Aug 9, 2026

Uh oh!

deepujain commented Aug 10, 2026

Uh oh!

hadoop-yetus commented Aug 10, 2026

Uh oh!

deepujain commented Aug 11, 2026

Uh oh!

deepujain commented Aug 11, 2026

Uh oh!

deepujain commented Aug 12, 2026

Uh oh!

deepujain commented Aug 15, 2026

Uh oh!

hadoop-yetus commented Sep 1, 2026

Uh oh!

deepujain commented Sep 1, 2026

Uh oh!

hadoop-yetus commented Sep 2, 2026

Uh oh!

deepujain commented Sep 4, 2026

deepujain commented Mar 9, 2026 •

edited

Loading

Validated repair head `bc2fe171` (2026-09-19)