Skip to content

test(e2e): wait for proven tip in full prover setup - #24393

Closed
AztecBot wants to merge 2 commits into
merge-train/fairies-v5from
cb/fix-fairies-v5-prover-full-timeout
Closed

AztecBot wants to merge 2 commits into
merge-train/fairies-v5from
cb/fix-fairies-v5-prover-full-timeout

Conversation

@AztecBot

@AztecBot AztecBot commented Jun 30, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Wait for the setup tip to reach the checkpointed chain before warping to the next epoch and marking it proven.
  • Wait for that setup tip to become proven before starting the second/full-prover PXE, avoiding PXE sync against a block that can be pruned.
  • Make FullProverTest teardown tolerate setup failures before the prover node is created, so the original setup error remains visible.

Investigation

aztec-packages#24388 was removed from the merge queue at 2026-06-30 09:29 UTC after merge-group run 28432921723 failed on temporary SHA 8bbf03bfd38dd76974ff007d7d540c900374bd80.

The failing leg was a1-fast arm64 ci-fast; the wrapper log reported exit 124, and the inner test-engine log showed FAKE_PROOFS=1 yarn-project/end-to-end/scripts/run_test.sh simple single-node/prover/full timing out. The suite log showed setup failing while PXE contract sync queried a block hash that the node had just pruned after the setup epoch warp/proof mark. Teardown then threw on this.proverAztecNode.stop() because setup had not reached prover-node creation.

The first CI run on this PR then failed the same suite earlier with Timeout awaiting block proven >= 6: the prior patch waited on the pre-prune L2 block number, but markAsProven() only marked the latest checkpoint as proven, so an uncheckpointed setup block was still pruned. This update waits for the setup block to become checkpointed before advancing/proving, then waits for that same block to become proven.

Testing

  • git diff --check
  • ./bootstrap.sh ci did not run locally: this checkout reports Unknown command: ci after Docker/Redis startup checks.
  • FAKE_PROOFS=1 yarn-project/end-to-end/scripts/run_test.sh simple single-node/prover/full did not start locally: missing yarn-project/node_modules/.bin/jest in this container.

Created by claudebox · group: slackbot

@AztecBot AztecBot added ci-draft Run CI on draft PRs. ci-no-fail-fast Sets NO_FAIL_FAST in the CI so the run is not aborted on the first failure claudebox Owned by claudebox. it can push to this PR. labels Jun 30, 2026
@AztecBot

Copy link
Copy Markdown
Collaborator Author

Flakey Tests

🤖 says: This CI run detected 1 tests that failed, but were tolerated due to a .test_patterns.yml entry.

\033FLAKED\033 (8;;http://ci.aztec-labs.com/1a2197cd6985d9ec�1a2197cd6985d9ec8;;�): yarn-project/scripts/run_test.sh p2p/src/client/test/p2p_client.integration_status_handshake.test.ts (17s) (code: 0) group:e2e-p2p-epoch-flakes

@AztecBot

AztecBot commented Jul 6, 2026

Copy link
Copy Markdown
Collaborator Author

Automatically closing this stale claudebox draft PR (no updates for 5+ days). Re-open if still needed.

@AztecBot AztecBot closed this Jul 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci-draft Run CI on draft PRs. ci-no-fail-fast Sets NO_FAIL_FAST in the CI so the run is not aborted on the first failure claudebox Owned by claudebox. it can push to this PR.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant