Skip to content

fix(ci): move nightly bench inclusion sweep to 06:00 UTC - #24830

Merged
PhilWindle merged 1 commit into
merge-train/spartanfrom
pw/fix-nightly-sweep-cron
Jul 21, 2026
Merged

PhilWindle merged 1 commit into
merge-train/spartanfrom
pw/fix-nightly-sweep-cron

Conversation

@PhilWindle

Copy link
Copy Markdown
Contributor

Problem

The Nightly Bench Inclusion Sweep (failing run) resolves the nightly git tag + docker image for the current day and verifies the tag exists:

git fetch --depth 1 origin refs/tags/v6.0.0-nightly.20260721:...
fatal: couldn't find remote ref refs/tags/v6.0.0-nightly.20260721

That tag is created by the separate Nightly Release Tag workflow at 0 4 * * * (04:00 UTC), but the sweep was scheduled at 30 3 * * * (03:30 UTC) — 30 min before the tag exists. GitHub's scheduled-run jitter preserves the gap (today the sweep ran at 04:38 UTC, the tag was created at 05:04 UTC), so Verify source git ref fails and the downstream cleanup/notify-failure jobs cascade.

Fix

Move the sweep to 0 6 * * * (06:00 UTC), aligning it with the other nightly consumers (nightly-spartan-bench, deploy-next-net) which already run at 06:00 — a 2h margin over the 04:00 tag job.

The sweep resolves the nightly git tag + docker image for the current
day and verifies the tag exists. It was scheduled at 03:30 UTC, before
the Nightly Release Tag workflow (04:00 UTC) creates that tag, so
"Verify source git ref" failed with "couldn't find remote ref". Align
it with the other nightly consumers (spartan-bench, deploy-next-net) at
06:00 UTC.
@PhilWindle
PhilWindle merged commit 60f0bb3 into merge-train/spartan Jul 21, 2026
21 of 25 checks passed
@PhilWindle
PhilWindle deleted the pw/fix-nightly-sweep-cron branch July 21, 2026 14:30
rangozd pushed a commit to rangozd/aztec-packages that referenced this pull request Aug 5, 2026
BEGIN_COMMIT_OVERRIDE
chore(spartan): lower mainnet inactivity slash target to 70% (AztecProtocol#24827)
chore: add rate-limited testnet rpc client (AztecProtocol#24836)
fix(ci): move nightly bench inclusion sweep to 06:00 UTC (AztecProtocol#24830)
fix(bench): handle void worker-wallet returns in inclusion sweep
(AztecProtocol#24843)
END_COMMIT_OVERRIDE
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants