Skip to content
This repository was archived by the owner on Nov 21, 2026. It is now read-only.

Benchmarks: a cell can only run the stage's pinned ArcadeDB version, and no ArcadeDB image tag floats - #473

Merged
tae898 merged 2 commits into
mainfrom
benchmarks-version-pin-guard
Oct 22, 2026
Merged

tae898 merged 2 commits into
mainfrom
benchmarks-version-pin-guard

Conversation

@tae898

@tae898 tae898 commented Oct 22, 2026

Copy link
Copy Markdown

Closes #470. Builds on #468 (wheel_guard.py), does not duplicate it.

On 2026-10-22 the laptop still held dbbench:arcadedb at 26.10.1 beside dbbench:arcadedb-26102 at 26.10.2, and every existing check read rows after the run. Now the runner reads the version out of what will run, before any cell.

  • Pre-run assertion (engine_pin.py, called from runner.main before the manifest and the first cell): the pin is the version in the ARCADEDB_WHEEL file name the stage exports. For every ArcadeDB arm of the batch the runner reads the version out of the image that will run (embedded: the installed arcadedb-embedded version and the engine jar the wheel ships; served: the engine jar of the server image) and refuses to start on any difference, an unreadable image, or an ArcadeDB arm with no pin. The readback is written to the manifest as engine_pin. It extends the existing manifest/JPype readback, no parallel path, and starts no server.
  • No floating tags: build_images.sh tags the image dbbench:arcadedb-<version> (refuses a wheel name without x.y.z); the runner swaps the logical dbbench:arcadedb in BACKENDS for the pinned tag and refuses any other ArcadeDB tag, dbbench:arcadedb and dbbench:arcadedb-26102 included. Comparator images keep dbbench:<target> (pinned by ==/digest, read back by version_pin_check.py --runtime). The stage generator's post-build checks, verify_pair_c25.sh and _images_for follow the versioned tag; the stage draft hashes are regenerated.
  • Docs in the same PR: CAMPAIGN.md (retirement step 9 now removes the retired version's images, wheels and build folders on the laptop and mini; row 90; the image-readback paragraph) and PROTOCOL.md.
  • Tests: test_engine_pin.py (32 tests, docker is a fake, no timed run, no image build; build_images.sh runs in a temp copy with a stub docker). uv run --no-project --with pytest --with numpy --with pandas --with pyarrow --with requests python -m pytest -q benchmarks/experiments from the experiments directory: 1002 passed, 24 skipped, 1 failed (test_export_client_twin.py::test_the_setup_and_the_sparse_table_say_what_the_rows_stamp, which also fails on main since Benchmarks: the served ArcadeDB arms leave -Xms unset, like the embedded arms #456's wording change, unrelated).

Outside this repo (.notes/bench): startup_check.sh section 5 and CURRENT_PIN list any dbbench image, server image or wheel outside the current pin on the laptop and mini, deleting nothing; DECISIONS #203.

🤖 Generated with Claude Code

tae898 and others added 2 commits October 22, 2026 14:50
…and no ArcadeDB image tag floats (#470)

runner.py reads the version out of every ArcadeDB image it will run (embedded: the installed wheel and the engine jar; served: the server image's engine jar) before the first cell and refuses any that is not the stage's pin or that has no version in its tag. build_images.sh tags the image dbbench:arcadedb-<version>. engine_pin.py, test_engine_pin.py, CAMPAIGN row 90, PROTOCOL.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…acts, only older versions and refused tags are stale (#470)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@tae898
tae898 merged commit e3a713d into main Oct 22, 2026
3 checks passed
@tae898
tae898 deleted the benchmarks-version-pin-guard branch October 22, 2026 06:55
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Benchmarks: a cell can only run the stage's pinned ArcadeDB version; no floating engine image tags; retiring a version removes its images and wheels

1 participant