This repository was archived by the owner on Nov 21, 2026. It is now read-only.
Repository navigation
Benchmarks: a cell can only run the stage's pinned ArcadeDB version, and no ArcadeDB image tag floats - #473
Merged
Merged
Conversation
…and no ArcadeDB image tag floats (#470) runner.py reads the version out of every ArcadeDB image it will run (embedded: the installed wheel and the engine jar; served: the server image's engine jar) before the first cell and refuses any that is not the stage's pin or that has no version in its tag. build_images.sh tags the image dbbench:arcadedb-<version>. engine_pin.py, test_engine_pin.py, CAMPAIGN row 90, PROTOCOL. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…acts, only older versions and refused tags are stale (#470) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #470. Builds on #468 (wheel_guard.py), does not duplicate it.
On 2026-10-22 the laptop still held
dbbench:arcadedbat 26.10.1 besidedbbench:arcadedb-26102at 26.10.2, and every existing check read rows after the run. Now the runner reads the version out of what will run, before any cell.engine_pin.py, called fromrunner.mainbefore the manifest and the first cell): the pin is the version in theARCADEDB_WHEELfile name the stage exports. For every ArcadeDB arm of the batch the runner reads the version out of the image that will run (embedded: the installedarcadedb-embeddedversion and the engine jar the wheel ships; served: the engine jar of the server image) and refuses to start on any difference, an unreadable image, or an ArcadeDB arm with no pin. The readback is written to the manifest asengine_pin. It extends the existing manifest/JPype readback, no parallel path, and starts no server.build_images.shtags the imagedbbench:arcadedb-<version>(refuses a wheel name without x.y.z); the runner swaps the logicaldbbench:arcadedbinBACKENDSfor the pinned tag and refuses any other ArcadeDB tag,dbbench:arcadedbanddbbench:arcadedb-26102included. Comparator images keepdbbench:<target>(pinned by==/digest, read back byversion_pin_check.py --runtime). The stage generator's post-build checks,verify_pair_c25.shand_images_forfollow the versioned tag; the stage draft hashes are regenerated.test_engine_pin.py(32 tests, docker is a fake, no timed run, no image build;build_images.shruns in a temp copy with a stubdocker).uv run --no-project --with pytest --with numpy --with pandas --with pyarrow --with requests python -m pytest -q benchmarks/experimentsfrom the experiments directory: 1002 passed, 24 skipped, 1 failed (test_export_client_twin.py::test_the_setup_and_the_sparse_table_say_what_the_rows_stamp, which also fails on main since Benchmarks: the served ArcadeDB arms leave -Xms unset, like the embedded arms #456's wording change, unrelated).Outside this repo (
.notes/bench):startup_check.shsection 5 andCURRENT_PINlist any dbbench image, server image or wheel outside the current pin on the laptop and mini, deleting nothing; DECISIONS #203.🤖 Generated with Claude Code