Repository navigation
CI: per-test Lite timings as an artifact, and temporary cap guards while #5208 is open - #5211
Merged
Merged
Conversation
erikdarlingdata
marked this pull request as ready for review
October 5, 2026 07:59
This was referenced Oct 5, 2026
This was referenced Oct 5, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Part of #5208. Lite.Tests on the hosted Windows runners has grown from about 9½ minutes of test time to about 45 in five days (+7 min/day, with only ~110 tests added). Last night's nightly was cancelled at its 90-minute build cap during the unsharded Lite run, so no release was published. This PR doesn't fix the slowdown. It makes the slowdown measurable, and keeps CI and the nightly from failing on it while it's found.
What changes
-xml) with per-test durations, uploaded as an artifact kept for 7 days:lite-testsshard:lite-tests-timing-<shard>, one file per chunk;lite-tests-timing-nightly;build.yml:lite-tests-timing-release..github/scripts/lite-timing-top.pyprints the 25 slowest classes, by summed test time, and the 25 slowest tests, right after each run.if: always()andcontinue-on-error: true, so they can never turn a job red.lite-tests:timeout-minutes20 → 30. The slowest shard reached 19 minutes on Oct 5.buildjob: 90 → 150. Its Lite step took 45, then 64, then more than 89 minutes on three consecutive nights.timeout-minutes(the 360-minute default), so it's unchanged.Checked
-xml <file>option: confirmed on xunit.v3 4.0.1's in-process runner on Windows 11. A one-class run wrote a schema-version-3 results file.SECTION: None (CI only)