Add CoreCLR WASM composite R2R microbenchmark lane

[lewing]

Adds a CoreCLR browser-WASM composite ReadyToRun microbenchmark lane next to the per-assembly R2R lane from #5297.

Dependencies

• [wasm][coreclr] Enable composite ReadyToRun publishing runtime#134618 ([wasm][coreclr] Enable composite ReadyToRun publishing): merged Oct 1. The lane needs a perf-build BrowserWasmCoreCLR artifact from a runtime commit that includes it; with an older artifact it fails with the runtime's PublishReadyToRunComposite is not supported for CoreCLR browser-wasm error.
• Wasm-aware ReadyToRun SDK tasks. [wasm][coreclr] Enable composite ReadyToRun publishing runtime#134618's _WasmCoreClrValidateCompositeTasks fails before the composite compile unless the SDK's ReadyToRun tasks name the owner <entry>.r2r.wasm. Port runtime PR dotnet/runtime#133111 R2R changes to SDK Crossgen tasks sdk#56395 merged on Oct 2 but hasn't reached the SDK in the perf artifact (dotnet-none, pinned by runtime's global.json to 11.0.100-rc.1.26420.103). Until it does, this PR uses runtime's Crossgen2Tasks shim, which [wasm][coreclr] Ship Crossgen2Tasks shim in the CoreCLR wasm perf artifact runtime#135204 stages into the artifact as staging/Crossgen2Tasks/. Without that PR (or a newer SDK), the composite lane fails early with that clear error rather than producing bad numbers. The shim is temporary; removal is tracked by [wasm] Remove the in-repo Crossgen2Tasks shim for browser composite R2R once the SDK names wasm R2R outputs runtime#135023.

Changes

• CLI (micro_benchmarks.py): new --wasm-ready-to-run-composite option that implies R2R. --wasm-ready-to-run still means per-assembly. Both options require --wasm --wasm-runtime-flavor CoreCLR. configure_wasm_ready_to_run always writes both PERFLAB_WASM_READY_TO_RUN and PERFLAB_WASM_READY_TO_RUN_COMPOSITE, so a stale parent value can't select the wrong mode. benchmarks_ci.py accepts --wasm-workload-source with either mode.
• Job script (run_performance_job.py): r2r_run_type == "r2r_composite" maps to R2RType=r2r_composite and passes --wasm-ready-to-run-composite to the Helix work item. The workload-source SDK cohort applies to both R2R modes. r2r_composite is rejected for any runtime type other than wasm_coreclr.
• MSBuild (MicroBenchmarks.Wasm.targets):
  • PublishReadyToRunComposite now comes from the selected mode. PublishTrimmed, WebCIL and ContainerFormat=wasm are the same as before, so per-assembly mode is unchanged.
  • ValidateWasmReadyToRunConfiguration checks that the applied composite value matches the selected mode, and that composite mode is only used together with R2R.
  • ValidateWasmReadyToRunOutputs (after _CreateR2RImages), composite mode: requires exactly one _ReadyToRunCompileList item with CreateCompositeImage=true. Its OutputR2RImage must end in .r2r.wasm and exist on disk, and there must be at least one _ReadyToRunCompositeBuildInput or _ReadyToRunCompositeUnrootedBuildInput.
  • ValidateWasmReadyToRunOutputs, per-assembly mode: now also fails if a composite image was planned.
  • New ValidateWasmReadyToRunCompositePublishAssets (after ProcessPublishFilesForWasm): requires exactly one _WasmCompositePublishStaticWebAsset with AssetTraitValue=readyToRunComposite. GenerateWasmBootJson routes exactly that asset to resources.coreAssembly (with isCompositeImage). This catches a composite that was compiled but never shipped or loaded.
  • I ran every guard branch locally in a stub MSBuild harness: each failure path reported its error, and the valid composite and per-assembly paths passed.
• Crossgen2Tasks shim (temporary): build_wasm_coreclr_payload copies staging/Crossgen2Tasks/ into the Helix payload as crossgen2-tasks/ when the artifact has it (and fails on an incomplete copy). For the r2r_composite lane only, run_performance_job.py exports PERFLAB_WASM_CROSSGEN2_TASKS_DIR in the Helix pre-commands, and micro_benchmarks.py turns that into Crossgen2SdkOverridePropsPath/Crossgen2SdkOverrideTargetsPath environment properties in composite mode. They must be environment properties, not set in MicroBenchmarks.Wasm.targets, because the WebAssembly SDK reads them during props evaluation, before BenchmarkDotNet imports that file. Per-assembly R2R keeps the SDK's own tasks. If the artifact has no shim, the job logs a warning and the composite build uses the SDK's tasks.
• Pipeline: new coreclr_r2r_composite_v8 job in runtime-wasm-perf-jobs.yml. It is identical to coreclr_r2r_v8 except r2rRunType: 'r2r_composite': same release-branch exclusion, payload, machine and engine. The run-performance-job.yml workload-source condition now covers both R2R types.
• Tests and docs: test_wasm_coreclr_r2r.py covers mode parsing and validation, env configuration (including stale values), work item forwarding, run configuration, the MSBuild property and guard structure, and a check that the new pipeline lane matches the per-assembly lane apart from its identity. They also cover shim staging in the payload, the pre-command export, and that the override applies to composite mode only. The docs describe the new option and the shim variable.

Validation

• python3 -m pytest -q scripts/tests/test_wasm_coreclr_r2r.py scripts/tests/test_run_performance_job.py: 79 passed.
• git diff --check: clean.
• Not run: an end-to-end composite publish. There is no browser CoreCLR runtime build available locally, so the first pipeline run with a [wasm][coreclr] Ship Crossgen2Tasks shim in the CoreCLR wasm perf artifact runtime#135204 artifact is the real test.

Results identity

Composite runs report R2RType=r2r_composite, so PerfLab keeps them in a separate history from per-assembly R2RType=r2r and from the interpreted coreclr_v8 lane. Existing histories don't change.

Risks to watch in the first validation run

• Crossgen2 time/memory vs. --buildTimeout 1200: one composite covers the whole trimmed benchmark closure, including Roslyn (Microsoft.CodeAnalysis*). It is one large, serial compile rather than many small ones, and could exceed the BDN build timeout or the machine's memory.
• BDN's WASM launcher and coreAssembly: the composite owner is loaded from the boot config's resources.coreAssembly before CoreCLR initializes, with component stubs staying in the TPA. BDN's generated WASM host must use the SDK's boot config and loader unchanged. If it doesn't, stubs will fail-fast because they can't find the owner.
• ColdStart/instantiation cost: instantiating one large .wasm image may noticeably move first-iteration and startup-sensitive numbers compared with per-assembly R2R.
• Shim compatibility: Crossgen2Tasks.dll is built against the same runtime global.json SDK that the artifact ships as dotnet-none, so it should load into that SDK's MSBuild. A mismatch would show up as a task-load error at the start of the composite compile.

Notes (no changes made)

• PublishReadyToRunExclude: none remain in MicroBenchmarks.csproj; Enable Jil for CoreCLR WASM R2R #5317, which removed the Jil exclusion, is already in main. Any future exclusion would keep that assembly out of the composite (it would stay IL/interpreted), which is the expected composite behavior.
• _AOT_InternalForceInterpretAssemblies (Roslyn): this is a Mono AOT item and has no effect on CoreCLR Crossgen2. In composite mode, Roslyn is compiled into the composite, the main contributor to the compile-time risk above. If that turns out too slow, a follow-up could exclude Microsoft.CodeAnalysis* from the composite.

Note

This PR description was generated with GitHub Copilot assistance.

[Copilot]

Copilot review overview

🟡 Changes recommended

The WASM targets file is not imported, so the composite configuration and validation do not run.

Review effort: Lite
Findings: 1

Open (1)

• Import WASM targets into the MicroBenchmarks build · New

What changed in this PR

Adds an opt-in CoreCLR browser-WASM composite ReadyToRun microbenchmark lane with distinct result tracking.

Changes:

• Adds composite R2R CLI, validation, environment propagation, and job forwarding.
• Adds MSBuild output and publish-asset checks.
• Adds pipeline wiring, tests, and documentation.

File	Summary
src/​benchmarks/​micro/​MicroBenchmarks.Wasm.targets	Composite R2R configuration and validation; currently not imported by the project, so these changes are inactive.
scripts/​tests/​test_wasm_coreclr_r2r.py	Tests mode parsing, forwarding, configuration, and pipeline behavior.
scripts/​run_performance_job.py	Propagates composite mode and result identity.
scripts/​micro_benchmarks.py	Adds composite R2R CLI support.
scripts/​benchmarks_ci.py	Accepts composite workload-source runs.
eng/​pipelines/​templates/​run-performance-job.yml	Enables workload-source forwarding.
eng/​pipelines/​runtime-wasm-perf-jobs.yml	Defines the composite benchmark lane.
docs/​benchmarking-workflow-dotnet-runtime.md	Documents composite R2R usage and dependencies.

---

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

[LoopedBard3]

This seems good to me, let's merge once we have the dependencies merged.

[DrewScoggins]

LGTM

[Copilot]

Copilot review overview

🟡 Changes recommended

Clear inherited Crossgen2 override paths before configuring R2R modes.

Review effort: Lite
Findings: 1

Open (1)

• Clear inherited Crossgen2 override paths before non-composite return · New

Resolved since last review (1)

• Import WASM targets into the MicroBenchmarks build

[Copilot]

Copilot review overview

🟡 Changes recommended

Unresolved critical MSBuild validation and moderate shim-handling findings remain.

Review effort: Lite
Findings: 1

Open (1)

• Use valid MSBuild syntax for composite image name validation · New

Resolved since last review (1)

• Clear inherited Crossgen2 override paths before non-composite return

Previously missed (1)

In code that hasn't changed since last review

Raise an error for incomplete Crossgen2Tasks shims

scripts/​build_runtime_payload.py:361

When the artifact is supplied as a directory and staging/Crossgen2Tasks exists but contains none of the required files (or only unrelated files), this branch treats the malformed shim as an old artifact and silently falls back to the SDK tasks. That contradicts the intended fail-fast behavior for an incomplete copy and makes the composite lane proceed with tasks that will fail the runtime's owner-name validation; distinguish an absent shim directory from a present-but-incomplete one and raise ValueError for the latter.

[Copilot]

Copilot review overview

🟡 Changes recommended

Composite R2R workload-source cohorts can skip required Crossgen2 task shim staging.

Review effort: Lite
Findings: 1

Open (1)

• SDK-cohort wasm workloads omit Crossgen2Tasks shim for composite R2R · New

Resolved since last review (1)

• Use valid MSBuild syntax for composite image name validation