Skip to content

[Perf] Windows/x64: 2 Regressions on 8/17/2024 7:43:54 PM #106710

Description

@performanceautofiler

Run Information

Name Value
Architecture x64
OS Windows 10.0.22621
Queue TigerWindows
Baseline 0d8e5652d86d5d5aec8125dbf336b3c383c1d124
Compare 217525ae6f6a117a0780620ed4fb1b94e03fd4d6
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Document.Tests.Perf_EnumerateObject

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.36 μs 2.52 μs 1.07 0.01 False
2.38 μs 2.52 μs 1.06 0.02 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateObject*'
Details

System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: NumericProperties)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: StringProperties)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Activity

  1. DrewScoggins commented on Aug 20, 2024

    @DrewScoggins
    Member

    Related to #106503

  2. dotnet-policy-service commented on Aug 20, 2024

    @dotnet-policy-service
    Contributor

    Tagging subscribers to this area: @dotnet/area-system-text-json, @gregsdennis
    See info in area-owners.md if you want to be subscribed.

  3. DrewScoggins commented on Aug 20, 2024

    @DrewScoggins
    Member

    PTAL @etemi

  4. etemi commented on Aug 20, 2024

    @etemi
    Contributor

    TBH I don't (yet) see how this regression is related to my changes.
    I will try to reproduce this locally.

  5. etemi commented on Aug 21, 2024

    @etemi
    Contributor
  6. added this to the 9.0.0 milestone on Aug 23, 2024
  7. removed
    untriagedNew issue has not been triaged by the area owner
    on Aug 23, 2024
  8. eiriktsarpalis commented on Aug 27, 2024

    @eiriktsarpalis
    Member

    I find it unlikely that this is being caused by #106503. It adds a few instructions to the main JsonDocument parsing method that could, theoretically, incur regressions in the micro level however the benchmark itself measures enumeration of a pre-parsed document which exercises a completely disjoint code-path.

    The regression concerns main, so I'm updating the milestone to reflect this.

  9. modified the milestones: 9.0.0, 10.0.0 on Aug 27, 2024
  10. locked and limited conversation to collaborators on Aug 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions