feat(firefox-beta): roll to r1516

[microsoft-playwright-automation]

No description provided.

[github-actions]

Test results for "MCP"

2 failed
❌ [chrome] › mcp/annotate.spec.ts:57 › should capture multiple screenshots in one annotation @mcp-windows-latest-chrome
❌ [chromium] › mcp/annotate.spec.ts:137 › should abort MCP annotation when last screenshot is removed @mcp-windows-latest-chromium

7084 passed, 1104 skipped

---

Merge workflow run.

[github-actions]

Test results for "tests 1"

41787 passed, 850 skipped

---

Merge workflow run.

[github-actions]

Test results for "tests others"

1 fatal errors, not part of any test

20 flaky

⚠️ [electron-page] › page/page-goto.spec.ts:462 › should fail when replaced by another navigation `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:28 › should work with cross-process _blank target `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:36 › should work with _blank target in form `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-request-continue.spec.ts:398 › should respect set-cookie in redirect response `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-route.spec.ts:74 › should not support ? in glob pattern `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-route.spec.ts:169 › should not override cookie header `@electron-ubuntu-latest`
⚠️ [electron-page] › page/page-goto.spec.ts:462 › should fail when replaced by another navigation `@electron-macos-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:28 › should work with cross-process _blank target `@electron-macos-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:36 › should work with _blank target in form `@electron-macos-latest`
⚠️ [electron-page] › page/page-request-continue.spec.ts:398 › should respect set-cookie in redirect response `@electron-macos-latest`
⚠️ [electron-page] › page/page-route.spec.ts:74 › should not support ? in glob pattern `@electron-macos-latest`
⚠️ [electron-page] › page/page-route.spec.ts:169 › should not override cookie header `@electron-macos-latest`
⚠️ [chromium-library] › library/video.spec.ts:682 › screencast › should capture full viewport on hidpi `@frozen-time-library-chromium-linux`
⚠️ [electron-api] › electron/electron-tracing.spec.ts:23 › should record trace `@electron-windows-latest`
⚠️ [electron-page] › page/page-goto.spec.ts:462 › should fail when replaced by another navigation `@electron-windows-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:28 › should work with cross-process _blank target `@electron-windows-latest`
⚠️ [electron-page] › page/page-navigation.spec.ts:36 › should work with _blank target in form `@electron-windows-latest`
⚠️ [electron-page] › page/page-request-continue.spec.ts:398 › should respect set-cookie in redirect response `@electron-windows-latest`
⚠️ [electron-page] › page/page-route.spec.ts:74 › should not support ? in glob pattern `@electron-windows-latest`
⚠️ [electron-page] › page/page-route.spec.ts:169 › should not override cookie header `@electron-windows-latest`

19724 passed, 652 skipped

---

Merge workflow run.

[github-actions]

Test results for "tests 2"

2 fatal errors, not part of any test
15 failed
❌ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:64 › should write traces to provided artifactsDir on connectOverCDP @tracing-chromium
❌ [chromium-library] › library/browsertype-connect.spec.ts:267 › launchServer › should send default User-Agent and X-Playwright-Browser headers with connect request @chromium-macos-26-large
❌ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:64 › should write traces to provided artifactsDir on connectOverCDP @tracing-chromium-tip-of-tree
❌ [chromium-library] › library/browsertype-connect.spec.ts:141 › launchServer › should be able to reconnect to a browser @msedge-dev-macos-latest
❌ [firefox-library] › library/screencast.spec.ts:28 › screencast.start delivers frames via onFrame callback @firefox-headed-macos-15-xlarge
❌ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:140 › should create userDataDir if it does not exist @firefox-macos-26-large
❌ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:161 › should have passed URL when launching with ignoreDefaultArgs: true @firefox-macos-26-large
❌ [firefox-library] › library/inspector/cli-codegen-csharp.spec.ts:202 › should not print context options method override in nunit if no options were passed @firefox-macos-26-large
❌ [webkit-library] › library/beforeunload.spec.ts:92 › should not stall on evaluate when dismissing beforeunload @webkit-macos-26-xlarge
❌ [webkit-library] › library/beforeunload.spec.ts:107 › should not stall on click when dismissing beforeunload @webkit-macos-26-xlarge
❌ [webkit-library] › library/beforeunload.spec.ts:130 › should support dismissing the dialog multiple times @webkit-macos-26-xlarge
❌ [webkit-library] › library/beforeunload.spec.ts:152 › should support closing the page after a previous dismiss @webkit-macos-26-xlarge
❌ [webkit-library] › library/browsercontext-add-cookies.spec.ts:227 › should isolate send cookie header @webkit-macos-26-xlarge
❌ [webkit-library] › library/browsercontext-add-cookies.spec.ts:263 › should set multiple cookies @webkit-macos-26-xlarge
❌ [webkit-library] › library/browsercontext-add-cookies.spec.ts:312 › should set a cookie with a path @webkit-macos-26-xlarge

109 flaky

⚠️ [chromium-library] › library/browsertype-launch.spec.ts:94 › should handle exception and report launch log `@msedge-dev-windows-latest`
⚠️ [chromium-library] › library/defaultbrowsercontext-2.spec.ts:245 › user agent is up to date `@msedge-dev-windows-latest`
⚠️ [chromium-library] › library/inspector/cli-codegen-3.spec.ts:490 › cli codegen › should generate getByTestId `@msedge-dev-windows-latest`
⚠️ [chromium-library] › library/inspector/cli-codegen-pick-locator.spec.ts:21 › should inspect locator `@msedge-dev-windows-latest`
⚠️ [chromium-library] › library/page-clock.frozen.spec.ts:19 › clock should be frozen `@msedge-dev-windows-latest`
⚠️ [chromium-library] › library/trace-viewer.spec.ts:416 › should truncate long return values with ellipsis but copy full value `@msedge-dev-windows-latest`
⚠️ [chromium-page] › page/page-dispatchevent.spec.ts:72 › should not fail when element is blocked on hover `@msedge-dev-windows-latest`
⚠️ [chromium-page] › page/workers.spec.ts:63 › should have timestamp on worker console messages `@msedge-dev-windows-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:189 › launchServer › should ignore page.pause when headed `@chromium-macos-26-large`
⚠️ [chromium-page] › page/page-set-input-files.spec.ts:203 › should upload large file with relative path `@chromium-macos-26-large`
⚠️ [chromium-page] › page/page-wait-for-selector-2.spec.ts:351 › should succeed if element handle was detached while waiting for detached `@chromium-macos-26-large`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:294 › launchServer › disconnected event should be emitted when browser is closed or server is closed `@chromium-tip-of-tree-macos-15--headed`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:374 › launchServer › should reject navigation when browser closes `@chromium-tip-of-tree-macos-15--headed`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:653 › launchServer › should be able to connect when the wsEndpoint is passed as an option `@chromium-tip-of-tree-macos-15--headed`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:686 › launchServer › should filter launch options `@chromium-tip-of-tree-macos-15--headed`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:1117 › launchServer only › should be able to reconnect to a browser 12 times without warnings `@chromium-tip-of-tree-macos-15--headed`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:141 › launchServer › should be able to reconnect to a browser `@chromium-headed-macos-15-xlarge`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:431 › launchServer › should reject waitForEvent before browser.close finishes `@chromium-headed-macos-15-xlarge`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:632 › launchServer › should properly disconnect when connection closes from the client side `@chromium-headed-macos-15-xlarge`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:653 › launchServer › should be able to connect when the wsEndpoint is passed as an option `@chromium-headed-macos-15-xlarge`
⚠️ [chromium-library] › library/video.spec.ts:719 › screencast › should work with video+trace `@chromium-tip-of-tree-windows-latest`
⚠️ [chromium-library] › library/browsercontext-proxy.spec.ts:103 › should set cookie for top-level domain `@msedge-beta-windows-latest`
⚠️ [chromium-library] › library/browsercontext-user-agent.spec.ts:110 › should work for navigator.userAgentData and sec-ch-ua headers `@msedge-macos-latest`
⚠️ [chromium-library] › library/video.spec.ts:133 › screencast › should continue recording main page after popup closes `@msedge-macos-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:141 › launchServer › should be able to reconnect to a browser `@channel-chromium-macos-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:161 › launchServer › should not crash on malformed json frame `@channel-chromium-macos-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:294 › launchServer › disconnected event should be emitted when browser is closed or server is closed `@channel-chromium-macos-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:386 › launchServer › should reject waitForSelector when browser closes `@channel-chromium-macos-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:431 › launchServer › should reject waitForEvent before browser.close finishes `@channel-chromium-macos-latest`
⚠️ [chromium-library] › library/inspector/cli-codegen-1.spec.ts:197 › cli codegen › should make a positioned click on a canvas `@chromium-windows-latest`
⚠️ [chromium-library] › library/inspector/cli-codegen-2.spec.ts:20 › cli codegen › should contain open page `@chromium-windows-latest`
⚠️ [chromium-library] › library/chromium/oopif.spec.ts:152 › should take screenshot `@chromium-macos-15-large`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:189 › launchServer › should ignore page.pause when headed `@chromium-macos-15-xlarge`
⚠️ [chromium-library] › library/video.spec.ts:647 › screencast › should capture full viewport `@chromium-macos-15-xlarge`
⚠️ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:675 › should skip default overrides with noDefaults `@msedge-beta-macos-latest`
⚠️ [chromium-library] › library/browsercontext-user-agent.spec.ts:110 › should work for navigator.userAgentData and sec-ch-ua headers `@msedge-dev-macos-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:294 › launchServer › disconnected event should be emitted when browser is closed or server is closed `@msedge-dev-macos-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:386 › launchServer › should reject waitForSelector when browser closes `@msedge-dev-macos-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:686 › launchServer › should filter launch options `@msedge-dev-macos-latest`
⚠️ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:675 › should skip default overrides with noDefaults `@msedge-dev-macos-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:189 › launchServer › should ignore page.pause when headed `@chrome-beta-macos-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:632 › launchServer › should properly disconnect when connection closes from the client side `@chrome-beta-macos-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:686 › launchServer › should filter launch options `@chrome-beta-macos-latest`
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:189 › launchServer › should ignore page.pause when headed `@chromium-macos-26-xlarge`
⚠️ [chromium-library] › library/video.spec.ts:682 › screencast › should capture full viewport on hidpi `@chromium-macos-26-xlarge`
⚠️ [chromium-library] › library/inspector/cli-codegen-javascript.spec.ts:102 › should print load/save storageState `@chromium-tip-of-tree-ubuntu-22.04--headed`
⚠️ [chromium-library] › library/selector-generator.spec.ts:186 › selector generator › should prefer data-testid `@chromium-tip-of-tree-ubuntu-22.04--headed`
⚠️ [chromium-library] › library/trace-viewer.spec.ts:1177 › should show action source `@chromium-tip-of-tree-ubuntu-22.04--headed`
⚠️ [firefox-library] › library/page-close.spec.ts:152 › should not treat navigations as new popups `@firefox-headed-macos-15-xlarge`
⚠️ [firefox-library] › library/screencast.spec.ts:55 › onFrame receives viewport size `@firefox-headed-macos-15-xlarge`
⚠️ [firefox-library] › library/browsercontext-basic.spec.ts:36 › should be able to click across browser contexts `@firefox-headed-ubuntu-24.04`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:43 › should poll on interval `@tracing-firefox`
⚠️ [firefox-library] › library/defaultbrowsercontext-1.spec.ts:111 › should support bypassCSP option `@firefox-beta-windows-latest`
⚠️ [firefox-library] › library/browsercontext-reuse.spec.ts:412 › reuse connect › should update viewport and media `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/headful.spec.ts:235 › should click in OOPIF `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-csharp.spec.ts:178 › should work with --save-har `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-csharp.spec.ts:221 › should work with --save-har in nunit `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-csharp.spec.ts:221 › should work with --save-har in mstest `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-csharp.spec.ts:221 › should work with --save-har in xunit `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-pytest.spec.ts:60 › should work with --save-har `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-python-async.spec.ts:139 › should work with --save-har `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-python.spec.ts:135 › should work with --save-har and --save-har-glob `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-test.spec.ts:86 › should not generate recordHAR with --save-har `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/proxy.spec.ts:44 › should use proxy for second page `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/screencast.spec.ts:78 › start throws if screencast is already started `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/screencast.spec.ts:202 › empty video `@firefox-headed-windows-latest`
⚠️ [firefox-page] › page/workers.spec.ts:177 › should clear upon cross-process navigation `@firefox-ubuntu-24.04`
⚠️ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:183 › should handle exception `@firefox-macos-26-large`
⚠️ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:190 › should fire close event for a persistent context `@firefox-macos-26-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:53 › cli codegen › should double click `@firefox-macos-26-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-3.spec.ts:224 › cli codegen › should generate frame locators (4) `@firefox-macos-26-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-java.spec.ts:125 › should print a valid basic program in junit `@firefox-macos-26-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-javascript.spec.ts:102 › should print load/save storageState `@firefox-macos-26-large`
⚠️ [firefox-page] › page/page-add-locator-handler.spec.ts:19 › should work `@firefox-macos-26-large`
⚠️ [firefox-page] › page/page-request-gc.spec.ts:19 › should work `@firefox-macos-26-large`
⚠️ [firefox-library] › library/browsercontext-basic.spec.ts:163 › should propagate default viewport to the page `@firefox-beta-macos-latest`
⚠️ [firefox-page] › page/page-event-console.spec.ts:133 › should trigger correct Log `@firefox-beta-macos-latest`
⚠️ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:161 › should have passed URL when launching with ignoreDefaultArgs: true `@firefox-macos-15-large`
⚠️ [firefox-page] › page/page-add-locator-handler.spec.ts:19 › should work `@firefox-macos-15-large`
⚠️ [firefox-page] › page/page-screenshot.spec.ts:431 › page screenshot › should take fullPage screenshots during navigation `@firefox-macos-15-large`
⚠️ [firefox-page] › page/retarget.spec.ts:337 › check retargeting `@firefox-macos-15-large`
⚠️ [firefox-page] › page/page-add-locator-handler.spec.ts:19 › should work `@firefox-windows-latest`
⚠️ [firefox-page] › page/page-leaks.spec.ts:85 › click should not leak `@firefox-windows-latest`
⚠️ [webkit-library] › library/browsertype-connect.spec.ts:739 › launchServer › should upload large file `@webkit-macos-26-large`
⚠️ [webkit-library] › library/browsertype-connect.spec.ts:792 › launchServer › should upload a folder `@webkit-macos-26-large`
⚠️ [webkit-library] › library/browsertype-connect.spec.ts:1117 › launchServer only › should be able to reconnect to a browser 12 times without warnings `@webkit-macos-26-large`
⚠️ [webkit-library] › library/defaultbrowsercontext-1.spec.ts:137 › should support offline option `@webkit-macos-26-large`
⚠️ [webkit-library] › library/defaultbrowsercontext-2.spec.ts:81 › should support ignoreHTTPSErrors option `@webkit-macos-26-large`
⚠️ [webkit-library] › library/download.spec.ts:328 › download event › should delete file `@webkit-macos-26-large`
⚠️ [webkit-library] › library/downloads-path.spec.ts:63 › downloads path › should report downloads in downloadsPath folder `@webkit-macos-26-large`
⚠️ [webkit-library] › library/emulation-focus.spec.ts:42 › should provide target for keyboard events `@webkit-macos-26-large`
⚠️ [webkit-library] › library/inspector/cli-codegen-3.spec.ts:979 › cli codegen › should record when manual popover with fullscreen backdrop is open `@webkit-macos-26-large`
⚠️ [webkit-library] › library/inspector/pause.spec.ts:249 › pause › should skip input when resuming `@webkit-macos-26-large`
⚠️ [webkit-library] › library/page-clock.spec.ts:147 › runFor › passes 2 hours, 34 minutes and 10 seconds `@webkit-macos-26-large`
⚠️ [webkit-library] › library/page-close.spec.ts:152 › should not treat navigations as new popups `@webkit-macos-26-large`
⚠️ [webkit-library] › library/permissions.spec.ts:73 › permissions › should grant notifications permission when listed `@webkit-macos-26-large`
⚠️ [webkit-library] › library/route-web-socket.spec.ts:75 › no-mock › should work with text message `@webkit-macos-26-large`
⚠️ [webkit-library] › library/trace-viewer.spec.ts:1162 › should highlight expect failure `@webkit-macos-26-large`
⚠️ [webkit-page] › page/page-add-locator-handler.spec.ts:184 › should work with toHaveScreenshot `@webkit-macos-26-large`
⚠️ [webkit-page] › page/page-aria-snapshot-ai.spec.ts:276 › should collapse generic nodes `@webkit-macos-26-large`
⚠️ [webkit-page] › page/page-aria-snapshot.spec.ts:145 › should support multiline text `@webkit-macos-26-large`
⚠️ [webkit-page] › page/page-autowaiting-basic.spec.ts:42 › should not stall on JS navigation link `@webkit-macos-26-large`
⚠️ [webkit-library] › library/tap.spec.ts:22 › should send all of the correct events @smoke `@webkit-headed-ubuntu-24.04`
⚠️ [webkit-library] › library/har.spec.ts:165 › should include form params `@webkit-headed-ubuntu-22.04`
⚠️ [webkit-library] › library/browsercontext-add-cookies.spec.ts:363 › should default to setting secure cookie for HTTPS websites `@webkit-macos-26-xlarge`
⚠️ [webkit-page] › page/page-request-fallback.spec.ts:221 › post data › should amend post data `@webkit-macos-15-xlarge`
⚠️ [webkit-library] › library/browsertype-connect.spec.ts:792 › launchServer › should upload a folder `@webkit-macos-15-large`
⚠️ [android-page] › page/page-goto.spec.ts:453 › should disable timeout when its set to 0
⚠️ [android-page] › page/page-request-continue.spec.ts:162 › should override method along with url

271926 passed, 11601 skipped, 4560 did not run

---

Merge workflow run.