Skip to content

flaky tests #1602

Description

@trusktr

The tests seem to be flaky for some reason. I re-ran the tests in #1598 like 5+ times, and could not get them to pass. Each time, a different test failed.

cc @jhildenbiddle Any ideas?

Activity

  1. jhildenbiddle commented on Jun 26, 2021

    @jhildenbiddle
    Member

    @trusktr --

    I'm seeing the same behavior when testing locally. The first time I ran all tests everything passed without issue. The second time a failure occurred in test/e2e/index-file.test.js. I can confirm, however, that skipping the tests in index-file.test.js resulted in five test runs without a single failure. I haven't spent a ton of time on this, but Playwright is providing useful information to help track down the issue:

    CleanShot 2021-06-26 at 17 39 14@2x

    It's clear from the text in the error that when this test fails, the content being loaded into #main is from plugins.md and not README.md as expected. Why? Not sure yet, but this gives us a place to start.

    More to come...

  2. jhildenbiddle commented on Jan 30, 2022

    @jhildenbiddle
    Member

    Addressed in #1736

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions