Skip to content

Suggested test: copilot/dynamic-workflows-engine-support #20389

Open

Description

@github-actions

Motivation

Link to the gh-aw PR: github/gh-aw#65937 — Support dynamic workflows in the Copilot CLI engine (engine.dynamic-workflows, enabled by default)

Proposed test

  • Workflow file: test-copilot-dynamic-workflows.md (name TBD)
  • Trigger: workflow_dispatch
  • Engine: copilot (this feature is explicitly Copilot-CLI-specific; also landed for Claude in Support Claude Code dynamic workflows across activation and agent jobs github/gh-aw#65905, so a parallel test-claude-dynamic-workflows.md could follow once this is triaged)
  • Safe output: create-issue or noop, just to confirm the agent ran with the dynamic-workflow extension available
  • Variant: standard

Minimal test prompt sketch

Configure engine.dynamic-workflows: true (or rely on the new default) so the Copilot CLI session loads the targeted EXTENSIONS feature flag and project-extension discovery. Have the prompt ask the agent to invoke a project-level dynamic workflow/extension bundled in the repo (or confirm its availability) and then create an issue confirming it ran, so the test fails if the extension/workflow restore step silently breaks.

New fixtures or secrets needed

Likely needs a minimal fixture dynamic-workflow/extension file checked into this repo (e.g. under a project extensions folder) for the agent to discover and invoke — the PR mentions "prompt-mode project extension discovery" and restoring supporting files from an activation artifact. Exact fixture shape is unclear without reading the gh-aw engine config docs for this feature in more detail.

Notes

Open questions: (1) what the minimal fixture file/extension needs to look like for Copilot CLI to discover it, (2) whether this is meaningfully different from the existing test-copilot-skills-frontmatter.md coverage (skills vs. dynamic workflows may be adjacent but distinct mechanisms — needs triage), (3) whether a disabled-by-default negative test is also warranted per the PR's "explicitly deny them when disabled" behavior. No existing test or open suggestion currently covers dynamic workflows.

Generated by 🔍 Suggest New E2E Tests · copilot · auto · 147.4 AIC · ⌖ 6.74 AIC · ⊞ 8.6K · ◷

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions