Skip to content

Suggested test: copilot/skill-per-auth #4930

Description

@github-actions

Motivation

Link to the gh-aw PR: github/gh-aw#42594 — Support per-skill GitHub auth in frontmatter skills

PR #42594 extended skills: frontmatter to accept object-form entries with per-skill github-token or github-app credentials, enabling multi-org skill installs with distinct auth. The compiler now emits a dedicated install step per skill entry, each scoped to the provided token. No existing test exercises the object-form skills: entry; all current skill-using tests use plain string refs.

Proposed test

  • Workflow file: test-copilot-skill-per-auth.md
  • Trigger: workflow_dispatch
  • Engine: copilot
  • Safe output: create-issue (simple confirmation)
  • Variant: standard

Minimal test prompt sketch

Define a skills: block containing both a plain string ref (existing format) and an object-form ref with github-token: ${{ secrets.GH_AW_TEST_PAT }} pointing to an existing skill. Ask the agent to create a summary issue confirming both skills are available. This exercises the compiler's per-entry install step generation and confirms the object-form token is correctly scoped at install time.

New fixtures or secrets needed

Minimal smoke path: reuse GH_AW_TEST_PAT (already available) for the per-skill token — same credential, different structural path. A true cross-org test would require a separate secret (e.g. SKILL_ORG_TOKEN) pointing to a different org's token; that can be deferred.

Notes

  • The --use-samples path does not exercise skill installs, so this test is only meaningful in live-engine mode.
  • Object-form github-app entries (app-generated tokens with client-id/private-key) require more fixture setup and can be a separate follow-up test.
  • The compiler emits one install step per skill entry in object form; a compilation smoke (gh aw compile) is a quick first check even without running the workflow.

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by 🔍 Suggest New E2E Tests · 49.8 AIC · ⌖ 6.78 AIC · ⊞ 5.6K · ◷

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions