You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Add create-check-run safe output for multi-agent PR analysis #33597
Check Runs are NOT PR reviews, a single user account / GitHub token can create N check runs and can decide on the pass/fail state of each check run and can provide summary/details for the check runs.
On workflow startup: post a check run in in_progress status (e.g. "Agent running…"). This may be difficult and may not be necessary as the Agent itself will show as in progress anyway.
On workflow completion: create/update that check run with a conclusion of success / failure / neutral, plus a title, summary, and text/details produced by the agent.
This gives users a first-class signal in the PR checks UI and on commits, distinct from issue/PR comments. PR Review Comments are restricted to the PR diff but check runs can report any problem allowing users to run several agents against a PR each verifying certain important criteria is met.
Sketch of the config
safe-outputs:
create-check-run:
name: "My Agent"# check run name shown in the UImax: 1# only one check run per workflow run
It might be desirable to allow the agent to specify the check run name (especially if we're to support having max > 1.
changed the title [-]Add `create-check-run` safe output for workflow status reporting[/-][+]Add `create-check-run` safe output for multi-agent PR analysis[/+]on May 20, 2026
Examples of what check_runs look like on a PR from my pr-rocket tool which runs many agents and reports each agent's findings as individual check runs:
Activity
[-]Add `create-check-run` safe output for workflow status reporting[/-][+]Add `create-check-run` safe output for multi-agent PR analysis[/+]strawgate commentedon May 20, 2026
Examples of what check_runs look like on a PR from my pr-rocket tool which runs many agents and reports each agent's findings as individual check runs:
