Smoke Test: Claude - 24837114207 #28087
Description
Summary
Smoke test run for Claude engine, triggered by PR #28082 on 2026-04-23.
Overall Status: PARTIAL (1 test unavailable, 1 test skipped × 2)
Run URL: https://github.com/github/gh-aw/actions/runs/24837114207
PR Used for Review Testing: #28082 ("Run pre-agent-steps before MCP gateway startup")
Timestamp: 2026-04-23T13:15:00Z
Test Results
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP Testing (last 2 merged PRs: #28079, #28078) | ✅ |
| 2 | MCP Scripts GH CLI Testing (PRs #28082, #28080) | ✅ |
| 3 | Serena MCP Testing (activated, 4 symbols found) | ✅ |
| 4 | Make Build Testing (make build succeeded) |
✅ |
| 5 | Playwright Testing (GitHub page title verified) | ✅ |
| 6 | Tavily Web Search Testing (5 results for "GitHub Agentic Workflows") | ✅ |
| 7 | File Writing Testing (/tmp/gh-aw/agent/smoke-test-claude-24837114207.txt) |
✅ |
| 8 | Bash Tool Testing (file read back successfully) | ✅ |
| 9 | Discussion Interaction Testing (discussion #28083 found, comic comment added) | ✅ |
| 10 | Agentic Workflows MCP Testing (smoke-claude status) |
❌ Tool error: "failed to get workflow statuses" |
| 11 | Slack Script Safe Output Testing (#smoke-tests) |
✅ |
| 12 | Code Scanning Alert Safe Output Testing (dummy warning on README.md:1) | ✅ |
| 13 | Update PR Testing (appended test message to PR #28082) | ✅ |
| 14 | PR Review Comment Testing (2 comments on compiler_yaml_main_job.go & test file) | ✅ |
| 15 | Submit PR Review Testing (COMMENT review submitted) | ✅ |
| 16 | Resolve Review Thread Testing | |
| 17 | Add Reviewer Testing (added copilot to PR #28082) |
✅ |
| 18 | Push to PR Branch Testing (smoke-test-files/smoke-claude-push-test.md) | ✅ |
| 19 | Close PR Testing |
Test #10 Error Details
Agentic Workflows MCP status tool returned error: "failed to get workflow statuses" when querying for workflow smoke-claude. The MCP server was reachable but the status endpoint returned an error. Status file written to /tmp/gh-aw/agent/smoke-claude-status-24837114207.txt with error details.
Test Details
- Serena symbols found:
cmd/gh-aw/main.go(File + Function),cmd/gh-aw-wasm/main.go(File + Function) — 4 symbols - Merged PRs reviewed: Refactor audit workflows with new
shared/daily-audit-chartscomposite import #28079 "Refactor audit workflows with newshared/daily-audit-chartscomposite import" (merged 2026-04-23T13:02:42Z) and Allowvulnerability-alertsin GitHub Actions schema validation for compiled workflows #28078 "Allowvulnerability-alertsin GitHub Actions schema validation for compiled workflows" (merged 2026-04-23T13:05:05Z) - Build output:
go build -ldflags "-s -w -X main.version=8560c49d9-dirty" -o gh-aw ./cmd/gh-aw - Playwright page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub"
- Tavily top result: githubnext.com/projects/agentic-workflows/ (score: 0.947)
💥 [THE END] — Illustrated by Smoke Claude · ● 210.7K · ◷
- expires on Apr 23, 2026, 3:20 PM UTC
Activity
github-actions commentedon Apr 23, 2026
This issue was automatically closed because it expired on 2026-04-23T15:20:07.669Z.