Repository navigation
Smoke Test: Claude - 22552233163 #19116
Description
Summary
Smoke test run for Claude engine. Overall status: PARTIAL (2 failed, 2 skipped, 13 passed).
PR used for review tests: #19092 — "Enforce readonly access to GitHub MCP server; remove dangerous-permissions-write feature flag"
Core Test Results (#1–10)
| # | Test | Result | Notes |
|---|---|---|---|
| 1 | GitHub MCP — list merged PRs | ✅ | PRs #19111, #19110 reviewed |
| 2 | Safe Inputs GH CLI | ✅ | PRs #19105, #19092 retrieved |
| 3 | Serena MCP (activate + find_symbol) | ❌ | Project activated OK; find_symbol failed with EOF errors (connection closed) |
| 4 | Make Build | ✅ | make build succeeded, binary built |
| 5 | Playwright | ✅ | Navigated to github.com; title contains "GitHub" |
| 6 | Tavily Web Search | ❌ | Rate limited (HTTP 429 — excessive requests) |
| 7 | File Writing | ✅ | /tmp/gh-aw/agent/smoke-test-claude-22552233163.txt created |
| 8 | Bash Tool | ✅ | File contents verified via cat |
| 9 | Discussion Interaction | ✅ | Discussion #19112 retrieved; comic comment added |
| 10 | Agentic Workflows MCP | ✅ | smoke-claude workflow: active, engine=claude, triggers: pull_request/reaction/schedule |
PR Review Test Results (#11–17)
| # | Test | Result | Notes |
|---|---|---|---|
| 11 | Update PR Body | ✅ | Appended test message to PR #19092 |
| 12 | PR Review Comments | ✅ | 2 inline comments added on lock files |
| 13 | Submit PR Review | ✅ | COMMENT review submitted |
| 14 | Resolve Review Thread | ✅ | Thread PRRT_kwDOPc1QR85xbaFA resolved |
| 15 | Add Reviewer | ✅ | copilot added as reviewer to PR #19092 |
| 16 | Push to PR Branch | Skipped — workflow triggered by schedule (not on PR branch) | |
| 17 | Close PR | Skipped — no safe test/bot PR found to close |
Failure Details
Test #3 — Serena MCP find_symbol failure
mcp__serena__activate_project succeeded and created project gh-aw. However, all subsequent find_symbol calls failed with:
MCP error 0: connection closed: calling "tools/call": client is closing: EOF
The Serena LSP server connection appears to drop after project activation.
Test #6 — Tavily rate limit
Both search attempts returned HTTP 429:
{"error":"Search failed","status":429,"detail":{"error":"Your request has been blocked due to excessive requests."}}Likely due to shared API key exhaustion at time of run.
Run: §22552233163
Timestamp: 2026-03-01 20:47 UTC
💥 [THE END] — Illustrated by Smoke Claude
- expires on Mar 1, 2026, 10:52 PM UTC
Activity
github-actions commentedon Mar 1, 2026
This issue is being closed as outdated. A newer issue has been created: #19125
View newer issue
This action was performed automatically by the
Smoke Claudeworkflow.