Skip to content

Smoke Test: Claude - 22656026286 #19512

Closed as not planned
Closed as not planned

Description

@github-actions

Smoke test results for Claude engine validation run §22656026286.

PR used for review testing: #19493 (copilot/fix-safe-inputs-script-error)

Overall Status: PARTIAL (1 failure, 2 skipped)

Core Tests (#1–10)

# Test Result Notes
1 GitHub MCP - Last 2 merged PRs ⚠️ Response exceeded token limit (71k chars); data retrieved via gh CLI fallback. PRs: #19502, #19501
2 Safe Inputs GH CLI ✅ PRs returned: #19509, #19507
3 Serena MCP ❌ Project activated OK; find_symbol failed with EOF (MCP server closed connection repeatedly)
4 Make Build ✅ make build succeeded, binary compiled
5 Playwright ✅ Title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub"
6 Tavily Web Search ✅ 3 results for "GitHub Agentic Workflows"
7 File Writing ✅ /tmp/gh-aw/agent/smoke-test-claude-22656026286.txt created
8 Bash Tool ✅ File read back successfully
9 Discussion Interaction ✅ Discussion #19508 found; comic-book comment added
10 Agentic Workflows MCP ✅ smoke-claude: active, compiled, triggers: PR/label, reaction:heart, every 12h

PR Review Tests (#11–17)

# Test Result Notes
11 Update PR Body ✅ Appended test message to PR #19493
12 PR Review Comments ✅ 2 comments added on safe-inputs-runner.cjs:27 and safe_inputs_generator.go:232
13 Submit PR Review ✅ COMMENT review submitted
14 Resolve Review Thread ⚠️ Skipped — no existing review threads on PR
15 Add Reviewer ✅ copilot added as reviewer
16 Push to PR Branch ✅ Committed and pushed smoke-test-push-22656026286.json to branch
17 Close PR ⚠️ Skipped — no safe test PR to close

Failure Details

Test 3 — Serena find_symbol (EOF)

  • activate_project succeeded for /home/runner/work/gh-aw/gh-aw
  • Subsequent find_symbol calls failed with MCP error 0: connection closed: calling "tools/call": client is closing: EOF
  • Tried patterns: main, run (substring), runSafeInput — all failed

References:

💥 [THE END] — Illustrated by Smoke Claude · ◷

  • expires on Mar 4, 2026, 7:19 AM UTC

Activity

  1. github-actions commented on Mar 4, 2026

    @github-actions
    ContributorAuthor

    This issue is being closed as outdated. A newer issue has been created: #19517

    View newer issue


    This action was performed automatically by the Smoke Claude workflow.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions