Skip to content

[plan] Add Conversation Transcript Access for Copilot Session Insights #14352

Description

@github-actions

Objective

Enable Copilot Session Insights workflow to access Copilot agent conversation transcripts for behavioral pattern analysis, or redesign workflow to work with available data.

Context

From Discussion #14345, the Copilot Session Insights workflow §21779587315 reported missing data:

Missing: Copilot agent session conversation transcripts (user prompts, agent responses, tool calls)

Impact: Cannot perform:

  • Behavioral pattern analysis
  • Prompt quality assessment
  • Success factor identification

Currently only GitHub Actions infrastructure logs are available, which lack the actual conversation content needed for insights.

Approach

  1. Research available data sources for Copilot agent conversations:
    • GitHub API endpoints for agent session data
    • Copilot telemetry/analytics APIs
    • Alternative data collection methods
  2. Evaluate feasibility of accessing conversation transcripts:
    • Required permissions/scopes
    • API availability and stability
    • Data format and completeness
  3. If conversation data is accessible:
    • Implement data collection in workflow
    • Add necessary authentication/permissions
    • Parse and analyze conversation patterns
  4. If conversation data is NOT accessible:
    • Redesign workflow to work with available data (GitHub Actions logs, workflow metrics)
    • Document limitations and adjust workflow goals
    • Consider alternative approaches for gaining insights

Files to Review

  • .github/workflows/copilot-session-insights.md - Workflow definition
  • Copilot API documentation for available data sources
  • Related data collection utilities

Acceptance Criteria

  • Research completed on available Copilot conversation data sources
  • Feasibility assessment documented
  • If data accessible: implement data collection and analysis
  • If data not accessible: redesign workflow with realistic scope
  • Test workflow completes successfully with chosen approach
  • Update workflow documentation with data source details and limitations

AI generated by Plan Command for discussion #14345

  • expires on Feb 9, 2026, 2:05 PM UTC

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions