Skip to content

refactor(integration-v2): drop step-skill lines the task prompts already say - #524

Draft
gewenyu99 wants to merge 4 commits into
mainfrom
vincent/thin-step-skills-main
Draft

gewenyu99 wants to merge 4 commits into
mainfrom
vincent/thin-step-skills-main

Conversation

@gewenyu99

@gewenyu99 gewenyu99 commented Nov 13, 2026 •

Copy link
Copy Markdown
Collaborator

Removes 24 sentences from ten integration-v2 step skills. Each is a goal the task prompt already states, or a rule every prompt that loads the skill repeats, so the task agent is told the same things. Users see nothing change.

What's new

  • integration-v2-report. Loses its intro and the closing publish reminders.
  • integration-v2-build. Loses the test-suite ban and the done and failed rule.
  • integration-v2-capture, -error-tracking-step, -identify. Lose two sentences each.
  • integration-v2-init, -install, -dashboard, -warehouse, -notebook. Lose one each.

Merge danger. Prose only, fetched by wizard task agents from the latest release. A revert restores the sentences. Blast radius: the task agents of the default, error-tracking, feature-flags, metrics, replay-vision and support flows.

How it flows

Nothing flows differently. No prompt, config, skill id or variant id changes.

Area Files
Step skills build, capture, dashboard, error-tracking-step, identify, init, install, notebook, report, warehouse

The rule

A sentence went only when a line in every prompt that loads the skill says it. Each removal has an inline comment quoting that line.

Details and verification

Checks, against a build of main at ff49233:

  • The text each task agent is given (prompt body, each built SKILL.md, each reference file) was rebuilt for 49 tasks across every framework variant, 634 texts. 24 sentences are gone, the ones commented on. 0 are new. 0 reference files changed.
  • npm test: 30 files, 339 tests pass.

Kept, though something else repeats them:

  • Lines only another skill repeats, such as dashboard's "create the insights anyway", which the insight skill also says.
  • Lines the default flow's prompt repeats and another flow's prompt doesn't: most of install, parts of init and identify.
  • Lines a prompt covers in looser words, such as build's "it matches the codebase".

🤖 Generated with Claude Code

…ady say

Each removed sentence is said again by every prompt that loads the skill, or
by another skill that prompt loads. Nothing moves and no prompt changes.

Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown

🧙 Wizard CI

Run the Wizard CI and test your changes against wizard-workbench example apps by replying with a GitHub comment using one of the following commands:

Test all apps:

  • /wizard-ci all

Test all apps in a directory:

  • /wizard-ci ai-observability
  • /wizard-ci basic-integration
  • /wizard-ci feature-flags
  • /wizard-ci mcp-analytics
  • /wizard-ci replay-vision
  • /wizard-ci revenue
  • /wizard-ci self-driving
  • /wizard-ci warehouse
  • /wizard-ci warehouse-seeded

Test an individual app:

  • /wizard-ci ai-observability/anthropic
  • /wizard-ci ai-observability/google-adk
  • /wizard-ci ai-observability/groq
Show more apps
  • /wizard-ci ai-observability/manual-capture
  • /wizard-ci ai-observability/openai
  • /wizard-ci ai-observability/openai-agents
  • /wizard-ci ai-observability/opentelemetry
  • /wizard-ci ai-observability/vercel-ai
  • /wizard-ci basic-integration/android
  • /wizard-ci basic-integration/angular
  • /wizard-ci basic-integration/astro
  • /wizard-ci basic-integration/django
  • /wizard-ci basic-integration/fastapi
  • /wizard-ci basic-integration/flask
  • /wizard-ci basic-integration/flutter
  • /wizard-ci basic-integration/javascript-node
  • /wizard-ci basic-integration/javascript-web
  • /wizard-ci basic-integration/laravel
  • /wizard-ci basic-integration/next-js
  • /wizard-ci basic-integration/nuxt
  • /wizard-ci basic-integration/python
  • /wizard-ci basic-integration/rails
  • /wizard-ci basic-integration/react-native
  • /wizard-ci basic-integration/react-router
  • /wizard-ci basic-integration/sveltekit
  • /wizard-ci basic-integration/swift
  • /wizard-ci basic-integration/tanstack-router
  • /wizard-ci basic-integration/tanstack-start
  • /wizard-ci basic-integration/vue
  • /wizard-ci feature-flags/django
  • /wizard-ci feature-flags/next-js
  • /wizard-ci mcp-analytics/custom-dispatcher
  • /wizard-ci mcp-analytics/go-sdk
  • /wizard-ci mcp-analytics/python-sdk
  • /wizard-ci mcp-analytics/ruby-sdk
  • /wizard-ci mcp-analytics/rust-sdk
  • /wizard-ci mcp-analytics/typescript-sdk
  • /wizard-ci replay-vision/javascript-node
  • /wizard-ci replay-vision/next-js
  • /wizard-ci replay-vision/react-vite
  • /wizard-ci revenue/stripe
  • /wizard-ci self-driving/astro
  • /wizard-ci self-driving/fastapi
  • /wizard-ci self-driving/nuxt
  • /wizard-ci self-driving/react-router
  • /wizard-ci self-driving/sveltekit
  • /wizard-ci warehouse/monorepo-env
  • /wizard-ci warehouse/multi-source-next
  • /wizard-ci warehouse/stripe-node
  • /wizard-ci warehouse/zero-source
  • /wizard-ci warehouse-seeded/next-stripe
  • /wizard-ci warehouse-seeded/next-stripe-declined

Test against a wizard branch:

  • /wizard-ci all wizard:my-branch

Add wizard:<branch> to any command above to pin the wizard branch. It defaults to main.

Results will be posted here when complete.

…drop two embedded goals

Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
Comment on lines -3 to -4
Decide which custom events are worth capturing, then instrument them — in one
pass, reading each file once.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A goal, and the prompt states it. Superseded by context/agents/integration-v2/capture.md:17-19:

Decide which events are worth capturing in this app, then instrument them in the same pass — read each file once, choose the events, and add the capture calls while the file is already open.

Comment on lines -41 to -42
`lower_snake_case` names and useful properties. Edit each file while it is already
open.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only "Edit each file while it is already open." is removed. Superseded by context/agents/integration-v2/capture.md:18-19:

read each file once, choose the events, and add the capture calls while the file is already open.

Comment on lines -31 to -32
in prose, without the marker, is dropped. Also record the dashboard URL in your
handoff so the report step can link it.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only "Also record the dashboard URL in your handoff so the report step can link it." is removed. Superseded by context/agents/integration-v2/dashboard.md:25-26:

A dashboard exists with a handful of insights on the captured events, and you hand off its URL for the report to link.

Comment on lines -8 to -9
add the handler there. Do not read through the whole app or wrap individual
components or routes by hand.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only "Do not read through the whole app or wrap individual components or routes by hand." is removed.

context/agents/integration-v2/error-tracking.md:40-42:

You did not install anything, run a build, lint, or tests (the review task verifies after you), search outside the project, or read through the whole app or hand-wrap individual components or routes.

context/agents/error-tracking/capture-exceptions.md:114-116:

You installed nothing but the server library your capture imports, and did not run tests, search outside the project, or read through the whole app or hand-wrap individual components or routes.

Comment on lines -30 to -31
Find the auth flow first: login and signup handlers, session callbacks. If the
app has no concept of a user, there is nothing to identify — report that and stop.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only "If the app has no concept of a user, there is nothing to identify — report that and stop." is removed.

context/agents/integration-v2/identify.md:64:

If the app has no auth or user concept, say so and stop.

context/agents/support/identify.md:38:

If the app has no login, say so and stop.

poetry, else pip; `composer.lock` → composer; `Gemfile.lock` → bundle). Add the
client library, plus the server library if the app sends events server-side.

Read the manifest first. If the SDK is already installed, leave it and say so.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only "If the SDK is already installed, leave it and say so." is removed. All five prompts that load this skill say it.

context/agents/integration-v2/install.md:31:

If the SDK is already installed, leave it and say so.

context/agents/error-tracking/install.md:16-17, context/agents/replay-vision/install.md:16-17:

If it's already installed, leave it alone and say so in your handoff.

context/agents/feature-flags/install.md:19:

Leave an SDK that is already there alone and say so.

context/agents/support/install.md:16-17:

If it's already there, leave it alone and say so in your handoff.

# Mirror the report into a PostHog notebook

Mirror the setup report into a shareable PostHog notebook, so the user has an
in-app copy to link and comment on. No report file is written to the project.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only "No report file is written to the project." is removed. All four report prompts that load this skill say it, in the same words:

Do not write a report file.

context/agents/integration-v2/report.md:23, context/agents/feature-flags/report.md:21, context/agents/metrics/report.md:35, context/agents/support/report.md:20.

Comment on lines -3 to -6
Compose the full setup report as markdown, then publish it in **one**
`publish_handoff` call. That call is how the report reaches the user's wizard
session. Do not write a report file. The same call mirrors the markdown into a
shareable PostHog notebook. The notebook skill says what its result means.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A goal, and the prompt states it. Superseded by context/agents/integration-v2/report.md:21-24:

Then publish it with a single publish_handoff call. The same call mirrors the markdown into a shareable PostHog notebook. The notebook skill says what the result means and covers older wizards. Do not write a report file. The handoff call and the notebook are how the report reaches the user.

Comment on lines -96 to -98
Do not fall back to writing a file. Then follow the notebook skill for what
the result means. The notebook is best effort and never fails this step.
Record its outcome in your final message. Do not call `publish_handoff` again.

@gewenyu99 gewenyu99 Nov 13, 2026 •

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Three sentences removed, each said in context/agents/integration-v2/report.md.

Removed Prompt line
Do not fall back to writing a file. :23 "Do not write a report file."
Then follow the notebook skill for what the result means. :22-23 "The notebook skill says what the result means and covers older wizards."
The notebook is best effort and never fails this step. :51-53 "The notebook mirror is best effort […] A missing notebook never fails this task."

Comment on lines -87 to -88
5. **Change no project code.** This step connects external data. It edits
nothing in the app.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Superseded by context/agents/integration-v2/warehouse.md:30:

Touch no project code. This step connects data; it does not edit the app.

The two tenets after it are renumbered, with no other change.

gewenyu99 and others added 2 commits November 13, 2026 11:14
…t in the same words

Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant