Skip to content

feat(iterate): add generic iterate skill, replace iterative-eval - #567

Merged
baleen37 merged 3 commits into
mainfrom
feat/iterate-skill
Mar 23, 2026
Merged

feat(iterate): add generic iterate skill, replace iterative-eval#567
baleen37 merged 3 commits into
mainfrom
feat/iterate-skill

Conversation

@baleen37

@baleen37 baleen37 commented Mar 23, 2026

Copy link
Copy Markdown
Owner

Summary

Generic iterate skill 추가 및 iterative-eval 대체, create-pr auto-merge broken state 버그 수정.

Changes

  • feat(iterate): add generic iterate skill, replace iterative-eval
  • feat(iterative-eval): add iterative-eval skill for incremental A/B improvement
  • fix(create-pr): stop auto-merge when verify reports broken state (exit 1 시 merge 중단)

Tests

  • create-pr SKILL.md 로직 검토 완료

Breaking

  • iterative-eval skill이 iterate로 대체됨

Summary by CodeRabbit

  • Bug Fixes
    • Improved PR merge automation to properly halt when verification checks fail, preventing inadvertent merges on failed validations.

Test User added 3 commits March 23, 2026 10:58
…provement

Skill for improving a file (prompt, config, template) toward reference
quality through repeated single-change A/B testing. Each iteration makes
exactly one change, tests it against reference examples via parallel
generation + judge evaluation, and adopts only what works.

Key design decisions:
- One change per iteration (bundled changes hide what helped/hurt)
- Dynamic next-change based on judge feedback (not pre-planned list)
- Same inputs every iteration for valid comparison
- Adopt on TIE (change that doesn't hurt is worth keeping)
- Stop after 2+ consecutive rejections (rethink approach)
Replace eval-specific iterative-eval with a general-purpose iterate
skill. Works for any incremental improvement: prompts, code, configs,
docs — anything where you can verify whether a change helped.

Key design:
- One change per iteration (clear signal)
- Pluggable verification (test, build, judge, user, metric, composite)
- Feedback-driven next change (not pre-planned)
- Stop on 2+ consecutive rejections

BREAKING CHANGE: removes iterative-eval skill
@baleen37
baleen37 enabled auto-merge (squash) March 23, 2026 02:47
@coderabbitai

coderabbitai Bot commented Mar 23, 2026

Copy link
Copy Markdown

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: 95685e3e-b815-4bfc-8522-3e88b479101d

📥 Commits

Reviewing files that changed from the base of the PR and between de28307 and d6ff626.

📒 Files selected for processing (1)
  • plugins/me/skills/create-pr/SKILL.md

📝 Walkthrough

Walkthrough

The script's post-gh pr checks --watch fallback path now captures the exit code from verify-pr-status.sh and conditionally halts before executing gh pr merge --squash. Previously, the code proceeded to merge regardless of verification status. The merge now only executes when the verifier returns exit code 0 or 2.

Changes

Cohort / File(s) Summary
Create-PR Merge Control Flow
plugins/me/skills/create-pr/SKILL.md
Added explicit exit code capture from verify-pr-status.sh and conditional branch to skip squash merge when verifier returns exit code 1, improving failure handling in the fallback merge path.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~15 minutes

Possibly related PRs

Poem

🐰 A script that once charged ahead, now stops and thinks instead,
Respecting what the verifier said—no reckless merge to dread!
Exit codes guide the way, 0 or 2 save the day,
While 1 halts the play. ✨

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch feat/iterate-skill

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@baleen37
baleen37 merged commit 0e8683e into main Mar 23, 2026
4 of 5 checks passed
@baleen37
baleen37 deleted the feat/iterate-skill branch March 23, 2026 02:48
baleen-release-app Bot pushed a commit that referenced this pull request Mar 23, 2026
# [9.0.0](v8.0.0...v9.0.0) (2026-03-23)

### Features

* **iterate:** add generic iterate skill, replace iterative-eval ([#567](#567)) ([0e8683e](0e8683e))

### BREAKING CHANGES

* **iterate:** removes iterative-eval skill

* fix(create-pr): stop auto-merge when verify reports broken state
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant