Skip to content

docs(artifacts): reorganize generated artifacts + docs (phase 10) - #10

Merged
xianyu9n merged 3 commits into
masterfrom
docs/artifacts-phase10
Aug 19, 2026
Merged

docs(artifacts): reorganize generated artifacts + docs (phase 10)#10
xianyu9n merged 3 commits into
masterfrom
docs/artifacts-phase10

Conversation

@xianyu9n

Copy link
Copy Markdown
Collaborator

Overview

Phase 10 tidies up artifacts/ and docs/ after the Phase 8/9 data + stats work. No training logic, prompts, parsers, rewards, parquets or algorithms changed.

  • docs/ = 项目文档(设计说明、分析结论、阶段报告)
  • artifacts/generated/ = 可复现生成产物(统计、对齐报告)

Changes

Reorganized: artifacts/artifacts/generated/

artifacts/generated/
├── alignment/                              # data_alignment_report.{json,md} (moved)
└── prompt_stats/
    ├── canonical_id_baseline/              # 旧 canonical-id 统计(legacy baseline,原样保留)
    └── choice_id/                          # choice-protocol 新统计(去 phase9_ 前缀)

Legacy stats (old prompt_token_stats_* / prompt_stats_* / prompt_token_stats_summary.json) are kept byte-identical in canonical_id_baseline/ for regressions/comparison.

New long-term docs (docs/)

  • docs/design/data_contract.md — canonical category_id 数据契约(registry/corpus/target、身份策略、训练入口规则)
  • docs/design/prompt_interface.md — prompt-facing choice protocol 与共享解码层
  • docs/prompt_length_analysis.md — Phase 9 token 分析(old∽new p95/max、Stage1 主收益、finance/shougang 反转、worst-case 2689/32768、PromptChoice 的 decoupling 目的)
  • docs/data_alignment.md — 对齐人工结论(人类维护,脚本报告在 generated/alignment/)

Moved (git rename, tracked history preserved)

  • artifacts/data_alignment_report.{json,md}artifacts/generated/alignment/
  • artifacts/prompt_token_stats_* + prompt_stats_*artifacts/generated/prompt_stats/canonical_id_baseline/
  • artifacts/stage2_contract_design.md / stage3c_report.md / stage4a_report.mddocs/phase_reports/(内部路径引用同步更新)

References / default paths

  • script/analysis/analyze_dataset_corpus_alignment.py: default output → artifacts/generated/alignment/
  • src/agent/task/dataset_config.py: comment path
  • README.md: 新增「文档与产物结构」说明(含 canonical_id_baseline / choice_id)

Not changed

No prompt / parser / reward / parquet / algorithm / training changes.

Verification

  • Full suite: 233 passed, 2 skipped(与改动前一致)
  • 迁移 JSON 全部可读;受控文件无旧路径残留

…se 10)

- artifacts/ -> artifacts/generated/: alignment/ + prompt_stats/
  (canonical_id_baseline/ = 旧 canonical-id 统计 baseline 原样保留;
   choice_id/ = choice-protocol 新统计, 去掉 phase9_ 前缀)
- docs/ = 文档: 新增 docs/design/{data_contract,prompt_interface}.md、
  docs/data_alignment.md、docs/prompt_length_analysis.md;
  阶段报告 artifacts/stage{2,3c,4a}*.md -> docs/phase_reports/
- analyze 脚本默认输出改为 artifacts/generated/alignment/
- README 增加 文档/生成产物 结构说明
- 无代码/算法/prompt/parquet 改动
@xianyu9n xianyu9n changed the title docs(artifacts): reorganize generated artifacts + long-term docs (phase 10) docs(artifacts): reorganize generated artifacts + docs (phase 10) Aug 19, 2026
曾立宏 added 2 commits August 19, 2026 16:52
…fy identity semantics

- data_alignment.md: split unique leaf coverage vs sample leaf_exact
  coverage into separate columns (finance 20/25(80%) | 534/568(94.0%),
  shougang 192/193(~99.5%) | 18393/19415(94.7%), pers_info 4/18(~22%)
  | 35/176(19.9%), infra 4/4 | 64/64); add note that denominators differ
- data_contract.md: target.category_id is the canonical semantic
  ground-truth identity; model-facing actions use derived choice ids
- prompt_interface.md: choice ids provide a compact action representation
  (do not reduce category count)
- prompt_length_analysis.md: 233-category registry applies to
  finance/infra/shougang; pers_info is 18
- drop gitignored tmp/re_export phase-9 script from the long-term doc;
  formal entry (python -m script.verl.sft.prompt_stats --model
  Qwen/Qwen2.5-7B-Instruct) verified to reproduce the tables exactly
  (finance train stage1 2535.4/2543/2553, stage2 494.0/560/740)
@xianyu9n
xianyu9n merged commit 7e660e6 into master Aug 19, 2026
3 checks passed
@xianyu9n
xianyu9n deleted the docs/artifacts-phase10 branch August 19, 2026 19:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant