docs(artifacts): reorganize generated artifacts + docs (phase 10) - #10
Merged
Conversation
…se 10)
- artifacts/ -> artifacts/generated/: alignment/ + prompt_stats/
(canonical_id_baseline/ = 旧 canonical-id 统计 baseline 原样保留;
choice_id/ = choice-protocol 新统计, 去掉 phase9_ 前缀)
- docs/ = 文档: 新增 docs/design/{data_contract,prompt_interface}.md、
docs/data_alignment.md、docs/prompt_length_analysis.md;
阶段报告 artifacts/stage{2,3c,4a}*.md -> docs/phase_reports/
- analyze 脚本默认输出改为 artifacts/generated/alignment/
- README 增加 文档/生成产物 结构说明
- 无代码/算法/prompt/parquet 改动
added 2 commits
August 19, 2026 16:52
…fy identity semantics - data_alignment.md: split unique leaf coverage vs sample leaf_exact coverage into separate columns (finance 20/25(80%) | 534/568(94.0%), shougang 192/193(~99.5%) | 18393/19415(94.7%), pers_info 4/18(~22%) | 35/176(19.9%), infra 4/4 | 64/64); add note that denominators differ - data_contract.md: target.category_id is the canonical semantic ground-truth identity; model-facing actions use derived choice ids - prompt_interface.md: choice ids provide a compact action representation (do not reduce category count) - prompt_length_analysis.md: 233-category registry applies to finance/infra/shougang; pers_info is 18
- drop gitignored tmp/re_export phase-9 script from the long-term doc; formal entry (python -m script.verl.sft.prompt_stats --model Qwen/Qwen2.5-7B-Instruct) verified to reproduce the tables exactly (finance train stage1 2535.4/2543/2553, stage2 494.0/560/740)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Overview
Phase 10 tidies up
artifacts/anddocs/after the Phase 8/9 data + stats work. No training logic, prompts, parsers, rewards, parquets or algorithms changed.docs/= 项目文档(设计说明、分析结论、阶段报告)artifacts/generated/= 可复现生成产物(统计、对齐报告)Changes
Reorganized:
artifacts/→artifacts/generated/Legacy stats (old
prompt_token_stats_*/prompt_stats_*/prompt_token_stats_summary.json) are kept byte-identical incanonical_id_baseline/for regressions/comparison.New long-term docs (
docs/)docs/design/data_contract.md— canonical category_id 数据契约(registry/corpus/target、身份策略、训练入口规则)docs/design/prompt_interface.md— prompt-facing choice protocol 与共享解码层docs/prompt_length_analysis.md— Phase 9 token 分析(old∽new p95/max、Stage1 主收益、finance/shougang 反转、worst-case 2689/32768、PromptChoice 的 decoupling 目的)docs/data_alignment.md— 对齐人工结论(人类维护,脚本报告在 generated/alignment/)Moved (git rename, tracked history preserved)
artifacts/data_alignment_report.{json,md}→artifacts/generated/alignment/artifacts/prompt_token_stats_*+prompt_stats_*→artifacts/generated/prompt_stats/canonical_id_baseline/artifacts/stage2_contract_design.md/stage3c_report.md/stage4a_report.md→docs/phase_reports/(内部路径引用同步更新)References / default paths
script/analysis/analyze_dataset_corpus_alignment.py: default output →artifacts/generated/alignment/src/agent/task/dataset_config.py: comment pathREADME.md: 新增「文档与产物结构」说明(含 canonical_id_baseline / choice_id)Not changed
No prompt / parser / reward / parquet / algorithm / training changes.
Verification
233 passed, 2 skipped(与改动前一致)