Skip to content

Improve generic localization quality and evidence preservation - #402

Open
zzet wants to merge 2 commits into
mainfrom
codex/localization-quality-pipeline
Open

Improve generic localization quality and evidence preservation#402
zzet wants to merge 2 commits into
mainfrom
codex/localization-quality-pipeline

Conversation

@zzet

@zzet zzet commented Jul 30, 2026

Copy link
Copy Markdown
Owner

Summary

  • add a benchmark-independent localization quality specification with anti-overfitting and evaluation gates
  • tighten declaration ownership for nested Go callables, PHP annotations, and C/Rust macros
  • preserve declaration-backed evidence across refinement, exact-read, and recovery transitions
  • keep terminal state honest when recovery is empty, exhausted, or evidence is shed
  • protect concurrent localization reservations and add deterministic, synthetic regression coverage

Design constraints

  • tree-sitter remains the primary source of syntax structure
  • manual parsing is limited to bounded grammar, recovery, preprocessor, or external-block gaps
  • production behavior is based on syntax, graph structure, query intent, and evidence provenance
  • no new benchmark task IDs, repositories, paths, transcripts, or expected answers are embedded in implementation or tests

Verification

  • go test ./internal/mcp ./internal/parser/languages -count=1
  • go test -race ./internal/mcp -count=1
  • go build ./internal/mcp/...
  • formatting and diff checks
  • independent review of ownership ambiguity, macro determinism, evidence preservation, and concurrent recovery behavior

@zzet
zzet force-pushed the codex/localization-quality-pipeline branch from 091a818 to db8abc9 Compare July 30, 2026 05:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant