Skip to content

Guard exact match against empty normalized answers - #717

Merged
TengJiao33 merged 1 commit into
mainfrom
codex/issue-716-empty-normalization
Sep 24, 2026
Merged

TengJiao33 merged 1 commit into
mainfrom
codex/issue-716-empty-normalization

Conversation

@TengJiao33

@TengJiao33 TengJiao33 commented Sep 24, 2026 •

Copy link
Copy Markdown
Collaborator

Fixes #716.

Changes

  • Return a non-match when either answer becomes empty after normalization.
  • Cover degenerate answers and ordinary matching behavior.

Validation

  • A800_2 EasyEdit environment: python -m unittest discover -s tests -p test_exact_match_fallback.py -v (2 tests passed).
  • git diff --check passed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

normalize_answer's article/punctuation stripping lets degenerate replies pass exact_match_score in the LLM-judge no-api_key fallback

2 participants