Skip to content

feat(ai): Validate LLM cache findings - #127017

Merged
vgrozdanic merged 1 commit into
masterfrom
feat/llm-cache-validation
Oct 13, 2026
Merged

vgrozdanic merged 1 commit into
masterfrom
feat/llm-cache-validation

Conversation

@vgrozdanic

@vgrozdanic vgrozdanic commented Oct 9, 2026 •

Copy link
Copy Markdown
Member

Adds validation rules that prevent provisional LLM cache classifications from becoming misleading shadow findings.

Traffic validation estimates how many calls could reuse cache within the default five-minute lifetime. It rejects call sites with too few reusable calls or a low reusable share. It also detects traffic that would only benefit from a longer one-hour lifetime, so we can distinguish cache configuration opportunities from ineffective caching.

Instrumentation validation distinguishes explicit zero cache-token values from spans that never reported cache attributes. Missing evidence and incomplete probes produce unknown or ineligible outcomes instead of findings.

provisional classification
→ validate reusable traffic
→ validate cache instrumentation
→ confirmed finding | ineligible | unknown

This layer only defines validation behavior. It does not run telemetry queries, schedule detection, emit logs, or create issues. The next stack layers supply probe data and connect these rules to detector execution.

@vgrozdanic
vgrozdanic added this pull request to stack #127016 October 9, 2026 11:55
@github-actions github-actions Bot added the Scope: Backend Automatically applied to PRs that change backend components label Oct 9, 2026
@vgrozdanic
vgrozdanic marked this pull request as ready for review October 9, 2026 11:56
@vgrozdanic
vgrozdanic requested a review from a team as a code owner October 9, 2026 11:56
@vgrozdanic
vgrozdanic force-pushed the feat/llm-cache-validation branch from cefadbd to 06b0065 Compare October 12, 2026 12:44
@vgrozdanic
vgrozdanic force-pushed the feat/llm-cache-validation branch from 06b0065 to 532e69b Compare October 12, 2026 15:28
@sentry

sentry Bot commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Sentry Snapshot Testing

Name Added Removed Changed Renamed Unchanged Skipped Status
sentry-frontend
sentry-frontend
0 0 0 0 620 0 ✅ Unchanged

⚙️ sentry-frontend Snapshot Settings

Base automatically changed from feat/llm-cache-classification to master October 12, 2026 15:49
@vgrozdanic
vgrozdanic force-pushed the feat/llm-cache-validation branch from 532e69b to 65f19bf Compare October 12, 2026 15:49
@vgrozdanic
vgrozdanic merged commit 7d31f0d into master Oct 13, 2026
66 checks passed
@vgrozdanic
vgrozdanic deleted the feat/llm-cache-validation branch October 13, 2026 05:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Scope: Backend Automatically applied to PRs that change backend components

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants