Skip to content

fix(001): remove All chains tab, per-chain rankings only - #1542

Merged
Flotapponnier merged 1 commit into
devfrom
fix/agg-head-lag-no-global-rank
Jul 26, 2026
Merged

fix(001): remove All chains tab, per-chain rankings only#1542
Flotapponnier merged 1 commit into
devfrom
fix/agg-head-lag-no-global-rank

Conversation

@Flotapponnier

Copy link
Copy Markdown
Collaborator

Problem

prom.scalar takes result[0] from multi-series PromQL vectors. Prometheus returns series in alphabetical label order, so chain="base" always comes first. The unfiltered "All chains" view silently showed Base data for every provider, giving Codex (Base leader at 0.8 s) a false global #1 — even though Mobula leads on BNB (1.0 s), Solana (0.09 s), and Robinhood (0.9 s).

Fix

  • Remove { value: all, label: All chains } from dimensions.chain — bench now always shows per-chain data, Base is the default tab
  • Keep { value: all, label: All regions } in dimensions.region — cross-region average for the chart is computed via prom.series (correct averaging), not prom.scalar
  • rank_matrix_query is unchanged — product page badges still use correct per-chain cell ranks (Codex gets "on Base", Mobula gets the other three)
  • Updated seo_description, findings[0/4/5/6], faq[0] to reference per-chain leaders instead of a cross-chain aggregate that never existed

After

  • /benchmarks/aggregator-head-lag defaults to Base tab — Codex correctly shows as leader
  • BNB / Solana / Robinhood tabs show Mobula leading
  • No global drop journal framing #1 claim anywhere

prom.scalar takes result[0] from multi-series vectors. Prometheus
returns series alphabetically so chain=base always comes first — the
unfiltered view silently showed Base data for every provider and
gave Codex (Base leader at 0.8 s) a false global #1 even though
Mobula leads on BNB, Solana and Robinhood.

Fix: drop the All chains dimension entry so the bench always shows
per-chain data. Base is now the default tab (first in list). Also
update seo_description, findings and faq to reference per-chain
leaders instead of a misleading cross-chain aggregate.
@Flotapponnier
Flotapponnier merged commit 81d0745 into dev Jul 26, 2026
1 check failed
Flotapponnier added a commit that referenced this pull request Jul 26, 2026
prom.scalar takes result[0] from multi-series vectors. Prometheus
returns series alphabetically so chain=base always comes first — the
unfiltered view silently showed Base data for every provider and
gave Codex (Base leader at 0.8 s) a false global #1 even though
Mobula leads on BNB, Solana and Robinhood.

Fix: drop the All chains dimension entry so the bench always shows
per-chain data. Base is now the default tab (first in list). Also
update seo_description, findings and faq to reference per-chain
leaders instead of a misleading cross-chain aggregate.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant