Skip to content

split network-coverage into asset-registry + dex-network benches - #1390

Merged
Flotapponnier merged 1 commit into
mainfrom
feat/split-network-coverage
Jul 24, 2026
Merged

split network-coverage into asset-registry + dex-network benches#1390
Flotapponnier merged 1 commit into
mainfrom
feat/split-network-coverage

Conversation

@Flotapponnier

Copy link
Copy Markdown
Collaborator

Summary

  • Splits legacy bench 005 network-coverage into 2 apple-to-apple benches
  • asset-registry-coverage (005): CoinGecko 461, CoinPaprika 307, CoinStats 149, Mobula 79
  • dex-network-coverage (090): GeckoTerminal 265, Codex 120, DefiLlama 479, DexPaprika 36, Sim by Dune 64
  • 301 redirect /benchmarks/network-coverage -> /benchmarks/asset-registry-coverage via RENAMED_BENCH_SLUGS (preserves CoinPaprika Twitter backlink + PageRank)
  • Adds 3 new provider fetchers in existing harness binary (coingecko, defillama, dexpaprika)

Why

Twitter user @sooneggg flagged CoinPaprika #1 with 307 chains via /v1/contracts (asset registry) is not comparable to GeckoTerminal 265 chains via /networks (DEX pool indexing). Different products, different question, splitting into 2 leaderboards makes each ranking meaningful.

Test plan

  • pnpm validate -> 87 specs OK
  • pnpm typecheck -> OK
  • go build ./cmd/script/ -> OK
  • After merge + prod deploy + VPS container rebuild:
    • curl https://openchainbench.com/api/stat/asset-registry-coverage returns 4 providers
    • curl https://openchainbench.com/api/stat/dex-network-coverage returns 5 providers
    • curl -I https://openchainbench.com/benchmarks/network-coverage returns 301 to asset-registry-coverage

…erage

Apple-to-apple ranking: CoinPaprika's 300+ chains via /v1/contracts is
asset-registry coverage (token metadata lookups), not comparable to
GeckoTerminal 265 chains via /networks which is DEX pool indexing.

- asset-registry-coverage bench (005): CoinGecko, CoinPaprika, CoinStats, Mobula
- dex-network-coverage bench (090): GeckoTerminal, Codex, DefiLlama, DexPaprika, Sim by Dune
- add fetchers coingecko, defillama, dexpaprika to harness (same binary)
- 301 redirect /benchmarks/network-coverage to /benchmarks/asset-registry-coverage
  via RENAMED_BENCH_SLUGS map (preserves external backlinks)
- retarget answer YAML to asset-registry-coverage with split framing
@Flotapponnier
Flotapponnier merged commit b2757fd into main Jul 24, 2026
Flotapponnier added a commit that referenced this pull request Jul 24, 2026
Legacy bench 005 network-coverage removed, 2 new slugs added
(asset-registry-coverage, dex-network-coverage). Bench SET changed so
the 3 unstable_cache keys need lockstep bumps (see comments):
- bench-unfiltered v45 -> v46
- all-benchmarks v48 -> v49
- bench-filters v20 -> v21

Without this, the new bench URLs 404 on prod (getBenchmark reads a
stale cached bench-set that predates the split), which just tripped
the sitemap smoke on #1390.

Co-authored-by: Florent Tapponnier <contact@mobula.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant