spb/ai-atlas

Sat, Sep 12, 2026 3

1. canonicalize pass 2: identifier aliases (snapshots, previews, effort/instruct suffixes, vendor prefixes, re-versioned ids) are not conflicts → 15 org-prefixed duplicate pairs merged keeping the plain slug, hard conflicts persisted as keep_separate; same-publisher organisations (Alibaba/Qwen, Meta/Meta AI) no longer block merges; OpenRouter routers retyped as product[kind=router]; effort variants resolve through any alias/identifier/api_model_id, dated snapshots and the exact-identifier preference, unresolved → identity low; quant/precision token in an official repo → artifact of the same-org plain model (merged when evaluators know it as the model); quantized_from only when it names the same model; official thinking releases and digit-gated tier words (devstral-medium, mistral-medium) stay models

   …

   Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

   Simon-Pierre Boucher committed 12 days ago · 1 file +26 −2
   f48531f
2. canonicalize: re-home benchmark results onto registry variant benchmarks (config.variant/board match, LiveBench category:<Name> → livebench-<slug>, aider well-formed), recompute keys/current rows and evaluated_on; family slugs use <slug>-family on collision and existing families are re-slugged with the old slug kept as alias

   …

   Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

   Simon-Pierre Boucher committed 12 days ago · 1 file +60
   4f09200
3. aia canonicalize: duplicates → variants → artifacts → families → licences → taxonomy → results → events → anomalies (dry-run by default, idempotent --apply); aia anomalies; aia quarantine list|release|discard

   …

   Every step plans from reads and reports counts + examples; --apply executes the plan through merge_entities / upsert_relation / a tier-2
   derived FactWriter. No deletes, snapshots untouched, a second --apply is a no-op. Optional entity scope for targeted runs and tests.
   docs/CANONICALIZATION.md documents every rule, what is never done, counting rules and how to re-run.
   
   Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

   Simon-Pierre Boucher committed 12 days ago · 1 file +286
   2e6e573