SPB Git

spb/llmindex Public

The discriminative, contamination-resistant, fully transparent LLM ranking — updated live.

TypeScript 77.9% TeX 15.2% Python 3.7% SQL 1.4% JavaScript 1.1% Shell 0.5%

History of README.md · clear filter

  1. docs(whitepaper): TikZ figures, landscape comparison table, sharp visual design
    - TikZ-redrawn LLMindex logo on the title page
    - Figures: evaluation pipeline flow, 2PL item characteristic curves +
      item information functions (pgfplots), score-composition diagram with
      the quality/economics wall, illustrative Pareto frontier
    - Comparison table rotated to landscape (fixes right-edge overflow)
    - Colored section titles, running headers, overfull boxes eliminated
    - 19 pages, clean latexmk build
    
    Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
    Simon-Pierre Boucher committed 5 days ago (Aug 5, 2026) · 1 file changed +1 −1
  2. docs: methodology white paper (17-page LaTeX + PDF + BibTeX)
    Full technical white paper: benchmark failure analysis, design principles,
    2PL IRT and Bradley-Terry mathematics, robustness metrics, score structure
    and interpretation guide, governance, limitations, comparison table, roadmap,
    33 academic references. Compiles with latexmk -pdf.
    
    Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
    Simon-Pierre Boucher committed 5 days ago (Aug 5, 2026) · 1 file changed +2 −1
  3. feat: LLM Index platform v0.2.0 — discriminative, contamination-resistant live LLM ranking
    IRT 2PL + Bradley-Terry scoring over 12 domains with dynamically generated
    items: hardened math/reasoning/code/knowledge/multilingual/instruction,
    home-made simulated agentic (+context-load) and terminal benches, SVG logo
    duels (3-judge cross-provider panel), vision OCR. Robust extraction cascade,
    parallel evaluation lanes with live-updating leaderboard, per-model full
    transparency pages, public API v1, detailed methodology with references.
    
    Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
    Simon-Pierre Boucher committed 5 days ago (Aug 5, 2026) · 1 file changed +190