spb/llm-api

Thu, Sep 10, 2026 1

1. LLM API v0.1.0 — private OpenAI-compatible local model server for Apple Silicon

   …

   FastAPI gateway + SQLite registry, MLX-LM / mlx-vlm and llama.cpp workers, load-on-demand
   with memory policy and eviction, OpenAI endpoints (chat/completions/embeddings/rerank, streaming),
   management API, Model Harvester, benchmarks, API keys, Next.js 16 console, tests and docs.
   
   Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

   Simon-Pierre Boucher committed 13 days ago · 1 file +71
   a48486c