SPB Git forge

spb/ai-atlas

Public
41commits 1branches 0releases
4.6 MBsize
maindefault branch
12 days agolast push
HTML 77.2% TypeScript 10.5% Python 9.6% JavaScript 2.5%
511 B · 9 lines python
Raw Blame History
1"""Local LLM factory gateway — an internal abstraction over interchangeable engines (MacLustr llm-api.io, any OpenAI-compatible2server, llama.cpp, vLLM…). Callers ask for a *task* and a *stage*, never for a specific vendor model.34    result = await gateway.extract(task_type="model_passport", document=text, schema=ModelPassport, stage="medium")5"""6from aiatlas.services.llm.gateway import LLMGateway, LLMResult, LLMUnavailable, gateway78__all__ = ["LLMGateway", "LLMResult", "LLMUnavailable", "gateway"]9