SPB Git

spb/ai-atlas

Public
511 B · 9 lines python
1"""Local LLM factory gateway — an internal abstraction over interchangeable engines (MacLustr llm-api.io, any OpenAI-compatible2server, llama.cpp, vLLM…). Callers ask for a *task* and a *stage*, never for a specific vendor model.34    result = await gateway.extract(task_type="model_passport", document=text, schema=ModelPassport, stage="medium")5"""6from aiatlas.services.llm.gateway import LLMGateway, LLMResult, LLMUnavailable, gateway78__all__ = ["LLMGateway", "LLMResult", "LLMUnavailable", "gateway"]9
Files · 2ae7efcdca5e4f972e75fcdfe69b418fc9d47bec
Menu

Theme