SPB Git forge

spb/polyllm

Public
15commits 1branches 0releases
2.2 MBsize
maindefault branch
13 days agolast push
TypeScript 97.4% SQL 1% JavaScript 0.9% CSS 0.6%
7.1 KB · 141 lines json
Raw Blame History
1[2  {3    "id": "gpt-oss-120b",4    "displayName": "GPT OSS 120B",5    "family": "gpt-oss",6    "contextTokens": 131000,7    "maxOutputTokens": 40000,8    "capabilities": {9      "text": true,10      "vision": false,11      "audioInput": false,12      "audioOutput": false,13      "imageGeneration": false,14      "video": false,15      "reasoning": true,16      "tools": true,17      "structuredOutput": true,18      "streaming": true,19      "files": false,20      "webSearch": false21    },22    "parameters": {23      "temperature": true,24      "topP": true,25      "topK": false,26      "maxTokens": true,27      "reasoningEffort": ["low", "medium", "high"],28      "thinkingBudget": false,29      "stop": true,30      "seed": true,31      "frequencyPenalty": true,32      "presencePenalty": true33    },34    "pricing": {35      "inputPerMillion": 0.35,36      "cachedInputPerMillion": 0.35,37      "outputPerMillion": 0.75,38      "longContextThresholdTokens": null,39      "longContextInputPerMillion": null,40      "longContextCachedInputPerMillion": null,41      "longContextOutputPerMillion": null,42      "imageInputPerMillionTokens": null43    },44    "status": "active",45    "aliases": [],46    "notes": "OpenAI open-weight 120B MoE served at ~2600-3000 tok/s (probed 2631). Always-reasoning: reasoning_effort default medium, accepts low|medium|high; 'none' and deprecated disable_reasoning -> 400 'Unsupported reasoning effort: none'. Reasoning returned as message.reasoning / delta.reasoning (plain text); reasoning_format parsed|raw|hidden all accepted (raw glues reasoning onto content without delimiter). Reasoning tokens are INSIDE completion_tokens and consume max_completion_tokens -> keep >= 1000 or content may be missing with finish_reason 'length'. tools + response_format together -> 400 '\"tools\" is incompatible with \"response_format\"'. min_tokens -> 400. Streams tool-call arguments as real deltas (name first, then argument fragments). Only 'text' content parts (image_url -> 400). developer role accepted. Context: 65k free / 131k paid (probed limit 131000 = prompt + max_completion_tokens). Max output 32k free / 40k paid (docs; not enforced with a 400). Prompt caching automatic, no price discount. Developer-tier limits observed: 1000 RPM / 500K TPM (docs: 1M uncached / 3M total TPM). Cheapest and fastest Cerebras model -> good default."47  },48  {49    "id": "qwen-3.8-27b",50    "displayName": "Qwen 3.8 27B",51    "family": "qwen-3.8",52    "contextTokens": 131072,53    "maxOutputTokens": 40960,54    "capabilities": {55      "text": true,56      "vision": true,57      "audioInput": false,58      "audioOutput": false,59      "imageGeneration": false,60      "video": false,61      "reasoning": true,62      "tools": true,63      "structuredOutput": true,64      "streaming": true,65      "files": false,66      "webSearch": false67    },68    "parameters": {69      "temperature": true,70      "topP": true,71      "topK": false,72      "maxTokens": true,73      "reasoningEffort": ["none", "low", "medium", "high"],74      "thinkingBudget": false,75      "stop": true,76      "seed": true,77      "frequencyPenalty": true,78      "presencePenalty": true79    },80    "pricing": {81      "inputPerMillion": 0.99,82      "cachedInputPerMillion": 0.99,83      "outputPerMillion": 1.49,84      "longContextThresholdTokens": null,85      "longContextInputPerMillion": null,86      "longContextCachedInputPerMillion": null,87      "longContextOutputPerMillion": null,88      "imageInputPerMillionTokens": 0.9989    },90    "status": "active",91    "aliases": [],92    "notes": "Added 2026-09-03; dense 27B multimodal model, ~1400-1500 tok/s (probed 1393). Reasoning ON by default at 'high'; reasoning_effort none|low|medium|high (none = no reasoning field, fastest); 'minimal' -> 400. reasoning_format parsed (default) or raw (content becomes 'reasoning\\n</think>\\n\\nanswer' - closing tag only); 'hidden' -> 400. Content after reasoning starts with '\\n\\n' -> trim. clear_thinking (qwen only) drops historical reasoning from the prompt. Reasoning tokens inside completion_tokens and count toward max_completion_tokens. Vision: base64 PNG/JPEG data URIs only (remote https URL -> 400 invalid_multimodal_input), user messages only, 2 images/request on Free Trial, 10 on Developer/Enterprise, 10 MiB payload, 32x32 px per image token (max 2304), image tokens billed at the input rate and reported in prompt_tokens_details.image_tokens; image_url.detail ignored. 'developer' role -> 400 'Unexpected message role' (use system). tools + response_format accepted. Tool calls arrive complete in a single stream chunk. Strict tool schemas may not use pattern/minLength/maxLength (docs). Context 64k free / 128k paid (probed limit 131072); max output 32768 free / 40960 paid (docs). Developer limits observed 450 RPM / 150K uncached TPM (docs 300 RPM) -> a single ~93k-token request exhausts the minute bucket (429 token_quota_exceeded, retry-after 60)."93  },94  {95    "id": "gemma-4-31b",96    "displayName": "Gemma 4 31B",97    "family": "gemma-4",98    "contextTokens": 131072,99    "maxOutputTokens": null,100    "capabilities": {101      "text": true,102      "vision": true,103      "audioInput": false,104      "audioOutput": false,105      "imageGeneration": false,106      "video": false,107      "reasoning": true,108      "tools": true,109      "structuredOutput": true,110      "streaming": true,111      "files": false,112      "webSearch": false113    },114    "parameters": {115      "temperature": true,116      "topP": true,117      "topK": false,118      "maxTokens": true,119      "reasoningEffort": ["none", "low", "medium", "high"],120      "thinkingBudget": false,121      "stop": true,122      "seed": true,123      "frequencyPenalty": true,124      "presencePenalty": true125    },126    "pricing": {127      "inputPerMillion": null,128      "cachedInputPerMillion": null,129      "outputPerMillion": null,130      "longContextThresholdTokens": null,131      "longContextInputPerMillion": null,132      "longContextCachedInputPerMillion": null,133      "longContextOutputPerMillion": null,134      "imageInputPerMillionTokens": null135    },136    "status": "deprecated",137    "aliases": [],138    "notes": "Officially REMOVED from Cerebras public endpoints on 2026-09-03 (changelog + deprecation page; replacement qwen-3.8-27b; still offered on Dedicated Endpoints). Nevertheless still listed by GET /v1/models for this Developer key and fully working in every probe (~1216 tok/s) -> treat as grandfathered/legacy: show only if present in /v1/models, badge it, never default to it. Pricing unknown (model page 404, not on pricing page). Reasoning OFF by default (no reasoning field); reasoning_effort low|medium|high enable it (docs: all three equivalent; probed 34-40 reasoning tokens regardless), streamed as delta.reasoning; reasoning_format raw/hidden -> 400 'Gemma-4 does not support ... reasoning format'; clear_thinking -> 400. Vision: base64 data URIs only, 48x48 px per token (max 280; a 32x32 PNG cost 256 image tokens), 2 images free / 10 paid. Tool calls arrive complete in one stream chunk; tools + response_format accepted. developer role accepted. seed is deterministic (identical output + system_fingerprint). Probed context limit 131072 (prompt + max_completion_tokens). Developer limits observed 500 RPM / 250K TPM."139  }140]141