SPB Git forge

spb/polyllm

Public
15commits 1branches 0releases
2.2 MBsize
maindefault branch
13 days agolast push
TypeScript 97.4% SQL 1% JavaScript 0.9% CSS 0.6%
8.8 KB · 203 lines json
Raw Blame History
1[2  {3    "id": "kimi-k3",4    "displayName": "Kimi K3",5    "family": "kimi-k3",6    "contextTokens": 1048576,7    "maxOutputTokens": 1048576,8    "capabilities": {9      "text": true,10      "vision": true,11      "audioInput": false,12      "audioOutput": false,13      "imageGeneration": false,14      "video": true,15      "reasoning": true,16      "tools": true,17      "structuredOutput": true,18      "streaming": true,19      "files": "file-extract-to-system-message",20      "webSearch": "formulas-or-responses-only"21    },22    "parameters": {23      "temperature": false,24      "topP": false,25      "topK": false,26      "maxTokens": true,27      "reasoningEffort": ["low", "high", "max"],28      "thinkingBudget": false,29      "stop": true,30      "seed": "accepted-undocumented",31      "frequencyPenalty": false,32      "presencePenalty": false33    },34    "pricing": {35      "inputPerMillion": 3.0,36      "cachedInputPerMillion": 0.3,37      "outputPerMillion": 15.0,38      "longContextThresholdTokens": null,39      "longContextInputPerMillion": null,40      "longContextCachedInputPerMillion": null,41      "longContextOutputPerMillion": null,42      "imageInputPerMillionTokens": 3.0,43      "webSearchPerCall": 0.005,44      "batchInputPerMillion": null,45      "batchCachedInputPerMillion": null,46      "batchOutputPerMillion": null47    },48    "status": "active",49    "aliases": [],50    "notes": "Flagship (2.8T params, 1M context). Thinking always on per docs (/models: supports_thinking_type 'only'); reasoning_effort low|high|max, default max ('medium' also accepted). UNDOCUMENTED (probed): thinking:{type:'disabled'} and reasoning_effort:'none' return 200 with no reasoning. temperature fixed 1, top_p fixed 0.95, n=1, penalties 0 (any other value -> 400 'invalid temperature: only 1 is allowed for this model'). logprobs -> 400 'only false is allowed'. tool_choice 'required' OK, forcing a specific function -> 400 (thinking). max_completion_tokens default 131072, documented max 1048576 (API accepts 2000000 without error -> clamp client-side). Hidden system prompt ~95 tokens. Builtin $web_search is BROKEN on this model (step 2 -> 400 'tokenization failed'): use official tools (GET /v1/formulas/moonshot/web-search:latest/tools + POST .../fibers, encrypted_output as tool content) or /v1/responses tools:[{type:'web_search'}] (no annotations, URL inline; ~7.9k input tokens per search). Dynamic tool loading (system message with tools) K3-only. Also available on /v1/responses and /anthropic/v1/messages. Batch price not published for K3."51  },52  {53    "id": "kimi-k2.7-code",54    "displayName": "Kimi K2.7 Code",55    "family": "kimi-k2.7-code",56    "contextTokens": 262144,57    "maxOutputTokens": 32768,58    "capabilities": {59      "text": true,60      "vision": true,61      "audioInput": false,62      "audioOutput": false,63      "imageGeneration": false,64      "video": true,65      "reasoning": true,66      "tools": true,67      "structuredOutput": true,68      "streaming": true,69      "files": "file-extract-to-system-message",70      "webSearch": true71    },72    "parameters": {73      "temperature": false,74      "topP": false,75      "topK": false,76      "maxTokens": true,77      "reasoningEffort": false,78      "thinkingBudget": false,79      "stop": true,80      "seed": "accepted-undocumented",81      "frequencyPenalty": false,82      "presencePenalty": false83    },84    "pricing": {85      "inputPerMillion": 0.95,86      "cachedInputPerMillion": 0.19,87      "outputPerMillion": 4.0,88      "longContextThresholdTokens": null,89      "longContextInputPerMillion": null,90      "longContextCachedInputPerMillion": null,91      "longContextOutputPerMillion": null,92      "imageInputPerMillionTokens": 0.95,93      "webSearchPerCall": 0.005,94      "batchInputPerMillion": 0.57,95      "batchCachedInputPerMillion": 0.114,96      "batchOutputPerMillion": 2.497    },98    "status": "active",99    "aliases": [],100    "notes": "Coding model, 256k context. Thinking ALWAYS on: thinking:{type:'disabled'} and reasoning_effort:'none' -> 400 'invalid thinking: only type=enabled is allowed for this model'; only {type:'enabled', keep:'all'} meaningful (Preserved Thinking always on -> replay reasoning_content on assistant messages; omission is tolerated by the API, probed). reasoning_effort low|medium|high|max silently accepted (no documented effect). Fixed temperature 1 / top_p 0.95 / n 1 / penalties 0. logprobs accepted. tool_choice 'required' and forced function -> 400 with thinking. json_object + strict json_schema reliable (docs: most stable model for structured output). Default max output 32768 (docs); API does not validate larger values. $web_search builtin round trip works (probed, ~9.3k prompt tokens for one search)."101  },102  {103    "id": "kimi-k2.7-code-highspeed",104    "displayName": "Kimi K2.7 Code (High-Speed)",105    "family": "kimi-k2.7-code",106    "contextTokens": 262144,107    "maxOutputTokens": 32768,108    "capabilities": {109      "text": true,110      "vision": true,111      "audioInput": false,112      "audioOutput": false,113      "imageGeneration": false,114      "video": true,115      "reasoning": true,116      "tools": true,117      "structuredOutput": true,118      "streaming": true,119      "files": "file-extract-to-system-message",120      "webSearch": null121    },122    "parameters": {123      "temperature": false,124      "topP": false,125      "topK": false,126      "maxTokens": true,127      "reasoningEffort": false,128      "thinkingBudget": false,129      "stop": true,130      "seed": "accepted-undocumented",131      "frequencyPenalty": false,132      "presencePenalty": false133    },134    "pricing": {135      "inputPerMillion": 1.9,136      "cachedInputPerMillion": 0.38,137      "outputPerMillion": 8.0,138      "longContextThresholdTokens": null,139      "longContextInputPerMillion": null,140      "longContextCachedInputPerMillion": null,141      "longContextOutputPerMillion": null,142      "imageInputPerMillionTokens": 1.9,143      "webSearchPerCall": 0.005,144      "batchInputPerMillion": null,145      "batchCachedInputPerMillion": null,146      "batchOutputPerMillion": null147    },148    "status": "active",149    "aliases": [],150    "notes": "Same model/behaviour as kimi-k2.7-code served at ~180 tok/s (up to 260 tok/s short context), exactly 2x the price. Thinking always on (disabled -> 400), fixed sampling params, tool_choice required/function -> 400. logprobs: every attempt returned 429 engine_overloaded_error (8/8) -> treat as unsupported, never send. Fastest probe latency (~1 s for a trivial prompt). $web_search not probed on this variant (works on kimi-k2.7-code). Batch pricing not listed."151  },152  {153    "id": "kimi-k2.6",154    "displayName": "Kimi K2.6",155    "family": "kimi-k2.6",156    "contextTokens": 262144,157    "maxOutputTokens": 32768,158    "capabilities": {159      "text": true,160      "vision": true,161      "audioInput": false,162      "audioOutput": false,163      "imageGeneration": false,164      "video": true,165      "reasoning": "switchable",166      "tools": true,167      "structuredOutput": "unreliable-json-schema-with-thinking",168      "streaming": true,169      "files": "file-extract-to-system-message",170      "webSearch": true171    },172    "parameters": {173      "temperature": false,174      "topP": false,175      "topK": false,176      "maxTokens": true,177      "reasoningEffort": false,178      "thinkingBudget": false,179      "stop": true,180      "seed": "accepted-undocumented",181      "frequencyPenalty": false,182      "presencePenalty": false183    },184    "pricing": {185      "inputPerMillion": 0.95,186      "cachedInputPerMillion": 0.16,187      "outputPerMillion": 4.0,188      "longContextThresholdTokens": null,189      "longContextInputPerMillion": null,190      "longContextCachedInputPerMillion": null,191      "longContextOutputPerMillion": null,192      "imageInputPerMillionTokens": 0.95,193      "webSearchPerCall": 0.005,194      "batchInputPerMillion": 0.57,195      "batchCachedInputPerMillion": 0.1,196      "batchOutputPerMillion": 2.4197    },198    "status": "active",199    "aliases": [],200    "notes": "General model, 256k context, text+image+video. The only model with a documented thinking switch: thinking:{type:'enabled'} (default, temp fixed 1.0) | {type:'disabled'} (temp fixed 0.6) | {type:'enabled', keep:'all'} (Preserved Thinking). reasoning_effort is undocumented here but accepted: low|medium|high|max no visible effect, 'none' disables thinking (probed). Fixed sampling params (400 otherwise). With thinking: tool_choice 'required' and forced function -> 400; with thinking disabled forced function works. json_object reliable; strict json_schema returned prose twice with thinking on and JSON preceded by ~300 blank lines with thinking off -> validate client-side (docs: 'occasionally unstable with complex schemas'). $web_search builtin round trip works (probed, ~7.3k prompt tokens per search) even with thinking on (docs claim incompatibility). Partial mode works (probed, non-thinking). Also answers on /v1/responses although docs list K3 only. Cheapest cache-hit price. Hidden prompt ~17 tokens."201  }202]203