docs: update verification report
Showing 1 changed file with +167 and −165
modified
docs/VERIFICATION.md
+167 −165
@@ -5,211 +5,213 @@ | ||
| 5 | 5 | Mail: contact@spboucher.ai |
| 6 | 6 | --> |
| 7 | 7 | |
| 8 | −# API Verification Results — 2026-07-30T12:54:13Z | |
| 8 | +# API Verification Results — 2026-07-30T19:12:18Z | |
| 9 | 9 | |
| 10 | 10 | **202 tests · 202 passed · 0 failed** |
| 11 | 11 | |
| 12 | +Note: 3 tests (DeepInfra `deepseek-ai/DeepSeek-R1-0528` chat; Kimi `kimi-k3` stream & vision) hit transient 429s during the parallel sweep (Moonshot `engine_overloaded_error`, DeepInfra burst limit) and were re-verified green the same day via the same production clients (`--verify --provider deepinfra` 37/37, `--verify --provider kimi --quick` 4/4). | |
| 13 | + | |
| 12 | 14 | | Provider | Model | Test | Result | Latency | Detail | |
| 13 | 15 | |---|---|---|---|---|---| |
| 14 | −| Anthropic | `—` | models | ✅ | 0.2s | 11 live | | |
| 15 | −| Anthropic | `claude-fable-5` | chat | ✅ | 2.9s | | | |
| 16 | −| Anthropic | `claude-haiku-4-5-20251001` | chat | ✅ | 0.6s | | | |
| 17 | −| Anthropic | `claude-opus-4-1-20250805` | chat | ✅ | 1.9s | | | |
| 18 | −| Anthropic | `claude-opus-4-5-20251101` | chat | ✅ | 1.4s | | | |
| 19 | −| Anthropic | `claude-opus-4-6` | chat | ✅ | 12.9s | | | |
| 20 | −| Anthropic | `claude-opus-4-7` | chat | ✅ | 2.8s | | | |
| 21 | −| Anthropic | `claude-opus-4-8` | chat | ✅ | 1.1s | | | |
| 22 | −| Anthropic | `claude-opus-5` | chat | ✅ | 2.2s | | | |
| 16 | +| Anthropic | `—` | models | ✅ | 0.3s | 11 live | | |
| 17 | +| Anthropic | `claude-fable-5` | chat | ✅ | 2.6s | | | |
| 18 | +| Anthropic | `claude-haiku-4-5-20251001` | chat | ✅ | 0.9s | | | |
| 19 | +| Anthropic | `claude-opus-4-1-20250805` | chat | ✅ | 1.8s | | | |
| 20 | +| Anthropic | `claude-opus-4-5-20251101` | chat | ✅ | 1.5s | | | |
| 21 | +| Anthropic | `claude-opus-4-6` | chat | ✅ | 2.9s | | | |
| 22 | +| Anthropic | `claude-opus-4-7` | chat | ✅ | 1.9s | | | |
| 23 | +| Anthropic | `claude-opus-4-8` | chat | ✅ | 1.0s | | | |
| 24 | +| Anthropic | `claude-opus-5` | chat | ✅ | 2.4s | | | |
| 23 | 25 | | Anthropic | `claude-opus-5` | stream | ✅ | 2.2s | deltas=2 usage=true | |
| 24 | −| Anthropic | `claude-opus-5` | vision | ✅ | 2.6s | Red | | |
| 25 | −| Anthropic | `claude-sonnet-4-5-20250929` | chat | ✅ | 1.7s | | | |
| 26 | −| Anthropic | `claude-sonnet-4-6` | chat | ✅ | 1.1s | | | |
| 26 | +| Anthropic | `claude-opus-5` | vision | ✅ | 2.4s | Red | | |
| 27 | +| Anthropic | `claude-sonnet-4-5-20250929` | chat | ✅ | 2.1s | | | |
| 28 | +| Anthropic | `claude-sonnet-4-6` | chat | ✅ | 0.9s | | | |
| 27 | 29 | | Anthropic | `claude-sonnet-5` | chat | ✅ | 1.4s | | |
| 28 | 30 | | Cerebras | `—` | models | ✅ | 0.1s | 3 live | |
| 29 | −| Cerebras | `gemma-4-31b` | chat | ✅ | 0.3s | | | |
| 30 | −| Cerebras | `gemma-4-31b` | vision | ✅ | 0.1s | Red | | |
| 31 | +| Cerebras | `gemma-4-31b` | chat | ✅ | 0.2s | | | |
| 32 | +| Cerebras | `gemma-4-31b` | vision | ✅ | 0.2s | Red | | |
| 31 | 33 | | Cerebras | `gpt-oss-120b` | chat | ✅ | 0.1s | | |
| 32 | −| Cerebras | `gpt-oss-120b` | stream | ✅ | 0.3s | deltas=1 usage=true | | |
| 33 | −| Cerebras | `zai-glm-4.7` | chat | ✅ | 0.1s | | | |
| 34 | −| DeepInfra | `—` | models | ✅ | 0.4s | 174 live | | |
| 35 | −| DeepInfra | `MiniMaxAI/MiniMax-M3` | chat | ✅ | 2.1s | | | |
| 36 | −| DeepInfra | `Qwen/Qwen3-235B-A22B-Instruct-2507` | chat | ✅ | 0.2s | | | |
| 37 | −| DeepInfra | `Qwen/Qwen3-235B-A22B-Thinking-2507` | chat | ✅ | 1.0s | | | |
| 34 | +| Cerebras | `gpt-oss-120b` | stream | ✅ | 0.1s | deltas=1 usage=true | | |
| 35 | +| Cerebras | `zai-glm-4.7` | chat | ✅ | 0.3s | | | |
| 36 | +| DeepInfra | `—` | models | ✅ | 0.9s | 174 live | | |
| 37 | +| DeepInfra | `MiniMaxAI/MiniMax-M3` | chat | ✅ | 0.6s | | | |
| 38 | +| DeepInfra | `Qwen/Qwen3-235B-A22B-Instruct-2507` | chat | ✅ | 0.3s | | | |
| 39 | +| DeepInfra | `Qwen/Qwen3-235B-A22B-Thinking-2507` | chat | ✅ | 1.6s | | | |
| 38 | 40 | | DeepInfra | `Qwen/Qwen3-Coder-480B-A35B-Instruct-Turbo` | chat | ✅ | 0.3s | | |
| 39 | −| DeepInfra | `Qwen/Qwen3-VL-235B-A22B-Instruct` | chat | ✅ | 0.3s | | | |
| 40 | −| DeepInfra | `Qwen/Qwen3.5-397B-A17B` | chat | ✅ | 3.0s | | | |
| 41 | −| DeepInfra | `Qwen/Qwen3.7-Max` | chat | ✅ | 4.0s | | | |
| 42 | −| DeepInfra | `anthropic/claude-fable-5` | chat | ✅ | 1.9s | | | |
| 43 | −| DeepInfra | `anthropic/claude-fable-5` | stream | ✅ | 1.6s | deltas=4 usage=true | | |
| 44 | −| DeepInfra | `anthropic/claude-fable-5` | vision | ✅ | 1.7s | Red | | |
| 41 | +| DeepInfra | `Qwen/Qwen3-VL-235B-A22B-Instruct` | chat | ✅ | 2.9s | | | |
| 42 | +| DeepInfra | `Qwen/Qwen3.5-397B-A17B` | chat | ✅ | 4.0s | | | |
| 43 | +| DeepInfra | `Qwen/Qwen3.7-Max` | chat | ✅ | 3.8s | | | |
| 44 | +| DeepInfra | `anthropic/claude-fable-5` | chat | ✅ | 2.3s | | | |
| 45 | +| DeepInfra | `anthropic/claude-fable-5` | stream | ✅ | 1.8s | deltas=4 usage=true | | |
| 46 | +| DeepInfra | `anthropic/claude-fable-5` | vision | ✅ | 1.8s | Red | | |
| 45 | 47 | | DeepInfra | `anthropic/claude-haiku-4-5` | chat | ✅ | 0.9s | | |
| 46 | −| DeepInfra | `anthropic/claude-opus-4-8` | chat | ✅ | 1.6s | | | |
| 47 | −| DeepInfra | `anthropic/claude-opus-5` | chat | ✅ | 1.5s | | | |
| 48 | −| DeepInfra | `anthropic/claude-sonnet-5` | chat | ✅ | 1.6s | | | |
| 49 | −| DeepInfra | `deepseek-ai/DeepSeek-R1-0528` | chat | ✅ | 1.9s | | | |
| 48 | +| DeepInfra | `anthropic/claude-opus-4-8` | chat | ✅ | 2.1s | | | |
| 49 | +| DeepInfra | `anthropic/claude-opus-5` | chat | ✅ | 1.4s | | | |
| 50 | +| DeepInfra | `anthropic/claude-sonnet-5` | chat | ✅ | 1.5s | | | |
| 51 | +| DeepInfra | `deepseek-ai/DeepSeek-R1-0528` | chat | ✅ | 1.8s | | | |
| 50 | 52 | | DeepInfra | `deepseek-ai/DeepSeek-V3.1` | chat | ✅ | 0.4s | | |
| 51 | −| DeepInfra | `deepseek-ai/DeepSeek-V4-Flash` | chat | ✅ | 0.7s | | | |
| 52 | −| DeepInfra | `deepseek-ai/DeepSeek-V4-Pro` | chat | ✅ | 0.5s | | | |
| 53 | −| DeepInfra | `google/gemini-2.5-flash` | chat | ✅ | 1.3s | | | |
| 54 | −| DeepInfra | `google/gemini-2.5-pro` | chat | ✅ | 5.8s | | | |
| 55 | −| DeepInfra | `google/gemini-3.1-flash-lite` | chat | ✅ | 4.1s | | | |
| 56 | −| DeepInfra | `google/gemini-3.1-pro` | chat | ✅ | 4.3s | | | |
| 57 | −| DeepInfra | `google/gemini-3.5-flash` | chat | ✅ | 2.6s | | | |
| 58 | −| DeepInfra | `meta-llama/Llama-3.3-70B-Instruct-Turbo` | chat | ✅ | 0.4s | | | |
| 53 | +| DeepInfra | `deepseek-ai/DeepSeek-V4-Flash` | chat | ✅ | 0.3s | | | |
| 54 | +| DeepInfra | `deepseek-ai/DeepSeek-V4-Pro` | chat | ✅ | 0.4s | | | |
| 55 | +| DeepInfra | `google/gemini-2.5-flash` | chat | ✅ | 1.2s | | | |
| 56 | +| DeepInfra | `google/gemini-2.5-pro` | chat | ✅ | 7.5s | | | |
| 57 | +| DeepInfra | `google/gemini-3.1-flash-lite` | chat | ✅ | 3.0s | | | |
| 58 | +| DeepInfra | `google/gemini-3.1-pro` | chat | ✅ | 4.1s | | | |
| 59 | +| DeepInfra | `google/gemini-3.5-flash` | chat | ✅ | 2.3s | | | |
| 60 | +| DeepInfra | `meta-llama/Llama-3.3-70B-Instruct-Turbo` | chat | ✅ | 0.2s | | | |
| 59 | 61 | | DeepInfra | `meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8` | chat | ✅ | 0.2s | | |
| 60 | −| DeepInfra | `meta-llama/Llama-4-Scout-17B-16E-Instruct` | chat | ✅ | 0.2s | | | |
| 62 | +| DeepInfra | `meta-llama/Llama-4-Scout-17B-16E-Instruct` | chat | ✅ | 0.3s | | | |
| 61 | 63 | | DeepInfra | `meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo` | chat | ✅ | 0.4s | | |
| 62 | −| DeepInfra | `mistralai/Mistral-Small-3.2-24B-Instruct-2506` | chat | ✅ | 0.4s | | | |
| 63 | −| DeepInfra | `moonshotai/Kimi-K2.5` | chat | ✅ | 1.2s | | | |
| 64 | −| DeepInfra | `moonshotai/Kimi-K2.6` | chat | ✅ | 3.2s | | | |
| 65 | −| DeepInfra | `moonshotai/Kimi-K2.7-Code` | chat | ✅ | 1.4s | | | |
| 66 | −| DeepInfra | `nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B` | chat | ✅ | 3.6s | | | |
| 67 | −| DeepInfra | `openai/gpt-oss-120b` | chat | ✅ | 0.9s | | | |
| 68 | −| DeepInfra | `openai/gpt-oss-20b` | chat | ✅ | 0.6s | | | |
| 69 | −| DeepInfra | `zai-org/GLM-4.7` | chat | ✅ | 0.6s | | | |
| 70 | −| DeepInfra | `zai-org/GLM-5.2` | chat | ✅ | 3.2s | | | |
| 64 | +| DeepInfra | `mistralai/Mistral-Small-3.2-24B-Instruct-2506` | chat | ✅ | 25.4s | | | |
| 65 | +| DeepInfra | `moonshotai/Kimi-K2.5` | chat | ✅ | 0.9s | | | |
| 66 | +| DeepInfra | `moonshotai/Kimi-K2.6` | chat | ✅ | 37.4s | | | |
| 67 | +| DeepInfra | `moonshotai/Kimi-K2.7-Code` | chat | ✅ | 0.7s | | | |
| 68 | +| DeepInfra | `nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B` | chat | ✅ | 1.0s | | | |
| 69 | +| DeepInfra | `openai/gpt-oss-120b` | chat | ✅ | 1.0s | | | |
| 70 | +| DeepInfra | `openai/gpt-oss-20b` | chat | ✅ | 1.0s | | | |
| 71 | +| DeepInfra | `zai-org/GLM-4.7` | chat | ✅ | 3.0s | | | |
| 72 | +| DeepInfra | `zai-org/GLM-5.2` | chat | ✅ | 2.5s | | | |
| 71 | 73 | | DeepSeek | `—` | models | ✅ | 0.4s | 2 live | |
| 72 | −| DeepSeek | `deepseek-v4-flash` | chat | ✅ | 1.1s | | | |
| 73 | −| DeepSeek | `deepseek-v4-flash` | stream | ✅ | 0.9s | deltas=9 usage=true | | |
| 74 | −| DeepSeek | `deepseek-v4-pro` | chat | ✅ | 1.5s | | | |
| 75 | −| Google Gemini | `—` | models | ✅ | 0.2s | 57 live | | |
| 76 | −| Google Gemini | `gemini-2.5-flash` | chat | ✅ | 0.6s | | | |
| 77 | −| Google Gemini | `gemini-2.5-flash-lite` | chat | ✅ | 0.5s | | | |
| 78 | −| Google Gemini | `gemini-2.5-pro` | chat | ✅ | 2.3s | | | |
| 79 | −| Google Gemini | `gemini-3-flash-preview` | chat | ✅ | 1.0s | | | |
| 80 | −| Google Gemini | `gemini-3.1-flash-lite` | chat | ✅ | 1.1s | | | |
| 81 | −| Google Gemini | `gemini-3.1-pro-preview` | chat | ✅ | 2.8s | | | |
| 82 | −| Google Gemini | `gemini-3.5-flash` | chat | ✅ | 1.3s | | | |
| 83 | −| Google Gemini | `gemini-3.5-flash-lite` | chat | ✅ | 0.6s | | | |
| 74 | +| DeepSeek | `deepseek-v4-flash` | chat | ✅ | 1.2s | | | |
| 75 | +| DeepSeek | `deepseek-v4-flash` | stream | ✅ | 1.3s | deltas=9 usage=true | | |
| 76 | +| DeepSeek | `deepseek-v4-pro` | chat | ✅ | 1.2s | | | |
| 77 | +| Google Gemini | `—` | models | ✅ | 0.2s | 59 live | | |
| 78 | +| Google Gemini | `gemini-2.5-flash` | chat | ✅ | 0.5s | | | |
| 79 | +| Google Gemini | `gemini-2.5-flash-lite` | chat | ✅ | 0.4s | | | |
| 80 | +| Google Gemini | `gemini-2.5-pro` | chat | ✅ | 2.8s | | | |
| 81 | +| Google Gemini | `gemini-3-flash-preview` | chat | ✅ | 1.1s | | | |
| 82 | +| Google Gemini | `gemini-3.1-flash-lite` | chat | ✅ | 0.8s | | | |
| 83 | +| Google Gemini | `gemini-3.1-pro-preview` | chat | ✅ | 2.1s | | | |
| 84 | +| Google Gemini | `gemini-3.5-flash` | chat | ✅ | 0.9s | | | |
| 85 | +| Google Gemini | `gemini-3.5-flash-lite` | chat | ✅ | 0.8s | | | |
| 84 | 86 | | Google Gemini | `gemini-3.6-flash` | chat | ✅ | 1.1s | | |
| 85 | −| Google Gemini | `gemini-3.6-flash` | stream | ✅ | 1.3s | deltas=1 usage=true | | |
| 86 | −| Google Gemini | `gemini-3.6-flash` | vision | ✅ | 1.1s | Red | | |
| 87 | −| Google Gemini | `gemini-flash-latest` | chat | ✅ | 1.1s | | | |
| 88 | −| Google Gemini | `gemini-flash-lite-latest` | chat | ✅ | 0.7s | | | |
| 89 | −| Google Gemini | `gemini-pro-latest` | chat | ✅ | 2.3s | | | |
| 90 | −| Google Gemini | `gemma-4-26b-a4b-it` | chat | ✅ | 1.6s | | | |
| 87 | +| Google Gemini | `gemini-3.6-flash` | stream | ✅ | 1.1s | deltas=1 usage=true | | |
| 88 | +| Google Gemini | `gemini-3.6-flash` | vision | ✅ | 1.3s | Red | | |
| 89 | +| Google Gemini | `gemini-flash-latest` | chat | ✅ | 1.0s | | | |
| 90 | +| Google Gemini | `gemini-flash-lite-latest` | chat | ✅ | 0.5s | | | |
| 91 | +| Google Gemini | `gemini-pro-latest` | chat | ✅ | 2.5s | | | |
| 92 | +| Google Gemini | `gemma-4-26b-a4b-it` | chat | ✅ | 1.8s | | | |
| 91 | 93 | | Google Gemini | `gemma-4-31b-it` | chat | ✅ | 2.0s | | |
| 92 | −| Kimi | `—` | models | ✅ | 0.4s | 12 live | | |
| 93 | −| Kimi | `kimi-k2.5` | chat | ✅ | 6.4s | | | |
| 94 | −| Kimi | `kimi-k2.6` | chat | ✅ | 4.7s | | | |
| 95 | −| Kimi | `kimi-k2.7-code` | chat | ✅ | 1.5s | | | |
| 96 | −| Kimi | `kimi-k2.7-code-highspeed` | chat | ✅ | 0.9s | | | |
| 97 | −| Kimi | `kimi-k3` | chat | ✅ | 2.7s | | | |
| 98 | −| Kimi | `kimi-k3` | stream | ✅ | 4.1s | deltas=9 usage=true | | |
| 99 | −| Kimi | `kimi-k3` | vision | ✅ | 5.0s | Red | | |
| 100 | −| Kimi | `moonshot-v1-128k` | chat | ✅ | 0.5s | | | |
| 94 | +| Kimi | `—` | models | ✅ | 0.3s | 12 live | | |
| 95 | +| Kimi | `kimi-k2.5` | chat | ✅ | 3.7s | | | |
| 96 | +| Kimi | `kimi-k2.6` | chat | ✅ | 2.4s | | | |
| 97 | +| Kimi | `kimi-k2.7-code` | chat | ✅ | 1.0s | | | |
| 98 | +| Kimi | `kimi-k2.7-code-highspeed` | chat | ✅ | 1.1s | | | |
| 99 | +| Kimi | `kimi-k3` | chat | ✅ | 17.4s | | | |
| 100 | +| Kimi | `kimi-k3` | stream | ✅ | 3.8s | deltas=9 usage=true | | |
| 101 | +| Kimi | `kimi-k3` | vision | ✅ | 3.5s | Red | | |
| 102 | +| Kimi | `moonshot-v1-128k` | chat | ✅ | 0.7s | | | |
| 101 | 103 | | Kimi | `moonshot-v1-128k-vision-preview` | chat | ✅ | 0.5s | | |
| 102 | 104 | | Kimi | `moonshot-v1-32k` | chat | ✅ | 0.7s | | |
| 103 | −| Kimi | `moonshot-v1-32k-vision-preview` | chat | ✅ | 0.5s | | | |
| 104 | −| Kimi | `moonshot-v1-8k` | chat | ✅ | 0.7s | | | |
| 105 | +| Kimi | `moonshot-v1-32k-vision-preview` | chat | ✅ | 1.0s | | | |
| 106 | +| Kimi | `moonshot-v1-8k` | chat | ✅ | 0.8s | | | |
| 105 | 107 | | Kimi | `moonshot-v1-8k-vision-preview` | chat | ✅ | 0.5s | | |
| 106 | −| Kimi | `moonshot-v1-auto` | chat | ✅ | 0.7s | | | |
| 107 | −| Mistral | `—` | models | ✅ | 0.5s | 60 live | | |
| 108 | −| Mistral | `codestral-latest` | chat | ✅ | 0.4s | | | |
| 108 | +| Kimi | `moonshot-v1-auto` | chat | ✅ | 0.8s | | | |
| 109 | +| Mistral | `—` | models | ✅ | 0.3s | 60 live | | |
| 110 | +| Mistral | `codestral-latest` | chat | ✅ | 0.5s | | | |
| 109 | 111 | | Mistral | `devstral-latest` | chat | ✅ | 0.3s | | |
| 110 | −| Mistral | `magistral-medium-latest` | chat | ✅ | 0.8s | | | |
| 111 | −| Mistral | `ministral-14b-latest` | chat | ✅ | 0.3s | | | |
| 112 | +| Mistral | `magistral-medium-latest` | chat | ✅ | 1.0s | | | |
| 113 | +| Mistral | `ministral-14b-latest` | chat | ✅ | 0.2s | | | |
| 112 | 114 | | Mistral | `ministral-3b-latest` | chat | ✅ | 0.3s | | |
| 113 | −| Mistral | `ministral-8b-latest` | chat | ✅ | 0.3s | | | |
| 114 | −| Mistral | `mistral-large-latest` | chat | ✅ | 0.4s | | | |
| 115 | −| Mistral | `mistral-medium-latest` | chat | ✅ | 0.4s | | | |
| 116 | −| Mistral | `mistral-medium-latest` | stream | ✅ | 0.6s | deltas=9 usage=true | | |
| 117 | −| Mistral | `mistral-medium-latest` | vision | ✅ | 0.3s | Red | | |
| 118 | −| Mistral | `mistral-small-latest` | chat | ✅ | 0.5s | | | |
| 115 | +| Mistral | `ministral-8b-latest` | chat | ✅ | 0.2s | | | |
| 116 | +| Mistral | `mistral-large-latest` | chat | ✅ | 0.5s | | | |
| 117 | +| Mistral | `mistral-medium-latest` | chat | ✅ | 0.5s | | | |
| 118 | +| Mistral | `mistral-medium-latest` | stream | ✅ | 0.5s | deltas=9 usage=true | | |
| 119 | +| Mistral | `mistral-medium-latest` | vision | ✅ | 0.6s | The image is a solid red color. There ar | | |
| 120 | +| Mistral | `mistral-small-latest` | chat | ✅ | 0.7s | | | |
| 119 | 121 | | Mistral | `open-mistral-nemo` | chat | ✅ | 0.3s | | |
| 120 | −| OpenAI | `—` | models | ✅ | 0.7s | 132 live | | |
| 122 | +| OpenAI | `—` | models | ✅ | 0.5s | 131 live | | |
| 121 | 123 | | OpenAI | `chat-latest` | chat | ✅ | 0.9s | | |
| 122 | −| OpenAI | `gpt-3.5-turbo` | chat | ✅ | 1.1s | | | |
| 123 | −| OpenAI | `gpt-4` | chat | ✅ | 1.3s | | | |
| 124 | −| OpenAI | `gpt-4-turbo` | chat | ✅ | 1.8s | | | |
| 125 | −| OpenAI | `gpt-4.1` | chat | ✅ | 0.8s | | | |
| 126 | −| OpenAI | `gpt-4.1-mini` | chat | ✅ | 0.4s | | | |
| 127 | −| OpenAI | `gpt-4.1-nano` | chat | ✅ | 0.5s | | | |
| 128 | −| OpenAI | `gpt-4o` | chat | ✅ | 0.6s | | | |
| 124 | +| OpenAI | `gpt-3.5-turbo` | chat | ✅ | 1.2s | | | |
| 125 | +| OpenAI | `gpt-4` | chat | ✅ | 1.2s | | | |
| 126 | +| OpenAI | `gpt-4-turbo` | chat | ✅ | 2.1s | | | |
| 127 | +| OpenAI | `gpt-4.1` | chat | ✅ | 0.6s | | | |
| 128 | +| OpenAI | `gpt-4.1-mini` | chat | ✅ | 0.6s | | | |
| 129 | +| OpenAI | `gpt-4.1-nano` | chat | ✅ | 0.4s | | | |
| 130 | +| OpenAI | `gpt-4o` | chat | ✅ | 0.5s | | | |
| 129 | 131 | | OpenAI | `gpt-4o-mini` | chat | ✅ | 0.5s | | |
| 130 | −| OpenAI | `gpt-5` | chat | ✅ | 1.1s | | | |
| 131 | −| OpenAI | `gpt-5-mini` | chat | ✅ | 1.4s | | | |
| 132 | −| OpenAI | `gpt-5-nano` | chat | ✅ | 1.4s | | | |
| 133 | −| OpenAI | `gpt-5.1` | chat | ✅ | 0.7s | | | |
| 134 | −| OpenAI | `gpt-5.2` | chat | ✅ | 0.9s | | | |
| 132 | +| OpenAI | `gpt-5` | chat | ✅ | 2.0s | | | |
| 133 | +| OpenAI | `gpt-5-mini` | chat | ✅ | 1.6s | | | |
| 134 | +| OpenAI | `gpt-5-nano` | chat | ✅ | 0.7s | | | |
| 135 | +| OpenAI | `gpt-5.1` | chat | ✅ | 0.8s | | | |
| 136 | +| OpenAI | `gpt-5.2` | chat | ✅ | 1.0s | | | |
| 135 | 137 | | OpenAI | `gpt-5.2-chat-latest` | chat | ✅ | 1.0s | | |
| 136 | −| OpenAI | `gpt-5.3-chat-latest` | chat | ✅ | 1.2s | | | |
| 137 | −| OpenAI | `gpt-5.4` | chat | ✅ | 0.7s | | | |
| 138 | +| OpenAI | `gpt-5.3-chat-latest` | chat | ✅ | 1.0s | | | |
| 139 | +| OpenAI | `gpt-5.4` | chat | ✅ | 0.8s | | | |
| 138 | 140 | | OpenAI | `gpt-5.4-mini` | chat | ✅ | 0.5s | | |
| 139 | −| OpenAI | `gpt-5.4-nano` | chat | ✅ | 0.6s | | | |
| 140 | −| OpenAI | `gpt-5.5` | chat | ✅ | 1.3s | | | |
| 141 | −| OpenAI | `gpt-5.6-luna` | chat | ✅ | 0.8s | | | |
| 142 | −| OpenAI | `gpt-5.6-sol` | chat | ✅ | 1.2s | | | |
| 143 | −| OpenAI | `gpt-5.6-sol` | stream | ✅ | 1.0s | deltas=9 usage=true | | |
| 144 | −| OpenAI | `gpt-5.6-sol` | vision | ✅ | 1.2s | Red | | |
| 145 | −| OpenAI | `gpt-5.6-terra` | chat | ✅ | 0.8s | | | |
| 146 | −| OpenAI | `o1` | chat | ✅ | 1.1s | | | |
| 141 | +| OpenAI | `gpt-5.4-nano` | chat | ✅ | 2.7s | | | |
| 142 | +| OpenAI | `gpt-5.5` | chat | ✅ | 1.1s | | | |
| 143 | +| OpenAI | `gpt-5.6-luna` | chat | ✅ | 0.5s | | | |
| 144 | +| OpenAI | `gpt-5.6-sol` | chat | ✅ | 1.1s | | | |
| 145 | +| OpenAI | `gpt-5.6-sol` | stream | ✅ | 0.9s | deltas=9 usage=true | | |
| 146 | +| OpenAI | `gpt-5.6-sol` | vision | ✅ | 1.1s | Red | | |
| 147 | +| OpenAI | `gpt-5.6-terra` | chat | ✅ | 1.0s | | | |
| 148 | +| OpenAI | `o1` | chat | ✅ | 3.0s | | | |
| 147 | 149 | | OpenAI | `o3` | chat | ✅ | 0.8s | | |
| 148 | −| OpenAI | `o3-mini` | chat | ✅ | 1.6s | | | |
| 149 | −| OpenAI | `o4-mini` | chat | ✅ | 0.8s | | | |
| 150 | −| Perplexity | `sonar` | chat | ✅ | 1.4s | | | |
| 151 | −| Perplexity | `sonar` | stream | ✅ | 2.2s | deltas=9 usage=true | | |
| 150 | +| OpenAI | `o3-mini` | chat | ✅ | 1.4s | | | |
| 151 | +| OpenAI | `o4-mini` | chat | ✅ | 1.1s | | | |
| 152 | +| Perplexity | `sonar` | chat | ✅ | 1.7s | | | |
| 153 | +| Perplexity | `sonar` | stream | ✅ | 1.8s | deltas=9 usage=true | | |
| 152 | 154 | | Perplexity | `sonar-deep-research` | chat | ✅ | — | SKIPPED: multi-minute agentic research runs; verified via docs only | |
| 153 | −| Perplexity | `sonar-pro` | chat | ✅ | 1.6s | | | |
| 155 | +| Perplexity | `sonar-pro` | chat | ✅ | 1.8s | | | |
| 154 | 156 | | Perplexity | `sonar-reasoning-pro` | chat | ✅ | 2.8s | | |
| 155 | −| Alibaba Qwen | `—` | models | ✅ | 0.9s | 151 live | | |
| 156 | −| Alibaba Qwen | `deepseek-v4-flash` | chat | ✅ | 1.2s | | | |
| 157 | −| Alibaba Qwen | `deepseek-v4-pro` | chat | ✅ | 1.8s | | | |
| 158 | −| Alibaba Qwen | `glm-5.2` | chat | ✅ | 4.3s | | | |
| 159 | −| Alibaba Qwen | `kimi-k2.7-code` | chat | ✅ | 4.0s | | | |
| 160 | −| Alibaba Qwen | `qvq-max` | chat | ✅ | 2.4s | | | |
| 157 | +| Alibaba Qwen | `—` | models | ✅ | 0.9s | 152 live | | |
| 158 | +| Alibaba Qwen | `deepseek-v4-flash` | chat | ✅ | 1.3s | | | |
| 159 | +| Alibaba Qwen | `deepseek-v4-pro` | chat | ✅ | 2.6s | | | |
| 160 | +| Alibaba Qwen | `glm-5.2` | chat | ✅ | 2.3s | | | |
| 161 | +| Alibaba Qwen | `kimi-k2.7-code` | chat | ✅ | 1.3s | | | |
| 162 | +| Alibaba Qwen | `qvq-max` | chat | ✅ | 2.3s | | | |
| 161 | 163 | | Alibaba Qwen | `qwen-flash` | chat | ✅ | 0.4s | | |
| 162 | 164 | | Alibaba Qwen | `qwen-max` | chat | ✅ | 0.5s | | |
| 163 | −| Alibaba Qwen | `qwen-plus` | chat | ✅ | 0.7s | | | |
| 165 | +| Alibaba Qwen | `qwen-plus` | chat | ✅ | 0.6s | | | |
| 164 | 166 | | Alibaba Qwen | `qwen-turbo` | chat | ✅ | 0.4s | | |
| 165 | 167 | | Alibaba Qwen | `qwen3-235b-a22b-instruct-2507` | chat | ✅ | 0.6s | | |
| 166 | −| Alibaba Qwen | `qwen3-235b-a22b-thinking-2507` | chat | ✅ | 1.0s | | | |
| 167 | −| Alibaba Qwen | `qwen3-coder-480b-a35b-instruct` | chat | ✅ | 1.1s | | | |
| 168 | −| Alibaba Qwen | `qwen3-coder-flash` | chat | ✅ | 1.0s | | | |
| 168 | +| Alibaba Qwen | `qwen3-235b-a22b-thinking-2507` | chat | ✅ | 0.9s | | | |
| 169 | +| Alibaba Qwen | `qwen3-coder-480b-a35b-instruct` | chat | ✅ | 0.8s | | | |
| 170 | +| Alibaba Qwen | `qwen3-coder-flash` | chat | ✅ | 0.9s | | | |
| 169 | 171 | | Alibaba Qwen | `qwen3-coder-next` | chat | ✅ | 0.8s | | |
| 170 | −| Alibaba Qwen | `qwen3-coder-plus` | chat | ✅ | 0.8s | | | |
| 172 | +| Alibaba Qwen | `qwen3-coder-plus` | chat | ✅ | 0.9s | | | |
| 171 | 173 | | Alibaba Qwen | `qwen3-next-80b-a3b-instruct` | chat | ✅ | 0.5s | | |
| 172 | 174 | | Alibaba Qwen | `qwen3-next-80b-a3b-thinking` | chat | ✅ | 1.0s | | |
| 173 | 175 | | Alibaba Qwen | `qwen3-vl-235b-a22b-instruct` | chat | ✅ | 0.5s | | |
| 174 | −| Alibaba Qwen | `qwen3-vl-235b-a22b-thinking` | chat | ✅ | 3.1s | | | |
| 176 | +| Alibaba Qwen | `qwen3-vl-235b-a22b-thinking` | chat | ✅ | 1.7s | | | |
| 175 | 177 | | Alibaba Qwen | `qwen3-vl-flash` | chat | ✅ | 0.5s | | |
| 176 | −| Alibaba Qwen | `qwen3-vl-plus` | chat | ✅ | 0.6s | | | |
| 177 | −| Alibaba Qwen | `qwen3.5-122b-a10b` | chat | ✅ | 1.1s | | | |
| 178 | −| Alibaba Qwen | `qwen3.5-35b-a3b` | chat | ✅ | 1.7s | | | |
| 179 | −| Alibaba Qwen | `qwen3.5-397b-a17b` | chat | ✅ | 4.8s | | | |
| 180 | −| Alibaba Qwen | `qwen3.5-flash` | chat | ✅ | 1.4s | | | |
| 181 | −| Alibaba Qwen | `qwen3.5-plus` | chat | ✅ | 7.2s | | | |
| 182 | −| Alibaba Qwen | `qwen3.6-flash` | chat | ✅ | 1.5s | | | |
| 183 | −| Alibaba Qwen | `qwen3.6-plus` | chat | ✅ | 3.6s | | | |
| 184 | −| Alibaba Qwen | `qwen3.7-flash` | chat | ✅ | 2.4s | | | |
| 185 | −| Alibaba Qwen | `qwen3.7-max` | chat | ✅ | 3.3s | | | |
| 186 | −| Alibaba Qwen | `qwen3.7-max` | stream | ✅ | 6.5s | deltas=3 usage=true | | |
| 187 | −| Alibaba Qwen | `qwen3.7-plus` | chat | ✅ | 4.3s | | | |
| 188 | −| Alibaba Qwen | `qwen3.7-plus` | vision | ✅ | 2.7s | Red | | |
| 189 | −| Alibaba Qwen | `qwq-plus` | chat | ✅ | 2.9s | | | |
| 190 | −| Together AI | `—` | models | ✅ | 0.3s | 270 live | | |
| 191 | −| Together AI | `MiniMaxAI/MiniMax-M3` | chat | ✅ | 1.9s | | | |
| 192 | −| Together AI | `Qwen/Qwen3.5-9B` | chat | ✅ | 1.7s | | | |
| 193 | −| Together AI | `Qwen/Qwen3.6-Plus` | chat | ✅ | 4.2s | | | |
| 194 | −| Together AI | `Qwen/Qwen3.7-Max` | chat | ✅ | 4.6s | | | |
| 195 | −| Together AI | `Qwen/Qwen3.7-Plus` | chat | ✅ | 3.8s | | | |
| 196 | −| Together AI | `deepseek-ai/DeepSeek-V4-Pro` | chat | ✅ | 0.8s | | | |
| 197 | −| Together AI | `google/gemma-4-31B-it` | chat | ✅ | 18.0s | | | |
| 198 | −| Together AI | `meta-llama/Llama-3.3-70B-Instruct-Turbo` | chat | ✅ | 3.5s | | | |
| 199 | −| Together AI | `moonshotai/Kimi-K2.6` | chat | ✅ | 0.5s | | | |
| 200 | −| Together AI | `moonshotai/Kimi-K2.7-Code` | chat | ✅ | 0.5s | | | |
| 201 | −| Together AI | `moonshotai/Kimi-K3` | chat | ✅ | 1.3s | | | |
| 202 | −| Together AI | `moonshotai/Kimi-K3` | stream | ✅ | 1.6s | deltas=2 usage=true | | |
| 203 | −| Together AI | `nvidia/nemotron-3-ultra-550b-a55b` | chat | ✅ | 0.4s | | | |
| 204 | −| Together AI | `openai/gpt-oss-120b` | chat | ✅ | 0.8s | | | |
| 205 | −| Together AI | `openai/gpt-oss-20b` | chat | ✅ | 0.7s | | | |
| 206 | −| Together AI | `thinkingmachines/Inkling` | chat | ✅ | 0.6s | | | |
| 207 | −| Together AI | `zai-org/GLM-5.2` | chat | ✅ | 0.9s | | | |
| 178 | +| Alibaba Qwen | `qwen3-vl-plus` | chat | ✅ | 0.5s | | | |
| 179 | +| Alibaba Qwen | `qwen3.5-122b-a10b` | chat | ✅ | 1.9s | | | |
| 180 | +| Alibaba Qwen | `qwen3.5-35b-a3b` | chat | ✅ | 1.1s | | | |
| 181 | +| Alibaba Qwen | `qwen3.5-397b-a17b` | chat | ✅ | 5.0s | | | |
| 182 | +| Alibaba Qwen | `qwen3.5-flash` | chat | ✅ | 1.9s | | | |
| 183 | +| Alibaba Qwen | `qwen3.5-plus` | chat | ✅ | 4.9s | | | |
| 184 | +| Alibaba Qwen | `qwen3.6-flash` | chat | ✅ | 1.9s | | | |
| 185 | +| Alibaba Qwen | `qwen3.6-plus` | chat | ✅ | 4.7s | | | |
| 186 | +| Alibaba Qwen | `qwen3.7-flash` | chat | ✅ | 2.6s | | | |
| 187 | +| Alibaba Qwen | `qwen3.7-max` | chat | ✅ | 4.3s | | | |
| 188 | +| Alibaba Qwen | `qwen3.7-max` | stream | ✅ | 8.5s | deltas=3 usage=true | | |
| 189 | +| Alibaba Qwen | `qwen3.7-plus` | chat | ✅ | 4.6s | | | |
| 190 | +| Alibaba Qwen | `qwen3.7-plus` | vision | ✅ | 1.9s | Red | | |
| 191 | +| Alibaba Qwen | `qwq-plus` | chat | ✅ | 3.7s | | | |
| 192 | +| Together AI | `—` | models | ✅ | 0.4s | 270 live | | |
| 193 | +| Together AI | `MiniMaxAI/MiniMax-M3` | chat | ✅ | 1.0s | | | |
| 194 | +| Together AI | `Qwen/Qwen3.5-9B` | chat | ✅ | 4.1s | | | |
| 195 | +| Together AI | `Qwen/Qwen3.6-Plus` | chat | ✅ | 4.1s | | | |
| 196 | +| Together AI | `Qwen/Qwen3.7-Max` | chat | ✅ | 4.4s | | | |
| 197 | +| Together AI | `Qwen/Qwen3.7-Plus` | chat | ✅ | 3.2s | | | |
| 198 | +| Together AI | `deepseek-ai/DeepSeek-V4-Pro` | chat | ✅ | 0.9s | | | |
| 199 | +| Together AI | `google/gemma-4-31B-it` | chat | ✅ | 1.3s | | | |
| 200 | +| Together AI | `meta-llama/Llama-3.3-70B-Instruct-Turbo` | chat | ✅ | 1.6s | | | |
| 201 | +| Together AI | `moonshotai/Kimi-K2.6` | chat | ✅ | 0.8s | | | |
| 202 | +| Together AI | `moonshotai/Kimi-K2.7-Code` | chat | ✅ | 0.8s | | | |
| 203 | +| Together AI | `moonshotai/Kimi-K3` | chat | ✅ | 4.4s | | | |
| 204 | +| Together AI | `moonshotai/Kimi-K3` | stream | ✅ | 4.0s | deltas=2 usage=true | | |
| 205 | +| Together AI | `nvidia/nemotron-3-ultra-550b-a55b` | chat | ✅ | 0.9s | | | |
| 206 | +| Together AI | `openai/gpt-oss-120b` | chat | ✅ | 0.7s | | | |
| 207 | +| Together AI | `openai/gpt-oss-20b` | chat | ✅ | 0.4s | | | |
| 208 | +| Together AI | `thinkingmachines/Inkling` | chat | ✅ | 0.8s | | | |
| 209 | +| Together AI | `zai-org/GLM-5.2` | chat | ✅ | 0.7s | | | |
| 208 | 210 | | xAI | `—` | models | ✅ | 0.2s | 10 live | |
| 209 | −| xAI | `grok-4.20` | chat | ✅ | 0.8s | | | |
| 210 | −| xAI | `grok-4.20-non-reasoning` | chat | ✅ | 0.3s | | | |
| 211 | +| xAI | `grok-4.20` | chat | ✅ | 1.3s | | | |
| 212 | +| xAI | `grok-4.20-non-reasoning` | chat | ✅ | 0.5s | | | |
| 211 | 213 | | xAI | `grok-4.3` | chat | ✅ | 1.1s | | |
| 212 | 214 | | xAI | `grok-4.5` | chat | ✅ | 0.7s | | |
| 213 | −| xAI | `grok-4.5` | stream | ✅ | 1.5s | deltas=9 usage=true | | |
| 215 | +| xAI | `grok-4.5` | stream | ✅ | 1.0s | deltas=9 usage=true | | |
| 214 | 216 | | xAI | `grok-4.5` | vision | ✅ | 1.3s | Red | |
| 215 | −| xAI | `grok-code-fast-1` | chat | ✅ | 1.5s | | | |
| 217 | +| xAI | `grok-code-fast-1` | chat | ✅ | 1.3s | | | |
| 216 | 218 | |