HTML 77.2%
TypeScript 10.5%
Python 9.6%
JavaScript 2.5%
1<?xml version="1.0" encoding="UTF-8"?>2<feed xmlns="http://www.w3.org/2005/Atom" xmlns:media="http://search.yahoo.com/mrss/" xml:lang="en-US">3 <id>tag:github.com,2008:https://github.com/vllm-project/vllm/releases</id>4 <link type="text/html" rel="alternate" href="https://github.com/vllm-project/vllm/releases"/>5 <link type="application/atom+xml" rel="self" href="https://github.com/vllm-project/vllm/releases.atom"/>6 <title>Release notes from vllm</title>7 <updated>2026-09-11T08:30:05Z</updated>8 <entry>9 <id>tag:github.com,2008:Repository/599547518/proto-v0.1.0</id>10 <updated>2026-09-11T08:30:05Z</updated>11 <link rel="alternate" type="text/html" href="https://github.com/vllm-project/vllm/releases/tag/proto-v0.1.0"/>12 <title>proto-v0.1.0</title>13 <content type="html"><p>vllm-proto 0.1.0</p></content>14 <author>15 <name>BugenZhao</name>16 </author>17 <media:thumbnail height="30" width="30" url="https://avatars.githubusercontent.com/u/25862682?s=60&v=4"/>18 </entry>19 <entry>20 <id>tag:github.com,2008:Repository/599547518/v0.29.0</id>21 <updated>2026-09-10T23:53:36Z</updated>22 <link rel="alternate" type="text/html" href="https://github.com/vllm-project/vllm/releases/tag/v0.29.0"/>23 <title>v0.29.0</title>24 <content type="html"><h1>v0.29.0</h1>25<h2>Highlights</h2>26<p>This release features 594 commits from 277 contributors (91 new)!</p>27<ul>28<li><strong>Model Runner V2 is now the default for all models</strong> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5209436023" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53183" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53183/hovercard" href="https://github.com/vllm-project/vllm/pull/53183">#53183</a>), completing the rollout that began with pooling models (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4859338343" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48290" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48290/hovercard" href="https://github.com/vllm-project/vllm/pull/48290">#48290</a>). MRV2 also gained CUDA graph memory profiling for KV cache auto-sizing (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5217002273" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53306" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53306/hovercard" href="https://github.com/vllm-project/vllm/pull/53306">#53306</a>), batch-sharded sampling that cuts per-step logits memory by 1/TP (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5023038565" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50465" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50465/hovercard" href="https://github.com/vllm-project/vllm/pull/50465">#50465</a>), prompt embeds (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4468165522" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/42963" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/42963/hovercard" href="https://github.com/vllm-project/vllm/pull/42963">#42963</a>), <code>extract_hidden_states</code> speculation (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4976435154" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49811" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49811/hovercard" href="https://github.com/vllm-project/vllm/pull/49811">#49811</a>), padded FULL cudagraph dispatch for uniform decode under spec decode (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5224268841" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53407" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53407/hovercard" href="https://github.com/vllm-project/vllm/pull/53407">#53407</a>), and DP-sync skipping before EAGLE/MTP draft prefill (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5243116045" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53694" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53694/hovercard" href="https://github.com/vllm-project/vllm/pull/53694">#53694</a>). MRV1 remains in use for a few ROCm models and features MRV2 does not yet support.</li>29<li><strong>New models</strong>: Hy4-preview, Tencent's 770B/49B-active MoE with Gated DeepSeek Sparse Attention and native MTP (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5275259831" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54160" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54160/hovercard" href="https://github.com/vllm-project/vllm/pull/54160">#54160</a>); Qwen3.8-Flash-Next with BF16/FP8/NVFP4 and MTP (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5257259389" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53896" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53896/hovercard" href="https://github.com/vllm-project/vllm/pull/53896">#53896</a>); GraniteSWA and GraniteMoeSWA (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5179178405" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52706" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52706/hovercard" href="https://github.com/vllm-project/vllm/pull/52706">#52706</a>); NemotronH_Omni_Reasoning_V3 with MTP (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5191749387" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52929" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52929/hovercard" href="https://github.com/vllm-project/vllm/pull/52929">#52929</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5204637894" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53121" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53121/hovercard" href="https://github.com/vllm-project/vllm/pull/53121">#53121</a>); Kimi K3 NVFP4 checkpoints (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5205567349" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53132" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53132/hovercard" href="https://github.com/vllm-project/vllm/pull/53132">#53132</a>).</li>30<li><strong>Kimi-K3 and DeepSeek V4 performance</strong>: fused MXFP4 top-k finalization in the K3 latent tail (about 5% E2E latency, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5206732861" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53152" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53152/hovercard" href="https://github.com/vllm-project/vllm/pull/53152">#53152</a>), K3 Mamba metadata preparation in one Triton launch (6.6-7.6x kernel speedup, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5155366912" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52388" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52388/hovercard" href="https://github.com/vllm-project/vllm/pull/52388">#52388</a>), tuned Hopper low-latency GEMM (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5270636056" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54088" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54088/hovercard" href="https://github.com/vllm-project/vllm/pull/54088">#54088</a>) now also dispatched on SM100 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5231554402" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53534" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53534/hovercard" href="https://github.com/vllm-project/vllm/pull/53534">#53534</a>) and used for <code>eh_proj</code> (12.9-25.2% kernel speedup, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5260560316" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53942" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53942/hovercard" href="https://github.com/vllm-project/vllm/pull/53942">#53942</a>), GEMM-RS extended to GEMM-AR (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5200092730" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53053" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53053/hovercard" href="https://github.com/vllm-project/vllm/pull/53053">#53053</a>), MLA gate merged into the QKV-A projection (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5265157591" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54015" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54015/hovercard" href="https://github.com/vllm-project/vllm/pull/54015">#54015</a>), K3 DCP with DSpark (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5143408851" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52188" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52188/hovercard" href="https://github.com/vllm-project/vllm/pull/52188">#52188</a>) and DCP partial prefix cache hits (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5024902326" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50493" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50493/hovercard" href="https://github.com/vllm-project/vllm/pull/50493">#50493</a>); DeepSeek V4 shared experts fused into MegaMoE (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5199333771" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53040" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53040/hovercard" href="https://github.com/vllm-project/vllm/pull/53040">#53040</a>), adaptive top-k width re-landed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5185770562" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52823" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52823/hovercard" href="https://github.com/vllm-project/vllm/pull/52823">#52823</a>), a native SwiGLU clamp kernel for Humming MoE (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5242692210" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53685" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53685/hovercard" href="https://github.com/vllm-project/vllm/pull/53685">#53685</a>), and an opt-in FlashInfer <code>moe_ep</code> expert backend (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4961919843" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49636" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49636/hovercard" href="https://github.com/vllm-project/vllm/pull/49636">#49636</a>).</li>31<li><strong>Speculative decoding</strong>: per-request acceptance stats in OpenAI API responses via <code>--per-request-spec-decode-metrics</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4908287242" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48915" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48915/hovercard" href="https://github.com/vllm-project/vllm/pull/48915">#48915</a>), adaptive verification extended to logprobs (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5147428527" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52242" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52242/hovercard" href="https://github.com/vllm-project/vllm/pull/52242">#52242</a>), SM100 sparse MLA for GLM-5.2 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5183188300" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52783" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52783/hovercard" href="https://github.com/vllm-project/vllm/pull/52783">#52783</a>) and DeepSeek V4 on SM90 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5183962079" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52795" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52795/hovercard" href="https://github.com/vllm-project/vllm/pull/52795">#52795</a>), Qwen3-Omni DSpark drafts (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5167704960" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52560" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52560/hovercard" href="https://github.com/vllm-project/vllm/pull/52560">#52560</a>), PLaMo3 EAGLE-3/DFlash (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5280514396" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54239" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54239/hovercard" href="https://github.com/vllm-project/vllm/pull/54239">#54239</a>), and DFlash2 loading from speculators format (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5250815518" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53797" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53797/hovercard" href="https://github.com/vllm-project/vllm/pull/53797">#53797</a>).</li>32<li><strong>RL weight sync</strong>: a new <code>sharded_rdt</code> P2P backend where each worker pulls only its TP/EP slice over NIXL or Ray Direct Transport (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4498962307" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/43375" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/43375/hovercard" href="https://github.com/vllm-project/vllm/pull/43375">#43375</a>), rank-local IPC weight updates (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5163032127" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52497" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52497/hovercard" href="https://github.com/vllm-project/vllm/pull/52497">#52497</a>), sparse checkpoint-coordinate updates through native weight loaders (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5040743562" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50723" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50723/hovercard" href="https://github.com/vllm-project/vllm/pull/50723">#50723</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5247441451" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53751" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53751/hovercard" href="https://github.com/vllm-project/vllm/pull/53751">#53751</a>), and routed expert loading for gpt-oss (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5145232591" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52209" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52209/hovercard" href="https://github.com/vllm-project/vllm/pull/52209">#52209</a>).</li>33<li><strong>Mamba prefix caching</strong>: internal prefill checkpoints deliver a 9%-25% TTFT improvement (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5183735872" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52789" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52789/hovercard" href="https://github.com/vllm-project/vllm/pull/52789">#52789</a>); <code>prefix_cache_retention_interval</code> is now a CLI argument defaulting to 0 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5145771808" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52216" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52216/hovercard" href="https://github.com/vllm-project/vllm/pull/52216">#52216</a>), with dense retention automatically restored for hybrid models using EAGLE/MTP (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5377316976" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/55760" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/55760/hovercard" href="https://github.com/vllm-project/vllm/pull/55760">#55760</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5384232024" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/55861" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/55861/hovercard" href="https://github.com/vllm-project/vllm/pull/55861">#55861</a>).</li>34<li><strong>New defaults</strong>: FlashInfer all-reduce enabled by default for TP CUDA groups, opt out with <code>VLLM_ALLREDUCE_USE_FLASHINFER=0</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5196781600" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52998" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52998/hovercard" href="https://github.com/vllm-project/vllm/pull/52998">#52998</a>); prefix-cache <code>NONE_HASH</code> is deterministic by default so distributed KV cache users no longer need to pin <code>PYTHONHASHSEED</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5124402404" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51875" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51875/hovercard" href="https://github.com/vllm-project/vllm/pull/51875">#51875</a>); new <code>--max-num-queued-reqs</code> / <code>--max-num-queued-tokens</code> admission-control flags (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4948101157" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49445" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49445/hovercard" href="https://github.com/vllm-project/vllm/pull/49445">#49445</a>).</li>35<li><strong>Breaking changes</strong>: ten deprecated model architectures removed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5237599903" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53608" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53608/hovercard" href="https://github.com/vllm-project/vllm/pull/53608">#53608</a>); FlexOlmo, Olmo3 and Hunyuan V1/VL migrated to the Transformers modeling backend (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5238189101" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53615" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53615/hovercard" href="https://github.com/vllm-project/vllm/pull/53615">#53615</a>); PyAV video decoder backend removed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5279922155" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54231" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54231/hovercard" href="https://github.com/vllm-project/vllm/pull/54231">#54231</a>); <code>python -m vllm.entrypoints.openai.api_server</code> deprecated in favor of <code>vllm serve</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5139471549" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52131" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52131/hovercard" href="https://github.com/vllm-project/vllm/pull/52131">#52131</a>); <code>VLLM_TEST_FORCE_FP8_MARLIN</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5142686969" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52182" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52182/hovercard" href="https://github.com/vllm-project/vllm/pull/52182">#52182</a>) and <code>VLLM_ROCM_USE_AITER_FP4_ASM_GEMM</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5205961808" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53141" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53141/hovercard" href="https://github.com/vllm-project/vllm/pull/53141">#53141</a>) removed.</li>36</ul>37<h2><g-emoji class="g-emoji" alias="warning">⚠️</g-emoji> Model Runner V1 Deprecation</h2>38<p>Now that Model Runner V2 is used by default, we are considering Model Runner V1 deprecated and are targeting v0.32 for its removal. We do not intend to accept any more MRV1-specific improvements or optimizations.</p>39<p>Some <a href="https://github.com/vllm-project/vllm/issues/47172" data-hovercard-type="issue" data-hovercard-url="/vllm-project/vllm/issues/47172/hovercard">features</a> are not yet supported in MRV2 but we are planning for these gaps to be closed within the next 2-3 weeks. These include sequence parallelism, dual-batch overlap, elastic expert parallellism, custom logits processors and certain speculative decoding methods. For now, vLLM will still fall back to use MRV1 if any of these features are configured.</p>40<h2>Release Artifacts</h2>41<h3>Python Wheels</h3>42<table>43<thead>44<tr>45<th>Platform</th>46<th>Install</th>47</tr>48</thead>49<tbody>50<tr>51<td>PyPI (CUDA 13.0)</td>52<td><code>pip install vllm</code></td>53</tr>54<tr>55<td>PyPI (CUDA 13.0, uv)</td>56<td><code>uv pip install vllm --torch-backend=auto</code></td>57</tr>58<tr>59<td>ROCm</td>60<td><code>pip install vllm --extra-index-url https://wheels.vllm.ai/rocm/0.29.0/rocm723</code></td>61</tr>62<tr>63<td>XPU</td>64<td><code>uv pip install vllm --extra-index-url https://wheels.vllm.ai/0.29.0/xpu --extra-index-url https://download.pytorch.org/whl/xpu --index-strategy unsafe-best-match</code></td>65</tr>66</tbody>67</table>68<h3>Docker Images</h3>69<table>70<thead>71<tr>72<th>Platform</th>73<th>Docker Image</th>74</tr>75</thead>76<tbody>77<tr>78<td>CUDA 13.0 (Default)</td>79<td><code>docker pull vllm/vllm-openai:v0.29.0</code> (<code>v0.29.0-cu130</code> also works)</td>80</tr>81<tr>82<td>CUDA 12.9</td>83<td><code>docker pull vllm/vllm-openai:v0.29.0-cu129</code></td>84</tr>85<tr>86<td>CUDA 13.0 + Ubuntu 24.04</td>87<td><code>docker pull vllm/vllm-openai:v0.29.0-ubuntu2404</code></td>88</tr>89<tr>90<td>CUDA 12.9 + Ubuntu 24.04</td>91<td><code>docker pull vllm/vllm-openai:v0.29.0-cu129-ubuntu2404</code></td>92</tr>93<tr>94<td>ROCm</td>95<td><code>docker pull vllm/vllm-openai-rocm:v0.29.0</code></td>96</tr>97<tr>98<td>CPU</td>99<td><code>docker pull vllm/vllm-openai-cpu:v0.29.0</code></td>100</tr>101<tr>102<td>XPU</td>103<td><code>docker pull vllm/vllm-openai-xpu:v0.29.0</code></td>104</tr>105</tbody>106</table>107<h3>Other Artifacts</h3>108<p>Pre-built release artifacts are available in the <strong>Assets</strong> section at the bottom of this page, including:</p>109<ul>110<li>Source distribution tarball</li>111<li>CUDA 12.9 Python wheels for x86_64 and arm64</li>112<li>CUDA 13.0 Python wheels for x86_64 and arm64</li>113<li>CPU Python wheels for x86_64, arm64, and macOS</li>114<li>XPU Python wheel for x86_64</li>115</ul>116<h2>Model Support</h2>117<ul>118<li><strong>New models</strong>: Hy4-preview (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5275259831" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54160" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54160/hovercard" href="https://github.com/vllm-project/vllm/pull/54160">#54160</a>), Qwen3.8-Flash-Next (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5257259389" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53896" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53896/hovercard" href="https://github.com/vllm-project/vllm/pull/53896">#53896</a>), GraniteSWA and GraniteMoeSWA via the existing Granite implementation (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5179178405" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52706" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52706/hovercard" href="https://github.com/vllm-project/vllm/pull/52706">#52706</a>), NemotronH_Omni_Reasoning_V3 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5191749387" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52929" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52929/hovercard" href="https://github.com/vllm-project/vllm/pull/52929">#52929</a>) with MTP for Nemotron VL models (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5204637894" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53121" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53121/hovercard" href="https://github.com/vllm-project/vllm/pull/53121">#53121</a>), bidirectional attention for DeepSeek-backbone embedding models (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5193245192" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52948" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52948/hovercard" href="https://github.com/vllm-project/vllm/pull/52948">#52948</a>), FP8 ModernBERT (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5202873727" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53101" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53101/hovercard" href="https://github.com/vllm-project/vllm/pull/53101">#53101</a>), and Kimi K3 NVFP4 checkpoints (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5205567349" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53132" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53132/hovercard" href="https://github.com/vllm-project/vllm/pull/53132">#53132</a>).</li>119<li><strong>Transformers modeling backend</strong>: FlexOlmo, Olmo3 and Hunyuan V1/VL migrated off native implementations (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5238189101" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53615" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53615/hovercard" href="https://github.com/vllm-project/vllm/pull/53615">#53615</a>), multimodal path hardened (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5121124453" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51827" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51827/hovercard" href="https://github.com/vllm-project/vllm/pull/51827">#51827</a>), and <code>RMSNormFuser.fuse</code> performance fixed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5182262756" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52766" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52766/hovercard" href="https://github.com/vllm-project/vllm/pull/52766">#52766</a>).</li>120<li><strong>Weight loading</strong>: weight tying now inspects the checkpoint so a real <code>lm_head</code> is loaded even when the config claims tied embeddings (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5109666279" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51665" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51665/hovercard" href="https://github.com/vllm-project/vllm/pull/51665">#51665</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5208221370" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53170" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53170/hovercard" href="https://github.com/vllm-project/vllm/pull/53170">#53170</a>).</li>121<li><strong>LoRA</strong>: DeepSeek V4 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5220828681" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53361" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53361/hovercard" href="https://github.com/vllm-project/vllm/pull/53361">#53361</a>), Qwen3-Omni multimodal LoRA (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5183318748" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52786" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52786/hovercard" href="https://github.com/vllm-project/vllm/pull/52786">#52786</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5233194725" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53557" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53557/hovercard" href="https://github.com/vllm-project/vllm/pull/53557">#53557</a>), tower/connector LoRA for LLaVA-NeXT (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4974910691" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49788" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49788/hovercard" href="https://github.com/vllm-project/vllm/pull/49788">#49788</a>) and LFM2-VL (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5097242709" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51498" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51498/hovercard" href="https://github.com/vllm-project/vllm/pull/51498">#51498</a>), plus fixes for Muse-Glimmer (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5230858374" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53513" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53513/hovercard" href="https://github.com/vllm-project/vllm/pull/53513">#53513</a>), Qwen3.5 embedding modules (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4902578074" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48850" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48850/hovercard" href="https://github.com/vllm-project/vllm/pull/48850">#48850</a>), partial LoRA on Qwen3.5/3.6 GatedDeltaNet (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4812313997" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47640" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47640/hovercard" href="https://github.com/vllm-project/vllm/pull/47640">#47640</a>), int32 overflow in punica kernels at long context (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5199007710" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53034" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53034/hovercard" href="https://github.com/vllm-project/vllm/pull/53034">#53034</a>), false target matches on unsupported module types (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5150483821" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52313" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52313/hovercard" href="https://github.com/vllm-project/vllm/pull/52313">#52313</a>), and base-layer/routed-expert prefix ordering (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5166563133" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52552" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52552/hovercard" href="https://github.com/vllm-project/vllm/pull/52552">#52552</a>).</li>122<li><strong>Multimodal performance</strong>: ViT full CUDA graph for Idefics3 and SmolVLM (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4811392083" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47625" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47625/hovercard" href="https://github.com/vllm-project/vllm/pull/47625">#47625</a>), packed encoder attention for Pixtral (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5142898516" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52185" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52185/hovercard" href="https://github.com/vllm-project/vllm/pull/52185">#52185</a>), fused Kimi vision Q/K RoPE kernel (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5017612796" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50400" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50400/hovercard" href="https://github.com/vllm-project/vllm/pull/50400">#50400</a>), Dots3 NOTE runtime (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5230913424" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53517" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53517/hovercard" href="https://github.com/vllm-project/vllm/pull/53517">#53517</a>) and Omni encoder optimizations (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5227026612" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53460" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53460/hovercard" href="https://github.com/vllm-project/vllm/pull/53460">#53460</a>), MM tensors no longer broadcast to workers for prefix-cache-covered items (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5134759141" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52041" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52041/hovercard" href="https://github.com/vllm-project/vllm/pull/52041">#52041</a>), redundant placeholder scans skipped (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5191315493" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52925" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52925/hovercard" href="https://github.com/vllm-project/vllm/pull/52925">#52925</a>), common token sequences cached (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5233476466" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53560" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53560/hovercard" href="https://github.com/vllm-project/vllm/pull/53560">#53560</a>), async media resolved concurrently across modalities (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5298486219" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54537" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54537/hovercard" href="https://github.com/vllm-project/vllm/pull/54537">#54537</a>), and H2D copies pinned to avoid stream stalls (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5224446151" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53412" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53412/hovercard" href="https://github.com/vllm-project/vllm/pull/53412">#53412</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5283293547" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54292" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54292/hovercard" href="https://github.com/vllm-project/vllm/pull/54292">#54292</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5283530752" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54299" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54299/hovercard" href="https://github.com/vllm-project/vllm/pull/54299">#54299</a>).</li>123<li><strong>Multimodal inputs</strong>: video embeds accepted by the Python frontend (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5280853540" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54242" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54242/hovercard" href="https://github.com/vllm-project/vllm/pull/54242">#54242</a>), modality-scoped <code>mm_processor_kwargs</code> honored (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5251698126" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53808" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53808/hovercard" href="https://github.com/vllm-project/vllm/pull/53808">#53808</a>), Qwen3-VL profiling honors <code>cap_pixels_per_frame</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5289377865" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54380" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54380/hovercard" href="https://github.com/vllm-project/vllm/pull/54380">#54380</a>), video frame sampling respects MP4 edit-list trims (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4882623102" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48608" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48608/hovercard" href="https://github.com/vllm-project/vllm/pull/48608">#48608</a>), oversized items skip the MM processor cache instead of crashing (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5198011038" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53016" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53016/hovercard" href="https://github.com/vllm-project/vllm/pull/53016">#53016</a>), encoder cache entries survive until their last use (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5283029292" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54284" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54284/hovercard" href="https://github.com/vllm-project/vllm/pull/54284">#54284</a>), and repeated multimodal requests with the SHM cache no longer terminate the engine (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5326935622" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54994" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54994/hovercard" href="https://github.com/vllm-project/vllm/pull/54994">#54994</a>).</li>124<li><strong>Correctness</strong>: PaliGemma stale image scaling removed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5178143135" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52692" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52692/hovercard" href="https://github.com/vllm-project/vllm/pull/52692">#52692</a>), Mistral3 placeholder grid with processor size overrides (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5189161450" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52874" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52874/hovercard" href="https://github.com/vllm-project/vllm/pull/52874">#52874</a>), MiniCPM-o on Transformers v5 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5296466801" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54501" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54501/hovercard" href="https://github.com/vllm-project/vllm/pull/54501">#54501</a>), JinaVL cache order (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5232825783" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53553" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53553/hovercard" href="https://github.com/vllm-project/vllm/pull/53553">#53553</a>), mixed CLIP/SigLIP pooling batches (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5207528366" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53165" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53165/hovercard" href="https://github.com/vllm-project/vllm/pull/53165">#53165</a>), XD-RoPE models on prefix-cache hits (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5226658887" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53456" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53456/hovercard" href="https://github.com/vllm-project/vllm/pull/53456">#53456</a>), Qwen3-Omni audio encoder with non-divisible TP (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5049295618" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50858" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50858/hovercard" href="https://github.com/vllm-project/vllm/pull/50858">#50858</a>), GLM-5.2 no longer uses dense MHA (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5163559243" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52512" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52512/hovercard" href="https://github.com/vllm-project/vllm/pull/52512">#52512</a>), Moondream3 MoE all-reduce (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5274944053" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54152" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54152/hovercard" href="https://github.com/vllm-project/vllm/pull/54152">#54152</a>), deepseek-vl2 config defaults (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5084211010" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51302" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51302/hovercard" href="https://github.com/vllm-project/vllm/pull/51302">#51302</a>), HY-V3 compressed-tensors ignore matching (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4888766885" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48682" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48682/hovercard" href="https://github.com/vllm-project/vllm/pull/48682">#48682</a>), MiniMax-M3 FP8 query allocation under CUDA graph replay (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5075534328" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51203" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51203/hovercard" href="https://github.com/vllm-project/vllm/pull/51203">#51203</a>), and GraniteMoeHybrid quantized expert loading (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5267929189" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54052" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54052/hovercard" href="https://github.com/vllm-project/vllm/pull/54052">#54052</a>).</li>125</ul>126<h2>Engine Core</h2>127<ul>128<li><strong>Model Runner V2</strong>: default for all models (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5209436023" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53183" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53183/hovercard" href="https://github.com/vllm-project/vllm/pull/53183">#53183</a>) and pooling models (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4859338343" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48290" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48290/hovercard" href="https://github.com/vllm-project/vllm/pull/48290">#48290</a>), CUDA graph memory reservation (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5217002273" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53306" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53306/hovercard" href="https://github.com/vllm-project/vllm/pull/53306">#53306</a>), batch-sharded sampling (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5023038565" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50465" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50465/hovercard" href="https://github.com/vllm-project/vllm/pull/50465">#50465</a>), prompt embeds (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4468165522" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/42963" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/42963/hovercard" href="https://github.com/vllm-project/vllm/pull/42963">#42963</a>), <code>extract_hidden_states</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4976435154" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49811" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49811/hovercard" href="https://github.com/vllm-project/vllm/pull/49811">#49811</a>), padded FULL cudagraph dispatch (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5224268841" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53407" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53407/hovercard" href="https://github.com/vllm-project/vllm/pull/53407">#53407</a>), DP-sync skipping for drafts (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5243116045" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53694" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53694/hovercard" href="https://github.com/vllm-project/vllm/pull/53694">#53694</a>), decoupled draft/target gumbel noise streams (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5282981569" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54282" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54282/hovercard" href="https://github.com/vllm-project/vllm/pull/54282">#54282</a>), encoder-only path split out (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5208829726" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53176" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53176/hovercard" href="https://github.com/vllm-project/vllm/pull/53176">#53176</a>), and memory released correctly on shutdown and sleep (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5230786234" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53508" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53508/hovercard" href="https://github.com/vllm-project/vllm/pull/53508">#53508</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5280947114" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54246" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54246/hovercard" href="https://github.com/vllm-project/vllm/pull/54246">#54246</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5275336219" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54162" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54162/hovercard" href="https://github.com/vllm-project/vllm/pull/54162">#54162</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5261657229" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53955" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53955/hovercard" href="https://github.com/vllm-project/vllm/pull/53955">#53955</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5242587074" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53682" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53682/hovercard" href="https://github.com/vllm-project/vllm/pull/53682">#53682</a>).</li>129<li><strong>Speculative decoding</strong>: per-request acceptance stats (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4908287242" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48915" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48915/hovercard" href="https://github.com/vllm-project/vllm/pull/48915">#48915</a>), adaptive verification with logprobs (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5147428527" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52242" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52242/hovercard" href="https://github.com/vllm-project/vllm/pull/52242">#52242</a>), on SM100 sparse MLA (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5183188300" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52783" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52783/hovercard" href="https://github.com/vllm-project/vllm/pull/52783">#52783</a>) and DSv4 + SM90 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5183962079" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52795" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52795/hovercard" href="https://github.com/vllm-project/vllm/pull/52795">#52795</a>), varlen trtllm-gen decode (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5140749483" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52157" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52157/hovercard" href="https://github.com/vllm-project/vllm/pull/52157">#52157</a>), FlashInfer MLA for DSpark drafting under DCP (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5282657237" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54277" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54277/hovercard" href="https://github.com/vllm-project/vllm/pull/54277">#54277</a>), fused GDN MTP for all Qwen head ratios (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5165287951" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52539" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52539/hovercard" href="https://github.com/vllm-project/vllm/pull/52539">#52539</a>), widest uniform decode batch captured by default (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5024571653" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50488" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50488/hovercard" href="https://github.com/vllm-project/vllm/pull/50488">#50488</a>) with memory-safe graph sizes (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5291610036" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54418" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54418/hovercard" href="https://github.com/vllm-project/vllm/pull/54418">#54418</a>), and fixes for short_conv/LFM2 targets (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5009940371" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50272" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50272/hovercard" href="https://github.com/vllm-project/vllm/pull/50272">#50272</a>), speculators-format config overrides (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4426318207" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/42376" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/42376/hovercard" href="https://github.com/vllm-project/vllm/pull/42376">#42376</a>), DFlash draft RoPE layout (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5288486337" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54373" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54373/hovercard" href="https://github.com/vllm-project/vllm/pull/54373">#54373</a>), draft models with a different GQA ratio (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5197159965" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53002" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53002/hovercard" href="https://github.com/vllm-project/vllm/pull/53002">#53002</a>), draft models with a larger hidden size under TP (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5143949093" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52193" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52193/hovercard" href="https://github.com/vllm-project/vllm/pull/52193">#52193</a>), DSpark backend inheritance scoped to DeepSeek V4 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5185034825" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52809" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52809/hovercard" href="https://github.com/vllm-project/vllm/pull/52809">#52809</a>), generic <code>DSparkDraftModel</code> configs for Qwen3 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5144136494" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52197" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52197/hovercard" href="https://github.com/vllm-project/vllm/pull/52197">#52197</a>), and Gemma4 MTP under CUDA graphs (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5256705004" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53884" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53884/hovercard" href="https://github.com/vllm-project/vllm/pull/53884">#53884</a>).</li>130<li><strong>Prefix caching &amp; scheduling</strong>: Mamba internal prefill checkpoints (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5183735872" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52789" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52789/hovercard" href="https://github.com/vllm-project/vllm/pull/52789">#52789</a>), <code>prefix_cache_retention_interval</code> argument (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5145771808" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52216" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52216/hovercard" href="https://github.com/vllm-project/vllm/pull/52216">#52216</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5377316976" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/55760" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/55760/hovercard" href="https://github.com/vllm-project/vllm/pull/55760">#55760</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5384232024" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/55861" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/55861/hovercard" href="https://github.com/vllm-project/vllm/pull/55861">#55861</a>), deterministic <code>NONE_HASH</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5124402404" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51875" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51875/hovercard" href="https://github.com/vllm-project/vllm/pull/51875">#51875</a>), queue admission control (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4948101157" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49445" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49445/hovercard" href="https://github.com/vllm-project/vllm/pull/49445">#49445</a>), KV null block reserved when validating <code>max_model_len</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4783990461" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47272" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47272/hovercard" href="https://github.com/vllm-project/vllm/pull/47272">#47272</a>), spec decode no longer padded up to <code>max_model_len</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5262211619" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53962" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53962/hovercard" href="https://github.com/vllm-project/vllm/pull/53962">#53962</a>), and negative external block allocation prevented (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5179259792" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52707" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52707/hovercard" href="https://github.com/vllm-project/vllm/pull/52707">#52707</a>).</li>131<li><strong>RL workflows</strong>: <code>sharded_rdt</code> P2P weight sync (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4498962307" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/43375" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/43375/hovercard" href="https://github.com/vllm-project/vllm/pull/43375">#43375</a>), rank-local IPC updates (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5163032127" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52497" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52497/hovercard" href="https://github.com/vllm-project/vllm/pull/52497">#52497</a>), sparse checkpoint updates (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5040743562" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50723" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50723/hovercard" href="https://github.com/vllm-project/vllm/pull/50723">#50723</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5247441451" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53751" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53751/hovercard" href="https://github.com/vllm-project/vllm/pull/53751">#53751</a>), gpt-oss routed expert loading (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5145232591" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52209" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52209/hovercard" href="https://github.com/vllm-project/vllm/pull/52209">#52209</a>), stable DeepSeek V4 mHC broadcast buffers across weight sync (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5172562231" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52626" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52626/hovercard" href="https://github.com/vllm-project/vllm/pull/52626">#52626</a>), and packed weight transfer stream reuse capping reserved-memory waste (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5193773321" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52951" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52951/hovercard" href="https://github.com/vllm-project/vllm/pull/52951">#52951</a>).</li>132<li><strong>Determinism</strong>: <code>trace_decode_token_ids</code> for deterministic decode replay (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4741800584" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/46701" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/46701/hovercard" href="https://github.com/vllm-project/vllm/pull/46701">#46701</a>), per-arch tuned batch-invariant matmul configs (about 3x decode kernels on RTX 4090D/H20, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5212728093" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53247" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53247/hovercard" href="https://github.com/vllm-project/vllm/pull/53247">#53247</a>), Blackwell autotuning with 33.6% E2E latency reduction (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5240357352" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53649" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53649/hovercard" href="https://github.com/vllm-project/vllm/pull/53649">#53649</a>), deterministic MoE combine under DP+EP (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4664004847" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/45683" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/45683/hovercard" href="https://github.com/vllm-project/vllm/pull/45683">#45683</a>), and <code>fuse_allreduce_rms</code> disabled under batch invariance (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5083618168" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51292" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51292/hovercard" href="https://github.com/vllm-project/vllm/pull/51292">#51292</a>).</li>133<li><strong>Kernels</strong>: fused embedding kernel (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5242321219" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53677" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53677/hovercard" href="https://github.com/vllm-project/vllm/pull/53677">#53677</a>), FA4 re-enabled for head_size=256 on Blackwell (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5195404163" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52980" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52980/hovercard" href="https://github.com/vllm-project/vllm/pull/52980">#52980</a>), vectorized sparse MLA mask loads (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5145820471" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52217" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52217/hovercard" href="https://github.com/vllm-project/vllm/pull/52217">#52217</a>), masked MHA prefill for GLM-5 head dimensions (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5249992008" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53785" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53785/hovercard" href="https://github.com/vllm-project/vllm/pull/53785">#53785</a>), GLM-5.2 sparse MLA Q concatenation fused with head padding (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5256552481" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53878" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53878/hovercard" href="https://github.com/vllm-project/vllm/pull/53878">#53878</a>), fused QK-norm + partial MRoPE + gate for Qwen3.6 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5177222479" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52676" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52676/hovercard" href="https://github.com/vllm-project/vllm/pull/52676">#52676</a>), FlashInfer CuTeDSL BF16 low-latency GEMM as opt-in <code>--linear-backend flashinfer_cutedsl</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5029607342" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50572" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50572/hovercard" href="https://github.com/vllm-project/vllm/pull/50572">#50572</a>), replicated embedding and norm fusion for DSV3 flat models (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4872775914" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48484" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48484/hovercard" href="https://github.com/vllm-project/vllm/pull/48484">#48484</a>), standardized fused shared-expert selection (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5111501584" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51695" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51695/hovercard" href="https://github.com/vllm-project/vllm/pull/51695">#51695</a>), GPT-OSS MoE topk metadata reuse (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4652747210" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/45457" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/45457/hovercard" href="https://github.com/vllm-project/vllm/pull/45457">#45457</a>), tuned cooperative topk (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5222178122" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53382" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53382/hovercard" href="https://github.com/vllm-project/vllm/pull/53382">#53382</a>), and tuned FP8 fused_moe for Qwen3.5 on L40S (+7%, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5252641623" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53819" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53819/hovercard" href="https://github.com/vllm-project/vllm/pull/53819">#53819</a>).</li>134<li><strong>Robustness</strong>: KV cache layout standardized under a <code>KVCacheLayout</code> enum (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5113191409" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51718" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51718/hovercard" href="https://github.com/vllm-project/vllm/pull/51718">#51718</a>), JIT warmup provider registry (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5002247365" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50174" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50174/hovercard" href="https://github.com/vllm-project/vllm/pull/50174">#50174</a>), <code>--cpu-offload-params</code> now reaches vision/audio towers (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5204596603" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53120" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53120/hovercard" href="https://github.com/vllm-project/vllm/pull/53120">#53120</a>), attention backend probe failures no longer crash init (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5112014582" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51703" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51703/hovercard" href="https://github.com/vllm-project/vllm/pull/51703">#51703</a>), FlashInfer XQA falls back on unsupported head_dim (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5203887298" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53111" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53111/hovercard" href="https://github.com/vllm-project/vllm/pull/53111">#53111</a>), FlashInfer prefill LSE normalized before merging to fix prefix-cache logits divergence (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5184047381" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52796" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52796/hovercard" href="https://github.com/vllm-project/vllm/pull/52796">#52796</a>), seed preserved when a batch mixes seeded and unseeded requests (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5124104450" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51866" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51866/hovercard" href="https://github.com/vllm-project/vllm/pull/51866">#51866</a>), startup thread allocation accounts for local DP workers (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5155009604" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52385" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52385/hovercard" href="https://github.com/vllm-project/vllm/pull/52385">#52385</a>), int32 overflow fixes in fused SiLU block quant (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5224370355" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53409" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53409/hovercard" href="https://github.com/vllm-project/vllm/pull/53409">#53409</a>) and LoRA kernels (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5199007710" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53034" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53034/hovercard" href="https://github.com/vllm-project/vllm/pull/53034">#53034</a>), a shared-memory race in fused groupwise RMSNorm quantization (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5272351015" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54111" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54111/hovercard" href="https://github.com/vllm-project/vllm/pull/54111">#54111</a>), BLHNC addressing for FlashInfer sparse MLA (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5293970400" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54465" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54465/hovercard" href="https://github.com/vllm-project/vllm/pull/54465">#54465</a>), Mamba state copy race (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5040991926" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50729" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50729/hovercard" href="https://github.com/vllm-project/vllm/pull/50729">#50729</a>), and a <code>start_profile</code> no-op after auto-stop (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5121873512" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51839" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51839/hovercard" href="https://github.com/vllm-project/vllm/pull/51839">#51839</a>).</li>135</ul>136<h2>Hardware &amp; Performance</h2>137<ul>138<li><strong>NVIDIA</strong>: DeepSeek V3.2 / GLM-5.2 DSA routed to the optimized CUDA path on all GPUs (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5188564287" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52861" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52861/hovercard" href="https://github.com/vllm-project/vllm/pull/52861">#52861</a>), PCP for DSv3.2 sparse MLA (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5135271047" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52046" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52046/hovercard" href="https://github.com/vllm-project/vllm/pull/52046">#52046</a>), cuBLAS out_dtype router GEMM on all archs including GB10 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5267649250" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54048" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54048/hovercard" href="https://github.com/vllm-project/vllm/pull/54048">#54048</a>), FlashInfer all-reduce tuning on SM103 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5218112707" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53318" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53318/hovercard" href="https://github.com/vllm-project/vllm/pull/53318">#53318</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5237365487" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53606" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53606/hovercard" href="https://github.com/vllm-project/vllm/pull/53606">#53606</a>), FA4 hdim256 on SM100 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5195404163" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52980" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52980/hovercard" href="https://github.com/vllm-project/vllm/pull/52980">#52980</a>), SM120 sparse MLA fixes (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5090252678" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51395" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51395/hovercard" href="https://github.com/vllm-project/vllm/pull/51395">#51395</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5234791846" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53574" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53574/hovercard" href="https://github.com/vllm-project/vllm/pull/53574">#53574</a>), DeepSeek V3.2 fused kernel grids hardened for 65k+ token launches (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5154772546" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52381" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52381/hovercard" href="https://github.com/vllm-project/vllm/pull/52381">#52381</a>), FlashMLA sparse decode workspace fix (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5247833448" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53755" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53755/hovercard" href="https://github.com/vllm-project/vllm/pull/53755">#53755</a>), MNNVL Lamport corruption fix (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5196888523" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53000" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53000/hovercard" href="https://github.com/vllm-project/vllm/pull/53000">#53000</a>), and opt-in Rubin Docker builds for CUDA 13.4/13.5 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5225808497" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53443" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53443/hovercard" href="https://github.com/vllm-project/vllm/pull/53443">#53443</a>).</li>139<li><strong>AMD ROCm</strong>: dual-stream decode with hipgraphs (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5134061672" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52033" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52033/hovercard" href="https://github.com/vllm-project/vllm/pull/52033">#52033</a>), W4A4 preshuffled asm GEMM by default (+15% throughput on Llama-3.3-70B MXFP4, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5205961808" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53141" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53141/hovercard" href="https://github.com/vllm-project/vllm/pull/53141">#53141</a>), ROCr/CLR update fixing graph replay segfaults with up to about 20% TPOT improvement (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5244809469" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53712" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53712/hovercard" href="https://github.com/vllm-project/vllm/pull/53712">#53712</a>), fused KDA decode on MI325X (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5149417773" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52293" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52293/hovercard" href="https://github.com/vllm-project/vllm/pull/52293">#52293</a>), FULL cudagraphs for AITER MLA spec decode (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5072151307" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51171" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51171/hovercard" href="https://github.com/vllm-project/vllm/pull/51171">#51171</a>), FP8 asm MLA prefill for non-divisor head counts (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5061802707" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51040" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51040/hovercard" href="https://github.com/vllm-project/vllm/pull/51040">#51040</a>), DCP causal multi-token verification (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5112328984" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51705" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51705/hovercard" href="https://github.com/vllm-project/vllm/pull/51705">#51705</a>) and prefix cache hits for Kimi-K3 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5236835602" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53598" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53598/hovercard" href="https://github.com/vllm-project/vllm/pull/53598">#53598</a>), AITER PA gluon decode for MiniMax-M3 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5187682710" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52849" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52849/hovercard" href="https://github.com/vllm-project/vllm/pull/52849">#52849</a>), DeepSeek-V4 fusions for mHC/RMSNorm (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5180504751" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52737" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52737/hovercard" href="https://github.com/vllm-project/vllm/pull/52737">#52737</a>), C4A top-k (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5189358891" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52882" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52882/hovercard" href="https://github.com/vllm-project/vllm/pull/52882">#52882</a>), C4 compressor GEMMs (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5253661833" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53838" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53838/hovercard" href="https://github.com/vllm-project/vllm/pull/53838">#53838</a>) and SWA q/kv norm + FP8 quant (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5231886266" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53540" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53540/hovercard" href="https://github.com/vllm-project/vllm/pull/53540">#53540</a>), fused shared experts for block-FP8 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5202501068" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53097" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53097/hovercard" href="https://github.com/vllm-project/vllm/pull/53097">#53097</a>), CPU offload on ROCm 7.13+ (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4472960194" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/43018" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/43018/hovercard" href="https://github.com/vllm-project/vllm/pull/43018">#43018</a>), TheRock 7.14 preview docker (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4983770111" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49925" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49925/hovercard" href="https://github.com/vllm-project/vllm/pull/49925">#49925</a>), int4/int8 quantization fixes (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5138599752" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52112" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52112/hovercard" href="https://github.com/vllm-project/vllm/pull/52112">#52112</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4915714074" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48998" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48998/hovercard" href="https://github.com/vllm-project/vllm/pull/48998">#48998</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5107635909" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51632" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51632/hovercard" href="https://github.com/vllm-project/vllm/pull/51632">#51632</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5203868298" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53110" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53110/hovercard" href="https://github.com/vllm-project/vllm/pull/53110">#53110</a>), CUDA graphs captured on the current stream (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5252521303" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53818" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53818/hovercard" href="https://github.com/vllm-project/vllm/pull/53818">#53818</a>), AITER metadata preserved across graph replay (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5252708600" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53821" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53821/hovercard" href="https://github.com/vllm-project/vllm/pull/53821">#53821</a>), and improved ROCm detection under WSL (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4160497140" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/38434" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/38434/hovercard" href="https://github.com/vllm-project/vllm/pull/38434">#38434</a>).</li>140<li><strong>Intel XPU</strong>: INC int4 W4A8 linear backend (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5025615988" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50501" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50501/hovercard" href="https://github.com/vllm-project/vllm/pull/50501">#50501</a>), AutoRound MXFP8 MoE (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5079981233" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51248" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51248/hovercard" href="https://github.com/vllm-project/vllm/pull/51248">#51248</a>), EC connector KV offloading (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4956097859" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49532" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49532/hovercard" href="https://github.com/vllm-project/vllm/pull/49532">#49532</a>), and fixes for HunyuanOCR XD-RoPE (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5142330814" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52174" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52174/hovercard" href="https://github.com/vllm-project/vllm/pull/52174">#52174</a>), sparse-MLA metadata sync (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5136054941" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52066" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52066/hovercard" href="https://github.com/vllm-project/vllm/pull/52066">#52066</a>), Mamba state pointer overflow (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4844992467" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48109" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48109/hovercard" href="https://github.com/vllm-project/vllm/pull/48109">#48109</a>), oneCCL warm-up at world size 1 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5155455899" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52389" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52389/hovercard" href="https://github.com/vllm-project/vllm/pull/52389">#52389</a>), and MRoPE (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5210099570" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53201" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53201/hovercard" href="https://github.com/vllm-project/vllm/pull/53201">#53201</a>).</li>141<li><strong>CPU</strong>: AMX high-performance MLA backend for DeepSeek V2/V3/R1 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5171924819" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52616" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52616/hovercard" href="https://github.com/vllm-project/vllm/pull/52616">#52616</a>) with MLA now running end-to-end (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5095464600" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51471" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51471/hovercard" href="https://github.com/vllm-project/vllm/pull/51471">#51471</a>), FP16/BF16 persisted GDN state on AMX (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5143816100" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52191" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52191/hovercard" href="https://github.com/vllm-project/vllm/pull/52191">#52191</a>), Int8 MoE through zentorch on AMD Zen (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4610349549" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/44834" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/44834/hovercard" href="https://github.com/vllm-project/vllm/pull/44834">#44834</a>), Voxtral support (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5259223723" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53921" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53921/hovercard" href="https://github.com/vllm-project/vllm/pull/53921">#53921</a>), C++ causal_conv1d GDN on non-AMX AVX-512BF16 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4966314300" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49688" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49688/hovercard" href="https://github.com/vllm-project/vllm/pull/49688">#49688</a>), and assorted fixes (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5267272744" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54042" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54042/hovercard" href="https://github.com/vllm-project/vllm/pull/54042">#54042</a>).</li>142</ul>143<h2>Large Scale Serving</h2>144<ul>145<li><strong>Context parallelism</strong>: Kimi-K3 DCP with DSpark (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5143408851" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52188" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52188/hovercard" href="https://github.com/vllm-project/vllm/pull/52188">#52188</a>) and partial prefix cache hits (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5024902326" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50493" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50493/hovercard" href="https://github.com/vllm-project/vllm/pull/50493">#50493</a>), FlashInfer native CP for MLA decode (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5265035147" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54012" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54012/hovercard" href="https://github.com/vllm-project/vllm/pull/54012">#54012</a>), FlashMLA sparse DCP on Hopper with MTP (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4727193891" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/46514" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/46514/hovercard" href="https://github.com/vllm-project/vllm/pull/46514">#46514</a>), NIXL P/D DCP for MLA models (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5032346193" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50611" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50611/hovercard" href="https://github.com/vllm-project/vllm/pull/50611">#50611</a>), PCP for DSv3.2 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5135271047" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52046" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52046/hovercard" href="https://github.com/vllm-project/vllm/pull/52046">#52046</a>) and NIXL PCP producers (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5182876833" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52779" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52779/hovercard" href="https://github.com/vllm-project/vllm/pull/52779">#52779</a>), <code>--dcp-q-replicate</code> with query replication default-on for GLM sparse attention (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5016269892" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50382" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50382/hovercard" href="https://github.com/vllm-project/vllm/pull/50382">#50382</a>), DCP fused attention fix for DeepSeek-V3.2 / GLM-5.2 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4989595181" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50005" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50005/hovercard" href="https://github.com/vllm-project/vllm/pull/50005">#50005</a>), sparse MLA metadata and kernel block sizes under DCP (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5154614070" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52377" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52377/hovercard" href="https://github.com/vllm-project/vllm/pull/52377">#52377</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5061299849" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51031" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51031/hovercard" href="https://github.com/vllm-project/vllm/pull/51031">#51031</a>), PCP PIECEWISE cudagraph fixes (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5255923997" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53869" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53869/hovercard" href="https://github.com/vllm-project/vllm/pull/53869">#53869</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5230910486" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53515" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53515/hovercard" href="https://github.com/vllm-project/vllm/pull/53515">#53515</a>), and PCP compatibility checks delegated to the PCP manager so plugins can enable GQA+PCP (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5254301913" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53853" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53853/hovercard" href="https://github.com/vllm-project/vllm/pull/53853">#53853</a>).</li>146<li><strong>Elastic EP</strong>: reduced eager-mode reconfiguration downtime (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5125332483" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51885" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51885/hovercard" href="https://github.com/vllm-project/vllm/pull/51885">#51885</a>), AOT cache reuse preserved during scaling (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5221788715" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53378" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53378/hovercard" href="https://github.com/vllm-project/vllm/pull/53378">#53378</a>), and scale-below-minimum rejected (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5178794791" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52702" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52702/hovercard" href="https://github.com/vllm-project/vllm/pull/52702">#52702</a>).</li>147<li><strong>MoE communication</strong>: DeepEP v2 receiver CPU overhead (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5067252911" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51114" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51114/hovercard" href="https://github.com/vllm-project/vllm/pull/51114">#51114</a>) and MXFP8 activation scale dispatch (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5090849670" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51398" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51398/hovercard" href="https://github.com/vllm-project/vllm/pull/51398">#51398</a>), FlashInfer one-sided All2All refinements (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5127258176" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51924" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51924/hovercard" href="https://github.com/vllm-project/vllm/pull/51924">#51924</a>), DeepEP v2 fixes for <code>--enforce-eager</code> startup (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5120810925" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51824" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51824/hovercard" href="https://github.com/vllm-project/vllm/pull/51824">#51824</a>) and the decode/cudagraph path (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5173468412" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52632" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52632/hovercard" href="https://github.com/vllm-project/vllm/pull/52632">#52632</a>), NCCL&gt;=2.31 heap overflow fix (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5197472419" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53008" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53008/hovercard" href="https://github.com/vllm-project/vllm/pull/53008">#53008</a>), cross-node MNNVL all-reduce gated by capability (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5213350847" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53253" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53253/hovercard" href="https://github.com/vllm-project/vllm/pull/53253">#53253</a>), and MNNVL all-reduce buffers sized for DSpark (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5055170821" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50932" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50932/hovercard" href="https://github.com/vllm-project/vllm/pull/50932">#50932</a>).</li>148<li><strong>KV connectors</strong>: Mooncake Store decode KV saving via <code>save_decode_cache</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5160954650" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52466" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52466/hovercard" href="https://github.com/vllm-project/vllm/pull/52466">#52466</a>) and hybrid DCP prefix caching (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5218350653" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53324" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53324/hovercard" href="https://github.com/vllm-project/vllm/pull/53324">#53324</a>), externally transferable KV cache group identification (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5249690529" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53779" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53779/hovercard" href="https://github.com/vllm-project/vllm/pull/53779">#53779</a>), async KV loads deferred past forward launch (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5219004789" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53333" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53333/hovercard" href="https://github.com/vllm-project/vllm/pull/53333">#53333</a>), <code>kv_transfer_params</code> for <code>/inference/v1/generate</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4446567128" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/42644" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/42644/hovercard" href="https://github.com/vllm-project/vllm/pull/42644">#42644</a>), MoRIIO shared KV region registration after the layout refactor (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5243691876" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53698" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53698/hovercard" href="https://github.com/vllm-project/vllm/pull/53698">#53698</a>), and Mamba fixes for Mooncake (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5087157013" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51362" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51362/hovercard" href="https://github.com/vllm-project/vllm/pull/51362">#51362</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5086979993" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51358" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51358/hovercard" href="https://github.com/vllm-project/vllm/pull/51358">#51358</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5241480015" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53663" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53663/hovercard" href="https://github.com/vllm-project/vllm/pull/53663">#53663</a>) and NIXL (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5231165743" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53523" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53523/hovercard" href="https://github.com/vllm-project/vllm/pull/53523">#53523</a>).</li>149<li><strong>KV offloading</strong>: EC offloading connector driven by CUDA events (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4989030901" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49994" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49994/hovercard" href="https://github.com/vllm-project/vllm/pull/49994">#49994</a>), ownership in KV cache events (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5136187894" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52067" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52067/hovercard" href="https://github.com/vllm-project/vllm/pull/52067">#52067</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5136206962" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52068" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52068/hovercard" href="https://github.com/vllm-project/vllm/pull/52068">#52068</a>), P2P tier request-level offload (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5190792789" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52912" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52912/hovercard" href="https://github.com/vllm-project/vllm/pull/52912">#52912</a>) and abort handling (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5168113159" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52571" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52571/hovercard" href="https://github.com/vllm-project/vllm/pull/52571">#52571</a>), <code>/dev/shm</code> leak on crash fixed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5170095777" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52596" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52596/hovercard" href="https://github.com/vllm-project/vllm/pull/52596">#52596</a>), CPU-&gt;GPU loads ordered against compute stream (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5038239407" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50696" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50696/hovercard" href="https://github.com/vllm-project/vllm/pull/50696">#50696</a>), <code>store_threshold</code> counting fixed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5146372859" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52227" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52227/hovercard" href="https://github.com/vllm-project/vllm/pull/52227">#52227</a>), in-flight primary keys cascaded (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5218859213" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53329" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53329/hovercard" href="https://github.com/vllm-project/vllm/pull/53329">#53329</a>), and padded GPU cache storage handled (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5265467470" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54021" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54021/hovercard" href="https://github.com/vllm-project/vllm/pull/54021">#54021</a>).</li>150<li><strong>Data/pipeline parallel</strong>: PP silent corruption fix (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5324060236" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54962" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54962/hovercard" href="https://github.com/vllm-project/vllm/pull/54962">#54962</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4935159122" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49274" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49274/hovercard" href="https://github.com/vllm-project/vllm/pull/49274">#49274</a>), DP coordinator wake handling (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5095868711" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51481" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51481/hovercard" href="https://github.com/vllm-project/vllm/pull/51481">#51481</a>), device sync on pause (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5190917705" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52914" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52914/hovercard" href="https://github.com/vllm-project/vllm/pull/52914">#52914</a>), TCPStore port fixes for Ray (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5241656210" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53666" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53666/hovercard" href="https://github.com/vllm-project/vllm/pull/53666">#53666</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5056901305" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50969" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50969/hovercard" href="https://github.com/vllm-project/vllm/pull/50969">#50969</a>), DP supervisor inheriting the uvicorn config (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5161531915" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52473" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52473/hovercard" href="https://github.com/vllm-project/vllm/pull/52473">#52473</a>), EPD encoder round-robin fix (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5162595398" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52491" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52491/hovercard" href="https://github.com/vllm-project/vllm/pull/52491">#52491</a>), and producer-only EC config normalization (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5241165547" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53656" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53656/hovercard" href="https://github.com/vllm-project/vllm/pull/53656">#53656</a>).</li>151</ul>152<h2>Quantization</h2>153<ul>154<li><strong>New backends</strong>: FlashInfer TRT-LLM MXFP8 linear (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5144692620" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52204" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52204/hovercard" href="https://github.com/vllm-project/vllm/pull/52204">#52204</a>), b12x FP4 MoE for SM120/SM121 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5132887932" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52018" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52018/hovercard" href="https://github.com/vllm-project/vllm/pull/52018">#52018</a>), AutoRound block-wise FP8 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4794241679" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47434" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47434/hovercard" href="https://github.com/vllm-project/vllm/pull/47434">#47434</a>), Humming MoE with MXFP4 weights + block-FP8 activations (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5085703484" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51332" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51332/hovercard" href="https://github.com/vllm-project/vllm/pull/51332">#51332</a>), and Humming for compressed-tensors WNA16 MoE (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4908628525" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48918" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48918/hovercard" href="https://github.com/vllm-project/vllm/pull/48918">#48918</a>).</li>155<li><strong>Fixes</strong>: weight-only NVFP4 checkpoints routed through W4A16 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5292310719" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54427" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54427/hovercard" href="https://github.com/vllm-project/vllm/pull/54427">#54427</a>), compressed-tensors block FP8 with Marlin (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5194512373" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52966" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52966/hovercard" href="https://github.com/vllm-project/vllm/pull/52966">#52966</a>) and int8 grouped WNA16 MoE (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5132036711" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52002" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52002/hovercard" href="https://github.com/vllm-project/vllm/pull/52002">#52002</a>), OCP MX mxfp6 activation emulation (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5178960258" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52704" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52704/hovercard" href="https://github.com/vllm-project/vllm/pull/52704">#52704</a>), MXFP8 FlashInfer path guarded on availability (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5174715929" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52648" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52648/hovercard" href="https://github.com/vllm-project/vllm/pull/52648">#52648</a>), and Humming activation aliasing (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5268166858" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54056" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54056/hovercard" href="https://github.com/vllm-project/vllm/pull/54056">#54056</a>).</li>156</ul>157<h2>API &amp; Frontend</h2>158<ul>159<li><strong>New endpoints &amp; options</strong>: <code>/v1/messages/render</code> for the Anthropic Messages API (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4672953156" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/45803" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/45803/hovercard" href="https://github.com/vllm-project/vllm/pull/45803">#45803</a>), <code>/cohere/v2/chat/render</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5211362691" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53219" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53219/hovercard" href="https://github.com/vllm-project/vllm/pull/53219">#53219</a>), SSE keep-alive comments for idle streams (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5061493469" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51034" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51034/hovercard" href="https://github.com/vllm-project/vllm/pull/51034">#51034</a>), per-request spec decode metrics (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4908287242" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48915" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48915/hovercard" href="https://github.com/vllm-project/vllm/pull/48915">#48915</a>), video embeds input (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5280853540" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54242" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54242/hovercard" href="https://github.com/vllm-project/vllm/pull/54242">#54242</a>), <code>--max-num-queued-reqs</code> / <code>--max-num-queued-tokens</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4948101157" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49445" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49445/hovercard" href="https://github.com/vllm-project/vllm/pull/49445">#49445</a>), and pooling requests can set padding (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5070709133" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51157" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51157/hovercard" href="https://github.com/vllm-project/vllm/pull/51157">#51157</a>).</li>160<li><strong>Anthropic &amp; Cohere</strong>: <code>vllm_xargs</code> forwarded to sampling params (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5217217428" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53308" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53308/hovercard" href="https://github.com/vllm-project/vllm/pull/53308">#53308</a>), <code>stop_sequence</code> stop reason reported (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4673469165" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/45807" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/45807/hovercard" href="https://github.com/vllm-project/vllm/pull/45807">#45807</a>), Cohere citation/tool 500s fixed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5142417361" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52175" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52175/hovercard" href="https://github.com/vllm-project/vllm/pull/52175">#52175</a>), and stop string limit applied (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5247377261" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53750" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53750/hovercard" href="https://github.com/vllm-project/vllm/pull/53750">#53750</a>).</li>161<li><strong>OpenAI compatibility</strong>: <code>logprobs=-1</code> in Completions (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4702354344" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/46175" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/46175/hovercard" href="https://github.com/vllm-project/vllm/pull/46175">#46175</a>), streamed logprob offsets with echo (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4825254121" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47815" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47815/hovercard" href="https://github.com/vllm-project/vllm/pull/47815">#47815</a>), batched chat echo (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5164651710" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52529" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52529/hovercard" href="https://github.com/vllm-project/vllm/pull/52529">#52529</a>), all choices returned from <code>/inference/v1/generate</code> with n&gt;1 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5156330156" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52399" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52399/hovercard" href="https://github.com/vllm-project/vllm/pull/52399">#52399</a>), <code>cache_salt</code> forwarded for content parts (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5284869290" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54315" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54315/hovercard" href="https://github.com/vllm-project/vllm/pull/54315">#54315</a>), <code>stop_token_ids</code> validated against vocab (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5277040609" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54196" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54196/hovercard" href="https://github.com/vllm-project/vllm/pull/54196">#54196</a>), and 4xx for client errors in <code>/detokenize</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5172198842" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52622" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52622/hovercard" href="https://github.com/vllm-project/vllm/pull/52622">#52622</a>), malformed namespace tools (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5248350117" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53763" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53763/hovercard" href="https://github.com/vllm-project/vllm/pull/53763">#53763</a>), malformed base64 audio (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5247065549" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53744" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53744/hovercard" href="https://github.com/vllm-project/vllm/pull/53744">#53744</a>), and unknown chat roles in DeepSeek encoders (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5201157754" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53071" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53071/hovercard" href="https://github.com/vllm-project/vllm/pull/53071">#53071</a>); tool-call arguments in replayed history are parsed defensively (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4909019190" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48922" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48922/hovercard" href="https://github.com/vllm-project/vllm/pull/48922">#48922</a>), empty <code>FlatLogprobs</code> slices are handled (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5244170627" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53704" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53704/hovercard" href="https://github.com/vllm-project/vllm/pull/53704">#53704</a>), and empty bad-word tokenizations are rejected (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5225478969" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53433" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53433/hovercard" href="https://github.com/vllm-project/vllm/pull/53433">#53433</a>).</li>162<li><strong>Structured output &amp; parsers</strong>: reasoning-end detection scoped to the current turn (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5270715291" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54089" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54089/hovercard" href="https://github.com/vllm-project/vllm/pull/54089">#54089</a>), terminal grammars stop under <code>min_tokens</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5279444949" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54218" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54218/hovercard" href="https://github.com/vllm-project/vllm/pull/54218">#54218</a>), unsupported pattern+length schemas rejected (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4989352366" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49996" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49996/hovercard" href="https://github.com/vllm-project/vllm/pull/49996">#49996</a>), MistralCommonBackend tokenizers (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5179888512" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52720" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52720/hovercard" href="https://github.com/vllm-project/vllm/pull/52720">#52720</a>), XGrammar termination in batches (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5184712897" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52805" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52805/hovercard" href="https://github.com/vllm-project/vllm/pull/52805">#52805</a>), spurious FSM errors after speculative reasoning end (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5199654396" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53046" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53046/hovercard" href="https://github.com/vllm-project/vllm/pull/53046">#53046</a>), shared parser engine adapters (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5186240533" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52830" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52830/hovercard" href="https://github.com/vllm-project/vllm/pull/52830">#52830</a>), Gemma4 parenthesized tool calls (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5241193116" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53657" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53657/hovercard" href="https://github.com/vllm-project/vllm/pull/53657">#53657</a>) and <code>enable_thinking</code> default (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5157922888" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52430" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52430/hovercard" href="https://github.com/vllm-project/vllm/pull/52430">#52430</a>), HY-V3 parallel calls in one delta (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5262459954" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53965" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53965/hovercard" href="https://github.com/vllm-project/vllm/pull/53965">#53965</a>), GPT-OSS Harmony strict grammar (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5146121681" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52222" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52222/hovercard" href="https://github.com/vllm-project/vllm/pull/52222">#52222</a>), Kimi K3 reserved markers excluded from response text (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5189523224" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52889" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52889/hovercard" href="https://github.com/vllm-project/vllm/pull/52889">#52889</a>), and unused request-local reasoners skipped (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5168474415" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52573" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52573/hovercard" href="https://github.com/vllm-project/vllm/pull/52573">#52573</a>).</li>163<li><strong>Rust frontend</strong>: HY3 unified parser with local XGrammar structural tags (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5200108726" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53054" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53054/hovercard" href="https://github.com/vllm-project/vllm/pull/53054">#53054</a>), gRPC audio/video inputs (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5248097964" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53760" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53760/hovercard" href="https://github.com/vllm-project/vllm/pull/53760">#53760</a>), gRPC LoRA lifecycle control (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5187034854" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52840" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52840/hovercard" href="https://github.com/vllm-project/vllm/pull/52840">#52840</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5133870428" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52031" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52031/hovercard" href="https://github.com/vllm-project/vllm/pull/52031">#52031</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5247940651" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53756" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53756/hovercard" href="https://github.com/vllm-project/vllm/pull/53756">#53756</a>), <code>--generation-config vllm</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5199448971" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53044" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53044/hovercard" href="https://github.com/vllm-project/vllm/pull/53044">#53044</a>), <code>truncate_prompt_tokens</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4881046433" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48584" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48584/hovercard" href="https://github.com/vllm-project/vllm/pull/48584">#48584</a>), OpenAI edge-case alignment (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5211336411" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53218" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53218/hovercard" href="https://github.com/vllm-project/vllm/pull/53218">#53218</a>), optimized SSE hot path (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5085325841" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51321" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51321/hovercard" href="https://github.com/vllm-project/vllm/pull/51321">#51321</a>), pure-Rust <code>protox</code> replacing <code>protoc</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5189704536" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52892" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52892/hovercard" href="https://github.com/vllm-project/vllm/pull/52892">#52892</a>), RL world-size reporting (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5210206507" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53204" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53204/hovercard" href="https://github.com/vllm-project/vllm/pull/53204">#53204</a>) and routed expert prompt offsets (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5178920917" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52703" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52703/hovercard" href="https://github.com/vllm-project/vllm/pull/52703">#52703</a>), and fixes for GLM-5.2 template parity (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5092455028" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51426" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51426/hovercard" href="https://github.com/vllm-project/vllm/pull/51426">#51426</a>), Qwen parser auto-detection (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5072051228" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51169" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51169/hovercard" href="https://github.com/vllm-project/vllm/pull/51169">#51169</a>), Kimi K3 <code>reasoning_effort="none"</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5199401760" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53043" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53043/hovercard" href="https://github.com/vllm-project/vllm/pull/53043">#53043</a>), <code>n &gt; 1</code> rejection on <code>/inference/v1/generate</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5187627320" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52844" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52844/hovercard" href="https://github.com/vllm-project/vllm/pull/52844">#52844</a>), and the <code>LogprobsTensors</code> wire schema (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5260458913" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53939" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53939/hovercard" href="https://github.com/vllm-project/vllm/pull/53939">#53939</a>).</li>164<li><strong>Pooling</strong>: BGE-M3 throughput (+3.13%, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5227627215" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53464" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53464/hovercard" href="https://github.com/vllm-project/vllm/pull/53464">#53464</a>) and task validation (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5120627199" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51823" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51823/hovercard" href="https://github.com/vllm-project/vllm/pull/51823">#51823</a>), prompts truncated before padding (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5287568175" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54364" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54364/hovercard" href="https://github.com/vllm-project/vllm/pull/54364">#54364</a>), parallel arrays truncated with the prompt (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5291138665" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54407" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54407/hovercard" href="https://github.com/vllm-project/vllm/pull/54407">#54407</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5296990904" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54509" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54509/hovercard" href="https://github.com/vllm-project/vllm/pull/54509">#54509</a>), and batched input throughput in <code>vllm bench serve</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5210690624" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53213" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53213/hovercard" href="https://github.com/vllm-project/vllm/pull/53213">#53213</a>).</li>165<li><strong>CLI &amp; tooling</strong>: <code>vllm launch</code> runs the serve argument checks (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5185940058" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52825" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52825/hovercard" href="https://github.com/vllm-project/vllm/pull/52825">#52825</a>), <code>run_batch.py</code> moved out of the openai folder (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5230582851" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53500" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53500/hovercard" href="https://github.com/vllm-project/vllm/pull/53500">#53500</a>) with its upload retry fixed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5031185594" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50588" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50588/hovercard" href="https://github.com/vllm-project/vllm/pull/50588">#50588</a>), <code>vllm bench</code> warns on a warm prefix cache for random runs (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5259210791" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53920" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53920/hovercard" href="https://github.com/vllm-project/vllm/pull/53920">#53920</a>) and restores multimodal datasets on the <code>vllm</code> throughput backend (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5141922176" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52168" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52168/hovercard" href="https://github.com/vllm-project/vllm/pull/52168">#52168</a>), and the vLLM recipes tool gained sweep recommendations and alias parsing (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5218372543" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53325" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53325/hovercard" href="https://github.com/vllm-project/vllm/pull/53325">#53325</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5260815323" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53946" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53946/hovercard" href="https://github.com/vllm-project/vllm/pull/53946">#53946</a>).</li>166</ul>167<h2>Security</h2>168<ul>169<li><code>cache_salt</code> length bounded to 1024 to prevent scheduler CPU exhaustion (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5286769014" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54353" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54353/hovercard" href="https://github.com/vllm-project/vllm/pull/54353">#54353</a>).</li>170<li>Oversized media rejected before full download (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5125680263" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51896" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51896/hovercard" href="https://github.com/vllm-project/vllm/pull/51896">#51896</a>); <code>VLLM_MAX_AUDIO_CLIP_FILESIZE_MB</code> enforced on all audio paths (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5233508812" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53561" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53561/hovercard" href="https://github.com/vllm-project/vllm/pull/53561">#53561</a>).</li>171<li>Decoder prompt-length validation enforced for processors that skip the check (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4732705502" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/46588" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/46588/hovercard" href="https://github.com/vllm-project/vllm/pull/46588">#46588</a>); PyNvVideoCodec decoder slot limit bypass fixed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5139393086" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52126" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52126/hovercard" href="https://github.com/vllm-project/vllm/pull/52126">#52126</a>).</li>172<li><code>api_key</code> and <code>hf_token</code> redacted from startup logs, compile cache factors, and the Rust frontend launch log (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5164415222" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52523" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52523/hovercard" href="https://github.com/vllm-project/vllm/pull/52523">#52523</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5238741378" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53625" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53625/hovercard" href="https://github.com/vllm-project/vllm/pull/53625">#53625</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5246943808" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53738" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53738/hovercard" href="https://github.com/vllm-project/vllm/pull/53738">#53738</a>).</li>173</ul>174<h2>Dependencies</h2>175<ul>176<li>FlashInfer 0.6.18 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5284825458" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54313" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54313/hovercard" href="https://github.com/vllm-project/vllm/pull/54313">#54313</a>), huggingface-hub 1.28.0 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5184048784" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52797" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52797/hovercard" href="https://github.com/vllm-project/vllm/pull/52797">#52797</a>), tpu-inference v0.28.0 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5265461395" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54020" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54020/hovercard" href="https://github.com/vllm-project/vllm/pull/54020">#54020</a>), NIXL 1.3.2 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5117694715" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51777" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51777/hovercard" href="https://github.com/vllm-project/vllm/pull/51777">#51777</a>).</li>177<li>InstantTensor added to CUDA dependencies; the loader is not enabled by default (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5184105735" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52801" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52801/hovercard" href="https://github.com/vllm-project/vllm/pull/52801">#52801</a>). CuPy constraint relaxed to exclude only 14.1.0 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4569052177" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/44284" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/44284/hovercard" href="https://github.com/vllm-project/vllm/pull/44284">#44284</a>).</li>178<li>ROCm base image: ROCr/CLR update (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5244809469" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53712" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53712/hovercard" href="https://github.com/vllm-project/vllm/pull/53712">#53712</a>), rocprofiler-sdk 1.3.2 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5209421339" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53182" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53182/hovercard" href="https://github.com/vllm-project/vllm/pull/53182">#53182</a>), TheRock 7.14 preview (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4983770111" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49925" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49925/hovercard" href="https://github.com/vllm-project/vllm/pull/49925">#49925</a>), LMCache connector packages (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5076186627" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51208" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51208/hovercard" href="https://github.com/vllm-project/vllm/pull/51208">#51208</a>).</li>179<li>XPU: vllm_xpu_kernels 0.1.14.1 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5277684434" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54203" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54203/hovercard" href="https://github.com/vllm-project/vllm/pull/54203">#54203</a>), UCX install updated (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5252425369" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53817" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53817/hovercard" href="https://github.com/vllm-project/vllm/pull/53817">#53817</a>).</li>180<li>Build fails closed when the selected precompiled CUDA variant is unavailable (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5165593048" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52545" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52545/hovercard" href="https://github.com/vllm-project/vllm/pull/52545">#52545</a>).</li>181</ul>182<h2>Breaking Changes &amp; Deprecations</h2>183<ul>184<li>Ten deprecated architectures removed: Arctic, Chameleon, Cheers, Fairseq2Llama, FireRedLID, GritLM, HCXVision, MPT, the <code>RWForCausalLM</code> and <code>StableLMEpochForCausalLM</code> aliases, and <code>PrithviGeoSpatialMAE</code> (superseded by <code>Terratorch</code>) (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5237599903" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53608" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53608/hovercard" href="https://github.com/vllm-project/vllm/pull/53608">#53608</a>).</li>185<li>FlexOlmo, Olmo3, Hunyuan V1 and Hunyuan VL are now served through the Transformers modeling backend (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5238189101" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53615" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53615/hovercard" href="https://github.com/vllm-project/vllm/pull/53615">#53615</a>).</li>186<li>PyAV video decoder backend removed; use OpenCV or Torchcodec (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5279922155" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54231" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54231/hovercard" href="https://github.com/vllm-project/vllm/pull/54231">#54231</a>).</li>187<li><code>python -m vllm.entrypoints.openai.api_server</code> is deprecated; use <code>vllm serve</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5139471549" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52131" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52131/hovercard" href="https://github.com/vllm-project/vllm/pull/52131">#52131</a>).</li>188<li>Model Runner V2 is the default runner for all models (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5209436023" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53183" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53183/hovercard" href="https://github.com/vllm-project/vllm/pull/53183">#53183</a>).</li>189<li><code>prefix_cache_retention_interval</code> default changed from dense to 0 for SWA/SSM models; the env var is deprecated in favor of the argument (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5145771808" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52216" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52216/hovercard" href="https://github.com/vllm-project/vllm/pull/52216">#52216</a>).</li>190<li>FlashInfer all-reduce enabled by default (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5196781600" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52998" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52998/hovercard" href="https://github.com/vllm-project/vllm/pull/52998">#52998</a>).</li>191<li><code>VLLM_TEST_FORCE_FP8_MARLIN</code> removed in favor of <code>--linear-backend</code> / <code>--moe-backend</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5142686969" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52182" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52182/hovercard" href="https://github.com/vllm-project/vllm/pull/52182">#52182</a>); <code>VLLM_ROCM_USE_AITER_FP4_ASM_GEMM</code> removed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5205961808" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53141" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53141/hovercard" href="https://github.com/vllm-project/vllm/pull/53141">#53141</a>); dead <code>--attention-config.use_prefill_decode_attention</code> removed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5167066764" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52557" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52557/hovercard" href="https://github.com/vllm-project/vllm/pull/52557">#52557</a>); other long-deprecated parameters cleaned up (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5233285489" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53559" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53559/hovercard" href="https://github.com/vllm-project/vllm/pull/53559">#53559</a>).</li>192</ul>193<h2>New Contributors</h2>194<ul>195<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/030611/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/030611">@030611</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5120627199" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51823" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51823/hovercard" href="https://github.com/vllm-project/vllm/pull/51823">#51823</a></li>196<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/92hyungjun/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/92hyungjun">@92hyungjun</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4783990461" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47272" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47272/hovercard" href="https://github.com/vllm-project/vllm/pull/47272">#47272</a></li>197<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ActiveSky/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ActiveSky">@ActiveSky</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5178143135" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52692" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52692/hovercard" href="https://github.com/vllm-project/vllm/pull/52692">#52692</a></li>198<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/adisivaprasad/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/adisivaprasad">@adisivaprasad</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5254304672" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53854" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53854/hovercard" href="https://github.com/vllm-project/vllm/pull/53854">#53854</a></li>199<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Agoni-02/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Agoni-02">@Agoni-02</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4902578074" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48850" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48850/hovercard" href="https://github.com/vllm-project/vllm/pull/48850">#48850</a></li>200<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/AmitMY/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/AmitMY">@AmitMY</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4882623102" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48608" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48608/hovercard" href="https://github.com/vllm-project/vllm/pull/48608">#48608</a></li>201<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Andy365-365/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Andy365-365">@Andy365-365</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5164415222" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52523" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52523/hovercard" href="https://github.com/vllm-project/vllm/pull/52523">#52523</a></li>202<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/andyluo7/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/andyluo7">@andyluo7</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5252708600" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53821" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53821/hovercard" href="https://github.com/vllm-project/vllm/pull/53821">#53821</a></li>203<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/AnkitNakhawa/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/AnkitNakhawa">@AnkitNakhawa</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5162595398" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52491" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52491/hovercard" href="https://github.com/vllm-project/vllm/pull/52491">#52491</a></li>204<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/anmolgupt/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/anmolgupt">@anmolgupt</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5189161450" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52874" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52874/hovercard" href="https://github.com/vllm-project/vllm/pull/52874">#52874</a></li>205<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/bobboli/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/bobboli">@bobboli</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5127258176" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51924" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51924/hovercard" href="https://github.com/vllm-project/vllm/pull/51924">#51924</a></li>206<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/brianosaurus/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/brianosaurus">@brianosaurus</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5167066764" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52557" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52557/hovercard" href="https://github.com/vllm-project/vllm/pull/52557">#52557</a></li>207<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/CalvinXKY/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/CalvinXKY">@CalvinXKY</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5049295618" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50858" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50858/hovercard" href="https://github.com/vllm-project/vllm/pull/50858">#50858</a></li>208<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/canlahlah/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/canlahlah">@canlahlah</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5224370355" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53409" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53409/hovercard" href="https://github.com/vllm-project/vllm/pull/53409">#53409</a></li>209<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/CherryLemon/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/CherryLemon">@CherryLemon</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5256506704" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53877" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53877/hovercard" href="https://github.com/vllm-project/vllm/pull/53877">#53877</a></li>210<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/CHIPMUNK-T0T/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/CHIPMUNK-T0T">@CHIPMUNK-T0T</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4811392083" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47625" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47625/hovercard" href="https://github.com/vllm-project/vllm/pull/47625">#47625</a></li>211<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/cogniera/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/cogniera">@cogniera</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5253709794" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53839" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53839/hovercard" href="https://github.com/vllm-project/vllm/pull/53839">#53839</a></li>212<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/cr-zhao/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/cr-zhao">@cr-zhao</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5155009604" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52385" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52385/hovercard" href="https://github.com/vllm-project/vllm/pull/52385">#52385</a></li>213<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/daviswer/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/daviswer">@daviswer</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5179178405" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52706" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52706/hovercard" href="https://github.com/vllm-project/vllm/pull/52706">#52706</a></li>214<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/DCoEngine/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/DCoEngine">@DCoEngine</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4888766885" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48682" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48682/hovercard" href="https://github.com/vllm-project/vllm/pull/48682">#48682</a></li>215<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dineshchitlangia/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dineshchitlangia">@dineshchitlangia</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4966314300" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49688" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49688/hovercard" href="https://github.com/vllm-project/vllm/pull/49688">#49688</a></li>216<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dkrisman/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dkrisman">@dkrisman</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5289377865" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54380" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54380/hovercard" href="https://github.com/vllm-project/vllm/pull/54380">#54380</a></li>217<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dmvevents/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dmvevents">@dmvevents</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5173468412" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52632" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52632/hovercard" href="https://github.com/vllm-project/vllm/pull/52632">#52632</a></li>218<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Edge-Explorer/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Edge-Explorer">@Edge-Explorer</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5225511425" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53435" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53435/hovercard" href="https://github.com/vllm-project/vllm/pull/53435">#53435</a></li>219<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/eilamc14/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/eilamc14">@eilamc14</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4812313997" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47640" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47640/hovercard" href="https://github.com/vllm-project/vllm/pull/47640">#47640</a></li>220<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/eligotts/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/eligotts">@eligotts</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5284869290" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54315" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54315/hovercard" href="https://github.com/vllm-project/vllm/pull/54315">#54315</a></li>221<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Eoin-Houstoun/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Eoin-Houstoun">@Eoin-Houstoun</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5112014582" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51703" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51703/hovercard" href="https://github.com/vllm-project/vllm/pull/51703">#51703</a></li>222<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/floatlibai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/floatlibai">@floatlibai</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5140155788" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52144" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52144/hovercard" href="https://github.com/vllm-project/vllm/pull/52144">#52144</a></li>223<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fuzzifikation/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fuzzifikation">@fuzzifikation</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5061493469" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51034" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51034/hovercard" href="https://github.com/vllm-project/vllm/pull/51034">#51034</a></li>224<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hagaikwa-redhat/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hagaikwa-redhat">@hagaikwa-redhat</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5211678040" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53230" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53230/hovercard" href="https://github.com/vllm-project/vllm/pull/53230">#53230</a></li>225<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/haoyangqian/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/haoyangqian">@haoyangqian</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5177840622" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52690" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52690/hovercard" href="https://github.com/vllm-project/vllm/pull/52690">#52690</a></li>226<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Hert4/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Hert4">@Hert4</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5070709133" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51157" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51157/hovercard" href="https://github.com/vllm-project/vllm/pull/51157">#51157</a></li>227<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ima-helikoptaaa/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ima-helikoptaaa">@ima-helikoptaaa</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5292310719" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/54427" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/54427/hovercard" href="https://github.com/vllm-project/vllm/pull/54427">#54427</a></li>228<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jbyczkow/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jbyczkow">@jbyczkow</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5142330814" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52174" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52174/hovercard" href="https://github.com/vllm-project/vllm/pull/52174">#52174</a></li>229<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/JC-ut0/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/JC-ut0">@JC-ut0</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5201157754" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53071" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53071/hovercard" href="https://github.com/vllm-project/vllm/pull/53071">#53071</a></li>230<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jiahaoliang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jiahaoliang">@jiahaoliang</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5080909185" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51262" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51262/hovercard" href="https://github.com/vllm-project/vllm/pull/51262">#51262</a></li>231<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/JiataiWang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/JiataiWang">@JiataiWang</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5232825783" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53553" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53553/hovercard" href="https://github.com/vllm-project/vllm/pull/53553">#53553</a></li>232<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jl9876/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jl9876">@jl9876</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5079981233" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51248" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51248/hovercard" href="https://github.com/vllm-project/vllm/pull/51248">#51248</a></li>233<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/JulianZJN/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/JulianZJN">@JulianZJN</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5213350847" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53253" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53253/hovercard" href="https://github.com/vllm-project/vllm/pull/53253">#53253</a></li>234<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jungjiyu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jungjiyu">@jungjiyu</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5260458913" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53939" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53939/hovercard" href="https://github.com/vllm-project/vllm/pull/53939">#53939</a></li>235<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/kyleliang-nv/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/kyleliang-nv">@kyleliang-nv</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5075534328" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51203" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51203/hovercard" href="https://github.com/vllm-project/vllm/pull/51203">#51203</a></li>236<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LH-and-FPGA/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LH-and-FPGA">@LH-and-FPGA</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5174715929" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52648" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52648/hovercard" href="https://github.com/vllm-project/vllm/pull/52648">#52648</a></li>237<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/li-ukumar/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/li-ukumar">@li-ukumar</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5168113159" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52571" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52571/hovercard" href="https://github.com/vllm-project/vllm/pull/52571">#52571</a></li>238<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LioEinaudi/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LioEinaudi">@LioEinaudi</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5212728093" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53247" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53247/hovercard" href="https://github.com/vllm-project/vllm/pull/53247">#53247</a></li>239<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LironKesem/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LironKesem">@LironKesem</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5259223723" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53921" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53921/hovercard" href="https://github.com/vllm-project/vllm/pull/53921">#53921</a></li>240<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Lossfull/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Lossfull">@Lossfull</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5193245192" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52948" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52948/hovercard" href="https://github.com/vllm-project/vllm/pull/52948">#52948</a></li>241<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/lxy-alexander/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/lxy-alexander">@lxy-alexander</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5157922888" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52430" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52430/hovercard" href="https://github.com/vllm-project/vllm/pull/52430">#52430</a></li>242<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/lxyxinyi/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/lxyxinyi">@lxyxinyi</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5046146281" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50809" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50809/hovercard" href="https://github.com/vllm-project/vllm/pull/50809">#50809</a></li>243<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/machero/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/machero">@machero</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5231323743" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53531" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53531/hovercard" href="https://github.com/vllm-project/vllm/pull/53531">#53531</a></li>244<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/matthewkotila/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/matthewkotila">@matthewkotila</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4908287242" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48915" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48915/hovercard" href="https://github.com/vllm-project/vllm/pull/48915">#48915</a></li>245<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mhoqueanik/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mhoqueanik">@mhoqueanik</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4961919843" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49636" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49636/hovercard" href="https://github.com/vllm-project/vllm/pull/49636">#49636</a></li>246<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mhuzaifa3/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mhuzaifa3">@mhuzaifa3</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5238741378" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53625" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53625/hovercard" href="https://github.com/vllm-project/vllm/pull/53625">#53625</a></li>247<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/minjang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/minjang">@minjang</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5231289454" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53530" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53530/hovercard" href="https://github.com/vllm-project/vllm/pull/53530">#53530</a></li>248<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/MKQuantum/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/MKQuantum">@MKQuantum</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5124104450" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51866" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51866/hovercard" href="https://github.com/vllm-project/vllm/pull/51866">#51866</a></li>249<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/new-TonyWang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/new-TonyWang">@new-TonyWang</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5244170627" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53704" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53704/hovercard" href="https://github.com/vllm-project/vllm/pull/53704">#53704</a></li>250<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/nicholaskh-ai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/nicholaskh-ai">@nicholaskh-ai</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5252641623" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53819" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53819/hovercard" href="https://github.com/vllm-project/vllm/pull/53819">#53819</a></li>251<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/oliverholworthy/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/oliverholworthy">@oliverholworthy</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5142898516" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52185" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52185/hovercard" href="https://github.com/vllm-project/vllm/pull/52185">#52185</a></li>252<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/prakharPant/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/prakharPant">@prakharPant</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5180954309" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52743" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52743/hovercard" href="https://github.com/vllm-project/vllm/pull/52743">#52743</a></li>253<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Prudhvivuda/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Prudhvivuda">@Prudhvivuda</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5198011038" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53016" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53016/hovercard" href="https://github.com/vllm-project/vllm/pull/53016">#53016</a></li>254<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/rajathpi/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/rajathpi">@rajathpi</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5172198842" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52622" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52622/hovercard" href="https://github.com/vllm-project/vllm/pull/52622">#52622</a></li>255<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ray24777/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ray24777">@ray24777</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5204596603" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53120" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53120/hovercard" href="https://github.com/vllm-project/vllm/pull/53120">#53120</a></li>256<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/roachsinai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/roachsinai">@roachsinai</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5231273628" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53528" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53528/hovercard" href="https://github.com/vllm-project/vllm/pull/53528">#53528</a></li>257<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/RookieCoder-Camera/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/RookieCoder-Camera">@RookieCoder-Camera</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4935159122" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49274" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49274/hovercard" href="https://github.com/vllm-project/vllm/pull/49274">#49274</a></li>258<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/sandeep-maddipatla/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/sandeep-maddipatla">@sandeep-maddipatla</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5117694715" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51777" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51777/hovercard" href="https://github.com/vllm-project/vllm/pull/51777">#51777</a></li>259<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/seonjinn/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/seonjinn">@seonjinn</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5144692620" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52204" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52204/hovercard" href="https://github.com/vllm-project/vllm/pull/52204">#52204</a></li>260<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ShengleiFu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ShengleiFu">@ShengleiFu</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5240472066" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53650" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53650/hovercard" href="https://github.com/vllm-project/vllm/pull/53650">#53650</a></li>261<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shepark/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shepark">@shepark</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5084211010" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51302" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51302/hovercard" href="https://github.com/vllm-project/vllm/pull/51302">#51302</a></li>262<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shijuzhao/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shijuzhao">@shijuzhao</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4664004847" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/45683" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/45683/hovercard" href="https://github.com/vllm-project/vllm/pull/45683">#45683</a></li>263<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shipiyouniao/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shipiyouniao">@shipiyouniao</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5130003345" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51979" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51979/hovercard" href="https://github.com/vllm-project/vllm/pull/51979">#51979</a></li>264<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ShuaiShao93/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ShuaiShao93">@ShuaiShao93</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5199007710" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53034" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53034/hovercard" href="https://github.com/vllm-project/vllm/pull/53034">#53034</a></li>265<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/simon-veitner-redhat/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/simon-veitner-redhat">@simon-veitner-redhat</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5195404163" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52980" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52980/hovercard" href="https://github.com/vllm-project/vllm/pull/52980">#52980</a></li>266<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/sseanliu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/sseanliu">@sseanliu</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5134759141" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52041" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52041/hovercard" href="https://github.com/vllm-project/vllm/pull/52041">#52041</a></li>267<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/studioego/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/studioego">@studioego</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5155455899" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52389" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52389/hovercard" href="https://github.com/vllm-project/vllm/pull/52389">#52389</a></li>268<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tanchao/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tanchao">@tanchao</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5003831860" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50191" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50191/hovercard" href="https://github.com/vllm-project/vllm/pull/50191">#50191</a></li>269<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/thanhpt1110/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/thanhpt1110">@thanhpt1110</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5179888512" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52720" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52720/hovercard" href="https://github.com/vllm-project/vllm/pull/52720">#52720</a></li>270<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/theamalsebastian/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/theamalsebastian">@theamalsebastian</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5169450657" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52588" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52588/hovercard" href="https://github.com/vllm-project/vllm/pull/52588">#52588</a></li>271<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/thunguo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/thunguo">@thunguo</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5202873727" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53101" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53101/hovercard" href="https://github.com/vllm-project/vllm/pull/53101">#53101</a></li>272<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tolleybot/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tolleybot">@tolleybot</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5083618168" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51292" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51292/hovercard" href="https://github.com/vllm-project/vllm/pull/51292">#51292</a></li>273<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tommy-asai-sonarsource/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tommy-asai-sonarsource">@tommy-asai-sonarsource</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5090252678" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51395" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51395/hovercard" href="https://github.com/vllm-project/vllm/pull/51395">#51395</a></li>274<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tthakkal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tthakkal">@tthakkal</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5025615988" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50501" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50501/hovercard" href="https://github.com/vllm-project/vllm/pull/50501">#50501</a></li>275<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ukannika/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ukannika">@ukannika</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5187682710" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52849" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52849/hovercard" href="https://github.com/vllm-project/vllm/pull/52849">#52849</a></li>276<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/VBS2004/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/VBS2004">@VBS2004</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4909019190" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48922" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48922/hovercard" href="https://github.com/vllm-project/vllm/pull/48922">#48922</a></li>277<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wyettzeng/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wyettzeng">@wyettzeng</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5145232591" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52209" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52209/hovercard" href="https://github.com/vllm-project/vllm/pull/52209">#52209</a></li>278<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuan-1998/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuan-1998">@Xuan-1998</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5197472419" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53008" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53008/hovercard" href="https://github.com/vllm-project/vllm/pull/53008">#53008</a></li>279<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/y0hnn/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/y0hnn">@y0hnn</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5132036711" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52002" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52002/hovercard" href="https://github.com/vllm-project/vllm/pull/52002">#52002</a></li>280<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Yiqin-17/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Yiqin-17">@Yiqin-17</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5191315493" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52925" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52925/hovercard" href="https://github.com/vllm-project/vllm/pull/52925">#52925</a></li>281<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/YukioZzz/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/YukioZzz">@YukioZzz</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5112328984" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51705" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51705/hovercard" href="https://github.com/vllm-project/vllm/pull/51705">#51705</a></li>282<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ZHIHANCHEN03/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ZHIHANCHEN03">@ZHIHANCHEN03</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5225466209" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/53432" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/53432/hovercard" href="https://github.com/vllm-project/vllm/pull/53432">#53432</a></li>283<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Zhou248/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Zhou248">@Zhou248</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5167704960" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52560" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52560/hovercard" href="https://github.com/vllm-project/vllm/pull/52560">#52560</a></li>284<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zllion/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zllion">@zllion</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4741800584" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/46701" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/46701/hovercard" href="https://github.com/vllm-project/vllm/pull/46701">#46701</a></li>285<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zwischenraum/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zwischenraum">@zwischenraum</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5009940371" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50272" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50272/hovercard" href="https://github.com/vllm-project/vllm/pull/50272">#50272</a></li>286</ul>287<h2>Contributors</h2>288<p><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/AndreasKaratzas/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/AndreasKaratzas">@AndreasKaratzas</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/khluu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/khluu">@khluu</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mgoin/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mgoin">@mgoin</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/taneem-ibrahim/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/taneem-ibrahim">@taneem-ibrahim</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yewentao256/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yewentao256">@yewentao256</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/njhill/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/njhill">@njhill</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BugenZhao/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BugenZhao">@BugenZhao</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hmellor/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hmellor">@hmellor</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/GirasoleY/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/GirasoleY">@GirasoleY</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/DarkLight1337/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/DarkLight1337">@DarkLight1337</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mayuyuace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mayuyuace">@mayuyuace</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/WoosukKwon/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/WoosukKwon">@WoosukKwon</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jeejeelee/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jeejeelee">@jeejeelee</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/noooop/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/noooop">@noooop</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jperezdealgaba/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jperezdealgaba">@jperezdealgaba</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LucasWilkinson/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LucasWilkinson">@LucasWilkinson</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wzhao18/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wzhao18">@wzhao18</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/stefankoncarevic/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/stefankoncarevic">@stefankoncarevic</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gau-nernst/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gau-nernst">@gau-nernst</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/okorzh-amd/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/okorzh-amd">@okorzh-amd</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ZJY0516/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ZJY0516">@ZJY0516</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/HollowMan6/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/HollowMan6">@HollowMan6</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/connorcarpenter15/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/connorcarpenter15">@connorcarpenter15</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gcanlin/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gcanlin">@gcanlin</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/aoshen02/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/aoshen02">@aoshen02</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/linitra24/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/linitra24">@linitra24</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mhuzaifa3/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mhuzaifa3">@mhuzaifa3</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Isotr0py/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Isotr0py">@Isotr0py</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Etelis/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Etelis">@Etelis</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/MatthewBonanni/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/MatthewBonanni">@MatthewBonanni</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/TheEpicDolphin/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/TheEpicDolphin">@TheEpicDolphin</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zupengwang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zupengwang">@zupengwang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/atalman/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/atalman">@atalman</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/NickLucche/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/NickLucche">@NickLucche</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/rasmith/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/rasmith">@rasmith</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/elvircrn/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/elvircrn">@elvircrn</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/JasonKeyiL/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/JasonKeyiL">@JasonKeyiL</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Hotragn/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Hotragn">@Hotragn</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/waizuichougou/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/waizuichougou">@waizuichougou</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/pmanczak/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/pmanczak">@pmanczak</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/divakar-amd/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/divakar-amd">@divakar-amd</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/he-yufeng/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/he-yufeng">@he-yufeng</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/xuebwang-amd/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/xuebwang-amd">@xuebwang-amd</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/qgallouedec/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/qgallouedec">@qgallouedec</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/esmeetu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/esmeetu">@esmeetu</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ZeldaHuang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ZeldaHuang">@ZeldaHuang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Prudhvivuda/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Prudhvivuda">@Prudhvivuda</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/chaunceyjiang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/chaunceyjiang">@chaunceyjiang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zxd1997066/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zxd1997066">@zxd1997066</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/louie-tsai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/louie-tsai">@louie-tsai</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/andyxning/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/andyxning">@andyxning</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/pisceskkk/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/pisceskkk">@pisceskkk</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tjtanaa/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tjtanaa">@tjtanaa</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/qli88/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/qli88">@qli88</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tlrmchlsmth/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tlrmchlsmth">@tlrmchlsmth</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LopezCastroRoberto/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LopezCastroRoberto">@LopezCastroRoberto</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/micah-wil/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/micah-wil">@micah-wil</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hongxiayang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hongxiayang">@hongxiayang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BabyDrangoner/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BabyDrangoner">@BabyDrangoner</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yimdev/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yimdev">@yimdev</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mganczarenko/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mganczarenko">@mganczarenko</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/SageMoore/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/SageMoore">@SageMoore</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/biswapanda/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/biswapanda">@biswapanda</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/sfeng33/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/sfeng33">@sfeng33</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/russellb/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/russellb">@russellb</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/itayalroy/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/itayalroy">@itayalroy</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/bigPYJ1151/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/bigPYJ1151">@bigPYJ1151</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/drakosha/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/drakosha">@drakosha</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/qwerqwerqwe8688-jpg/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/qwerqwerqwe8688-jpg">@qwerqwerqwe8688-jpg</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/akii96/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/akii96">@akii96</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shen-shanshan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shen-shanshan">@shen-shanshan</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/meiyeh123/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/meiyeh123">@meiyeh123</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/reidliu41/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/reidliu41">@reidliu41</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yma11/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yma11">@yma11</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/frgossen/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/frgossen">@frgossen</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/lukealonso/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/lukealonso">@lukealonso</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tanchao/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tanchao">@tanchao</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Fangzhou-Ai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Fangzhou-Ai">@Fangzhou-Ai</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/vllm-agent/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/vllm-agent">@vllm-agent</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/djramic/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/djramic">@djramic</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/andrewbcohere/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/andrewbcohere">@andrewbcohere</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zyongye/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zyongye">@zyongye</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gty111/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gty111">@gty111</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ShuoleiWang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ShuoleiWang">@ShuoleiWang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ZHIHANCHEN03/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ZHIHANCHEN03">@ZHIHANCHEN03</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/KurodaKanbei/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/KurodaKanbei">@KurodaKanbei</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/alexeldeib/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/alexeldeib">@alexeldeib</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/khushali9/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/khushali9">@khushali9</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/xiaohuguo2023/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/xiaohuguo2023">@xiaohuguo2023</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hungnnvidia/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hungnnvidia">@hungnnvidia</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/thisjiang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/thisjiang">@thisjiang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/arpera/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/arpera">@arpera</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ShengleiFu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ShengleiFu">@ShengleiFu</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zhenwei-intel/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zhenwei-intel">@zhenwei-intel</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jungjiyu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jungjiyu">@jungjiyu</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yzong-rh/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yzong-rh">@yzong-rh</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/charlifu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/charlifu">@charlifu</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hclsys/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hclsys">@hclsys</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Ronald1995/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Ronald1995">@Ronald1995</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mkhazraee/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mkhazraee">@mkhazraee</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/YukioZzz/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/YukioZzz">@YukioZzz</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/theamalsebastian/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/theamalsebastian">@theamalsebastian</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/030611/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/030611">@030611</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/cr-zhao/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/cr-zhao">@cr-zhao</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jbyczkow/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jbyczkow">@jbyczkow</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tommy-asai-sonarsource/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tommy-asai-sonarsource">@tommy-asai-sonarsource</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jikunshang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jikunshang">@jikunshang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/bobboli/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/bobboli">@bobboli</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LH-and-FPGA/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LH-and-FPGA">@LH-and-FPGA</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/SayHelloToWorld/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/SayHelloToWorld">@SayHelloToWorld</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/kkt-cohere/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/kkt-cohere">@kkt-cohere</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/floatlibai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/floatlibai">@floatlibai</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/rajathpi/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/rajathpi">@rajathpi</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/lxy-alexander/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/lxy-alexander">@lxy-alexander</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gangula-karthik/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gangula-karthik">@gangula-karthik</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ActiveSky/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ActiveSky">@ActiveSky</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fxmarty-amd/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fxmarty-amd">@fxmarty-amd</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/sstamenk/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/sstamenk">@sstamenk</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mpashkovskii/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mpashkovskii">@mpashkovskii</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LiuYinfeng01/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LiuYinfeng01">@LiuYinfeng01</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/chaojun-zhang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/chaojun-zhang">@chaojun-zhang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Oxygen56/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Oxygen56">@Oxygen56</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/daviswer/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/daviswer">@daviswer</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/vineethsaivs/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/vineethsaivs">@vineethsaivs</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Agoni-02/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Agoni-02">@Agoni-02</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Andy365-365/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Andy365-365">@Andy365-365</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wangxiyuan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wangxiyuan">@wangxiyuan</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/haoyangqian/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/haoyangqian">@haoyangqian</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Naveassaf/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Naveassaf">@Naveassaf</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/eilamc14/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/eilamc14">@eilamc14</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/sseanliu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/sseanliu">@sseanliu</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/y0hnn/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/y0hnn">@y0hnn</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dineshchitlangia/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dineshchitlangia">@dineshchitlangia</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yiliu30/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yiliu30">@yiliu30</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Lossfull/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Lossfull">@Lossfull</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/lxyxinyi/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/lxyxinyi">@lxyxinyi</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/vanshbhatia-amd/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/vanshbhatia-amd">@vanshbhatia-amd</a>, @jcotant-inferact, @chengy-sysu, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/92hyungjun/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/92hyungjun">@92hyungjun</a>, @xyang16, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/AmitMY/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/AmitMY">@AmitMY</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zllion/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zllion">@zllion</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/AnkitNakhawa/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/AnkitNakhawa">@AnkitNakhawa</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dmvevents/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dmvevents">@dmvevents</a>, @lengrongfu, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/JC-ut0/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/JC-ut0">@JC-ut0</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Eoin-Houstoun/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Eoin-Houstoun">@Eoin-Houstoun</a>, @sagearc, @wjabbour, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/sandeep-maddipatla/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/sandeep-maddipatla">@sandeep-maddipatla</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/seonjinn/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/seonjinn">@seonjinn</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Yiqin-17/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Yiqin-17">@Yiqin-17</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/kyleliang-nv/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/kyleliang-nv">@kyleliang-nv</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/thanhpt1110/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/thanhpt1110">@thanhpt1110</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/MKQuantum/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/MKQuantum">@MKQuantum</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/matthewkotila/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/matthewkotila">@matthewkotila</a>, @vhagor, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tthakkal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tthakkal">@tthakkal</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ShuaiShao93/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ShuaiShao93">@ShuaiShao93</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hagaikwa-redhat/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hagaikwa-redhat">@hagaikwa-redhat</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shijuzhao/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shijuzhao">@shijuzhao</a>, @elwhyjay, @Gregory-Pereira, @ErenAta16, @morrison-turnansky, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/DCoEngine/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/DCoEngine">@DCoEngine</a>, @SoluMilken, @xianbaoqian, @kliuae, @nascheme, @waynehacking8, @stecasta, @vMaroon, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zwischenraum/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zwischenraum">@zwischenraum</a>, @Rohan138, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Zhou248/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Zhou248">@Zhou248</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/brianosaurus/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/brianosaurus">@brianosaurus</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/anmolgupt/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/anmolgupt">@anmolgupt</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wyettzeng/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wyettzeng">@wyettzeng</a>, @hao-aaron, @frank-suwen, @danisereb, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fuzzifikation/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fuzzifikation">@fuzzifikation</a>, @KernelClint, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/thunguo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/thunguo">@thunguo</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/studioego/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/studioego">@studioego</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shipiyouniao/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shipiyouniao">@shipiyouniao</a>, @cjackal, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LioEinaudi/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LioEinaudi">@LioEinaudi</a>, @guan404ming, @libinta, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mhoqueanik/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mhoqueanik">@mhoqueanik</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/minjang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/minjang">@minjang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Edge-Explorer/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Edge-Explorer">@Edge-Explorer</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shepark/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shepark">@shepark</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/JiataiWang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/JiataiWang">@JiataiWang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jiahaoliang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jiahaoliang">@jiahaoliang</a>, @therealnaveenkamal, @ColinZ22, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tolleybot/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tolleybot">@tolleybot</a>, @almogtavor, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/simon-veitner-redhat/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/simon-veitner-redhat">@simon-veitner-redhat</a>, @hyeongyun0916, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/nicholaskh-ai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/nicholaskh-ai">@nicholaskh-ai</a>, @mawong-amd, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/adisivaprasad/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/adisivaprasad">@adisivaprasad</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ray24777/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ray24777">@ray24777</a>, @robertgshaw2-redhat, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/new-TonyWang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/new-TonyWang">@new-TonyWang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/oliverholworthy/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/oliverholworthy">@oliverholworthy</a>, @fanxingran, @lucianommartins, @hallerite, @avininjamay8, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/VBS2004/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/VBS2004">@VBS2004</a>, @omerpaz95, @Sunt-ing, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Hert4/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Hert4">@Hert4</a>, @wangshangsam, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/cogniera/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/cogniera">@cogniera</a>, @jeffreywang88, @Xarbirus, @fynnsu, @jiahanc, @zixi-qi, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/prakharPant/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/prakharPant">@prakharPant</a>, @haic0, @maobaolong, @xinyu-intel, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/CHIPMUNK-T0T/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/CHIPMUNK-T0T">@CHIPMUNK-T0T</a>, @hangy-amd, @afriedri, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/canlahlah/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/canlahlah">@canlahlah</a>, @Alnusjaponica, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ukannika/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ukannika">@ukannika</a>, @pranavthakur0-0, @zzaebok, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuan-1998/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuan-1998">@Xuan-1998</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/JulianZJN/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/JulianZJN">@JulianZJN</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/roachsinai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/roachsinai">@roachsinai</a>, @ivanium, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/CalvinXKY/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/CalvinXKY">@CalvinXKY</a>, @yu-xin-c, @rchalamala, @QwertyJack, @Kaif10, @yudigege86, @yiz-liu, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dkrisman/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dkrisman">@dkrisman</a>, @simondanielsson, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/machero/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/machero">@machero</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/CherryLemon/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/CherryLemon">@CherryLemon</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ima-helikoptaaa/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ima-helikoptaaa">@ima-helikoptaaa</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/RookieCoder-Camera/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/RookieCoder-Camera">@RookieCoder-Camera</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LironKesem/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LironKesem">@LironKesem</a>, @peakcrosser7, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/eligotts/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/eligotts">@eligotts</a>, @foraxe, @zufangzhu, @tianmu-li, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jl9876/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jl9876">@jl9876</a>, @lucifer1004, @liranschour, @maithilijoshi20, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/li-ukumar/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/li-ukumar">@li-ukumar</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/andyluo7/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/andyluo7">@andyluo7</a>, @Zhenzhong1, @faaany, @joerowell, @juhi10071998, @ganeshr10, @Priyjain-amd, @SubSir, @luyixiao95, @djw8605, @codex</p></content>289 <author>290 <name>khluu</name>291 </author>292 <media:thumbnail height="30" width="30" url="https://avatars.githubusercontent.com/u/51931015?s=60&v=4"/>293 </entry>294 <entry>295 <id>tag:github.com,2008:Repository/599547518/v0.29.0rc6</id>296 <updated>2026-09-08T08:34:20Z</updated>297 <link rel="alternate" type="text/html" href="https://github.com/vllm-project/vllm/releases/tag/v0.29.0rc6"/>298 <title>v0.29.0rc6</title>299 <content type="html"><p>[Bugfix][Core] Apply dense prefix cache default to hybrid models (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1693327998" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/55" data-hovercard-type="issue" data-hovercard-url="/vllm-project/vllm/issues/55/hovercard" href="https://github.com/vllm-project/vllm/issues/55">#55</a>…</p></content>300 <author>301 <name>ZJY0516</name>302 </author>303 <media:thumbnail height="30" width="30" url="https://avatars.githubusercontent.com/u/86695626?s=60&v=4"/>304 </entry>305 <entry>306 <id>tag:github.com,2008:Repository/599547518/v0.29.0rc5</id>307 <updated>2026-09-08T08:20:33Z</updated>308 <link rel="alternate" type="text/html" href="https://github.com/vllm-project/vllm/releases/tag/v0.29.0rc5"/>309 <title>v0.29.0rc5</title>310 <content type="html"><p>[Core] Default prefix_cache_retention_interval to dense for Mamba + E…</p></content>311 <author>312 <name>ZJY0516</name>313 </author>314 <media:thumbnail height="30" width="30" url="https://avatars.githubusercontent.com/u/86695626?s=60&v=4"/>315 </entry>316 <entry>317 <id>tag:github.com,2008:Repository/599547518/v0.29.0rc4</id>318 <updated>2026-09-04T22:58:29Z</updated>319 <link rel="alternate" type="text/html" href="https://github.com/vllm-project/vllm/releases/tag/v0.29.0rc4"/>320 <title>v0.29.0rc4: [Bugfix] Avoid sync in TRT-LLM ragged prefill</title>321 <content type="html"><p>Generated-by: Codex <a href="mailto:codex@openai.com">codex@openai.com</a></p>322<p>Signed-off-by: Codex <a href="mailto:codex@openai.com">codex@openai.com</a></p></content>323 <author>324 <name>codex</name>325 </author>326 <media:thumbnail height="30" width="30" url="https://avatars.githubusercontent.com/u/267193182?s=60&v=4"/>327 </entry>328 <entry>329 <id>tag:github.com,2008:Repository/599547518/v0.29.0rc3</id>330 <updated>2026-09-04T00:52:54Z</updated>331 <link rel="alternate" type="text/html" href="https://github.com/vllm-project/vllm/releases/tag/v0.29.0rc3"/>332 <title>v0.29.0rc3</title>333 <content type="html"><p>[CI] Remove deleted nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF1…</p></content>334 <author>335 <name>khluu</name>336 </author>337 <media:thumbnail height="30" width="30" url="https://avatars.githubusercontent.com/u/51931015?s=60&v=4"/>338 </entry>339 <entry>340 <id>tag:github.com,2008:Repository/599547518/v0.29.0rc2</id>341 <updated>2026-09-03T09:41:12Z</updated>342 <link rel="alternate" type="text/html" href="https://github.com/vllm-project/vllm/releases/tag/v0.29.0rc2"/>343 <title>v0.29.0rc2</title>344 <content type="html"><p>[Bugfix][Multimodal] Handle prefix-covered items in SHM worker cache …</p></content>345 <author>346 <name>waizuichougou</name>347 </author>348 <media:thumbnail height="30" width="30" url="https://avatars.githubusercontent.com/u/105572299?s=60&v=4"/>349 </entry>350 <entry>351 <id>tag:github.com,2008:Repository/599547518/v0.29.0rc1</id>352 <updated>2026-09-02T02:11:30Z</updated>353 <link rel="alternate" type="text/html" href="https://github.com/vllm-project/vllm/releases/tag/v0.29.0rc1"/>354 <title>v0.29.0rc1: [Bugfix] Handle padded routes in CUTLASS MoE permutations (#54747)</title>355 <content type="html"><p>Signed-off-by: Kevin Luu <a href="mailto:51931015+khluu@users.noreply.github.com">51931015+khluu@users.noreply.github.com</a><br>356Signed-off-by: Yongye Zhu <a href="mailto:zyy1102000@gmail.com">zyy1102000@gmail.com</a><br>357Co-authored-by: Codex <a href="mailto:codex@openai.com">codex@openai.com</a><br>358Co-authored-by: Yongye Zhu <a href="mailto:zyy1102000@gmail.com">zyy1102000@gmail.com</a></p></content>359 <author>360 <name>khluu</name>361 </author>362 <media:thumbnail height="30" width="30" url="https://avatars.githubusercontent.com/u/51931015?s=60&v=4"/>363 </entry>364 <entry>365 <id>tag:github.com,2008:Repository/599547518/v0.28.1rc0</id>366 <updated>2026-08-27T06:58:23Z</updated>367 <link rel="alternate" type="text/html" href="https://github.com/vllm-project/vllm/releases/tag/v0.28.1rc0"/>368 <title>v0.28.1rc0</title>369 <content type="html"><p>[Tools][Recipes] Improve sweep recommendations and short-alias parsin…</p></content>370 <author>371 <name>louie-tsai</name>372 </author>373 <media:thumbnail height="30" width="30" url="https://avatars.githubusercontent.com/u/21761437?s=60&v=4"/>374 </entry>375 <entry>376 <id>tag:github.com,2008:Repository/599547518/v0.28.0</id>377 <updated>2026-08-26T10:17:05Z</updated>378 <link rel="alternate" type="text/html" href="https://github.com/vllm-project/vllm/releases/tag/v0.28.0"/>379 <title>v0.28.0</title>380 <content type="html"><h1>v0.28.0</h1>381<h2>Highlights</h2>382<p>This release features 584 commits from 270 contributors (76 new)!</p>383<ul>384<li><strong>Kimi-K3 performance push</strong>: a major optimization effort for Kimi-K3 across the stack — Decode Context Parallel (DCP) support (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5024323514" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50484" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50484/hovercard" href="https://github.com/vllm-project/vllm/pull/50484">#50484</a>), fused FlashKDA decode and prefill kernels (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5035155331" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50654" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50654/hovercard" href="https://github.com/vllm-project/vllm/pull/50654">#50654</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5084819738" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51311" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51311/hovercard" href="https://github.com/vllm-project/vllm/pull/51311">#51311</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5160378588" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52458" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52458/hovercard" href="https://github.com/vllm-project/vllm/pull/52458">#52458</a>), SiTU activation support for MegaMoE (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5026036754" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50510" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50510/hovercard" href="https://github.com/vllm-project/vllm/pull/50510">#50510</a>), GEMM-RS for sequence parallelism (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5136777880" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52079" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52079/hovercard" href="https://github.com/vllm-project/vllm/pull/52079">#52079</a>), combined all-gathers with 1.5~3x kernel-level speedup (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5064176312" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51070" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51070/hovercard" href="https://github.com/vllm-project/vllm/pull/51070">#51070</a>), an adaptive speculative token budget delivering ~60% better DSpark TTFT (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5113682718" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51725" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51725/hovercard" href="https://github.com/vllm-project/vllm/pull/51725">#51725</a>), and optional shared-expert sharding saving ~17 GiB of memory per GPU (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5053646772" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50912" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50912/hovercard" href="https://github.com/vllm-project/vllm/pull/50912">#50912</a>). Kimi-K3 also now runs on ROCm with the V2 model runner (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5108926237" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51653" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51653/hovercard" href="https://github.com/vllm-project/vllm/pull/51653">#51653</a>).</li>385<li><strong>DeepSeek V4</strong>: sparse MLA now works end-to-end for plain decode, MTP, and DSpark speculative decoding (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5101531400" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51538" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51538/hovercard" href="https://github.com/vllm-project/vllm/pull/51538">#51538</a>), joined by AMD Quark NVFP4 support (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4835520784" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47972" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47972/hovercard" href="https://github.com/vllm-project/vllm/pull/47972">#47972</a>), reasoning-effort prompts and mappings (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5030980529" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50580" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50580/hovercard" href="https://github.com/vllm-project/vllm/pull/50580">#50580</a>), sparse top-k metadata kernel optimizations (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5137310673" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52084" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52084/hovercard" href="https://github.com/vllm-project/vllm/pull/52084">#52084</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5129184600" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51967" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51967/hovercard" href="https://github.com/vllm-project/vllm/pull/51967">#51967</a>), narrowed eager CUDA graph regions (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5092896769" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51430" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51430/hovercard" href="https://github.com/vllm-project/vllm/pull/51430">#51430</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5156348462" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52401" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52401/hovercard" href="https://github.com/vllm-project/vllm/pull/52401">#52401</a>), and ROCm enablement on gfx11 and gfx950 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4766317415" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47017" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47017/hovercard" href="https://github.com/vllm-project/vllm/pull/47017">#47017</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5145545577" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52212" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52212/hovercard" href="https://github.com/vllm-project/vllm/pull/52212">#52212</a>).</li>386<li><strong>Speculative decoding advances</strong>: DFlash2 with local convolution and a candidate selector (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5185508751" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52816" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52816/hovercard" href="https://github.com/vllm-project/vllm/pull/52816">#52816</a>), DSpark confidence-scheduled verification (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4824929811" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47808" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47808/hovercard" href="https://github.com/vllm-project/vllm/pull/47808">#47808</a>), and async scheduling auto-enabled for draft models (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4862124280" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48341" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48341/hovercard" href="https://github.com/vllm-project/vllm/pull/48341">#48341</a>).</li>387<li><strong>Model Runner V2 maturation</strong>: E/P/D disaggregation (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4155353913" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/38390" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/38390/hovercard" href="https://github.com/vllm-project/vllm/pull/38390">#38390</a>), weight offloading (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5091635999" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51413" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51413/hovercard" href="https://github.com/vllm-project/vllm/pull/51413">#51413</a>), multi-layer MTP KV cache support (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4993780584" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50062" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50062/hovercard" href="https://github.com/vllm-project/vllm/pull/50062">#50062</a>), encoder CUDA graphs (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4979046200" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49852" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49852/hovercard" href="https://github.com/vllm-project/vllm/pull/49852">#49852</a>), decoder token-wise pooling (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5055136007" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50931" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50931/hovercard" href="https://github.com/vllm-project/vllm/pull/50931">#50931</a>) plus Transformers pooling models (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5157751117" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52425" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52425/hovercard" href="https://github.com/vllm-project/vllm/pull/52425">#52425</a>), attention-free models (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5154157605" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52374" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52374/hovercard" href="https://github.com/vllm-project/vllm/pull/52374">#52374</a>), and <code>thinking_token_budget</code> support (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4744261944" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/46727" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/46727/hovercard" href="https://github.com/vllm-project/vllm/pull/46727">#46727</a>).</li>388<li><strong>Tiered KV cache offloading</strong>: disk offloading support (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4963653413" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49644" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49644/hovercard" href="https://github.com/vllm-project/vllm/pull/49644">#49644</a>), out-of-tree secondary tier managers via <code>module_path</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5058868734" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51007" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51007/hovercard" href="https://github.com/vllm-project/vllm/pull/51007">#51007</a>), partial secondary-tier load results (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5013391634" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50321" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50321/hovercard" href="https://github.com/vllm-project/vllm/pull/50321">#50321</a>), tiering metrics (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4898117346" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48798" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48798/hovercard" href="https://github.com/vllm-project/vllm/pull/48798">#48798</a>), and a canonical CPU layout for parallelism-agnostic offload (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4867574663" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48414" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48414/hovercard" href="https://github.com/vllm-project/vllm/pull/48414">#48414</a>).</li>389<li><strong>Rust frontend &amp; gRPC</strong>: a standalone renderer (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5011355404" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50289" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50289/hovercard" href="https://github.com/vllm-project/vllm/pull/50289">#50289</a>), multimodal image inference over gRPC (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5015640495" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50368" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50368/hovercard" href="https://github.com/vllm-project/vllm/pull/50368">#50368</a>), explicit data-parallel rank routing (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5072919309" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51178" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51178/hovercard" href="https://github.com/vllm-project/vllm/pull/51178">#51178</a>), and RL lifecycle control (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5084945361" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51316" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51316/hovercard" href="https://github.com/vllm-project/vllm/pull/51316">#51316</a>), with protobuf schemas now published to Buf (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5082805927" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51276" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51276/hovercard" href="https://github.com/vllm-project/vllm/pull/51276">#51276</a>).</li>390<li><strong>New defaults</strong>: <code>max_num_batched_tokens</code> raised from 8192 to 16384 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5113757558" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51726" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51726/hovercard" href="https://github.com/vllm-project/vllm/pull/51726">#51726</a>), prefix caching enabled by default for Mamba models (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5057990179" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50991" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50991/hovercard" href="https://github.com/vllm-project/vllm/pull/50991">#50991</a>), and the Blackwell CUDA graph capture default raised to 1024 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4944760977" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49390" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49390/hovercard" href="https://github.com/vllm-project/vllm/pull/49390">#49390</a>).</li>391<li><strong>Breaking changes</strong>: bitsandbytes support migrated to an out-of-tree plugin (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4512000173" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/43529" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/43529/hovercard" href="https://github.com/vllm-project/vllm/pull/43529">#43529</a>); Transformers bumped to 5.15.0 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5109844757" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51668" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51668/hovercard" href="https://github.com/vllm-project/vllm/pull/51668">#51668</a>); the deprecated <code>calculate_kv_scales</code> runtime KV scale calculation was removed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4944675936" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49389" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49389/hovercard" href="https://github.com/vllm-project/vllm/pull/49389">#49389</a>); <code>override_attention_dtype</code> was removed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4888820267" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48684" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48684/hovercard" href="https://github.com/vllm-project/vllm/pull/48684">#48684</a>).</li>392</ul>393<h2>Release Artifacts</h2>394<h3>Python Wheels</h3>395<table>396<thead>397<tr>398<th>Platform</th>399<th>Install</th>400</tr>401</thead>402<tbody>403<tr>404<td>PyPI (CUDA 13.0)</td>405<td><code>pip install vllm</code></td>406</tr>407<tr>408<td>PyPI (CUDA 13.0, uv)</td>409<td><code>uv pip install vllm --torch-backend=auto</code></td>410</tr>411<tr>412<td>ROCm</td>413<td><code>pip install vllm --extra-index-url https://wheels.vllm.ai/rocm/0.28.0/rocm722</code></td>414</tr>415</tbody>416</table>417<h3>Docker Images</h3>418<table>419<thead>420<tr>421<th>Platform</th>422<th>Docker Image</th>423</tr>424</thead>425<tbody>426<tr>427<td>CUDA 13.0 (Default)</td>428<td><code>docker pull vllm/vllm-openai:v0.28.0</code> (<code>v0.28.0-cu130</code> also works)</td>429</tr>430<tr>431<td>CUDA 12.9</td>432<td><code>docker pull vllm/vllm-openai:v0.28.0-cu129</code></td>433</tr>434<tr>435<td>CUDA 13.0 + Ubuntu 24.04</td>436<td><code>docker pull vllm/vllm-openai:v0.28.0-ubuntu2404</code></td>437</tr>438<tr>439<td>CUDA 12.9 + Ubuntu 24.04</td>440<td><code>docker pull vllm/vllm-openai:v0.28.0-cu129-ubuntu2404</code></td>441</tr>442<tr>443<td>ROCm</td>444<td><code>docker pull vllm/vllm-openai-rocm:v0.28.0</code></td>445</tr>446<tr>447<td>CPU</td>448<td><code>docker pull vllm/vllm-openai-cpu:v0.28.0</code></td>449</tr>450<tr>451<td>XPU</td>452<td><code>docker pull vllm/vllm-openai-xpu:v0.28.0</code></td>453</tr>454</tbody>455</table>456<h3>Other Artifacts</h3>457<p>Pre-built release artifacts are available in the <strong>Assets</strong> section at the bottom of this page, including:</p>458<ul>459<li>Source distribution tarball</li>460<li>CUDA 12.9 Python wheels for x86_64 and arm64</li>461<li>CUDA 13.0 Python wheels for x86_64 and arm64</li>462<li>CPU Python wheels for x86_64, arm64, and macOS</li>463</ul>464<h2>Model Support</h2>465<ul>466<li><strong>New models</strong>: Muse Glimmer (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5109068083" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51655" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51655/hovercard" href="https://github.com/vllm-project/vllm/pull/51655">#51655</a>), Ling 3.0 Flash with BF16, MTP, and parser support (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5062200231" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51045" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51045/hovercard" href="https://github.com/vllm-project/vllm/pull/51045">#51045</a>) plus an FP8 variant (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5081088003" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51265" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51265/hovercard" href="https://github.com/vllm-project/vllm/pull/51265">#51265</a>) and hybrid MXFP4 routed experts (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5138714046" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52114" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52114/hovercard" href="https://github.com/vllm-project/vllm/pull/52114">#52114</a>), Dots3 NOTE native multimodal support (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5080636421" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51255" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51255/hovercard" href="https://github.com/vllm-project/vllm/pull/51255">#51255</a>), and Interns2mobius (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5070167356" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51149" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51149/hovercard" href="https://github.com/vllm-project/vllm/pull/51149">#51149</a>).</li>467<li><strong>Qwen</strong>: Qwen3.8 enabled on AMD ROCm (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4994163972" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50068" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50068/hovercard" href="https://github.com/vllm-project/vllm/pull/50068">#50068</a>), fused CUDA post-conv MTP decode kernel for Qwen3.5 GDN (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5110251224" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51674" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51674/hovercard" href="https://github.com/vllm-project/vllm/pull/51674">#51674</a>), GDN gates aligned with speculative tokens (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5119924903" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51812" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51812/hovercard" href="https://github.com/vllm-project/vllm/pull/51812">#51812</a>), and Qwen3.5 fixes for text-only checkpoints (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5041533191" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50734" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50734/hovercard" href="https://github.com/vllm-project/vllm/pull/50734">#50734</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5015166584" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50355" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50355/hovercard" href="https://github.com/vllm-project/vllm/pull/50355">#50355</a>).</li>468<li><strong>Transformers modeling backend</strong>: MLA support (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4854954561" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48250" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48250/hovercard" href="https://github.com/vllm-project/vllm/pull/48250">#48250</a>), hardware-agnostic model definition (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4949852429" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49458" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49458/hovercard" href="https://github.com/vllm-project/vllm/pull/49458">#49458</a>), fully generalized input embedding handling (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5079925625" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51247" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51247/hovercard" href="https://github.com/vllm-project/vllm/pull/51247">#51247</a>), logit softcapping (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5142232127" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52173" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52173/hovercard" href="https://github.com/vllm-project/vllm/pull/52173">#52173</a>), and a hardened multimodal path (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5091535399" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51408" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51408/hovercard" href="https://github.com/vllm-project/vllm/pull/51408">#51408</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5109234791" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51657" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51657/hovercard" href="https://github.com/vllm-project/vllm/pull/51657">#51657</a>).</li>469<li><strong>LoRA</strong>: vision tower LoRA for Gemma4 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4447596402" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/42662" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/42662/hovercard" href="https://github.com/vllm-project/vllm/pull/42662">#42662</a>), tower/connector LoRA for Keye (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5117831469" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51780" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51780/hovercard" href="https://github.com/vllm-project/vllm/pull/51780">#51780</a>) and Ultravox (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4852532476" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48215" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48215/hovercard" href="https://github.com/vllm-project/vllm/pull/48215">#48215</a>).</li>470<li><strong>Vision encoders</strong>: ViT full CUDA graph for Kimi-K2.5 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5054946690" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50929" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50929/hovercard" href="https://github.com/vllm-project/vllm/pull/50929">#50929</a>) and Ernie-4.5-VL (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4638377271" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/45254" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/45254/hovercard" href="https://github.com/vllm-project/vllm/pull/45254">#45254</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5094710843" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51461" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51461/hovercard" href="https://github.com/vllm-project/vllm/pull/51461">#51461</a>), torch.compile for the Qwen3-VL encoder (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4280907120" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/40116" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/40116/hovercard" href="https://github.com/vllm-project/vllm/pull/40116">#40116</a>), and long-blocking H2D copies avoided in ViT (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5122128314" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51841" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51841/hovercard" href="https://github.com/vllm-project/vllm/pull/51841">#51841</a>).</li>471<li><strong>MoE</strong>: extended EPLB support for Mistral Large 3 and additional MoE backends (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4862575204" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48355" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48355/hovercard" href="https://github.com/vllm-project/vllm/pull/48355">#48355</a>), CuTe DSL skinny GEMM extended to GLM-5.2 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4974961267" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49791" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49791/hovercard" href="https://github.com/vllm-project/vllm/pull/49791">#49791</a>).</li>472<li><strong>Speculative decoding coverage</strong>: EAGLE3 support declared on KimiLinear (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5142174474" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52171" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52171/hovercard" href="https://github.com/vllm-project/vllm/pull/52171">#52171</a>), Qwen3.6 dSpark acceptance coverage (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5084816525" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51310" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51310/hovercard" href="https://github.com/vllm-project/vllm/pull/51310">#51310</a>).</li>473<li><strong>Correctness</strong>: MiniMax-M3 NVFP4 inference (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4909402263" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48929" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48929/hovercard" href="https://github.com/vllm-project/vllm/pull/48929">#48929</a>) and compressed-tensors FP8 MoE SwiGLU params (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4753355344" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/46845" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/46845/hovercard" href="https://github.com/vllm-project/vllm/pull/46845">#46845</a>), Gemma3n/Gemma4 variable-length audio batch padding (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5056517829" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50958" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50958/hovercard" href="https://github.com/vllm-project/vllm/pull/50958">#50958</a>), Gemma 4 compatibility with the upcoming Transformers version (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4975118381" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49797" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49797/hovercard" href="https://github.com/vllm-project/vllm/pull/49797">#49797</a>), and a Qwen3-Omni crash on video without an audio track (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4867742380" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48420" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48420/hovercard" href="https://github.com/vllm-project/vllm/pull/48420">#48420</a>).</li>474<li><strong>Multimodal performance</strong>: fused on-device multimodal preprocess normalization (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5018037064" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50411" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50411/hovercard" href="https://github.com/vllm-project/vllm/pull/50411">#50411</a>), faster placeholder and token-match scanning (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5040490475" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50716" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50716/hovercard" href="https://github.com/vllm-project/vllm/pull/50716">#50716</a>), and repeated prompt-update scans avoided (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5117550492" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51774" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51774/hovercard" href="https://github.com/vllm-project/vllm/pull/51774">#51774</a>).</li>475</ul>476<h2>Engine Core</h2>477<ul>478<li><strong>Speculative decoding</strong>: DSpark confidence-scheduled verification (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4824929811" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47808" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47808/hovercard" href="https://github.com/vllm-project/vllm/pull/47808">#47808</a>), top-k DSpark Markov projection (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4986937996" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49969" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49969/hovercard" href="https://github.com/vllm-project/vllm/pull/49969">#49969</a>), DFlash2 with local convolution and a candidate selector (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5185508751" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52816" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52816/hovercard" href="https://github.com/vllm-project/vllm/pull/52816">#52816</a>), async scheduling auto-enabled for draft models (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4862124280" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48341" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48341/hovercard" href="https://github.com/vllm-project/vllm/pull/48341">#48341</a>), fused MTP trailing all-reduce with local-argmax draft tokens (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4974961517" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49793" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49793/hovercard" href="https://github.com/vllm-project/vllm/pull/49793">#49793</a>), and an adaptive budget for speculative scheduled input tokens (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5113682718" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51725" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51725/hovercard" href="https://github.com/vllm-project/vllm/pull/51725">#51725</a>).</li>479<li><strong>KV cache &amp; scheduling</strong>: per-request scheduling for MLA chunked context (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5032406796" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50613" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50613/hovercard" href="https://github.com/vllm-project/vllm/pull/50613">#50613</a>), partial-tail prefix reuse with fine-grained prefix matching (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5025949938" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50507" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50507/hovercard" href="https://github.com/vllm-project/vllm/pull/50507">#50507</a>), backend-published KV packing in the KV-cache layout refactor (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5106577224" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51612" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51612/hovercard" href="https://github.com/vllm-project/vllm/pull/51612">#51612</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5112161404" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51704" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51704/hovercard" href="https://github.com/vllm-project/vllm/pull/51704">#51704</a>), LIFO free-block reuse order restored when prefix caching is off (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5095892290" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51482" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51482/hovercard" href="https://github.com/vllm-project/vllm/pull/51482">#51482</a>), and silent request skipping in priority scheduling fixed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4929919653" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49206" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49206/hovercard" href="https://github.com/vllm-project/vllm/pull/49206">#49206</a>).</li>480<li><strong>Performance</strong>: continued elimination of GPU&lt;-&gt;CPU syncs on the execution path (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5094482379" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51458" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51458/hovercard" href="https://github.com/vllm-project/vllm/pull/51458">#51458</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5114866861" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51738" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51738/hovercard" href="https://github.com/vllm-project/vllm/pull/51738">#51738</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5153411613" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52369" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52369/hovercard" href="https://github.com/vllm-project/vllm/pull/52369">#52369</a>) now guarded by a CI sync check (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4478832887" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/43107" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/43107/hovercard" href="https://github.com/vllm-project/vllm/pull/43107">#43107</a>), new JIT warmup infrastructure with predicate filtering (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4937589477" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49315" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49315/hovercard" href="https://github.com/vllm-project/vllm/pull/49315">#49315</a>), the top-k/top-p Triton sampler launched with 8 warps (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5098414548" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51507" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51507/hovercard" href="https://github.com/vllm-project/vllm/pull/51507">#51507</a>), detokenization skipped in offline beam search (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5013860355" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50333" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50333/hovercard" href="https://github.com/vllm-project/vllm/pull/50333">#50333</a>), Mask Replay (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4957847501" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49577" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49577/hovercard" href="https://github.com/vllm-project/vllm/pull/49577">#49577</a>), optimized long-context MLA cache gathers (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5114956422" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51739" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51739/hovercard" href="https://github.com/vllm-project/vllm/pull/51739">#51739</a>), and HF revisions resolved to a commit hash once per model load (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4988652213" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49990" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49990/hovercard" href="https://github.com/vllm-project/vllm/pull/49990">#49990</a>).</li>481<li><strong>Hybrid/Mamba</strong>: prefix caching on by default (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5057990179" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50991" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50991/hovercard" href="https://github.com/vllm-project/vllm/pull/50991">#50991</a>), the final part of the Mamba attention module refactor (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4611638222" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/44857" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/44857/hovercard" href="https://github.com/vllm-project/vllm/pull/44857">#44857</a>), 3D-grid tiling of the state-copy Triton kernels (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4947786164" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49436" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49436/hovercard" href="https://github.com/vllm-project/vllm/pull/49436">#49436</a>), and Mamba alignment applied before encoder caps (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5106204681" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51603" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51603/hovercard" href="https://github.com/vllm-project/vllm/pull/51603">#51603</a>).</li>482<li><strong>RL workflows</strong>: stateful trainer send over NCCL and sparse NCCL (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5052865253" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50902" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50902/hovercard" href="https://github.com/vllm-project/vllm/pull/50902">#50902</a>), <code>CuMemAllocator.discard()</code> for tag-selective GPU memory release (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5163599130" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52514" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52514/hovercard" href="https://github.com/vllm-project/vllm/pull/52514">#52514</a>), level-2 sleep/wake/reload fixed with LoRA enabled (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4270869719" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/39935" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/39935/hovercard" href="https://github.com/vllm-project/vllm/pull/39935">#39935</a>), and rewritten weight-transfer docs with standardized examples (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5114163681" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51729" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51729/hovercard" href="https://github.com/vllm-project/vllm/pull/51729">#51729</a>).</li>483<li><strong>Startup robustness</strong>: file:// rendezvous for single-node executors eliminates startup port races (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5058472637" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50999" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50999/hovercard" href="https://github.com/vllm-project/vllm/pull/50999">#50999</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5108869919" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51652" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51652/hovercard" href="https://github.com/vllm-project/vllm/pull/51652">#51652</a>), frontend processes are watched during engine startup (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4501773174" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/43417" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/43417/hovercard" href="https://github.com/vllm-project/vllm/pull/43417">#43417</a>), a <code>get_open_port()</code> livelock on DP-reserved ports was fixed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5056737065" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50965" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50965/hovercard" href="https://github.com/vllm-project/vllm/pull/50965">#50965</a>), and NVML is no longer re-initialized on every device-capability check (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5017351693" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50393" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50393/hovercard" href="https://github.com/vllm-project/vllm/pull/50393">#50393</a>).</li>484</ul>485<h2>Hardware &amp; Performance</h2>486<ul>487<li><strong>NVIDIA</strong>: FlashInfer XQA decode support on SM12x (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4968310920" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49718" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49718/hovercard" href="https://github.com/vllm-project/vllm/pull/49718">#49718</a>), a CuTeDSL fused query kernel on SM100 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4974961399" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49792" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49792/hovercard" href="https://github.com/vllm-project/vllm/pull/49792">#49792</a>), programmatic dependent launch for the DSA decode kernels (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5007213321" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50230" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50230/hovercard" href="https://github.com/vllm-project/vllm/pull/50230">#50230</a>), the native DSA decode path for MTP=3 on SM90 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5141736925" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52164" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52164/hovercard" href="https://github.com/vllm-project/vllm/pull/52164">#52164</a>), GB10 fused-MoE FP8 tuning configs (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5163209275" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52502" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52502/hovercard" href="https://github.com/vllm-project/vllm/pull/52502">#52502</a>), and B12X dense linear backends (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5132880482" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52016" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52016/hovercard" href="https://github.com/vllm-project/vllm/pull/52016">#52016</a>).</li>488<li><strong>AMD ROCm</strong>: torch 2.12 / triton 3.7 stack bump (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5032123371" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50607" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50607/hovercard" href="https://github.com/vllm-project/vllm/pull/50607">#50607</a>), AITER and FP8 inference enabled on GFX120x (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4518781910" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/43615" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/43615/hovercard" href="https://github.com/vllm-project/vllm/pull/43615">#43615</a>), DeepSeek-V4 on gfx11 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4766317415" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47017" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47017/hovercard" href="https://github.com/vllm-project/vllm/pull/47017">#47017</a>), optimized Triton sparse-MLA decode on gfx950 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5145545577" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52212" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52212/hovercard" href="https://github.com/vllm-project/vllm/pull/52212">#52212</a>), FlyDSL decode-attention kernel for 4-bit TurboQuant KV cache (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4830518406" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47896" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47896/hovercard" href="https://github.com/vllm-project/vllm/pull/47896">#47896</a>) and an fp8 MQA logits kernel on gfx942 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4956444620" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49544" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49544/hovercard" href="https://github.com/vllm-project/vllm/pull/49544">#49544</a>), a fused Kimi-K3 KDA decode kernel (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5035155331" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50654" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50654/hovercard" href="https://github.com/vllm-project/vllm/pull/50654">#50654</a>), fused bf16→fp32 router GEMM (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5009779919" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50268" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50268/hovercard" href="https://github.com/vllm-project/vllm/pull/50268">#50268</a>), pinned memory on supported WSL2 kernels (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4997388876" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50126" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50126/hovercard" href="https://github.com/vllm-project/vllm/pull/50126">#50126</a>), and preshuffled sparse indexing for 16-token blocks (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5076855828" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51216" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51216/hovercard" href="https://github.com/vllm-project/vllm/pull/51216">#51216</a>).</li>489<li><strong>Intel XPU</strong>: a torch linear backend including blockwise GEMM (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4964968726" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49664" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49664/hovercard" href="https://github.com/vllm-project/vllm/pull/49664">#49664</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5047328210" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50826" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50826/hovercard" href="https://github.com/vllm-project/vllm/pull/50826">#50826</a>), MXFP8 linear weights for the INC DeepSeek V4 model (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4871724476" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48476" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48476/hovercard" href="https://github.com/vllm-project/vllm/pull/48476">#48476</a>), async-scheduling PP sampled-token broadcast overlapped with compute (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5108748890" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51650" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51650/hovercard" href="https://github.com/vllm-project/vllm/pull/51650">#51650</a>), an XPU wheel added to the release pipeline (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5138581112" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52108" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52108/hovercard" href="https://github.com/vllm-project/vllm/pull/52108">#52108</a>), tuned Mamba SSU configs for Arc Pro B70 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5026981323" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50534" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50534/hovercard" href="https://github.com/vllm-project/vllm/pull/50534">#50534</a>), and UVA weight offloading fixes (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5117276306" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51770" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51770/hovercard" href="https://github.com/vllm-project/vllm/pull/51770">#51770</a>).</li>490<li><strong>CPU</strong>: an MLA backend so DeepSeek-V2/V3 can run on CPU (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4948910396" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49453" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49453/hovercard" href="https://github.com/vllm-project/vllm/pull/49453">#49453</a>), a triton-cpu wheel (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5137623585" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52092" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52092/hovercard" href="https://github.com/vllm-project/vllm/pull/52092">#52092</a>), GPTQ and AWQ enabled on s390x (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5070079354" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51148" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51148/hovercard" href="https://github.com/vllm-project/vllm/pull/51148">#51148</a>) along with tcmalloc (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5048108687" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50841" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50841/hovercard" href="https://github.com/vllm-project/vllm/pull/50841">#50841</a>), BF16 MoE routed through zentorch on AMD (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4562633711" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/44201" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/44201/hovercard" href="https://github.com/vllm-project/vllm/pull/44201">#44201</a>), an unquantized MoE backend for Power (VSX) (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5107432976" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51624" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51624/hovercard" href="https://github.com/vllm-project/vllm/pull/51624">#51624</a>), unquantized MoE migrated to the modular-kernel experts structure (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4997915103" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50133" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50133/hovercard" href="https://github.com/vllm-project/vllm/pull/50133">#50133</a>), and the MXFP4 block scale folded in 2 instructions instead of 4 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5104914644" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51583" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51583/hovercard" href="https://github.com/vllm-project/vllm/pull/51583">#51583</a>).</li>491</ul>492<h2>Large Scale Serving</h2>493<ul>494<li><strong>E/P/D disaggregation</strong>: Model Runner V2 E/P/D support (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4155353913" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/38390" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/38390/hovercard" href="https://github.com/vllm-project/vllm/pull/38390">#38390</a>), duplicate image preprocessing removed with GPU-side preprocessing (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5017201855" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50390" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50390/hovercard" href="https://github.com/vllm-project/vllm/pull/50390">#50390</a>), KV consumers may omit multimodal embeddings (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5178516449" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52697" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52697/hovercard" href="https://github.com/vllm-project/vllm/pull/52697">#52697</a>), encoder-instance requests kept alive until their images are encoded (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5010138054" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50275" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50275/hovercard" href="https://github.com/vllm-project/vllm/pull/50275">#50275</a>), and EC connector scheduler/worker metadata plumbing (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4958264375" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49579" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49579/hovercard" href="https://github.com/vllm-project/vllm/pull/49579">#49579</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4958842553" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49585" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49585/hovercard" href="https://github.com/vllm-project/vllm/pull/49585">#49585</a>).</li>495<li><strong>KV offloading</strong>: disk offloading for SimpleCPUOffloadConnector (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4963653413" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49644" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49644/hovercard" href="https://github.com/vllm-project/vllm/pull/49644">#49644</a>), out-of-tree secondary tier managers via <code>module_path</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5058868734" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51007" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51007/hovercard" href="https://github.com/vllm-project/vllm/pull/51007">#51007</a>), partial secondary-tier load results (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5013391634" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50321" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50321/hovercard" href="https://github.com/vllm-project/vllm/pull/50321">#50321</a>), tiering offloading metrics (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4898117346" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48798" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48798/hovercard" href="https://github.com/vllm-project/vllm/pull/48798">#48798</a>), data-parallel topology exposed to offloading backends (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5124610407" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51879" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51879/hovercard" href="https://github.com/vllm-project/vllm/pull/51879">#51879</a>), a canonical CPU layout for parallelism-agnostic offload (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4867574663" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48414" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48414/hovercard" href="https://github.com/vllm-project/vllm/pull/48414">#48414</a>), and quadratic ARC batch eviction avoided (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5058051344" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50992" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50992/hovercard" href="https://github.com/vllm-project/vllm/pull/50992">#50992</a>).</li>496<li><strong>Mooncake</strong>: store group semantics (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4619061887" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/44956" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/44956/hovercard" href="https://github.com/vllm-project/vllm/pull/44956">#44956</a>), tenant ID support (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4842736295" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48069" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48069/hovercard" href="https://github.com/vllm-project/vllm/pull/48069">#48069</a>), and official wheels in the Docker image (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5063707796" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51067" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51067/hovercard" href="https://github.com/vllm-project/vllm/pull/51067">#51067</a>).</li>497<li><strong>Connectors</strong>: transfer mode (push/pull) included in the NIXL compatibility hash (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5032823656" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50620" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50620/hovercard" href="https://github.com/vllm-project/vllm/pull/50620">#50620</a>), a MoRIIO per-layer READ-completion barrier (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4877993752" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48534" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48534/hovercard" href="https://github.com/vllm-project/vllm/pull/48534">#48534</a>), 2P2D wide-EP with mori-ep/mori-io at dp=ep=16 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4623803757" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/45043" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/45043/hovercard" href="https://github.com/vllm-project/vllm/pull/45043">#45043</a>), and stale remote cleanup in the push connector (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5007459375" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50234" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50234/hovercard" href="https://github.com/vllm-project/vllm/pull/50234">#50234</a>).</li>498<li><strong>Parallelism</strong>: EPLB balancedness calculation fixed and tested (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5119937614" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51813" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51813/hovercard" href="https://github.com/vllm-project/vllm/pull/51813">#51813</a>), dense multinode DP rescope (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4930303331" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49212" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49212/hovercard" href="https://github.com/vllm-project/vllm/pull/49212">#49212</a>).</li>499</ul>500<h2>Quantization</h2>501<ul>502<li><strong>Online quantization</strong>: online MXFP4 support (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4940594936" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49347" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49347/hovercard" href="https://github.com/vllm-project/vllm/pull/49347">#49347</a>), online weight scales shared across TP (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4972474663" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49764" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49764/hovercard" href="https://github.com/vllm-project/vllm/pull/49764">#49764</a>), precision preserved in online NVFP4 expert packing (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4991067162" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50029" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50029/hovercard" href="https://github.com/vllm-project/vllm/pull/50029">#50029</a>), and the online NVFP4 MoE kernel reused across reloads (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4994606400" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50074" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50074/hovercard" href="https://github.com/vllm-project/vllm/pull/50074">#50074</a>).</li>503<li><strong>NVFP4</strong>: batch-invariant NVFP4 MoE via CUTLASS (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4296607986" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/40372" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/40372/hovercard" href="https://github.com/vllm-project/vllm/pull/40372">#40372</a>), KV 4-over-6 scale search (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4634559370" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/45187" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/45187/hovercard" href="https://github.com/vllm-project/vllm/pull/45187">#45187</a>), CuTeDSL MoE with SwiGLU-OAI and ReLU2 activations (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4773510143" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47106" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47106/hovercard" href="https://github.com/vllm-project/vllm/pull/47106">#47106</a>), and out_dtype matched to the model dtype (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4904369637" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48861" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48861/hovercard" href="https://github.com/vllm-project/vllm/pull/48861">#48861</a>).</li>504<li><strong>New kernels</strong>: block-wise scaled_mm (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4984081053" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49932" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49932/hovercard" href="https://github.com/vllm-project/vllm/pull/49932">#49932</a>), DeepSeek-V4 AMD Quark NVFP4 with an emulation kernel (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4835520784" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47972" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47972/hovercard" href="https://github.com/vllm-project/vllm/pull/47972">#47972</a>).</li>505<li><strong>Fixes</strong>: dynamic INT8 W8A8 MoE config no longer built as W8A16 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5047730226" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50833" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50833/hovercard" href="https://github.com/vllm-project/vllm/pull/50833">#50833</a>) and a TritonExperts crash (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5091616049" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51411" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51411/hovercard" href="https://github.com/vllm-project/vllm/pull/51411">#51411</a>), MXFP4 conversion for FlashInfer CUTLASS (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5061729452" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51038" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51038/hovercard" href="https://github.com/vllm-project/vllm/pull/51038">#51038</a>), fp32 weight scales and per-expert checkpoint mapping for MXFP4 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5091982004" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51419" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51419/hovercard" href="https://github.com/vllm-project/vllm/pull/51419">#51419</a>), and fused block-scale orientation (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5040990227" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50727" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50727/hovercard" href="https://github.com/vllm-project/vllm/pull/50727">#50727</a>).</li>506</ul>507<h2>API &amp; Frontend</h2>508<ul>509<li><strong>New capabilities</strong>: request priority parsed from an HTTP header (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5066001756" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51089" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51089/hovercard" href="https://github.com/vllm-project/vllm/pull/51089">#51089</a>), session ID plumbing into requests (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4841177349" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48048" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48048/hovercard" href="https://github.com/vllm-project/vllm/pull/48048">#48048</a>), <code>count_reasoning_tokens</code> in the streaming parser engine (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4672899048" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/45802" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/45802/hovercard" href="https://github.com/vllm-project/vllm/pull/45802">#45802</a>), <code>content_parts</code> on <code>/inference/v1/generate</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5095831219" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51478" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51478/hovercard" href="https://github.com/vllm-project/vllm/pull/51478">#51478</a>), <code>model</code> optional on all <code>/derender</code> request classes (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5094894762" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51463" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51463/hovercard" href="https://github.com/vllm-project/vllm/pull/51463">#51463</a>), output token IDs logged at DEBUG level (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5137940807" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52098" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52098/hovercard" href="https://github.com/vllm-project/vllm/pull/52098">#52098</a>), and vLLM Recipes connected to native config-based deployment and benchmarking (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5084531279" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51308" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51308/hovercard" href="https://github.com/vllm-project/vllm/pull/51308">#51308</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5124601163" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51878" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51878/hovercard" href="https://github.com/vllm-project/vllm/pull/51878">#51878</a>).</li>510<li><strong>Rust frontend</strong>: a standalone renderer (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5011355404" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50289" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50289/hovercard" href="https://github.com/vllm-project/vllm/pull/50289">#50289</a>), gRPC multimodal image inference (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5015640495" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50368" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50368/hovercard" href="https://github.com/vllm-project/vllm/pull/50368">#50368</a>), explicit data-parallel rank routing (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5072919309" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51178" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51178/hovercard" href="https://github.com/vllm-project/vllm/pull/51178">#51178</a>), RL lifecycle control (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5084945361" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51316" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51316/hovercard" href="https://github.com/vllm-project/vllm/pull/51316">#51316</a>), dynamic tools from developer messages (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5069432556" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51144" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51144/hovercard" href="https://github.com/vllm-project/vllm/pull/51144">#51144</a>), protobuf schemas published to Buf (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5082805927" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51276" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51276/hovercard" href="https://github.com/vllm-project/vllm/pull/51276">#51276</a>), and MiniJinja upgraded to 2.22 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5078832228" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51235" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51235/hovercard" href="https://github.com/vllm-project/vllm/pull/51235">#51235</a>).</li>511<li><strong>Anthropic API</strong>: 4xx returned for client-caused errors on <code>/v1/messages</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5147551906" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52246" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52246/hovercard" href="https://github.com/vllm-project/vllm/pull/52246">#52246</a>), <code>disable_parallel_tool_use</code> preserved (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5133246623" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52021" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52021/hovercard" href="https://github.com/vllm-project/vllm/pull/52021">#52021</a>), and stop sequences bounded (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5131747956" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51997" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51997/hovercard" href="https://github.com/vllm-project/vllm/pull/51997">#51997</a>).</li>512<li><strong>Cohere</strong>: upstreamed parser fixes (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5131753634" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51998" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51998/hovercard" href="https://github.com/vllm-project/vllm/pull/51998">#51998</a>), stop sequences reported correctly (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5102649101" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51556" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51556/hovercard" href="https://github.com/vllm-project/vllm/pull/51556">#51556</a>), and vectorized binary embedding bit-packing (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5148708378" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52277" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52277/hovercard" href="https://github.com/vllm-project/vllm/pull/52277">#52277</a>).</li>513<li><strong>Structured output</strong>: request stop tokens masked in xgrammar until the grammar terminates (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4931076709" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49227" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49227/hovercard" href="https://github.com/vllm-project/vllm/pull/49227">#49227</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5031582024" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50595" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50595/hovercard" href="https://github.com/vllm-project/vllm/pull/50595">#50595</a>), NUL bytes rejected in <code>structured_outputs.regex</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5118845323" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51796" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51796/hovercard" href="https://github.com/vllm-project/vllm/pull/51796">#51796</a>), negative token IDs rejected as out-of-vocabulary (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5118829807" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51795" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51795/hovercard" href="https://github.com/vllm-project/vllm/pull/51795">#51795</a>), and <code>VLLMValidationError</code> raised from validators (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5156138521" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52394" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52394/hovercard" href="https://github.com/vllm-project/vllm/pull/52394">#52394</a>).</li>514<li><strong>Robustness</strong>: uvicorn signal handlers disabled instead of racing them (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5054208715" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50916" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50916/hovercard" href="https://github.com/vllm-project/vllm/pull/50916">#50916</a>), a consolidated entrypoint exception handler (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5148463554" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52261" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52261/hovercard" href="https://github.com/vllm-project/vllm/pull/52261">#52261</a>), 400 instead of 500 on non-object JSON bodies (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5109037008" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51654" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51654/hovercard" href="https://github.com/vllm-project/vllm/pull/51654">#51654</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5164650433" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52528" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52528/hovercard" href="https://github.com/vllm-project/vllm/pull/52528">#52528</a>), generation inputs bounded before expensive work (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5093882388" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51447" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51447/hovercard" href="https://github.com/vllm-project/vllm/pull/51447">#51447</a>), and <code>cache_salt</code> now required to be non-empty (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5046668464" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50816" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50816/hovercard" href="https://github.com/vllm-project/vllm/pull/50816">#50816</a>).</li>515</ul>516<h2>Security</h2>517<ul>518<li>Fixed a DoS via sample-rate forgery that bypassed the audio decode duration guard (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4985115111" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49948" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49948/hovercard" href="https://github.com/vllm-project/vllm/pull/49948">#49948</a>); the audio decode duration limit is now also enforced in NanoNemotronVL (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5006702499" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50221" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50221/hovercard" href="https://github.com/vllm-project/vllm/pull/50221">#50221</a>).</li>519<li>DeepStream classified as a GPU backend with pixel limits enforced (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5043666962" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50755" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50755/hovercard" href="https://github.com/vllm-project/vllm/pull/50755">#50755</a>).</li>520<li><code>_load_ov2_processor</code> guarded with <code>resolve_trust_remote_code</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5193797677" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52952" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52952/hovercard" href="https://github.com/vllm-project/vllm/pull/52952">#52952</a>).</li>521<li>Documentation now warns that <code>--api-key</code> does not gate all endpoints (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5131764514" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51999" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51999/hovercard" href="https://github.com/vllm-project/vllm/pull/51999">#51999</a>).</li>522</ul>523<h2>Dependencies</h2>524<ul>525<li>Transformers 5.15.0 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5109844757" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51668" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51668/hovercard" href="https://github.com/vllm-project/vllm/pull/51668">#51668</a>), huggingface-hub 1.27.0 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5092131862" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51422" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51422/hovercard" href="https://github.com/vllm-project/vllm/pull/51422">#51422</a>), fastsafetensors upgrade (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5047371176" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50827" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50827/hovercard" href="https://github.com/vllm-project/vllm/pull/50827">#50827</a>).</li>526<li>ROCm: torch 2.12, triton 3.7, torchaudio, torchvision (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5032123371" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50607" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50607/hovercard" href="https://github.com/vllm-project/vllm/pull/50607">#50607</a>).</li>527<li>Runtime image upgraded to Ubuntu 24.04, picking up rdma-core &gt; 44 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5063091059" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51058" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51058/hovercard" href="https://github.com/vllm-project/vllm/pull/51058">#51058</a>).</li>528<li>DeepGEMM pinned to the deepseek-ai nv_dev tip (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5134204828" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52035" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52035/hovercard" href="https://github.com/vllm-project/vllm/pull/52035">#52035</a>), DeepEP pinned by full commit hash (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5133584994" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52028" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52028/hovercard" href="https://github.com/vllm-project/vllm/pull/52028">#52028</a>), FlashAttention 3 built with the torch stable API (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4960056521" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49599" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49599/hovercard" href="https://github.com/vllm-project/vllm/pull/49599">#49599</a>).</li>529</ul>530<h2>Breaking Changes &amp; Deprecations</h2>531<ul>532<li>bitsandbytes support is now an out-of-tree plugin (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4512000173" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/43529" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/43529/hovercard" href="https://github.com/vllm-project/vllm/pull/43529">#43529</a>).</li>533<li>The deprecated <code>calculate_kv_scales</code> runtime KV scale calculation was removed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4944675936" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49389" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49389/hovercard" href="https://github.com/vllm-project/vllm/pull/49389">#49389</a>).</li>534<li><code>override_attention_dtype</code> was removed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4888820267" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48684" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48684/hovercard" href="https://github.com/vllm-project/vllm/pull/48684">#48684</a>).</li>535<li><code>reasoning_content</code> output removal is documented as a breaking client change (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5033215124" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50624" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50624/hovercard" href="https://github.com/vllm-project/vllm/pull/50624">#50624</a>).</li>536<li>KV offload tiering metrics renamed from <code>kv_offload_tiering_block_{queries,hits}</code> to <code>..._chunk_...</code> (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5185155341" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52812" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52812/hovercard" href="https://github.com/vllm-project/vllm/pull/52812">#52812</a>).</li>537<li>MoE legacy code removed (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5064749809" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51078" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51078/hovercard" href="https://github.com/vllm-project/vllm/pull/51078">#51078</a>).</li>538</ul>539<h2>New Contributors</h2>540<ul>541<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/acheamponge/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/acheamponge">@acheamponge</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4941429215" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49353" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49353/hovercard" href="https://github.com/vllm-project/vllm/pull/49353">#49353</a></li>542<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/acmore/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/acmore">@acmore</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5080785739" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51259" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51259/hovercard" href="https://github.com/vllm-project/vllm/pull/51259">#51259</a></li>543<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/anhtra3889/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/anhtra3889">@anhtra3889</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5058701438" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51002" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51002/hovercard" href="https://github.com/vllm-project/vllm/pull/51002">#51002</a></li>544<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/anujbolewar/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/anujbolewar">@anujbolewar</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5049889451" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50867" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50867/hovercard" href="https://github.com/vllm-project/vllm/pull/50867">#50867</a></li>545<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/arthurgao2003/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/arthurgao2003">@arthurgao2003</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4852532476" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48215" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48215/hovercard" href="https://github.com/vllm-project/vllm/pull/48215">#48215</a></li>546<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/baodii/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/baodii">@baodii</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5076795320" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51215" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51215/hovercard" href="https://github.com/vllm-project/vllm/pull/51215">#51215</a></li>547<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/bitborne/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/bitborne">@bitborne</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4619061887" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/44956" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/44956/hovercard" href="https://github.com/vllm-project/vllm/pull/44956">#44956</a></li>548<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/bohnstingl/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/bohnstingl">@bohnstingl</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4949852429" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49458" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49458/hovercard" href="https://github.com/vllm-project/vllm/pull/49458">#49458</a></li>549<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ccaadaro/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ccaadaro">@ccaadaro</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5104914644" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51583" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51583/hovercard" href="https://github.com/vllm-project/vllm/pull/51583">#51583</a></li>550<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/cmiyai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/cmiyai">@cmiyai</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4754819791" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/46870" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/46870/hovercard" href="https://github.com/vllm-project/vllm/pull/46870">#46870</a></li>551<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/d4l3k/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/d4l3k">@d4l3k</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5066535102" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51097" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51097/hovercard" href="https://github.com/vllm-project/vllm/pull/51097">#51097</a></li>552<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dmai-afk/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dmai-afk">@dmai-afk</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5067868281" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51120" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51120/hovercard" href="https://github.com/vllm-project/vllm/pull/51120">#51120</a></li>553<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dmholtz/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dmholtz">@dmholtz</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5057306751" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50977" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50977/hovercard" href="https://github.com/vllm-project/vllm/pull/50977">#50977</a></li>554<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/efschu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/efschu">@efschu</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5041533191" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50734" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50734/hovercard" href="https://github.com/vllm-project/vllm/pull/50734">#50734</a></li>555<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fangchenli/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fangchenli">@fangchenli</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5148708378" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52277" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52277/hovercard" href="https://github.com/vllm-project/vllm/pull/52277">#52277</a></li>556<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fanxingran/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fanxingran">@fanxingran</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5059044965" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51011" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51011/hovercard" href="https://github.com/vllm-project/vllm/pull/51011">#51011</a></li>557<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fatday/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fatday">@fatday</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4850038638" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48171" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48171/hovercard" href="https://github.com/vllm-project/vllm/pull/48171">#48171</a></li>558<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fattchris/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fattchris">@fattchris</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4904369637" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48861" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48861/hovercard" href="https://github.com/vllm-project/vllm/pull/48861">#48861</a></li>559<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fcui-amd/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fcui-amd">@fcui-amd</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4997388876" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50126" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50126/hovercard" href="https://github.com/vllm-project/vllm/pull/50126">#50126</a></li>560<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fede-kamel/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fede-kamel">@fede-kamel</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5033215124" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50624" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50624/hovercard" href="https://github.com/vllm-project/vllm/pull/50624">#50624</a></li>561<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fxfxfxfxfxfxfxfx/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fxfxfxfxfxfxfxfx">@fxfxfxfxfxfxfxfx</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4925208326" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49139" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49139/hovercard" href="https://github.com/vllm-project/vllm/pull/49139">#49139</a></li>562<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gabriel-peracio/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gabriel-peracio">@gabriel-peracio</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5002983791" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50183" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50183/hovercard" href="https://github.com/vllm-project/vllm/pull/50183">#50183</a></li>563<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gchinora/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gchinora">@gchinora</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5092593137" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51427" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51427/hovercard" href="https://github.com/vllm-project/vllm/pull/51427">#51427</a></li>564<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/guanxingithub/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/guanxingithub">@guanxingithub</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5031207461" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50589" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50589/hovercard" href="https://github.com/vllm-project/vllm/pull/50589">#50589</a></li>565<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/haregali/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/haregali">@haregali</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5040490475" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50716" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50716/hovercard" href="https://github.com/vllm-project/vllm/pull/50716">#50716</a></li>566<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hsusul/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hsusul">@hsusul</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4960695993" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49613" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49613/hovercard" href="https://github.com/vllm-project/vllm/pull/49613">#49613</a></li>567<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/iwannagotobed/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/iwannagotobed">@iwannagotobed</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5109640766" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51664" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51664/hovercard" href="https://github.com/vllm-project/vllm/pull/51664">#51664</a></li>568<li>@jacobzhang22 made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4190902375" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/38771" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/38771/hovercard" href="https://github.com/vllm-project/vllm/pull/38771">#38771</a></li>569<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jairitAge/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jairitAge">@jairitAge</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5066645094" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51100" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51100/hovercard" href="https://github.com/vllm-project/vllm/pull/51100">#51100</a></li>570<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jamesETsmith/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jamesETsmith">@jamesETsmith</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5076855828" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51216" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51216/hovercard" href="https://github.com/vllm-project/vllm/pull/51216">#51216</a></li>571<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jimmy-adams/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jimmy-adams">@jimmy-adams</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4835520784" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47972" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47972/hovercard" href="https://github.com/vllm-project/vllm/pull/47972">#47972</a></li>572<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jyan-R/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jyan-R">@jyan-R</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5150426007" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52311" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52311/hovercard" href="https://github.com/vllm-project/vllm/pull/52311">#52311</a></li>573<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Kaif10/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Kaif10">@Kaif10</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5164650433" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52528" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52528/hovercard" href="https://github.com/vllm-project/vllm/pull/52528">#52528</a></li>574<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/karen-sy/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/karen-sy">@karen-sy</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4841177349" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48048" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48048/hovercard" href="https://github.com/vllm-project/vllm/pull/48048">#48048</a></li>575<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Lin-z-w/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Lin-z-w">@Lin-z-w</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4842736295" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48069" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48069/hovercard" href="https://github.com/vllm-project/vllm/pull/48069">#48069</a></li>576<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/liushujia122/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/liushujia122">@liushujia122</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5117831469" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51780" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51780/hovercard" href="https://github.com/vllm-project/vllm/pull/51780">#51780</a></li>577<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Luosuu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Luosuu">@Luosuu</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4896453823" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48789" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48789/hovercard" href="https://github.com/vllm-project/vllm/pull/48789">#48789</a></li>578<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mispa-ms/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mispa-ms">@mispa-ms</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5157569183" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52419" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52419/hovercard" href="https://github.com/vllm-project/vllm/pull/52419">#52419</a></li>579<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mkhazraee/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mkhazraee">@mkhazraee</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5013391634" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50321" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50321/hovercard" href="https://github.com/vllm-project/vllm/pull/50321">#50321</a></li>580<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/NVShreyas/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/NVShreyas">@NVShreyas</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5053519932" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50911" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50911/hovercard" href="https://github.com/vllm-project/vllm/pull/50911">#50911</a></li>581<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/pavelzak/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/pavelzak">@pavelzak</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5163209275" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52502" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52502/hovercard" href="https://github.com/vllm-project/vllm/pull/52502">#52502</a></li>582<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/positive666/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/positive666">@positive666</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5151372357" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52329" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52329/hovercard" href="https://github.com/vllm-project/vllm/pull/52329">#52329</a></li>583<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/rajfirke/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/rajfirke">@rajfirke</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5104027805" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51573" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51573/hovercard" href="https://github.com/vllm-project/vllm/pull/51573">#51573</a></li>584<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Rapisurazurite/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Rapisurazurite">@Rapisurazurite</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5056274756" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50950" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50950/hovercard" href="https://github.com/vllm-project/vllm/pull/50950">#50950</a></li>585<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/rchalamala/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/rchalamala">@rchalamala</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5024552383" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50487" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50487/hovercard" href="https://github.com/vllm-project/vllm/pull/50487">#50487</a></li>586<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/RobbieJ/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/RobbieJ">@RobbieJ</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4938814574" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49328" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49328/hovercard" href="https://github.com/vllm-project/vllm/pull/49328">#49328</a></li>587<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ruirui6946/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ruirui6946">@ruirui6946</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5137940807" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52098" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52098/hovercard" href="https://github.com/vllm-project/vllm/pull/52098">#52098</a></li>588<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/RyanJHamby/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/RyanJHamby">@RyanJHamby</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4867742380" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/48420" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/48420/hovercard" href="https://github.com/vllm-project/vllm/pull/48420">#48420</a></li>589<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/samuelkim7/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/samuelkim7">@samuelkim7</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5013860355" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50333" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50333/hovercard" href="https://github.com/vllm-project/vllm/pull/50333">#50333</a></li>590<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shanewidanagama/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shanewidanagama">@shanewidanagama</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5125777348" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51901" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51901/hovercard" href="https://github.com/vllm-project/vllm/pull/51901">#51901</a></li>591<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shikamd123/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shikamd123">@shikamd123</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4623803757" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/45043" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/45043/hovercard" href="https://github.com/vllm-project/vllm/pull/45043">#45043</a></li>592<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/SilenNaihin/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/SilenNaihin">@SilenNaihin</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4270869719" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/39935" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/39935/hovercard" href="https://github.com/vllm-project/vllm/pull/39935">#39935</a></li>593<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/skysnow2001/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/skysnow2001">@skysnow2001</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4518781910" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/43615" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/43615/hovercard" href="https://github.com/vllm-project/vllm/pull/43615">#43615</a></li>594<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Sundaresan-G/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Sundaresan-G">@Sundaresan-G</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5026734206" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50526" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50526/hovercard" href="https://github.com/vllm-project/vllm/pull/50526">#50526</a></li>595<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/syedalijaseem/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/syedalijaseem">@syedalijaseem</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4816318436" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47692" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47692/hovercard" href="https://github.com/vllm-project/vllm/pull/47692">#47692</a></li>596<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/taking-lying-flat/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/taking-lying-flat">@taking-lying-flat</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5089824977" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51391" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51391/hovercard" href="https://github.com/vllm-project/vllm/pull/51391">#51391</a></li>597<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tandixit95/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tandixit95">@tandixit95</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5022876167" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50462" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50462/hovercard" href="https://github.com/vllm-project/vllm/pull/50462">#50462</a></li>598<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Tejas-Raj01/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Tejas-Raj01">@Tejas-Raj01</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4929919653" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49206" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49206/hovercard" href="https://github.com/vllm-project/vllm/pull/49206">#49206</a></li>599<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/theminghuang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/theminghuang">@theminghuang</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5095892290" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51482" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51482/hovercard" href="https://github.com/vllm-project/vllm/pull/51482">#51482</a></li>600<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tobymao/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tobymao">@tobymao</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5085087394" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51318" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51318/hovercard" href="https://github.com/vllm-project/vllm/pull/51318">#51318</a></li>601<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/TrainToGPB/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/TrainToGPB">@TrainToGPB</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5056517829" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50958" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50958/hovercard" href="https://github.com/vllm-project/vllm/pull/50958">#50958</a></li>602<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tzulingk/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tzulingk">@tzulingk</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4931304334" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49230" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49230/hovercard" href="https://github.com/vllm-project/vllm/pull/49230">#49230</a></li>603<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/UgaTheDev/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/UgaTheDev">@UgaTheDev</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5107513556" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51627" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51627/hovercard" href="https://github.com/vllm-project/vllm/pull/51627">#51627</a></li>604<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/varoudis/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/varoudis">@varoudis</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5017659562" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50404" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50404/hovercard" href="https://github.com/vllm-project/vllm/pull/50404">#50404</a></li>605<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Vegetog/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Vegetog">@Vegetog</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4980552220" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/49876" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/49876/hovercard" href="https://github.com/vllm-project/vllm/pull/49876">#49876</a></li>606<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/vitamin-chaos/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/vitamin-chaos">@vitamin-chaos</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4773510143" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/47106" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/47106/hovercard" href="https://github.com/vllm-project/vllm/pull/47106">#47106</a></li>607<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wangxian001/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wangxian001">@wangxian001</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5010158133" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50276" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50276/hovercard" href="https://github.com/vllm-project/vllm/pull/50276">#50276</a></li>608<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/WillZZZy/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/WillZZZy">@WillZZZy</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4746058933" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/46747" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/46747/hovercard" href="https://github.com/vllm-project/vllm/pull/46747">#46747</a></li>609<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/xiaopusun/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/xiaopusun">@xiaopusun</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5096858411" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51495" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51495/hovercard" href="https://github.com/vllm-project/vllm/pull/51495">#51495</a></li>610<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/xijiaat/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/xijiaat">@xijiaat</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5037831541" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50693" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50693/hovercard" href="https://github.com/vllm-project/vllm/pull/50693">#50693</a></li>611<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/xudonlyu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/xudonlyu">@xudonlyu</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5110787791" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51682" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51682/hovercard" href="https://github.com/vllm-project/vllm/pull/51682">#51682</a></li>612<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yifjiang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yifjiang">@yifjiang</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5076989189" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51218" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51218/hovercard" href="https://github.com/vllm-project/vllm/pull/51218">#51218</a></li>613<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yu-xin-c/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yu-xin-c">@yu-xin-c</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5108869919" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51652" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51652/hovercard" href="https://github.com/vllm-project/vllm/pull/51652">#51652</a></li>614<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zcxGGmu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zcxGGmu">@zcxGGmu</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5042543748" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/50746" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/50746/hovercard" href="https://github.com/vllm-project/vllm/pull/50746">#50746</a></li>615<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ziqifan617/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ziqifan617">@ziqifan617</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5124610407" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/51879" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/51879/hovercard" href="https://github.com/vllm-project/vllm/pull/51879">#51879</a></li>616<li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zobinHuang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zobinHuang">@zobinHuang</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5141736925" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52164" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52164/hovercard" href="https://github.com/vllm-project/vllm/pull/52164">#52164</a></li>617</ul>618<h2>Contributors</h2>619<p><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yewentao256/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yewentao256">@yewentao256</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/AndreasKaratzas/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/AndreasKaratzas">@AndreasKaratzas</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/njhill/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/njhill">@njhill</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mgoin/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mgoin">@mgoin</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/aoshen02/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/aoshen02">@aoshen02</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/khluu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/khluu">@khluu</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hmellor/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hmellor">@hmellor</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/stefankoncarevic/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/stefankoncarevic">@stefankoncarevic</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/taneem-ibrahim/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/taneem-ibrahim">@taneem-ibrahim</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LucasWilkinson/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LucasWilkinson">@LucasWilkinson</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/chaunceyjiang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/chaunceyjiang">@chaunceyjiang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jikunshang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jikunshang">@jikunshang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zufangzhu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zufangzhu">@zufangzhu</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/bigPYJ1151/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/bigPYJ1151">@bigPYJ1151</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/NickLucche/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/NickLucche">@NickLucche</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/askliar/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/askliar">@askliar</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fxmarty-amd/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fxmarty-amd">@fxmarty-amd</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Rohan138/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Rohan138">@Rohan138</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gty111/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gty111">@gty111</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zhenwei-intel/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zhenwei-intel">@zhenwei-intel</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Isotr0py/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Isotr0py">@Isotr0py</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jeejeelee/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jeejeelee">@jeejeelee</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ZJY0516/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ZJY0516">@ZJY0516</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wangxiyuan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wangxiyuan">@wangxiyuan</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BugenZhao/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BugenZhao">@BugenZhao</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yma11/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yma11">@yma11</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zyongye/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zyongye">@zyongye</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/DarkLight1337/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/DarkLight1337">@DarkLight1337</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jperezdealgaba/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jperezdealgaba">@jperezdealgaba</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zhou9402/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zhou9402">@zhou9402</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/connorcarpenter15/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/connorcarpenter15">@connorcarpenter15</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/kliuae/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/kliuae">@kliuae</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/lucifer1004/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/lucifer1004">@lucifer1004</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Alex-ai-future/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Alex-ai-future">@Alex-ai-future</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/aarushjain29/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/aarushjain29">@aarushjain29</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/TheEpicDolphin/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/TheEpicDolphin">@TheEpicDolphin</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/chaojun-zhang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/chaojun-zhang">@chaojun-zhang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/pmanczak/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/pmanczak">@pmanczak</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/WoosukKwon/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/WoosukKwon">@WoosukKwon</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BabyDrangoner/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BabyDrangoner">@BabyDrangoner</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/noooop/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/noooop">@noooop</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/almogtavor/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/almogtavor">@almogtavor</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hongxiayang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hongxiayang">@hongxiayang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fuscof-ibm/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fuscof-ibm">@fuscof-ibm</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gau-nernst/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gau-nernst">@gau-nernst</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zxd1997066/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zxd1997066">@zxd1997066</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tlrmchlsmth/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tlrmchlsmth">@tlrmchlsmth</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/music-dino/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/music-dino">@music-dino</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zexplorerhj/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zexplorerhj">@zexplorerhj</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/S1ro1/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/S1ro1">@S1ro1</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jdebache/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jdebache">@jdebache</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/sfeng33/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/sfeng33">@sfeng33</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mayuyuace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mayuyuace">@mayuyuace</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ganeshr10/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ganeshr10">@ganeshr10</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/benchislett/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/benchislett">@benchislett</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tzulingk/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tzulingk">@tzulingk</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gcanlin/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gcanlin">@gcanlin</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ivanium/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ivanium">@ivanium</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/divakar-amd/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/divakar-amd">@divakar-amd</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/R3hankhan123/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/R3hankhan123">@R3hankhan123</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/sagearc/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/sagearc">@sagearc</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/vhagor/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/vhagor">@vhagor</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ronensc/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ronensc">@ronensc</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/micah-wil/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/micah-wil">@micah-wil</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/qyYue1389/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/qyYue1389">@qyYue1389</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/vanshbhatia-amd/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/vanshbhatia-amd">@vanshbhatia-amd</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hao-aaron/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hao-aaron">@hao-aaron</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/chengy-sysu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/chengy-sysu">@chengy-sysu</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/elvircrn/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/elvircrn">@elvircrn</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/taking-lying-flat/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/taking-lying-flat">@taking-lying-flat</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/omerpaz95/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/omerpaz95">@omerpaz95</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Etelis/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Etelis">@Etelis</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/vllmellm/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/vllmellm">@vllmellm</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/frank-suwen/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/frank-suwen">@frank-suwen</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/KernelClint/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/KernelClint">@KernelClint</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Fangzhou-Ai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Fangzhou-Ai">@Fangzhou-Ai</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/louie-tsai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/louie-tsai">@louie-tsai</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/simondanielsson/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/simondanielsson">@simondanielsson</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/maxyanghu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/maxyanghu">@maxyanghu</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dmai-afk/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dmai-afk">@dmai-afk</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/KurodaKanbei/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/KurodaKanbei">@KurodaKanbei</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ziqifan617/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ziqifan617">@ziqifan617</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/bastefaniak/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/bastefaniak">@bastefaniak</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ECMGit/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ECMGit">@ECMGit</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/haregali/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/haregali">@haregali</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/cmiyai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/cmiyai">@cmiyai</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fede-kamel/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fede-kamel">@fede-kamel</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/drakosha/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/drakosha">@drakosha</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/vineethsaivs/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/vineethsaivs">@vineethsaivs</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zcxGGmu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zcxGGmu">@zcxGGmu</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/TQCB/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/TQCB">@TQCB</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/skysnow2001/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/skysnow2001">@skysnow2001</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shenoyvvarun/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shenoyvvarun">@shenoyvvarun</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/karen-sy/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/karen-sy">@karen-sy</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fattchris/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fattchris">@fattchris</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/RyanJHamby/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/RyanJHamby">@RyanJHamby</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shikamd123/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shikamd123">@shikamd123</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/namgyu-youn/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/namgyu-youn">@namgyu-youn</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zzt93/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zzt93">@zzt93</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/abmfy/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/abmfy">@abmfy</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/reidliu41/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/reidliu41">@reidliu41</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Rapisurazurite/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Rapisurazurite">@Rapisurazurite</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tandixit95/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tandixit95">@tandixit95</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mganczarenko/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mganczarenko">@mganczarenko</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yimdev/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yimdev">@yimdev</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/anujbolewar/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/anujbolewar">@anujbolewar</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LiuYinfeng01/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LiuYinfeng01">@LiuYinfeng01</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/lk-chen/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/lk-chen">@lk-chen</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/NVShreyas/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/NVShreyas">@NVShreyas</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/huangzhilin-hzl/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/huangzhilin-hzl">@huangzhilin-hzl</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/varoudis/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/varoudis">@varoudis</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Yejing-Lai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Yejing-Lai">@Yejing-Lai</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mkhazraee/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mkhazraee">@mkhazraee</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jzakrzew/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jzakrzew">@jzakrzew</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/TrainToGPB/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/TrainToGPB">@TrainToGPB</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/waynehacking8/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/waynehacking8">@waynehacking8</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zixi-qi/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zixi-qi">@zixi-qi</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Sundaresan-G/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Sundaresan-G">@Sundaresan-G</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mindungil/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mindungil">@mindungil</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/bitborne/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/bitborne">@bitborne</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Wauplin/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Wauplin">@Wauplin</a>, @jacobzhang22, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zhewenl/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zhewenl">@zhewenl</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/bnellnm/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/bnellnm">@bnellnm</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/pisceskkk/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/pisceskkk">@pisceskkk</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Lin-z-w/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Lin-z-w">@Lin-z-w</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gabriel-peracio/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gabriel-peracio">@gabriel-peracio</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/SilenNaihin/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/SilenNaihin">@SilenNaihin</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/baodii/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/baodii">@baodii</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/YunzhuLu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/YunzhuLu">@YunzhuLu</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/xwu-intel/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/xwu-intel">@xwu-intel</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BWAAEEEK/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BWAAEEEK">@BWAAEEEK</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/thisjiang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/thisjiang">@thisjiang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/maobaolong/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/maobaolong">@maobaolong</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/anhtra3889/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/anhtra3889">@anhtra3889</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/JaredforReal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/JaredforReal">@JaredforReal</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/lvhan028/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/lvhan028">@lvhan028</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/xiaolong-intel/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/xiaolong-intel">@xiaolong-intel</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/andyxning/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/andyxning">@andyxning</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/cleonard530/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/cleonard530">@cleonard530</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gnovack/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gnovack">@gnovack</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/MatthewBonanni/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/MatthewBonanni">@MatthewBonanni</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wangxian001/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wangxian001">@wangxian001</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/lengrongfu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/lengrongfu">@lengrongfu</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Tejas-Raj01/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Tejas-Raj01">@Tejas-Raj01</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/simon-mo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/simon-mo">@simon-mo</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/vitamin-chaos/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/vitamin-chaos">@vitamin-chaos</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/arpera/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/arpera">@arpera</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jairitAge/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jairitAge">@jairitAge</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jimmy-adams/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jimmy-adams">@jimmy-adams</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ILikeIneine/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ILikeIneine">@ILikeIneine</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/woosebastian/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/woosebastian">@woosebastian</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/haic0/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/haic0">@haic0</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/edwinlim0919/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/edwinlim0919">@edwinlim0919</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fcui-amd/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fcui-amd">@fcui-amd</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jhu960213/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jhu960213">@jhu960213</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jinzhen-lin/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jinzhen-lin">@jinzhen-lin</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/coltonottley/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/coltonottley">@coltonottley</a>, @walterbm, @meenchen, @matteso1, @djramic, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gchinora/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gchinora">@gchinora</a>, @davidjpyu, @tianmu-li, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/xiaopusun/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/xiaopusun">@xiaopusun</a>, @majunze2001, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Vegetog/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Vegetog">@Vegetog</a>, @puririshi98, @janeyx99, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/RobbieJ/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/RobbieJ">@RobbieJ</a>, @oonyshch, @thegoldenflow, @Srinivasoo7, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fatday/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fatday">@fatday</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/acheamponge/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/acheamponge">@acheamponge</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/efschu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/efschu">@efschu</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/rajfirke/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/rajfirke">@rajfirke</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fanxingran/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fanxingran">@fanxingran</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/xudonlyu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/xudonlyu">@xudonlyu</a>, @lcskrishna, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/xijiaat/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/xijiaat">@xijiaat</a>, @GirasoleY, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/d4l3k/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/d4l3k">@d4l3k</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/samuelkim7/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/samuelkim7">@samuelkim7</a>, @tarukumar, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/acmore/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/acmore">@acmore</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/theminghuang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/theminghuang">@theminghuang</a>, @khushali9, @wzhao18, @Priyjain-amd, @yiz-liu, @lkm2835, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dmholtz/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dmholtz">@dmholtz</a>, @Dao007forever, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/liushujia122/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/liushujia122">@liushujia122</a>, @LopezCastroRoberto, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/UgaTheDev/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/UgaTheDev">@UgaTheDev</a>, @tuukkjs, @aditi-amd, @guan404ming, @yiliu30, @zou3519, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Luosuu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Luosuu">@Luosuu</a>, @JoursBleu, @varun-sundar-rabindranath, @mpashkovskii, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yu-xin-c/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yu-xin-c">@yu-xin-c</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/WillZZZy/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/WillZZZy">@WillZZZy</a>, @vrdn-23, @xyang16, @ccrhx4, @tanpinsiang, @russellb, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fxfxfxfxfxfxfxfx/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fxfxfxfxfxfxfxfx">@fxfxfxfxfxfxfxfx</a>, @afriedri, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yifjiang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yifjiang">@yifjiang</a>, @Akashcodes732, @HF-001, @ovidiusm, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/arthurgao2003/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/arthurgao2003">@arthurgao2003</a>, @TomerBN-Nvidia, @hotTea123, @vx120, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/bohnstingl/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/bohnstingl">@bohnstingl</a>, @qwerqwerqwe8688-jpg, @jasonozuzu-cohere, @vineetatiwari27, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ruirui6946/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ruirui6946">@ruirui6946</a>, @linitra24, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/syedalijaseem/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/syedalijaseem">@syedalijaseem</a>, @nickus, @yzong-rh, @s3woz, @jhaotingc, @lukealonso, @Jie-Fang, @kzwrime, @xianbaoqian, @velonica0, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ccaadaro/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ccaadaro">@ccaadaro</a>, @yisustc, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fangchenli/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fangchenli">@fangchenli</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/iwannagotobed/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/iwannagotobed">@iwannagotobed</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zobinHuang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zobinHuang">@zobinHuang</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/rchalamala/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/rchalamala">@rchalamala</a>, @shanjiaz, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jamesETsmith/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jamesETsmith">@jamesETsmith</a>, @stacyroberts, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/guanxingithub/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/guanxingithub">@guanxingithub</a>, @biswapanda, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shanewidanagama/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shanewidanagama">@shanewidanagama</a>, @UranusSeven, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hsusul/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hsusul">@hsusul</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tobymao/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tobymao">@tobymao</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mispa-ms/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mispa-ms">@mispa-ms</a>, @jeffreywang88, @SayHelloToWorld, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jyan-R/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jyan-R">@jyan-R</a>, @oops-oom, @shantipriya-amd, @andakai, @akii96, @shen-shanshan, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Kaif10/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Kaif10">@Kaif10</a>, @yitingdc, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/positive666/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/positive666">@positive666</a>, <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/pavelzak/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/pavelzak">@pavelzak</a>, @SubSir, @ywang96</p></content>620 <author>621 <name>khluu</name>622 </author>623 <media:thumbnail height="30" width="30" url="https://avatars.githubusercontent.com/u/51931015?s=60&v=4"/>624 </entry>625</feed>626