HTML 77.2%
TypeScript 10.5%
Python 9.6%
JavaScript 2.5%
1<?xml version="1.0" encoding="utf-8" standalone="yes"?>2<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/">3 <channel>4 <title>Blog on Qwen</title>5 <link>https://qwenlm.github.io/blog/</link>6 <description>Recent content in Blog on Qwen</description>7 <image>8 <url>https://qwenlm.github.io/%3Clink%20or%20path%20of%20image%20for%20opengraph,%20twitter-cards%3E</url>9 <link>https://qwenlm.github.io/%3Clink%20or%20path%20of%20image%20for%20opengraph,%20twitter-cards%3E</link>10 </image>11 <generator>Hugo -- gohugo.io</generator>12 <lastBuildDate>Tue, 23 Sep 2025 04:00:00 +0800</lastBuildDate><atom:link href="https://qwenlm.github.io/blog/index.xml" rel="self" type="application/rss+xml" />13 <item>14 <title>Qwen3Guard: Real-time Safety for Your Token Stream</title>15 <link>https://qwenlm.github.io/blog/qwen3guard/</link>16 <pubDate>Tue, 23 Sep 2025 04:00:00 +0800</pubDate>17 18 <guid>https://qwenlm.github.io/blog/qwen3guard/</guid>19 <description>Tech Report GitHub Hugging Face ModelScope DISCORD20Introduction We are excited to introduce Qwen3Guard, the first safety guardrail model in the Qwen family. Built upon the powerful Qwen3 foundation models and fine-tuned specifically for safety classificatoin, Qwen3Guard ensures responsible AI interactions by delivering precise safety detection for both prompts and responses, complete with risk levels and categorized classifications for accurate moderation.21Qwen3Guard achieves state-of-the-art performance on major safety benchmarks, demonstrating strong capabilities in both prompt and response classification tasks across English, Chinese, and multilingual environments.</description>22 </item>23 24 <item>25 <title>Qwen-Image-Edit: Image Editing with Higher Quality and Efficiency</title>26 <link>https://qwenlm.github.io/blog/qwen-image-edit/</link>27 <pubDate>Tue, 19 Aug 2025 01:30:00 +0800</pubDate>28 29 <guid>https://qwenlm.github.io/blog/qwen-image-edit/</guid>30 <description>QWEN CHAT GITHUB HUGGING FACE MODELSCOPE DISCORD31We are excited to introduce Qwen-Image-Edit, the image editing version of Qwen-Image. Built upon our 20B Qwen-Image model, Qwen-Image-Edit successfully extends Qwen-Image&rsquo;s unique text rendering capabilities to image editing tasks, enabling precise text editing. Furthermore, Qwen-Image-Edit simultaneously feeds the input image into Qwen2.5-VL (for visual semantic control) and the VAE Encoder (for visual appearance control), achieving capabilities in both semantic and appearance editing.</description>32 </item>33 34 <item>35 <title>Qwen-Image: Crafting with Native Text Rendering</title>36 <link>https://qwenlm.github.io/blog/qwen-image/</link>37 <pubDate>Mon, 04 Aug 2025 22:08:30 +0800</pubDate>38 39 <guid>https://qwenlm.github.io/blog/qwen-image/</guid>40 <description>GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD41We are thrilled to release Qwen-Image, a 20B MMDiT image foundation model that achieves significant advances in complex text rendering and precise image editing. To try the latest model, feel free to visit Qwen Chat and choose “Image Generation”.42The key features include:43Superior Text Rendering: Qwen-Image excels at complex text rendering, including multi-line layouts, paragraph-level semantics, and fine-grained details. It supports both alphabetic languages (e.</description>44 </item>45 46 <item>47 <title>GSPO: Towards Scalable Reinforcement Learning for Language Models</title>48 <link>https://qwenlm.github.io/blog/gspo/</link>49 <pubDate>Sun, 27 Jul 2025 15:00:00 +0800</pubDate>50 51 <guid>https://qwenlm.github.io/blog/gspo/</guid>52 <description>PAPER DISCORD53Introduction Reinforcement Learning (RL) has emerged as a pivotal paradigm for scaling language models and enhancing their deep reasoning and problem-solving capabilities. To scale RL, the foremost prerequisite is maintaining stable and robust training dynamics. However, we observe that existing RL algorithms (such as GRPO) exhibit severe instability issues during long training and lead to irreversible model collapse, hindering further performance improvements with increased compute.54To enable successful RL scaling, we propose the Group Sequence Policy Optimization (GSPO) algorithm.</description>55 </item>56 57 <item>58 <title>Qwen-MT: Where Speed Meets Smart Translation</title>59 <link>https://qwenlm.github.io/blog/qwen-mt/</link>60 <pubDate>Thu, 24 Jul 2025 22:00:00 +0800</pubDate>61 62 <guid>https://qwenlm.github.io/blog/qwen-mt/</guid>63 <description>DEMO API DISCORD64Introduction Here we introduce the latest update of Qwen-MT (qwen-mt-turbo) via Qwen API. This update builds upon the powerful Qwen3, leveraging trillions multilingual and translation tokens to comprehensively enhance the model’s multilingual understanding and translation capabilities. By integrating reinforcement learning techniques, the model achieves significant improvements in translation accuracy and linguistic fluency.65Key Features:66Multilingual Support for 92 Languages: Qwen-MT enables high-quality translation across 92 major official languages and prominent dialects, covering over 95% of the global population to meet diverse cross-lingual communication needs.</description>67 </item>68 69 <item>70 <title>Qwen3-Coder: Agentic Coding in the World</title>71 <link>https://qwenlm.github.io/blog/qwen3-coder/</link>72 <pubDate>Tue, 22 Jul 2025 21:00:00 +0800</pubDate>73 74 <guid>https://qwenlm.github.io/blog/qwen3-coder/</guid>75 <description>GITHUB HUGGING FACE MODELSCOPE DISCORD76Today, we&rsquo;re announcing Qwen3-Coder, our most agentic code model to date. Qwen3-Coder is available in multiple sizes, but we&rsquo;re excited to introduce its most powerful variant first: Qwen3-Coder-480B-A35B-Instruct — a 480B-parameter Mixture-of-Experts model with 35B active parameters which supports the context length of 256K tokens natively and 1M tokens with extrapolation methods, offering exceptional performance in both coding and agentic tasks. Qwen3-Coder-480B-A35B-Instruct sets new state-of-the-art results among open models on Agentic Coding, Agentic Browser-Use, and Agentic Tool-Use, comparable to Claude Sonnet 4.</description>77 </item>78 79 <item>80 <title>Time to Speak Some Dialects, Qwen-TTS!</title>81 <link>https://qwenlm.github.io/blog/qwen-tts/</link>82 <pubDate>Fri, 27 Jun 2025 15:01:30 +0800</pubDate>83 84 <guid>https://qwenlm.github.io/blog/qwen-tts/</guid>85 <description>API DISCORD86Introduction Here we introduce the latest update of Qwen-TTS (qwen-tts-latest or qwen-tts-2025-05-22) through Qwen API . Trained on a large-scale dataset encompassing over millions of hours of speech, Qwen-TTS achieves human-level naturalness and expressiveness. Notably, Qwen-TTS automatically adjusts prosody, pacing, and emotional inflections in response to the input text. Notably, Qwen-TTS supports the generation of 3 Chinese dialects, including Pekingese, Shanghainese, and Sichuanese.87As of now, Qwen-TTS supports 7 Chinese-English bilingual voices, including Cherry, Ethan, Chelsie, Serena, Dylan (Pekingese), Jada (Shanghainese) and Sunny (Sichuanese).</description>88 </item>89 90 <item>91 <title>Qwen VLo: From "Understanding" the World to "Depicting" It</title>92 <link>https://qwenlm.github.io/blog/qwen-vlo/</link>93 <pubDate>Thu, 26 Jun 2025 22:00:04 +0800</pubDate>94 95 <guid>https://qwenlm.github.io/blog/qwen-vlo/</guid>96 <description>QWEN CHAT DISCORD97Introduction The evolution of multimodal large models is continually pushing the boundaries of what we believe technology can achieve. From the initial QwenVL to the latest Qwen2.5 VL, we have made progress in enhancing the model&rsquo;s ability to understand image content. Today, we are excited to introduce a new model, Qwen VLo, a unified multimodal understanding and generation model. This newly upgraded model not only &ldquo;understands&rdquo; the world but also generates high-quality recreations based on that understanding, truly bridging the gap between perception and creation.</description>98 </item>99 100 <item>101 <title>Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Models</title>102 <link>https://qwenlm.github.io/blog/qwen3-embedding/</link>103 <pubDate>Thu, 05 Jun 2025 21:00:00 +0800</pubDate>104 105 <guid>https://qwenlm.github.io/blog/qwen3-embedding/</guid>106 <description>GITHUB HUGGING FACE MODELSCOPE DISCORD107We release Qwen3 Embedding series, a new proprietary model of the Qwen model family. These models are specifically designed for text embedding, retrieval, and reranking tasks, built on the Qwen3 foundation model. Leveraging Qwen3’s robust multilingual text understanding capabilities, the series achieves state-of-the-art performance across multiple benchmarks for text embedding and reranking tasks. We have open-sourced this series of text embedding and reranking models under the Apache 2.</description>108 </item>109 110 <item>111 <title>Qwen3: Think Deeper, Act Faster</title>112 <link>https://qwenlm.github.io/blog/qwen3/</link>113 <pubDate>Tue, 29 Apr 2025 04:00:00 +0800</pubDate>114 115 <guid>https://qwenlm.github.io/blog/qwen3/</guid>116 <description>QWEN CHAT GitHub Hugging Face ModelScope Kaggle DEMO DISCORD117Introduction Today, we are excited to announce the release of Qwen3, the latest addition to the Qwen family of large language models. Our flagship model, Qwen3-235B-A22B, achieves competitive results in benchmark evaluations of coding, math, general capabilities, etc., when compared to other top-tier models such as DeepSeek-R1, o1, o3-mini, Grok-3, and Gemini-2.5-Pro. Additionally, the small MoE model, Qwen3-30B-A3B, outcompetes QwQ-32B with 10 times of activated parameters, and even a tiny model like Qwen3-4B can rival the performance of Qwen2.</description>118 </item>119 120 <item>121 <title>QVQ-Max: Think with Evidence</title>122 <link>https://qwenlm.github.io/blog/qvq-max-preview/</link>123 <pubDate>Fri, 28 Mar 2025 00:00:04 +0800</pubDate>124 125 <guid>https://qwenlm.github.io/blog/qvq-max-preview/</guid>126 <description>QWEN CHAT GITHUB HUGGING FACE MODELSCOPE DISCORD127Introduction Last December, we launched QVQ-72B-Preview as an exploratory model, but it had many issues. Today, we are officially releasing the first version of QVQ-Max, our visual reasoning model. This model can not only &ldquo;understand&rdquo; the content in images and videos but also analyze and reason with this information to provide solutions. From math problems to everyday questions, from programming code to artistic creation, QVQ-Max has demonstrated impressive capabilities.</description>128 </item>129 130 <item>131 <title>Qwen2.5 Omni: See, Hear, Talk, Write, Do It All!</title>132 <link>https://qwenlm.github.io/blog/qwen2.5-omni/</link>133 <pubDate>Thu, 27 Mar 2025 00:00:45 +0800</pubDate>134 135 <guid>https://qwenlm.github.io/blog/qwen2.5-omni/</guid>136 <description>QWEN CHAT HUGGING FACE MODELSCOPE DASHSCOPE GITHUB PAPER DEMO DISCORD137We release Qwen2.5-Omni, the new flagship end-to-end multimodal model in the Qwen series. Designed for comprehensive multimodal perception, it seamlessly processes diverse inputs including text, images, audio, and video, while delivering real-time streaming responses through both text generation and natural speech synthesis. To try the latest model, feel free to visit Qwen Chat and choose Qwen2.5-Omni-7B. The model is now openly available on Hugging Face, ModelScope, DashScope,and GitHub, with technical documentation available in our Paper.</description>138 </item>139 140 <item>141 <title>Qwen2.5-VL-32B: Smarter and Lighter</title>142 <link>https://qwenlm.github.io/blog/qwen2.5-vl-32b/</link>143 <pubDate>Mon, 24 Mar 2025 00:00:04 +0800</pubDate>144 145 <guid>https://qwenlm.github.io/blog/qwen2.5-vl-32b/</guid>146 <description>QWEN CHAT GITHUB HUGGING FACE MODELSCOPE DISCORD147Introduction At the end of January this year, we launched the Qwen2.5-VL series of models, which received widespread attention and positive feedback from the community. Building on the Qwen2.5-VL series, we continued to optimize the model using reinforcement learning and open-sourced the new VL model with the beloved 32B parameter scale under the Apache 2.0 license — Qwen2.5-VL-32B-Instruct. Compared to the previously released Qwen2.</description>148 </item>149 150 <item>151 <title>QwQ-32B: Embracing the Power of Reinforcement Learning</title>152 <link>https://qwenlm.github.io/blog/qwq-32b/</link>153 <pubDate>Thu, 06 Mar 2025 00:00:04 +0800</pubDate>154 155 <guid>https://qwenlm.github.io/blog/qwq-32b/</guid>156 <description>QWEN CHAT Hugging Face ModelScope DEMO DISCORD157Scaling Reinforcement Learning (RL) has the potential to enhance model performance beyond conventional pretraining and post-training methods. Recent studies have demonstrated that RL can significantly improve the reasoning capabilities of models. For instance, DeepSeek R1 has achieved state-of-the-art performance by integrating cold-start data and multi-stage training, enabling deep thinking and complex reasoning.158Our research explores the scalability of Reinforcement Learning (RL) and its impact on enhancing the intelligence of large language models.</description>159 </item>160 161 <item>162 <title><think>...</think> QwQ-Max-Preview</title>163 <link>https://qwenlm.github.io/blog/qwq-max-preview/</link>164 <pubDate>Tue, 25 Feb 2025 02:00:04 +0800</pubDate>165 166 <guid>https://qwenlm.github.io/blog/qwq-max-preview/</guid>167 <description>QWEN CHAT DISCORD168This is a blog created by QwQ-Max-Preview. We hope you enjoy it!169Introduction &lt;think&gt;170Okay, the user wants me to create a title and introduction for their blog announcing the release of QwQ-Max-Preview. Let me start by understanding the key points they mentioned. First, the model is part of the Qwen series, built on Qwen2.5-Max. It&rsquo;s a preview version, so they probably want to highlight that it&rsquo;s a sneak peek before the full release.</description>171 </item>172 173 <item>174 <title>Qwen2.5-Max: Exploring the Intelligence of Large-scale MoE Model</title>175 <link>https://qwenlm.github.io/blog/qwen2.5-max/</link>176 <pubDate>Tue, 28 Jan 2025 23:00:04 +0800</pubDate>177 178 <guid>https://qwenlm.github.io/blog/qwen2.5-max/</guid>179 <description>QWEN CHAT API DEMO DISCORD180It is widely recognized that continuously scaling both data size and model size can lead to significant improvements in model intelligence. However, the research and industry community has limited experience in effectively scaling extremely large models, whether they are dense or Mixture-of-Expert (MoE) models. Many critical details regarding this scaling process were only disclosed with the recent release of DeepSeek V3. Concurrently, we are developing Qwen2.</description>181 </item>182 183 <item>184 <title>Qwen2.5-1M: Deploy Your Own Qwen with Context Length up to 1M Tokens</title>185 <link>https://qwenlm.github.io/blog/qwen2.5-1m/</link>186 <pubDate>Mon, 27 Jan 2025 00:00:03 +0800</pubDate>187 188 <guid>https://qwenlm.github.io/blog/qwen2.5-1m/</guid>189 <description>Tech Report HuggingFace ModelScope Qwen Chat HuggingFace Demo ModelScope Demo DISCORD190Introduction Two months after upgrading Qwen2.5-Turbo to support context length up to one million tokens, we are back with the open-source Qwen2.5-1M models and the corresponding inference framework support. Here&rsquo;s what you can expect from this release:191Opensource Models: We&rsquo;re releasing two new checkpoints, Qwen2.5-7B-Instruct-1M and Qwen2.5-14B-Instruct-1M, marking the first time we&rsquo;ve upgraded our opensource Qwen models to handle 1M-token contexts.</description>192 </item>193 194 <item>195 <title>Qwen2.5 VL! Qwen2.5 VL! Qwen2.5 VL!</title>196 <link>https://qwenlm.github.io/blog/qwen2.5-vl/</link>197 <pubDate>Sun, 26 Jan 2025 19:08:30 +0800</pubDate>198 199 <guid>https://qwenlm.github.io/blog/qwen2.5-vl/</guid>200 <description>QWEN CHAT GITHUB HUGGING FACE MODELSCOPE DISCORD201We release Qwen2.5-VL, the new flagship vision-language model of Qwen and also a significant leap from the previous Qwen2-VL. To try the latest model, feel free to visit Qwen Chat and choose Qwen2.5-VL-72B-Instruct. Also, we open both base and instruct models in 3 sizes, including 3B, 7B, and 72B, in both Hugging Face and ModelScope.202The key features include:203Understand things visually: Qwen2.</description>204 </item>205 206 <item>207 <title>Global-batch load balance almost free lunch to improve your MoE LLM training</title>208 <link>https://qwenlm.github.io/blog/global-load-balance/</link>209 <pubDate>Tue, 21 Jan 2025 00:00:03 +0800</pubDate>210 211 <guid>https://qwenlm.github.io/blog/global-load-balance/</guid>212 <description>GITHUB HUGGING FACE MODELSCOPE DISCORD213Background The Mixture-of-Experts (MoEs) architecture has become a popular model-parameter-scale-up technique. Typically, one MoE layer consists of a router (often parameterized as one single Linear layer) and a group of experts (for transformer-based models, each expert is one feedforward layer). Given an input, only a subset of experts will be activated, and then their outputs will be aggregated based on the scores the router assigned.</description>214 </item>215 216 <item>217 <title>Towards Effective Process Supervision in Mathematical Reasoning</title>218 <link>https://qwenlm.github.io/blog/qwen2.5-math-prm/</link>219 <pubDate>Tue, 14 Jan 2025 00:00:03 +0800</pubDate>220 221 <guid>https://qwenlm.github.io/blog/qwen2.5-math-prm/</guid>222 <description>GITHUB HUGGING FACE MODELSCOPE DISCORD223Introduction In recent years, Large Language Models (LLMs) have made remarkable advances in mathematical reasoning, yet they can make mistakes, such as miscalculations or logical errors, leading to wrong conclusions. Moreover, even when achieving correct final answers, these powerful models can still regularly make up plausible reasoning steps, where the final answers build upon flawed calculations or derivations, which undermine the reliability and trustworthiness of LLMs&rsquo; reasoning processes.</description>224 </item>225 226 <item>227 <title>QVQ: To See the World with Wisdom</title>228 <link>https://qwenlm.github.io/blog/qvq-72b-preview/</link>229 <pubDate>Wed, 25 Dec 2024 00:00:03 +0800</pubDate>230 231 <guid>https://qwenlm.github.io/blog/qvq-72b-preview/</guid>232 <description>GITHUB HUGGING FACE MODELSCOPE KAGGLE DEMO DISCORD233Language and vision intertwine in the human mind, shaping how we perceive and understand the world around us. Our ability to reason is deeply rooted in both linguistic thought and visual memory - but what happens when we extend these capabilities to AI? Today&rsquo;s large language models have demonstrated remarkable reasoning abilities, but we wondered: could they harness the power of visual understanding to reach new heights of cognitive capability?</description>234 </item>235 236 <item>237 <title>QwQ: Reflect Deeply on the Boundaries of the Unknown</title>238 <link>https://qwenlm.github.io/blog/qwq-32b-preview/</link>239 <pubDate>Thu, 28 Nov 2024 00:00:03 +0800</pubDate>240 241 <guid>https://qwenlm.github.io/blog/qwq-32b-preview/</guid>242 <description>GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD243Note: This is the pronunciation of QwQ: /kwju:/ , similar to the word &ldquo;quill&rdquo;.244What does it mean to think, to question, to understand? These are the deep waters that QwQ (Qwen with Questions) wades into. Like an eternal student of wisdom, it approaches every problem - be it mathematics, code, or knowledge of our world - with genuine wonder and doubt. QwQ embodies that ancient philosophical spirit: it knows that it knows nothing, and that&rsquo;s precisely what drives its curiosity.</description>245 </item>246 247 <item>248 <title>Extending the Context Length to 1M Tokens!</title>249 <link>https://qwenlm.github.io/blog/qwen2.5-turbo/</link>250 <pubDate>Fri, 15 Nov 2024 00:00:03 +0800</pubDate>251 252 <guid>https://qwenlm.github.io/blog/qwen2.5-turbo/</guid>253 <description>API Documentation (Chinese) HuggingFace Demo ModelScope Demo254Introduction After the release of Qwen2.5, we heard the community&rsquo;s demand for processing longer contexts. In recent months, we have made many optimizations for the model capabilities and inference performance of extremely long context. Today, we are proud to introduce the new Qwen2.5-Turbo version, which features:255Longer Context Support: We have extended the model&rsquo;s context length from 128k to 1M, which is approximately 1 million English words or 1.</description>256 </item>257 258 <item>259 <title>Qwen2.5-Coder Series: Powerful, Diverse, Practical.</title>260 <link>https://qwenlm.github.io/blog/qwen2.5-coder-family/</link>261 <pubDate>Tue, 12 Nov 2024 00:00:02 +0800</pubDate>262 263 <guid>https://qwenlm.github.io/blog/qwen2.5-coder-family/</guid>264 <description>GITHUB HUGGING FACE MODELSCOPE KAGGLE DEMO DISCORD265Introduction Today, we are excited to open source the &ldquo;Powerful&rdquo;, &ldquo;Diverse&rdquo;, and &ldquo;Practical&rdquo; Qwen2.5-Coder series, dedicated to continuously promoting the development of Open CodeLLMs.266Powerful: Qwen2.5-Coder-32B-Instruct has become the current SOTA open-source code model, matching the coding capabilities of GPT-4o. While demonstrating strong and comprehensive coding abilities, it also possesses good general and mathematical skills; Diverse: Building on the previously open-sourced two sizes of 1.</description>267 </item>268 269 <item>270 <title>Qwen2.5: A Party of Foundation Models!</title>271 <link>https://qwenlm.github.io/blog/qwen2.5/</link>272 <pubDate>Thu, 19 Sep 2024 00:00:04 +0800</pubDate>273 274 <guid>https://qwenlm.github.io/blog/qwen2.5/</guid>275 <description>GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD276Introduction In the past three months since Qwen2&rsquo;s release, numerous developers have built new models on the Qwen2 language models, providing us with valuable feedback. During this period, we have focused on creating smarter and more knowledgeable language models. Today, we are excited to introduce the latest addition to the Qwen family: Qwen2.5. We are announcing what might be the largest opensource release in history!</description>277 </item>278 279 <item>280 <title>Qwen2.5-LLM: Extending the boundary of LLMs</title>281 <link>https://qwenlm.github.io/blog/qwen2.5-llm/</link>282 <pubDate>Thu, 19 Sep 2024 00:00:03 +0800</pubDate>283 284 <guid>https://qwenlm.github.io/blog/qwen2.5-llm/</guid>285 <description>GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD286Introduction In this blog, we delve into the details of our latest Qwen2.5 series language models. We have developed a range of decoder-only dense models, with seven of them open-sourced, spanning from 0.5B to 72B parameters. Our research indicates a significant interest among users in models within the 10-30B range for production use, as well as 3B models for mobile applications. To meet these demands, we are open-sourcing Qwen2.</description>287 </item>288 289 <item>290 <title>Qwen2.5-Coder: Code More, Learn More!</title>291 <link>https://qwenlm.github.io/blog/qwen2.5-coder/</link>292 <pubDate>Thu, 19 Sep 2024 00:00:02 +0800</pubDate>293 294 <guid>https://qwenlm.github.io/blog/qwen2.5-coder/</guid>295 <description>GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD296Introduction In early April, we introduced CodeQwen1.5, which garnered significant attention from the community. Since then, we have been working to enhance the coding model. Today, we are excited to announce the release of the next generation of open-source coding models, Qwen2.5-Coder, and officially rename CodeQwen to Qwen-Coder. We think &ldquo;Coder&rdquo; is more human-like and agile, reflecting our vision of it becoming a true coding partner in the future.</description>297 </item>298 299 <item>300 <title>Qwen2.5-Math: The world's leading open-sourced mathematical LLMs</title>301 <link>https://qwenlm.github.io/blog/qwen2.5-math/</link>302 <pubDate>Thu, 19 Sep 2024 00:00:01 +0800</pubDate>303 304 <guid>https://qwenlm.github.io/blog/qwen2.5-math/</guid>305 <description>GITHUB HUGGING FACE MODELSCOPE DISCORD306🚨 Qwen2.5-Math mainly supports solving English and Chinese math problems through CoT and TIR. We do not recommend using this series of models for other tasks. Introduction A month ago, we released the first series of mathematical LLMs - Qwen2-Math - of our Qwen family. Today, we have upgraded it and open-sourced Qwen2.5-Math series, including base models Qwen2.5-Math-1.5B/7B/72B, instruction-tuned models Qwen2.5-Math-1.5B/7B/72B-Instruct, and mathematical reward model Qwen2.</description>307 </item>308 309 <item>310 <title>Qwen2-VL: To See the World More Clearly</title>311 <link>https://qwenlm.github.io/blog/qwen2-vl/</link>312 <pubDate>Thu, 29 Aug 2024 00:24:00 +0800</pubDate>313 314 <guid>https://qwenlm.github.io/blog/qwen2-vl/</guid>315 <description>DEMO GITHUB HUGGING FACE MODELSCOPE API DISCORD316After a year&rsquo;s relentless efforts, today we are thrilled to release Qwen2-VL! Qwen2-VL is the latest version of the vision language models based on Qwen2 in the Qwen model familities. Compared with Qwen-VL, Qwen2-VL has the capabilities of:317SoTA understanding of images of various resolution &amp; ratio: Qwen2-VL achieves state-of-the-art performance on visual understanding benchmarks, including MathVista, DocVQA, RealWorldQA, MTVQA, etc.318Understanding videos of 20min+: Qwen2-VL can understand videos over 20 minutes for high-quality video-based question answering, dialog, content creation, etc.</description>319 </item>320 321 <item>322 <title>Qwen2-Audio: Chat with Your Voice!</title>323 <link>https://qwenlm.github.io/blog/qwen2-audio/</link>324 <pubDate>Fri, 09 Aug 2024 16:18:19 +0800</pubDate>325 326 <guid>https://qwenlm.github.io/blog/qwen2-audio/</guid>327 <description>DEMO PAPER GITHUB HUGGING FACE MODELSCOPE DISCORD328To achieve the objective of building an AGI system, the model should be capable of understanding information from different modalities. Thanks to the rapid development of large language models, LLMs are now capable of understanding language and reasoning. Previously we have taken a step forward to extend our LLM, i.e., Qwen, to more modalities, including vision and audio, and built Qwen-VL and Qwen-Audio. Today, we release Qwen2-Audio, the next version of Qwen-Audio, which is capable of accepting audio and text inputs and generating text outputs.</description>329 </item>330 331 <item>332 <title>Introducing Qwen2-Math</title>333 <link>https://qwenlm.github.io/blog/qwen2-math/</link>334 <pubDate>Thu, 08 Aug 2024 00:00:00 +0800</pubDate>335 336 <guid>https://qwenlm.github.io/blog/qwen2-math/</guid>337 <description>GITHUB HUGGING FACE MODELSCOPE DISCORD338🚨 This model mainly supports English. We will release bilingual (English and Chinese) math models soon. Introduction Over the past year, we have dedicated significant effort to researching and enhancing the reasoning capabilities of large language models, with a particular focus on their ability to solve arithmetic and mathematical problems. Today, we are delighted to introduce a series of math-specific large language models of our Qwen2 series, Qwen2-Math and Qwen2-Math-Instruct-1.</description>339 </item>340 341 <item>342 <title>Hello Qwen2</title>343 <link>https://qwenlm.github.io/blog/qwen2/</link>344 <pubDate>Fri, 07 Jun 2024 00:00:00 +0800</pubDate>345 346 <guid>https://qwenlm.github.io/blog/qwen2/</guid>347 <description>GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD348Introduction After months of efforts, we are pleased to announce the evolution from Qwen1.5 to Qwen2. This time, we bring to you:349Pretrained and instruction-tuned models of 5 sizes, including Qwen2-0.5B, Qwen2-1.5B, Qwen2-7B, Qwen2-57B-A14B, and Qwen2-72B; Having been trained on data in 27 additional languages besides English and Chinese; State-of-the-art performance in a large number of benchmark evaluations; Significantly improved performance in coding and mathematics; Extended context length support up to 128K tokens with Qwen2-7B-Instruct and Qwen2-72B-Instruct.</description>350 </item>351 352 <item>353 <title>Generalizing an LLM from 8k to 1M Context using Qwen-Agent</title>354 <link>https://qwenlm.github.io/blog/qwen-agent-2405/</link>355 <pubDate>Thu, 06 Jun 2024 11:59:59 +0800</pubDate>356 357 <guid>https://qwenlm.github.io/blog/qwen-agent-2405/</guid>358 <description>We&rsquo;ve created an agent using Qwen2 models with an 8k context size to understand documents with 1M tokens, surpassing RAG and native long-context models. This agent was also used to generate data for training new long-context Qwen models.</description>359 </item>360 361 <item>362 <title>Notes on Qwen-Max-0428</title>363 <link>https://qwenlm.github.io/blog/qwen-max-0428/</link>364 <pubDate>Sat, 11 May 2024 18:10:00 +0800</pubDate>365 366 <guid>https://qwenlm.github.io/blog/qwen-max-0428/</guid>367 <description>API DEMO DISCORD368Previously, we opensourced a series of Qwen1.5 model ranging from 0.5 to 110 billion parameters. Now, we release a larger model, Qwen-Max-0428. Qwen-Max-0428 is an instruction-tuned model for chat service. Very recently, it is available via Chatbot Arena and it has now become the top-10 in the leaderboard. Furthermore, our evaluation of MT-Bench also demonstrates that the new model outperforms our previous largest model Qwen1.5-110B-Chat.369Models MT-Bench Arena Qwen1.</description>370 </item>371 372 <item>373 <title>Qwen1.5-110B: The First 100B+ Model of the Qwen1.5 Series</title>374 <link>https://qwenlm.github.io/blog/qwen1.5-110b/</link>375 <pubDate>Thu, 25 Apr 2024 13:33:00 +0800</pubDate>376 377 <guid>https://qwenlm.github.io/blog/qwen1.5-110b/</guid>378 <description>GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD379Introduction Recently we have witnessed a burst of large-scale models with over 100 billion parameters in the opensource community. These models have demonstrated remarkable performance in both benchmark evaluation and chatbot arena. Today, we release the first 100B+ model of the Qwen1.5 series, Qwen1.5-110B, which achieves comparable performance with Meta-Llama3-70B in the base model evaluation, and outstanding performance in the chat evaluation, including MT-Bench and AlpacaEval 2.</description>380 </item>381 382 <item>383 <title>Code with CodeQwen1.5</title>384 <link>https://qwenlm.github.io/blog/codeqwen1.5/</link>385 <pubDate>Tue, 16 Apr 2024 13:33:00 +0800</pubDate>386 387 <guid>https://qwenlm.github.io/blog/codeqwen1.5/</guid>388 <description>GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD389Introduction The advent of advanced programming tools, which harnesses the power of large language models (LLMs), has significantly enhanced programmer productivity and accuracy. Notwithstanding these advancements, dominant coding assistants like Github Copilot, built upon proprietary LLMs, pose notable challenges in terms of cost, privacy, security, and potential copyright infringement. Recognizing the imperative for a more transparent and accessible alternative, the open-source community has embarked on a concerted endeavor to develop open codeLLMs.</description>390 </item>391 392 <item>393 <title>Qwen1.5-32B: Fitting the Capstone of the Qwen1.5 Language Model Series</title>394 <link>https://qwenlm.github.io/blog/qwen1.5-32b/</link>395 <pubDate>Tue, 02 Apr 2024 13:33:00 +0800</pubDate>396 397 <guid>https://qwenlm.github.io/blog/qwen1.5-32b/</guid>398 <description>GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD399Introduction The open-source community has long sought a model that strikes an ideal balance between performance, efficiency, and memory footprint. Despite the emergence of cutting-edge models like Qwen1.5-72B and DBRX, the models have faced persistent challenges such as large memory consumption, slow inference speed, and substantial finetuning costs.400A growing consensus within the field now points to a model with approximately 30 billion parameters as the optimal &ldquo;sweet spot&rdquo; for achieving both strong performance and manageable resource requirements.</description>401 </item>402 403 <item>404 <title>Qwen1.5-MoE: Matching 7B Model Performance with 1/3 Activated Parameters</title>405 <link>https://qwenlm.github.io/blog/qwen-moe/</link>406 <pubDate>Thu, 28 Mar 2024 11:31:44 +0800</pubDate>407 408 <guid>https://qwenlm.github.io/blog/qwen-moe/</guid>409 <description>GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD410Introduction Since the surge in interest sparked by Mixtral, research on mixture-of-expert (MoE) models has gained significant momentum. Both researchers and practitioners are keenly interested in understanding how to effectively train such models and assessing their efficiency and effectiveness. Today, we introduce Qwen1.5-MoE-A2.7B, a small MoE model with only 2.7 billion activated parameters yet matching the performance of state-of-the-art 7B models like Mistral 7B and Qwen1.</description>411 </item>412 413 <item>414 <title>Introducing Qwen1.5</title>415 <link>https://qwenlm.github.io/blog/qwen1.5/</link>416 <pubDate>Sun, 04 Feb 2024 13:33:00 +0800</pubDate>417 418 <guid>https://qwenlm.github.io/blog/qwen1.5/</guid>419 <description>GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD420Introduction In recent months, our focus has been on developing a &ldquo;good&rdquo; model while optimizing the developer experience. As we progress towards Qwen1.5, the next iteration in our Qwen series, this update arrives just before the Chinese New Year.421With Qwen1.5, we are open-sourcing base and chat models across six sizes: 0.5B, 1.8B, 4B, 7B, 14B, 32B, 72B, and 110B, and also an MoE model (see blog for more information).</description>422 </item>423 424 <item>425 <title>Introducing Qwen-VL</title>426 <link>https://qwenlm.github.io/blog/qwen-vl/</link>427 <pubDate>Thu, 25 Jan 2024 13:33:00 +0800</pubDate>428 429 <guid>https://qwenlm.github.io/blog/qwen-vl/</guid>430 <description>Along with the rapid development of our large language model Qwen, we leveraged Qwen’s capabilities and unified multimodal pretraining to address the limitations of multimodal models in generalization, and we opensourced multimodal model Qwen-VL in Sep. 2023. Recently, the Qwen-VL series has undergone a significant upgrade with the launch of two enhanced versions, Qwen-VL-Plus and Qwen-VL-Max. The key technical advancements in these versions include:431Substantially boost in image-related reasoning capabilities; Considerable enhancement in recognizing, extracting, and analyzing details within images and texts contained therein; Support for high-definition images with resolutions above one million pixels and images of various aspect ratios.</description>432 </item>433 434 <item>435 <title>Introducing Qwen</title>436 <link>https://qwenlm.github.io/blog/qwen/</link>437 <pubDate>Tue, 23 Jan 2024 22:13:29 +0800</pubDate>438 439 <guid>https://qwenlm.github.io/blog/qwen/</guid>440 <description>4 months after our first release of Qwen-7B, which is the starting point of our opensource journey of large language models (LLM), we now provide an introduction to the Qwen series to give you a whole picture of our work as well as our objectives. Below are important links to our opensource projects and community.441PAPER GITHUB HUGGING FACE MODELSCOPE DISCORD442Additionally, we have WeChat groups for chatting and we invite you to join the groups through the provided link in our GitHub readme.</description>443 </item>444 445 <item>446 <title>OFA: Towards Building a One-For-All Model</title>447 <link>https://qwenlm.github.io/blog/ofa/</link>448 <pubDate>Mon, 14 Nov 2022 16:01:41 +0800</pubDate>449 450 <guid>https://qwenlm.github.io/blog/ofa/</guid>451 <description>2022 is a year of generalist models! With the bloom of multimodal pretraining, especially the unified model, we have witnessed the opportunity to building a generalist model that is capable of processing tasks of different modalities or multi-modalities! Thus, we propose OFA1, namely One-For-All, a unified multimodal pretrained model that unifies understanding and generation tasks concerning modalities into a single framework, and we pretrain OFA with the instruction-based multitask-pretraining that endows it with multiple capabilities.</description>452 </item>453 454 <item>455 <title>OFASys: Enabling Multitask Learning with One Line of Code! </title>456 <link>https://qwenlm.github.io/blog/ofasys/</link>457 <pubDate>Wed, 28 Dec 2022 18:01:21 +0800</pubDate>458 459 <guid>https://qwenlm.github.io/blog/ofasys/</guid>460 <description>Intro Generalist Models are hot! We all see an opportunity towards a real generalist model by multimodal multitask learning. We previously release an opensourced unified multimodal pretrained model OFA for this goal. However, we actually met a lot of difficulties in our implementation. For example, it is hard to set up multiple tasks concerning multiple modalities, and it is hard to organize multitask learning, e.g., how to batchify your data and how to make your training stable.</description>461 </item>462 463 <item>464 <title>Chinese CLIP: Contrastive Vision-Language Pretraining in Chinese</title>465 <link>https://qwenlm.github.io/blog/chinese-clip/</link>466 <pubDate>Sat, 24 Dec 2022 14:54:19 +0800</pubDate>467 468 <guid>https://qwenlm.github.io/blog/chinese-clip/</guid>469 <description>CLIP1 is a phenomenal playmaker in vision and multimodal representation learning. It plays not only as a foundation model but also a bridge between vision and language. It has triggered a series of research in different fields, especially text-to-image generation. However, we find that there is a necessity for a language-specific CLIP for applications, especially cross-modal retrieval, and there is no opensourced Chinese CLIP with good performance. We therefore launched this project to promote the Chinese multimodal representation learning.</description>470 </item>471 472 </channel>473</rss>474