DeepSeek V4, GLM 5.2, Kimi K2.6, Kimi K3, MiniMax M3, Qwen3 VL, and Gemma 4. Compare the best open-source LLMs of 2026 by benchmarks, context window, and use case.

The best open-source LLMs in 2026 are DeepSeek V4, GLM 5.2, Kimi K2.6, Kimi K3, MiniMax M3, Qwen3 VL 235B, and Google Gemma 4 31B. These seven lead the latest open source LLMs on benchmarks and real-world use. Kimi K3, with full weights released July 27, posts 93.5% on GPQA Diamond. Gemma 4 31B brings dense-model performance to 85.2% MMLU and 80.0% SWE-Bench. DeepSeek V4 ships in two variants, Pro and Flash, both with 1M context windows. OpenAI also entered the open-source space with GPT oss 120b and 20b, though those models are not yet frontier-grade. The seven on this list are competitive with proprietary models on coding and math benchmarks, and you can self-host every one of them.
The field has moved fast. Two years ago, LLaMA 3 and Falcon topped most lists. Today, the frontier belongs to sparse mixture-of-experts models from labs in China, plus Google's efficient Gemma line. If you're new to the topic, start with what an LLM is before picking a model.
Build with open-source LLMs on TelnyxTelnyx hosts open-source and proprietary LLMs with co-located telephony and AI infrastructure. Sub-500ms latency, one API, one bill. Explore the LLM Library
Get started| Model | Context window | Standout benchmark |
|---|---|---|
| DeepSeek V4 Pro | 1M | 80.6% SWE-Bench |
| DeepSeek V4 Flash | 1M | 85.9% BrowseComp |
| GLM 5.2 | 1M | 54.7% Humanity's Last Exam |
| Kimi K2.6 | 256K | 80.2% SWE-Bench |
| Kimi K3 | 1M | 93.5% GPQA Diamond |
| MiniMax M3 | 1M | 93% GPQA Diamond |
| Qwen3 VL 235B | 256K (up to 1M) | 87.1% MMLU |
| Gemma 4 31B | 262K | 85.2% MMLU |
DeepSeek V4 comes in two variants. Pro is the heavyweight. It scores 80.6% on SWE-Bench and 90.1% on GPQA Diamond. Flash trades a little raw power for speed and cost. It still holds its own with 79% on SWE-Bench and 88.1% on GPQA Diamond.
Flash has one trick Pro does not. It leads the field on BrowseComp at 85.9%. That benchmark tests how well a model finds hard-to-locate information on the web. If your workload involves agentic search, Flash is the pick.
| Variant | SWE-Bench | GPQA Diamond | HLE |
|---|---|---|---|
| V4 Pro | 80.6% | 90.1% | 48.2% |
| V4 Flash | 79% | 88.1% | 51.6% |
Both variants use a Mixture-of-Experts architecture with 671B total parameters and 37B active per token. Both offer a 1M context window. Math remains a strength, with 96.0% on GSM8K. Licensing is permissive under Apache 2.0 and MIT, so commercial use is straightforward.
Best for: Teams that want frontier-level coding and reasoning without frontier-level costs. Pick Pro for depth. Pick Flash for agentic web tasks.
Zhipu AI's GLM 5.2 sits at the top of the Vellum leaderboard, and it earned the spot. The model packs 744B total parameters with 40B active per token, plus a 1M-token context window. That context size changes what's practical. You can feed it an entire codebase or a multi-hour transcript in a single request.
Its scores hold up across the hardest evaluations in use today:
Best for complex systems engineering and agents that need to hold a lot of state over long sessions. Zhipu ships GLM under an MIT-style license. Check the model card on HuggingFace for the exact terms of your version.
Moonshot AI's Kimi K2.6 is the largest model on this list at 1 trillion total parameters, though only 32B activate per token. It ranks second overall on Vellum and leads most computer-use evaluations. This is the model people reach for when they want an agent that can actually operate software in production.
The numbers back that up:
Best for autonomous agents, computer use, and coding. Moonshot releases K2 models under a modified MIT license, so read the terms before commercial deployment. In practice the restrictions are light.
Moonshot AI released Kimi K3 in July 2026 and published full weights on July 27, 2026. The model uses a mixture-of-experts architecture with 2.8T total parameters, activating 16 of 896 experts per token, per Moonshot's model card. That keeps inference costs far below what the raw parameter count suggests.
The headline number is reasoning. Kimi K3 scores 93.5% on GPQA Diamond, the highest of any open model per the Onyx leaderboard. Its 1M-token context window handles entire codebases, long legal documents, or multi-session agent histories without truncation.
Moonshot publishes K3 under a modified MIT license with light commercial restrictions. Read the model card before deployment.
Best for: Reasoning-heavy workloads at frontier scale. If your application needs graduate-level scientific reasoning or long-document analysis with open weights, Kimi K3 is the current ceiling.
MiniMax M3 is the reasoning specialist. Its 93% on GPQA Diamond is the second-highest in this group, behind Kimi K3, and it pairs that with a 1M-token context window. It also posts 80.5% on SWE-Bench Verified, edging out Kimi K2.6, and 70.1% on OSWorld for computer use.
What stands out in daily use:
Best for reasoning-heavy work and agentic coding pipelines. MiniMax publishes open weights under a permissive license. As with GLM, confirm the current terms on the model card before you ship.
Alibaba's Qwen3 VL 235B is the multimodal entry on this list. It's a 235B-parameter MoE model with 22B active per token, and it handles images and text in one model. Native context is 256K tokens, expandable to 1M. It scores 87.1% on MMLU and 90.3% on GSM8K per Alibaba's model card, so the vision capability doesn't come at the cost of language performance.
Where it earns its spot:
Best for visual comprehension, multilingual OCR, and GUI automation. If your product touches documents, screenshots, or interfaces, this is the open model to test first. It also pairs well with conversational AI applications that need to see what users see.
Google released Gemma 4 31B IT in April 2026 under an Apache 2.0 license, per Google's model card. Unlike the MoE giants on this list, it is a dense 32.2B-parameter model. That makes it practical to run on a single high-memory GPU or on-device hardware.
The jump from Gemma 3 is substantial. Context grew from 128K to 262K tokens. MMLU rose from 76.9% to 85.2%. GPQA Diamond sits at 84.3%. Gemma 4 posts an 80.0% SWE-Bench score, a benchmark Gemma 3 did not register on, per the Onyx leaderboard and Fireworks AI data.
Why small teams keep choosing it:
Best for local deployment and on-device workloads where data can't leave your infrastructure. The dense architecture and Apache 2.0 license make it the strongest small open model for regulated environments.
OpenAI entered the open-source space. The company released two open-weight models, GPT oss 120b and GPT oss 20b. The larger model scores 14.9% on Humanity's Last Exam with a 131K context window. The smaller one scores 10.9%.
Neither model competes with DeepSeek or GLM on hard reasoning benchmarks. That is not the point. These are smaller, efficient models from the biggest name in the industry, and they run on modest hardware.
The signal matters more than the scores. When OpenAI publishes open weights, the market has shifted. The next release could be a real contender.
Open-source models give you the weights. You can inspect them, fine-tune them, self-host them, and switch providers whenever you want. Closed models like GPT and Claude give you an API and nothing else. You trade control for convenience.
The performance gap has mostly closed. GLM 5.2 and Kimi K3 are competitive with proprietary frontier models on SWE-Bench and GPQA Diamond. The remaining differences come down to operations, not capability:
For most production workloads in 2026, an open model behind a managed inference API is the sensible default.
Match the model to the job, not the leaderboard. A 1T-parameter model is the wrong answer if your workload fits on a 31B model running locally.
Work through these questions in order:
Cross-check candidates on the HuggingFace leaderboard with your own eval set. Public benchmarks tell you a model is competent. Only your data tells you it fits.
The direction is clear. Open models are catching closed ones, and the gap closes every quarter.
Here is what to watch in 2026 and beyond:
The takeaway is simple. Pick the model that fits your task, not the one with the biggest headline number. Test it on your own workload before you commit.
Open models are getting fast enough for real-time conversation. Platforms now pair them with Voice AI infrastructure and a Speech-to-Text API on the same network. If you want to see what that looks like in practice, here's how to build an AI voice agent end to end.
Start building with open-source LLMsAccess DeepSeek, GLM, Qwen, and more through a single API. Co-located with telephony for sub-500ms voice AI. No multi-vendor Frankenstack. Try the LLM Library
Get startedRelated articles