Run new open models right, the first time.

One card per model: which quant, which chat template fix, which sampling settings, and what actually works in vLLM, llama.cpp, Ollama, LM Studio, MLX and your coding agent. Every claim links to its source.

Which model fits my hardware? →

Latest cards

DeepSeek-V4.1-Flash

DeepSeek · verified 2026-10-16

Multimodal MoE: 552B backbone params, 8B/16B activated, 1M context, MIT license. No Jinja chat template ships; local runs today mostly via antirez's DwarfStar SSD-streaming engine on Macs.

Template Caveats · 0 works · 0 caveats · 9 unverified

Gemma 4 (26B-A4B / 31B)

Google DeepMind · verified 2026-10-16

Apache-2.0 multimodal family. 26B-A4B MoE for speed, 31B dense for quality. New thinking control tokens and a strict multi-turn rule.

Template Works · 4 works · 0 caveats · 5 unverified

GLM-4.7-Flash (30B-A3B)

Z.ai · verified 2026-10-16

30B-A3B MoE, MIT license. Still a community favorite for 16-24 GB setups months after release.

Template Unverified · 4 works · 0 caveats · 5 unverified

GLM-5.3-Flash (320B-A18B)

Z.ai · verified 2026-10-16

First natively multimodal GLM-5 model: 320B total, 18B active, MIT license. Thinking budget via reasoning_effort (low/high/max, default max).

Template Works · 1 works · 0 caveats · 8 unverified

gpt-oss-120b / 20b

OpenAI · verified 2026-10-16

Apache-2.0 MoE models shipped natively in MXFP4. Uses the Harmony format; many early Jinja templates rendered it wrong.

Template Caveats · 3 works · 0 caveats · 6 unverified

KAT-Coder-V2.5-Dev (35B-A3B)

Kwaipilot (Kuaishou) · verified 2026-10-16

Open-weight coding model: 35B MoE, 3B active, 262K native context, Apache-2.0. Language-model weights only (no vision tower). Qwen-style reasoning and tool parsers.

Template Works · 1 works · 1 caveats · 7 unverified

Kimi K3

Moonshot AI · verified 2026-10-16

2.8T-parameter native multimodal agentic model with 1M context. Top of open-weight leaderboards; data-center hardware only (smallest Unsloth GGUF is 594 GB).

Template Caveats · 1 works · 0 caveats · 8 unverified

Kolibri-1 (78B-A3.5B)

Aleph Alpha · verified 2026-10-16

European Apache-2.0 MoE: 78B total, 3.46B active, 262K native context (1M by extrapolation). Reasoning effort low/high or none.

Template Works · 1 works · 0 caveats · 8 unverified

Laguna XS 2.1 (33B-A3B)

poolside · verified 2026-10-16

Agentic coding MoE, 33B total / 3B active, 262K context, OpenMDW-1.1 (fully permissive). Vendor says it runs on a 36 GB Mac.

Template Caveats · 1 works · 3 caveats · 5 unverified

LFM2.5-24B-A2B

Liquid AI · verified 2026-10-16

24B MoE with 2.45B active, 131K context, always reasons before answering. Built for fast on-device agents; vendor claims it beats Qwen3.6-35B-A3B on LiveClaw.

Template Works · 3 works · 0 caveats · 6 unverified

MiMo-V2.6-Flash

Xiaomi · verified 2026-10-16

Sparse MoE, 309B total / 15B active, 1M context, MIT license. Popular on r/LocalLLaMA for agentic coding on big-memory rigs.

Template Unverified · 1 works · 0 caveats · 8 unverified

MiniCPM-V 4.7 (35B-A3B)

OpenBMB · verified 2026-10-16

Vision-language MoE, 35B total / 3B active, Apache-2.0. OpenBMB's llama.cpp-omni fork adds Lookahead Expert Scheduling to stream experts on low-memory devices (vendor demos on iPhone/iPad).

Template Works · 3 works · 0 caveats · 6 unverified

Mistral Small 4 (119B, 2603)

Mistral AI · verified 2026-10-16

119B MoE (128 experts, 4 active), 256K context, text+image input, Apache-2.0. reasoning_effort none/high.

Template Works · 2 works · 0 caveats · 7 unverified

Muse Spark Open (816B-A42B)

Meta · verified 2026-10-16

Meta's 816B MoE (42B active), 1M context, natively multimodal, gated Muse Model License. Meta quotes 700 GB VRAM for NVFP4; community runs on dual 512 GB Mac Studios.

Template Unverified · 2 works · 0 caveats · 7 unverified

Nemotron 3.5 Bolt 74B-A9B (24GB)

NVIDIA · verified 2026-10-16

Vision-language MoE compressed from Nemotron 3.5 Super VL (120B-A12B) to 74B with 9B active, shipped with experts at native 2-bit so it fits in about 24 GB. 256K context. Built for local agents in llama.cpp.

Template Works · 1 works · 0 caveats · 8 unverified

Nemotron 3.5 Lightning 30B-A3B

NVIDIA · verified 2026-10-16

Hybrid Mamba-2 + MoE + attention, 30B total / 3B active, up to 1M context, MTP layers, pre-trained in NVFP4. Fast small agent model.

Template Works · 2 works · 0 caveats · 7 unverified

Qwen3.6-27B

Alibaba Qwen · verified 2026-10-16

Dense 27B hybrid-thinking model, popular for local agentic coding. Most pain is chat-template / tool-call handling in agent loops.

Template Caveats · 3 works · 3 caveats · 3 unverified

Qwen3.6-35B-A3B

Alibaba Qwen · verified 2026-10-16

MoE sibling of Qwen3.6-27B (3B active). Faster decode; same template family and same tool-call caveats.

Template Caveats · 3 works · 1 caveats · 5 unverified

Qwen3.8-27B

Alibaba Qwen · verified 2026-10-16

Newest dense Qwen with reasoning_effort control. Biggest gotcha: official template defaults to xhigh reasoning, which can burn the token budget.

Template Caveats · 2 works · 0 caveats · 7 unverified

Qwen3.8-Flash-Next (125B-A6B preview)

Alibaba Qwen · verified 2026-10-16

Experimental preview of the Qwen4 architecture: 125B MoE with 6B active (plus 51B n-gram embedding and 4B MTP). 262K native context. Thinks by default. Big-memory box territory.

Template Works · 1 works · 0 caveats · 8 unverified