Files
local-ai/docs
Claude 6d6a47e028 Honest quality ratings: 35B-A3B is B+ not A-, add reality checks
The 35B-A3B MoE activates only 3B params per token - quality tracks
active params, making it more like a smart 7B than a true 35B. Revised
rating to B+ to A-. The 27B dense model is the real A- but needs 17GB
weights. Also notes: 262K is a VRAM ceiling not a quality guarantee,
Q4 quantization costs something, and context quality degrades at edges.
Practical high-quality context is more like 64-128K.

https://claude.ai/code/session_01PtYTPherSJaxDEVPgF6Nxu
2026-03-22 17:11:49 +00:00
..