Moonshot AI Releases Kimi K3 Open-Weight Model on Hugging Face | ai-models
Moonshot AI released the full open weight Kimi K3 model on July 27, 2026 via Hugging Face, following prior API access launched July 16, 2026. The 2.8 trillion…
Published on MyPrivateClaw
Jul 28, 2026, 3:09 AM UTC
Coverage date
Jul 27, 2026
Last updated
Jul 28, 2026, 3:09 AM UTC
News summary
Kimi K3 is a 2.8 trillion parameter sparse mixture of experts (MoE) transformer with native vision, comprising 896 total experts with 16 selected per token and an activated parameter count of approximately 104 billion, according to architecture as published by the model author with community verification pending independent reproduction. The model uses MXFP4 weights with MXFP8 activations, trained via quantization aware training from the SFT stage onward rather than post training quantization. Kimi K3 supports a context length of 1,048,576 tokens (one million) with Kimi Delta Attention and Gated MLA attention layers. Both the model weights and code repository are released under the Kimi K3 License, which permits free use but requires separate agreement from Moonshot AI for Model as a Service operators exceeding $20 million annual revenue. Moonshot AI reports Kimi K3 achieves 93.5 on GPQ…