AI Briefing
KO

Kimi K3 GGUF Released

·2026.08.07 17:47

Key point

Unsloth has released the massive GGUF quantized files for Kimi K3.

Details

Unsloth has released the Kimi K3 GGUF quantized files on Hugging Face.

The current file sizes are as follows:

  • UD-Q1_0: 466GB
  • TQ2_0: 551GB
  • TQ1_0: 509GB
  • IQ1_M: 649GB

Even the smallest quantized version reaches 466GB, requiring substantial memory and storage to run locally or on self-hosted servers.

huggingfacequantizationunslothggufllm-inferencekimi-k3
Read originalShare on Threads

This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.

Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.

Related

RedditCommunity Template Fix Corrects GPT-OSS Bug That Dropped Answers in Multi-Turn ChatsRedditTextCLF Releases Calibration-Free TQ Quantization Method and Open-Source Quant FactoryPyTorchKREdge0 Runs 35B MoE Model on 3GiB Memory via SSD StreamingPyTorchKRNVIDIA Releases Model Lightweighting ToolTLDR AIThe Efficient Frontier of LLM Inference (6-minute read)TLDR AIvLLM v0.28.0 Released with Major Optimizations for Kimi-K3 and DeepSeek V4