AI BriefingMiniCPM5-2B-GGUF: Tool-Calling Model with 2B Parameters for Edge Devices
openbmb/MiniCPM5-2B-GGUF
About the project
The lightweight MiniCPM5 model with 2B parameters has been released in GGUF format. It offers various quantization versions such as Q4_K_M, Q8_0, and F16, enabling efficient execution on local environments or edge devices.
Beyond simple text generation, it supports tool calling and long-context processing. It is designed to operate reliably in agent workflows and complex conversational scenarios.
It is compatible with major inference engines such as llama.cpp, Ollama, and vLLM. Optimized for English and Chinese processing, it can be easily integrated into the open-source ecosystem, which also considers commercial use under the Apache 2.0 license.
openbmb/MiniCPM5-2B-GGUF
The original page has no description.
text-generation
This introduction was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report errors, attribution issues, or removal requests via Contact.