AI BriefingHugging Face releases AnyLanguageModel 1.0 for local and hosted LLM inference on Apple platforms
·2026.10.20 09:00
Key point
The 1.0 release adds support for OpenAI, Anthropic, and Gemini APIs alongside local models like Gemma 4 E2B and Qwen3.8 27B.
Details
- AnyLanguageModel 1.0, swift-huggingface 1.0, and swift-xet 1.0 are released, providing a drop-in replacement for Apple's Foundation Models framework.
- The library supports a unified API for local inference via llama.cpp, MLX, and Core ML, as well as hosted providers including OpenAI, Anthropic, Google Gemini, and Ollama.
- Key features include tool calling, guided generation, and image support across all providers, with reasoning blocks automatically managed when switching providers.
- Recommended local models include Gemma 4 E2B (3.4 GB) and LFM2.5 2.6B (1.7 GB) for iPhone, and Qwen3.8 27B (16 GB) for Macs with 32 GB or more memory.
- The library now runs on Linux, allowing the same code to be used for server-side inference.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.