AI Briefing#apple-silicon
The latest AI and developer news about #apple-silicon, with the original source and a short summary.
The latest AI and developer news about #apple-silicon, with the original source and a short summary.
Vyact, an open-source desktop app integrating local LLMs with documents, browsers, and coding features, has been released.
PyTorch 2.14 has officially launched with the NVGEMM backend and distributed training fault tolerance features, while securing ABI stability for torchvision.
The Apple Silicon-specific inference engine Lily achieved a 35% improvement in decoding speed and high hardware utilization compared to MLX-LM.
A new llama.cpp branch featuring Metal and n-gram SSD offload optimizations has been released, improving Qwen-3.8-Flash-Next inference performance on Apple Silicon.
Apple has unveiled the new Mac Studio featuring the M5 Max and M5 Ultra chips.
Apple unveiled the M6 chip based on the 2-nanometer process and the M5 Ultra chip with a quad-die architecture, significantly enhancing performance and AI computing.
A new technique leveraging parallel ANE and GPU execution on Apple Silicon improves LLM Prefill speed by up to 50%.
An abliterated version of Qwen3.8-27B with censorship removed has been released in MLX format for Apple Silicon.
Released an MLX quantized version of Qwen3.8-27B with safety alignment removed for Apple Silicon.
Redis developer antirez released h3.c, a C/Metal-based inference engine that runs the MiniMax H3 model on Apple Silicon.
llama.cpp inference speed on Apple Silicon macOS VMs was increased up to 16x using a Metal compatibility layer.
Apple has unveiled a new audio synthesis architecture that generates high-quality speech in real time while minimizing memory usage.
Logue, a privacy-focused meeting notes app that runs 100% on-device using MLX on Apple Silicon, has been open-sourced.
A technology was unveiled that performs RL post-training using 14 Macs distributed across 4 countries worldwide.
An Apple Silicon executive revealed the demand for Mac mini to power AI agents and Apple's on-device AI strategy.
A research paper that reverse-engineers and analyzes the architecture and operating principles of the Neural Engine (ANE), Apple Silicon's AI accelerator.
tunelab, an open-source tool that shifts repetitive LLM tasks to local small models to cut costs and verify accuracy, has been released.
A native app has launched that converts photos into 3D Gaussian Splats using the Mac GPU with no separate setup required.
Ultra-lightweight 1-bit and Ternary Bonsai Image 4B models have been released, enabling high-quality image generation on local devices.
Unsloth Studio now supports model training using MLX on Mac.
Conifer, an open-source local inference engine for Apple Silicon, has been unveiled and is recruiting beta testers.
The SDK 'Cider,' which supports W8A8 activation quantization on Apple Silicon by addressing MLX's limitations, has been released.
An MLX port has been implemented that allows Cohere's 218B MoE model, Command A+, to run on Apple Silicon.
AWS has secured M3 Ultra Mac Studio units, which are not available for general purchase, and is offering them via the cloud.