AI Briefing
KO

Qwen 3.6 1L Benchmark

·2026.04.17 06:47

Key point

A case of running Qwen 3.6 35B on an RTX 2000 Ada 16GB at 400 t/s prompt and 24 t/s generation.

Details

Ran Qwen 3.6 35B A3B Q4_K_M (Unsloth) on a p3 tiny gen 2 and RTX 2000 Ada 16GB, achieving a prompt speed of 400 t/s and a generation speed of 24 t/s.

The key was applying the llama.cpp PR 21793 change to align with Claude Code, along with the prompt prefix cache.

benchmarkqwenquantizationclaude-codelocal-llmprompt-cachingllama-cpp
Read originalShare on Threads

This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.

Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.

Related

RedditMica v0.1 4B Released: Open-Source Decision Model for Agent Loops Trained for Under $30RedditTextCLF Releases Calibration-Free TQ Quantization Method and Open-Source Quant FactoryTLDR AIQwen Intelligence Launches Three Mobile AI Agents and Open Benchmark SuitePyTorchKRPrismML Releases 'Ternary Bonsai 2 27B', a Ternary Quantized Model Maintaining 98.2% of FP16 PerformanceHacker NewsApple Releases LensVLM-9B for Processing Compressed Text ImagesOpenAI BlogOpenAI Releases Prompt Caching Optimization Guide and Diagnostic Tools for GPT-6 Models