#vellium
The latest AI and developer news about #vellium, with the original source and a short summary.
The latest AI and developer news about #vellium, with the original source and a short summary.
The update reduces system prompts from ~8k to ~1k characters and uses plain text markers instead of JSON to ensure reliable performance on smaller local models like Gemma 12B.
Vellium v1.1.0 released an update supporting local STT/TTS and automatic llama.cpp detection.