Open-Source Stack ODS Released for Building Local AI Servers

ODS (Osmantic Deployment System) is an open-source project that installs various AI tools that previously had to be set up individually—Ollama, Open WebUI, n8n, ComfyUI, and more—through a single line of script.

Upon installation, it builds an integrated environment that includes the following features:

• Chat and Inference: Open WebUI, llama-server, LiteLLM (with hybrid mode support), TEI embedding service
• Voice and Agents: Whisper (speech recognition), Kokoro (speech synthesis), Hermes Agent, n8n (workflow automation)
• Knowledge and Search: Qdrant (vector DB), SearXNG (web search), Perplexica (research engine)
• Generation and Operations: ComfyUI (image generation), Privacy Shield, a dashboard for GPU status and model management

Through automatic hardware detection, it automatically selects a GGUF model optimized for the user's GPU memory capacity, and it supports Linux, macOS, and Windows environments. It also offers an option to run using cloud APIs even in environments without a GPU.