LLM Fallback Proxy Trooper V2 Released

Trooper is a lightweight Go-based proxy that operates between applications and cloud LLMs. When a cloud provider's API quota or rate limit is reached, it provides the ability to instantly switch to a local model while preserving conversation context.

Key features are as follows:

• Local-first design: Ollama is set as the top priority to enhance data privacy, with cloud models used only when needed.
• Smart Chain: You can configure various API keys such as Claude, Gemini, and OpenAI to set up chaining between models.
• Context Preservation: Since the full conversation history is managed server-side, uninterrupted conversation is possible even when switching from cloud to local.
• Easy adoption: It can be used immediately just by changing the Base URL to localhost:3000, with no code modifications required.

The project is publicly available as open source.