Open Bias releases LLM policy proxy
·2026.04.26 07:56
Key point
Open Bias enforces RULES.md-based rules in front of LLM calls.
1 / 2
Details
Open Bias is a proxy that sits between LLM applications and model providers, reading RULES.md to evaluate requests and responses in real time.
- It applies pending interventions in pre-call, and runs sync/async engines in post-call.
- Violations are handled in three ways:
block,intervene,shadow. - It provides a default starter
RULES.mdand an automatic evaluator, and lets you adjust the engine, tracing, and enforcement method viaopenbias.yaml. - Engines are divided into
judge,nemo,fsm, andllm;judgeis async so core-path latency is 0ms,nemois 200-800ms, andfsmandllmare experimental. - Non-critical violations are processed asynchronously to be reflected in the next turn, and existing OpenAI-compatible clients can connect just by changing
base_urltohttp://localhost:4000/v1.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.