AI Briefing
KO

Open Bias releases LLM policy proxy

·2026.04.26 07:56

Key point

Open Bias enforces RULES.md-based rules in front of LLM calls.

1 / 2

Details

Open Bias is a proxy that sits between LLM applications and model providers, reading RULES.md to evaluate requests and responses in real time.

  • It applies pending interventions in pre-call, and runs sync/async engines in post-call.
  • Violations are handled in three ways: block, intervene, shadow.
  • It provides a default starter RULES.md and an automatic evaluator, and lets you adjust the engine, tracing, and enforcement method via openbias.yaml.
  • Engines are divided into judge, nemo, fsm, and llm; judge is async so core-path latency is 0ms, nemo is 200-800ms, and fsm and llm are experimental.
  • Non-critical violations are processed asynchronously to be reflected in the next turn, and existing OpenAI-compatible clients can connect just by changing base_url to http://localhost:4000/v1.

This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.

Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.