Wayfinder Router: Deterministic Query Routing Between Local and Hosted LLMs

Wayfinder Router is a tool that forwards queries to either local models or cloud models by analyzing structural features of the prompt (length, headings, lists, presence of code) and lexical cues (math, proofs, constraints, etc.).

Unlike existing routers such as RouteLLM or Martian, which determine routing through a separate model call (a Classifier or LLM Judge) and thus incur latency and cost, Wayfinder uses deterministic structural analysis.

Key features:

• Zero Model Call: No additional model call is needed for routing decisions, resulting in near-zero latency and no cost.
• Fully Offline: Runs instantly on the local machine without a network connection.
• Customizable: Thresholds can be calibrated based on user data.
• Cost Efficiency: Automatically distributes low-difficulty tasks such as simple summarization or typo correction to local models, while routing complex tasks to high-performance cloud models to optimize cost.