AI BriefingBuilding the No.1 LLM Comparison Tool with Bounties: nat.dev
Key point
Former GitHub CEO Nat Friedman built the LLM comparison tool nat.dev through Replit Bounties.
Details
Former GitHub CEO Nat Friedman wanted to build a playground where developers could test and compare various LLMs. He envisioned a tool that would offer functionality similar to OpenAI's playground while supporting a variety of models, including:
- Hugging Face
- Anthropic
- Forefront
- Cohere
Nat used Replit Bounties to quickly find a hacker to implement the idea. In this process, Alexandr Wang (CEO of Scale AI) and Matt Huang (co-founder of Paradigm) joined as co-investors to support the project.
Developer Zain Huda went beyond simply applying by demoing a working prototype directly on Twitter, catching Nat's attention, and was ultimately selected as the developer. Alex Lourenco later joined to complete the model comparison and hosting features.
nat.dev became the most popular LLM comparison tool in February 2023, and Nat open-sourced the code in April 2023.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.
Related
Qwen3.5-based Small Decision Model 'Kev' Released with TypeSafe API Compatibility and Performance MetricsJevper Released: A Jev Classification Wrapper for OpenAI-Compatible Models with Automatic Logprobs Detection