LLM-Based 3D NPC Interaction Platform Unveiled
Key point
NPC-Playground, an open-source project that implements intelligent NPCs in 3D environments using LLMs' function calling capabilities, has been unveiled.
Details
NPC-Playground is a 3D demo platform designed to let in-game characters (NPCs) leveraging LLMs hold realistic conversations, perform complex actions, and follow commands.
This project is built on three core technology stacks:
- Cubzh: An open-source UGC game engine that lets users create content directly.
- Gigax: A platform for running LLM-based NPCs at scale, using Function Calling principles so that NPCs can perform specific actions (e.g.,
<say>,<jump>,<attack>) within the 3D environment. - Hugging Face Spaces: An environment for hosting the demo and sharing the idea open-source.
Gigax provides fine-tuned models optimized for NPC interaction. Users can directly download models based on Phi-3 and Mistral-7B from the Hugging Face Hub.
Developers can teach NPCs new skills or set up custom personas through Lua scripting, and the entire stack is open-sourced via GitHub.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.