Claude Fable 5.1 Agent Swarm Generates 3D Worlds Based on Real Terrain in San Francisco and Kyoto

The autonomous agent swarm of Claude Fable 5.1 generated 3D worlds based on the real terrain of Union Square in San Francisco and Higashiyama in Kyoto, utilizing OpenStreetMap, USGS elevation data, and public reference images. This project was implemented purely with Three.js and Canvas2D code, without game engines or proprietary 3D tiles, and was released in a form executable via npm run dev.

San Francisco Union Square

453 buildings, 129 shops, 220 pedestrians, and 109 vehicles (including cable cars) are simulated in real time. It also includes two interior spaces, Apple Union Square and Nintendo SAN FRANCISCO, supporting lighting changes for day/sunset/night. A QA process compared 34 camera viewpoints against actual photos.

Kyoto Higashiyama

A 2.3km walking route from Gion to Kiyomizu-dera was rendered in an anime background style. It includes 266 buildings, 471 shops, and 1,938 trees, with all textures generated at runtime via Canvas2D without binary assets. Using 1m LiDAR data from the Geospatial Information Authority of Japan (GSI), it corrected previously misreported figures (e.g., Yasaka Pagoda height of 38.79m) and improved precision.

Technical Features and License

The pipeline followed a process where parallel research agents collected data, Blender scripts generated GLB assets, and Playwright-based camera matching QA verified visual accuracy. The code and generated assets are released under the MIT license, with geometry based on OpenStreetMap (ODbL) and USGS 3DEP (public domain) data.