Muse Open-Sources Device SDKs for Building Custom AI Hardware Gadgets

Muse has released the source code for its device SDKs and firmware as open-source software under the Apache 2.0 license. The project, hosted on GitHub under the facebookincubator organization, allows developers to build custom hardware devices that interface with the Muse AI assistant. The documentation describes the project as being built by hackers, for hackers, and encourages users to connect Muse to displays, buttons, sensors, and actuators using off-the-shelf components.

Supported Hardware and SDKs

The SDK provides two primary integration paths:

• ESP32 Device SDK: Enables connection of ESP32 boards to Muse, supporting features like image display on screens, audio input/output, and integration with various sensors.
• Linux Device SDK: Allows Raspberry Pi or other Linux boxes to act as Muse gadgets, facilitating tasks such as system administration or integration with Home Assistant.

Featured Project Examples

The documentation highlights several reference implementations and compatible devices:

• Raspberry Pi 5: Used for Home Assistant and Linux application integration.
• Waveshare ESP32-S3-Touch-AMOLED-1.75C: A round touch screen device with push-to-talk, speaker, mic, and battery.
• Seeed reTerminal E1002: A color e-ink display for showing briefings, reminders, or lists.
• M5Stack StickS3: A pocket-sized device with a color status screen and button.
• AiPi Lite: A desk buddy with push-to-talk and color screen capabilities.
• Home Assistant Voice Preview Edition: Supports push-to-talk and LED status rings.
• Muse on your TV: An upcoming HDMI stick for displaying Muse content on large screens.

Community and Availability

The project encourages community contribution through a dedicated Discord server. While the SDK and firmware are open-source, the source notes that the hardware devices listed are manufactured by third parties and are not endorsed or warranted by Meta. The Muse Home Link is currently available only to Muse subscribers in the United States, with a claim system to reserve shipping slots.