Meta opened the code necessary for users to create their own devices equipped with the Muse, its new artificial intelligence (AI) agent. The initiative allows connecting the system to different types of hardware, including ESP32 boards and Raspberry Pi computers, as well as screens, buttons, sensors, and other components.
The proposal transforms Muse into a platform that can be integrated into custom projects. Instead of relying solely on devices developed by Meta itself, users can build their own gadgets using components available on the market.
According to the company, the code of the Muse Gadget SDK was released as open source. The tool allows programming an ESP32 board or configuring a Raspberry Pi to connect Muse to different devices.
Muse can have screens and sensors
- Meta suggests several uses for the so-called Muse gadgets. One of them is connecting the agent to a colored E Ink screen to display reminders;
- Another possibility is using an HDMI-connected device to place Muse on a large screen. It is also possible to use a small touch-sensitive screen to create something similar to the Muse Charm, a device developed by Meta itself;
- The company describes the gadgets as open-source devices that can be built by the users themselves;
- “Muse gadgets are open-source devices that you build yourself,” says Meta. “Program an ESP32 board available on the market or set up a Raspberry Pi with our SDKs and connect Muse to your screens, buttons, sensors, actuators, and everything else you have on your workbench.”;
- However, the company warns users who decide to try the projects: “Proceed at your own risk”;
- The open-source code also allows developers to create more specific applications for the AI agent. In practice, the same system can be adapted to different device formats, depending on the available components.
Read more:
- Muse: What to Expect from Meta's AI Agent in Brazil
- Meta denies that Muse has read private messages without authorization
- U.S.: Justice Could Impose a R$ 208 Billion Fine on Facebook's Owner
Meta suggests various uses for the so-called Muse gadgets – Image: Ascannio/Shutterstock
Meta also created a home gadget
In addition to releasing the tools for creating custom devices, Meta developed its own hardware based on Muse.
The Muse Home Link was designed to connect the AI agent to home devices. Through skills developed by the community, the gadget can perform tasks such as turning on a light, controlling a television, or sending a document to a printer. The functionality depends on the devices and the configuration used by the user.
Meta manufactured five thousand units of the Muse Home Link, according to Nat Friedman from Meta Superintelligence Labs. The device has not yet been made available to the general public. The company opened a waiting list for interested parties, with shipments of the units expected this month still.
Muse becomes an open platform
The strategy expands Muse's reach beyond a closed product. By providing the SDK, Meta allows developers and enthusiasts to experiment with different hardware formats and create devices that may not necessarily be produced by the company.
One project could use an e-ink screen to display information, while another could turn a Raspberry Pi into a TV-connected assistant. It is also possible to add sensors and actuators to enable the agent to interact with physical objects.
The idea brings Muse closer to a kind of experimental hardware platform for AI, where part of the innovation may come from the community itself.
The code for the Muse Gadget SDK is available on GitHub, while Meta also maintains a dedicated page for Muse gadgets projects.
Rodrigo Mozelli is a journalist graduated from the Universidade Metodista de São Paulo (UMESP) and is currently a writer at Olhar Digital.
