OpenBMB Open-Sources ESP32-S3 Voice Tower: MiniCPM5-2B + VoxCPM2
OpenBMB ambassador @emwstudio has open-sourced an ESP32-S3 cockpit-style attitude indicator project that uses MiniCPM5-2B to generate tower replies and VoxCPM2 to synthesize speech. The device sends push-to-talk audio over Wi-Fi to a Mac-side pipeline, where Qwen3-ASR performs local recognition, and the reply audio then streams back to the device speaker. The tower incorporates simulated flight data such as altitude, speed, heading, pitch, and roll, and points out inconsistencies between requests and instrument readings.
Body
Hold a button. Request landing. Hear an AI tower respond to your simulated flight state. ✈️🎙️ Powered by MiniCPM5-2B + VoxCPM2.
Meet an open-source build from our ambassador @emwstudio: an ESP32-S3 cockpit-style attitude indicator with simulated flight data, voice alerts, and push-to-talk conversations with an AI “tower.” 🎙️
🧠 MiniCPM5-2B gives the tower its responses. Flight-state data, including altitude, speed, heading, pitch, and roll, is fed into the conversation. The tower can respond to the simulated aircraft’s situation and flag inconsistencies between your request and the instrument readings.
🔊 VoxCPM2 brings the tower’s voice to life. Voice cloning from a reference recording, paired with radio-style filtering, background hiss, and a squelch tail, creates that familiar air-to-ground radio feel.
📡 Hold, speak, release. The ESP32 sends audio over Wi-Fi to a Mac-side pipeline. Qwen3-ASR handles local speech recognition, MiniCPM5-2B generates the reply, and VoxCPM2 synthesizes audio that streams back to the device’s speaker.
🛠️ A creative community-built example of model capabilities meeting interactive hardware, with firmware and voice-pipeline code publicly available for others to explore and build on.
💻 Explore Project: https://t.co/mPmG9yaJLv 🤗 Get Models: https://t.co/TNUu629lXn https://t.co/NE1t03jOXz
What would you build with MiniCPM + VoxCPM? 👀
#OpenBMB #MiniCPM #VoxCPM #OpenSource #ESP32