←新闻详情

面壁智能 OpenBMB更新于 10月30日 14:22

面壁智能开源 ESP32-S3 语音塔台:MiniCPM5-2B + VoxCPM2

Hold a button. Request landing. Hear an AI tower respond to your simulated flight state. ✈️🎙️ Powered by MiniCPM5-2B + VoxCPM2.

AI 导读

面壁智能大使 @emwstudio 开源了一个 ESP32-S3 座舱式姿态仪项目,用 MiniCPM5-2B 生成塔台回复、VoxCPM2 合成语音。设备通过 Wi-Fi 把按键说话音频送到 Mac 端流水线,由 Qwen3-ASR 本地识别,回复音频再流回设备扬声器。塔台会结合高度、速度、航向、俯仰和滚转等模拟飞行数据,指出请求与仪表读数的不一致。

正文

Hold a button. Request landing. Hear an AI tower respond to your simulated flight state. ✈️🎙️ Powered by MiniCPM5-2B + VoxCPM2.

Meet an open-source build from our ambassador @emwstudio: an ESP32-S3 cockpit-style attitude indicator with simulated flight data, voice alerts, and push-to-talk conversations with an AI “tower.” 🎙️

🧠 MiniCPM5-2B gives the tower its responses. Flight-state data, including altitude, speed, heading, pitch, and roll, is fed into the conversation. The tower can respond to the simulated aircraft’s situation and flag inconsistencies between your request and the instrument readings.

🔊 VoxCPM2 brings the tower’s voice to life. Voice cloning from a reference recording, paired with radio-style filtering, background hiss, and a squelch tail, creates that familiar air-to-ground radio feel.

📡 Hold, speak, release. The ESP32 sends audio over Wi-Fi to a Mac-side pipeline. Qwen3-ASR handles local speech recognition, MiniCPM5-2B generates the reply, and VoxCPM2 synthesizes audio that streams back to the device’s speaker.

🛠️ A creative community-built example of model capabilities meeting interactive hardware, with firmware and voice-pipeline code publicly available for others to explore and build on.

💻 Explore Project: https://t.co/mPmG9yaJLv 🤗 Get Models: https://t.co/TNUu629lXn https://t.co/NE1t03jOXz

What would you build with MiniCPM + VoxCPM? 👀

#OpenBMB #MiniCPM #VoxCPM #OpenSource #ESP32

来源

面壁智能 OpenBMB