Qwen Audio Agent实时语音运行时

A realtime voice runtime that keeps Agents talking, working, and present. Real-time Voice Runtime for AI Agents

Qwen Audio Agent 中文 | English | User Guide | Quickstart | Paper Agent Presence Real conversation should not leave you waiting after a single sentence, nor should it grind to a halt just because the Agent is looking something up, calling a tool, or working on a task. Conversation should keep flowing, and the Agent should always be present. That is why we built qwen-audio-agent—a realtime voice runtime that keeps Agents talking, working, and present. Whether chatting with you, thinking through a problem, or working on a task, your Agent remains in the conversation. It listens, responds, and when the task is complete, naturally tells you: "It's ready." News 2026-09-23 · v2.0.0 🏗️ Rebuilt the orchestration runtime with a unified client protocol and ACP / A2A backend integration; 🎙️ expanded voice and video model support; 🧠 enhanced frontend tools, memory, and knowledge libraries; 💬 added a desktop conversation panel and remote mobile access; 🧩 added customer service, smart cockpit, digital human, and other examples; 📄 published the technical report. 2026-08-20 · v1.11.0 🧩 Adds embeddable Gateway and Realtime Provider extensions; 🛠️ supports installing and managing Agent Skills; 📎 adds multimodal input to the TUI; 🎨 links pet animations to runtime states. 2026-08-13 · v1.9.0 🧩 Desktop task cards show live Agent progress; 🔎 backend Agent selection is clearer and searchable; 🎙️ supports Qwen3.5-Omni Realtime frontend integration. 2026-08-07 · v1.7.0 🎨 The orb opens up custom skins — import your own look, compatible with pet packs from the Awesome Codex Pet community gallery; 🪟 improved Windows backend Agent startup. 2026-08-05 · v1.5.0 ⏰ Adds scheduled reminders and progress reporting; 🗣️ adds the voice wake word ("你好千问"); 🐧 desktop build support for Linux; the desktop app now uses a data directory isolated from the CLI. 2026-08-03 · v1.3.0 🎙️ Adds 🤗 speech-to-speech frontend integration, supporting fully local VAD, STT, LLM, and TTS. 2026-07-30 · v1.0.0 🚀 First stable release, introducing a macOS desktop app with a built-in Gateway. 2026-07-28 · v0.9.0 🌍 Project officially open-sourced; backend Agents unified under the ACP architecture. Conversation Continues, Tasks Too Conversation doesn't stop for background tasks; when a task completes, the result naturally returns to the current conversation: Office Smart Cockpit qwen-audio-agent-v2.mp4 qwen-audio-agent-car_16x9.mp4 Core Features Full-duplex realtime voice interaction, natural interruption, and sustained multi-turn conversation Replaceable realtime voice frontends, with cloud services and local deployment options One-click integration with your preferred Agent, reusing its model configuration, tools, MCP, Skills, and authentication Frontend conversation and background tasks run in parallel; ask about progress or cancel at any time Create multiple independent tasks executed asynchronously by the backend Agent, with continuous status tracking Task results automatically return to the current conversation, supporting follow-up questions and modifications WebUI, terminal TUI, and desktop floating orb (macOS / Windows / Linux) Long-term per-user personalization and cross-session memory Architecture Questions that can be answered directly are answered immediately; when tools or sustained processing are needed, the task is delegated to the backend Agent. Throughout, the user always faces the same assistant. For the full design and module breakdown, see the architecture document. Frontend and Backend Support The voice frontend handles realtime conversation; the backend Agent executes tasks. They integrate independently and can be combined as needed. Voice Frontends Voice frontend Deployment Setup Features Qwen Audio 3.0 Realtime Cloud Bailian API Key Duplex voice, tool calling Qwen Audio 3.1 Realtime Plus Cloud Bailian API Key Duplex voice, tool calling GPT-Live / OpenAI Realtime Cloud OpenAI API Key — Google Gemini Live Cloud Google API Key Live video input Qwen3.5-Omni Realtime Cloud Bailian API Key Live video input Qwen3.8 Omni Flash Realtime Cloud Bailian API Key + workspace-specific endpoint Live video input Doubao Seeduplex 3.0 Realtime Cloud Volcengine Speech API Key — StepAudio 3 Realtime Cloud StepFun API Key — Hugging Face Speech-to-Speech Local Start the service and set its URL Configurable STT / LLM / TTS MiniCPM-o 4.5 Local or cloud Compatible service URL Live video input, no tool calling To connect another voice service, implement the Realtime Provider interface without changing the Gateway's core voice-session or backend-task logic. Backend Agents Backend Agent Integration Setup Rating None N/A Frontend-only mode, no backend config needed ★★★★★ Bare LLM Built-in Chat Completions OpenAI-compatible API key, URL, and model Experimental Qwen Code Native ACP One-click install, user config required ★★★★★ OpenCode Native ACP One-click install + Bailian config ★★★★★ OpenClaw Built-in ACP bridge One-click install + Bailian config ★★★★★ Qoder Native ACP One-click install, user config required ★★★★★ MiniMax Code Native ACP One-click install, user config required ★★★★☆ Kimi Code Native ACP One-click install, user config required ★★★★★ Hermes Native ACP One-click install, user config required ★★★★☆ CodeBuddy Native ACP One-click install, user config required ★★★★☆ Codex External ACP adapter One-click install (base + adapter), user config required ★★★★☆ Claude Code External ACP adapter One-click install (base + adapter), user config required ★★★★☆ DeepSeek Harness Native ACP One-click install, DeepSeek API key required ★★★★☆ Pi External ACP adapter One-click install (base + adapter), user config required ★★★★☆ Muse Code Native MSP adapter Install Muse and its optional SDK on demand; user config required ★★★☆☆ Ratings reflect current integration completeness, compatibility, and verification level: five stars indicate a thoroughly tested recommended integration; four stars indicate active development or not yet fully verified. For detailed configura