OpenTranscribe：自托管音视频转录与分析

Self-hosted AI-powered transcription platform with speaker diarization, search, and collaboration features. Built with Svelte, FastAPI, a…

AI-Powered Transcription and Media Analysis Platform Project status — active development. The default branch tracks ongoing work and may contain unreleased or in-progress features. For a stable deployment, install a published release — the one-line installer below resolves the latest release automatically and pins your deployment to it. OpenTranscribe is a powerful, containerized web application for transcribing and analyzing audio/video files using state-of-the-art AI models. Built with modern technologies and designed for scalability, it provides an end-to-end solution for speech-to-text conversion, speaker identification, and content analysis. Note: This application is 99.9% written by AI using frontier models from commercial providers, demonstrating the power of AI-assisted development. 📸 Quick Look Complete workflow: Login → Upload → Process → Transcribe → Speaker Identification → AI Tags & Collections 📚 For detailed screenshots and visual guides, see the Complete Documentation 🗺️ Where this is going: the Roadmap shows what is in each release and how far along it is, generated from the issue tracker. Release Themes explains what each version is for and the exit criteria it has to meet. ✨ Key Features 🎧 Advanced Transcription High-Accuracy Speech Recognition: Powered by WhisperX with faster-whisper backend Fast Default Model: large-v3-turbo, a much faster variant of large-v3 with excellent English accuracy (it cannot translate; pick large-v3 for translation) Word-Level Timestamps: Native word-level timing for all 100+ languages via batched inference 100+ Language Support: Transcribe in 100+ languages with optional English translation Configurable Source Language: Auto-detect or specify source language for improved accuracy Translation Toggle: Choose to keep original language or translate non-English audio to English Batch Processing: ~40x realtime for the full pipeline including diarization, measured on an RTX A6000 with the large-v3-turbo default (see docs/TRANSCRIPTION_OPTIMIZATION.md); your speed depends on hardware Pagination for Large Transcripts: Efficient display of long transcripts without browser hanging Audio Waveform Visualization: Interactive waveform player with precise timing and click-to-seek Browser Recording: Built-in microphone recording with real-time audio level monitoring Recording Controls: Pause/resume recording with duration tracking and quality settings 👥 Smart Speaker Management Automatic Speaker Diarization: Identify different speakers with the native diarization engine (the diar-native sidecar, built on the pyannote/speaker-diarization-community-1 weights) by default, with the in-process PyAnnote v4 pipeline as automatic failover; or detect speakers with a cloud provider Speaker Overlap Detection: Detect and handle multiple simultaneous speakers with advanced PyAnnote v4 capabilities Diarization Boundary Correction: Word-boundary smoothing (default on, ~−32% word speaker error rate) collapses short wrong-speaker islands at turn boundaries, plus an opt-in acoustic backchannel re-check that re-embeds disputed words by voiceprint — both tuned live by a super admin under Settings → Speaker Identification → Speaker Engine (no restart) Cross-Video Speaker Recognition: AI-powered voice fingerprinting to identify speakers across different media files Speaker Profile System: Create and manage global speaker profiles that persist across all transcriptions Intelligent Speaker Suggestions: Consolidated speaker identification with confidence scoring and automatic profile matching LLM-Enhanced Speaker Recognition: Content-based speaker-name suggestions from conversational context. A suggestion is shown with its confidence and only becomes the speaker's name when you accept it; a name otherwise comes from a person or a voiceprint match Profile Embedding Service: Advanced voice similarity matching using vector embeddings for cross-video speaker linking Smart Speaker Status Tracking: Comprehensive speaker verification status with computed fields for UI optimization Auto-Profile Creation: Automatic speaker profile creation and assignment when speakers are labeled Retroactive Speaker Matching: Cross-video speaker matching with automatic label propagation for high-confidence matches Custom Speaker Labels: Edit and manage speaker names and information with intelligent suggestions Speaker Analytics: View speaking time distribution, cross-media appearances, and interaction patterns Speaker Merge UI: Combine duplicate speakers into single profiles with segment reassignment Per-File Speaker Settings: Configure min/max speaker count per upload or reprocess operation User-Level Speaker Preferences: Save default speaker detection settings (always prompt, use defaults, use custom values) GPU-Accelerated Clustering: Fast speaker clustering using GPU-accelerated embeddings Gender Detection: Automatic speaker gender detection for improved labeling suggestions (each user can switch Predict gender from voice off in Settings → Speaker Identification) Profile Avatars: Visual speaker profile avatars for easy identification across the media library Corrections That Stick: Unassigning a speaker from a cluster means "this voice is not that person" — with Prevent from rejoining this cluster ticked (the default), no automatic path puts it back, and the correction survives re-processing the file. You can name a speaker inline from the transcript's speaker menu, and removing a speaker removes every stored copy of its voice 🎬 Rich Media Support Universal Format Support: Audio (MP3, WAV, FLAC, M4A) and Video (MP4, MOV, AVI, MKV), and more. Formats browsers cannot play (AIFF, WMA, AVI and similar) get a playable copy for the player Universal Media URL Support: Process videos from 1800+ platforms via yt-dlp (YouTube, Dailymotion, Twitter/X, TikTok, and more) Smart Platform Handling: User-friendly error messages with platform-specific guidance for authentication-required videos YouTube Playlist Processin