Skip to content

feat(meta): add Muse Voice streaming STT plugin - #7097

Open
seyeong-han wants to merge 2 commits into
livekit:mainfrom
seyeong-han:feat/meta-muse-voice-transcribe
Open

feat(meta): add Muse Voice streaming STT plugin#7097
seyeong-han wants to merge 2 commits into
livekit:mainfrom
seyeong-han:feat/meta-muse-voice-transcribe

Conversation

@seyeong-han

Copy link
Copy Markdown

Summary

Adds livekit-plugins-meta with streaming speech-to-text support for Meta Muse Voice Transcribe 1.0.

  • exposes livekit.plugins.meta.STT
  • sends 24 kHz mono PCM16 audio in paced 80 ms frames
  • supports static keywords and language bias at stream creation
  • maps cumulative Muse events into non-overlapping LiveKit speech turns
  • emits incremental recognition usage from successfully sent audio
  • avoids retrying after audio has been consumed, preventing silent speech loss
  • redacts credentials, provider payloads, transcripts, and WebSocket close reasons from errors
  • adds the workspace source and livekit-agents[meta] extra

The adapter uses LiveKit's shared aiohttp context and the framework-managed input channel/resampler. Batch recognition, diarization, detected-language metadata, and active-stream keyterm updates are intentionally not advertised.

Testing

  • uv run pytest tests/test_meta_stt.py --unit (33 passed)
  • make check (format, Ruff, and mypy across 648 source files)
  • wheel and sdist build, followed by an isolated Python 3.10 wheel import
  • real Muse realtime smoke: handshake, paced 24 kHz audio, usage events, endStream, and clean close
  • full hermetic run: 2462 passed, 5 skipped; the remaining 9 tests/test_room.py cases independently reproduce a local LiveKit server 401 invalid API key: devkey and are unrelated to this plugin

@seyeong-han
seyeong-han requested a review from a team as a code owner September 2, 2026 16:14
@CLAassistant

CLAassistant commented Sep 2, 2026

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Devin Review

@seyeong-han
seyeong-han marked this pull request as draft September 2, 2026 16:20
@seyeong-han
seyeong-han force-pushed the feat/meta-muse-voice-transcribe branch from bf775ca to a4efd32 Compare September 2, 2026 18:28
@seyeong-han
seyeong-han force-pushed the feat/meta-muse-voice-transcribe branch from a4efd32 to 7aa7210 Compare September 2, 2026 18:31
@seyeong-han
seyeong-han marked this pull request as ready for review September 2, 2026 18:50
@seyeong-han
seyeong-han force-pushed the feat/meta-muse-voice-transcribe branch from 7aa7210 to f314479 Compare September 2, 2026 19:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants