perf(huddle): enable bit-exact streaming TTS by default - #6334
Closed
johnmatthewtennant wants to merge 3 commits into
Closed
perf(huddle): enable bit-exact streaming TTS by default#6334johnmatthewtennant wants to merge 3 commits into
johnmatthewtennant wants to merge 3 commits into
Conversation
johnmatthewtennant
force-pushed
the
jtennant/harden-pocket-tts-streaming
branch
from
August 19, 2026 18:33
df5c133 to
b348a00
Compare
johnmatthewtennant
force-pushed
the
jtennant/enable-pocket-tts-streaming
branch
from
August 19, 2026 18:33
06c90fe to
49b4aca
Compare
johnmatthewtennant
force-pushed
the
jtennant/harden-pocket-tts-streaming
branch
from
August 19, 2026 18:50
b348a00 to
2b01e7f
Compare
johnmatthewtennant
force-pushed
the
jtennant/enable-pocket-tts-streaming
branch
from
August 19, 2026 18:50
49b4aca to
4896e15
Compare
johnmatthewtennant
force-pushed
the
jtennant/harden-pocket-tts-streaming
branch
from
August 19, 2026 18:51
2b01e7f to
f445345
Compare
johnmatthewtennant
force-pushed
the
jtennant/enable-pocket-tts-streaming
branch
from
August 19, 2026 18:51
4896e15 to
0bdc626
Compare
Signed-off-by: John Tennant <jtennant@squareup.com>
Signed-off-by: John Tennant <jtennant@squareup.com>
Signed-off-by: John Tennant <jtennant@squareup.com>
johnmatthewtennant
force-pushed
the
jtennant/harden-pocket-tts-streaming
branch
from
August 19, 2026 19:03
f445345 to
0a4010a
Compare
johnmatthewtennant
force-pushed
the
jtennant/enable-pocket-tts-streaming
branch
from
August 19, 2026 19:03
0bdc626 to
d4d0f0c
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Context
PR #5671 reduced Pocket TTS time-to-first-audio by streaming stateful Mimi decoder output, but kept the path disabled by default pending exactness, cancellation, failure, and listening validation.
The 12-frame decoder boundary produces the same samples as batch decoding. The streaming path now also preserves queued speech across inference failures, fades partial tails, and keeps cancellation from flushing retained audio.
Summary
Enable Pocket TTS streaming by default at the Mimi decoder's native 12-frame boundary. Operators can restore batch synthesis with
BUZZ_TTS_STREAMING=0orBUZZ_TTS_STREAMING=false.Changes
streaming_emit_frames()to 12 instead of requiringBUZZ_TTS_STREAMING=1.0andfalsevalues for operational rollback.BUZZ_TTS_EMIT_FRAMESfor explicit latency experiments.Related issue
No issue found. Promotion follow-up to #5671.
Testing
The installed April Pocket model produced
delta_frames=12: max|diff|=0.000000when the same real latent sequence was decoded through the batch and stateful streaming paths. The integration test now requires exact equality rather than accepting a tolerance.The default and both rollback values are covered through the pure environment resolver.
A real huddle ear and barge-in soak pass is still required before this draft is marked ready. The current environment can exercise the model and native pipeline deterministically, but cannot independently judge audible quality or conduct a two-party huddle.
Screenshots
Not applicable. This changes the native audio pipeline and has no visual UI change.
Reviewer-reproducible examples
From a fresh checkout with the Pocket model installed at
~/.buzz/models/pocket-tts:Observed output excerpt:
For the remaining manual gate, run this branch with no
BUZZ_TTS_STREAMINGenvironment variable, enable Pocket TTS, and request a long multi-sentence response in a real huddle. Confirm speech begins during synthesis, remains continuous, and stops cleanly for PTT, barge-in, and speaker removal. Repeat withBUZZ_TTS_STREAMING=falseand confirm batch playback remains available as a rollback.