kami/Maven
1
0
Fork 0
Code Issues 1 Pull Requests 1 Actions Packages Projects Releases Wiki Activity

Golden-audio STT tests against real whisper.cpp (#288) #75

Closed
claude wants to merge 1 commits from overnight/stt-golden-audio into overnight/senses-speaker
pull from: overnight/stt-golden-audio
merge into: kami:overnight/senses-speaker
Conversation 2 Commits 1 Files Changed 8
+439 -1

1 Commits

Author SHA1 Message Date
kami 62cc072f8c Add golden-audio STT tests against real whisper.cpp (#288) 
Four committed WAV fixtures go through the real whisper.cpp binding in
cmd/mavsttd, so a wrong model, a wrong language hint, a broken resample
or a regressed silence gate fails `make test` instead of surfacing as
Maven mishearing him.

The fixtures are piper-synthesised, not recorded: scripts/gen-stt-fixtures.sh
drives the vendored piper with the ru_RU-irina voice Maven already speaks
with, so nothing of the owner's voice is committed and every fixture is
reproducible. 360K total for three Russian clips and one English.

Matching is tolerant on purpose. Golden transcripts move with the model,
so each case asserts intent-carrying keywords (prefix match, so Russian
inflection does not fail it) plus a word error rate ceiling, not an exact
string. The matcher is unit-tested on its own and needs no model.

TestGoldenAudioTranscription skips when models/stt/ggml-small.bin is
absent, so `make test` still passes on a box without models.
TestGoldenFixturesAreCanonical runs everywhere and checks the WAVs are
16k mono s16le and would clear mavsttd's own silence gate.
 2026-08-01 05:32:10 +04:00