34f66d234c
* Added duration_to_bytes to FileMockMicrophone Added duration_to_bytes to fix AttributeError: 'FileMockMicrophone' object has no attribute 'duration_to_bytes' in call from mycroft-core/mycroft/client/speech/mic.py _wait_until_wake_word * Update wake_word_test.py Fixed formatting issues * Update wake_word_test.py Fixed formatting * Remove whitespaces for PEP8 Co-authored-by: Kris Gesling <kris.gesling@mycroft.ai> |
||
|---|---|---|
| .. | ||
| README.md | ||
| __main__.py | ||
| wake_word_test.py | ||
README.md
Audio Accuracy Test
This is a small tool running tests against the selected wakeword engine. It supports testing false negatives (wake word not triggering when it should) and false positives (wake word triggering when it should not).
To run this test you first need to setup data to use.
in this folder create a data folder with two subdirectories with_wake_word and without_wake_word:
data/
├──with_wake_word/
├── file1.wav
├── file2.wav
├── ...
└── fileN.wav
├──without_wake_word/
├── file1.wav
├── file2.wav
├── ...
└── fileN.wav
the wave files in with_wake_word will be checked that a wakeword IS triggered and the files in the without_wake_word directory will be checked to NOT trigger a wake word.
The test uses the mycroft config and listener directly so make sure your wave files are the correct format (16 kHz sample rate by default) and matches the hotword settings you are using.
The test can either be started using the mycroft startup script
./start-mycroft.sh audioaccuracytest
from the mycroft-core root folder or invoking the module directly
python -m test.audio_accuracy