Commit Graph

144 Commits (simple_video)

Author SHA1 Message Date
Åke Forslund 6dd059e888 Consume whole queue before considering skill done
This will handle any extra messages after the skill complete message was detected. For example messages from certain fallback skills
2021-05-02 09:27:47 +02:00
Åke Forslund 053d29b92c Use the correct event for fallback handler 2021-05-02 09:26:29 +02:00
Åke Forslund 512fa9c820 Implement wait_for_response for old skill tester
Previously this was just skipped over but is now needed for the fallback intents
2021-05-02 09:25:14 +02:00
Åke Forslund 3970f84e4b Fix Padatious setup
This was broken when Padatious moved from a separate "skill" into the
service manager. This updates the code to call the correct methods
2021-05-01 08:35:01 +02:00
Kris Gesling 89555380d8 Add VK method to wait for audio service 2021-01-18 11:16:41 +09:30
Åke Forslund 83ed811dba Add check to make sure speak message has metadata
This can occur if a custom made speak message is injected and VK should
handle malformed speak messages.
2021-01-10 21:03:25 +01:00
Åke Forslund 35fd035337 Add timeout waiting for config change 2021-01-10 21:02:54 +01:00
Kris Gesling 8b107ce733
Merge pull request #2742 from forslund/bugfix/vk-reset-config-spam
Fix Voight kampff reset of patched config
2020-11-06 14:38:28 +09:30
Åke Forslund dfe909aa2e Add a log for when config is patched
Since we have a reset log a matching info message for when updating the
config should be shown
2020-10-29 08:05:32 +01:00
Åke Forslund 3de34003cf Use custom cleanup to reset patched config
original_config will now only live in the scenario part of the context
being automatically cleared at the end of each scenario. To reset the
patch a custom cleanup is added when the patch is performed.
2020-10-29 08:05:28 +01:00
Åke Forslund 0a9de0ab7c Update to pyee 8.1.0
pyee 8.1.0 adds a small change to make the once call to be more safe in
multithreaded environments.

This switches back from the now deprecated BaseEventEmitter to the
standard EventEmitter.
2020-10-22 11:43:06 +02:00
Kris Gesling 52b908f350
Merge pull request #2663 from forslund/feature/given-timeout
Voight Kampff given timeout
2020-09-09 14:32:25 +09:30
Kris Gesling 3eee84f053
Merge pull request #2679 from forslund/refactor/remove-imp
Refactor/remove imp
2020-08-24 01:28:34 +00:00
Åke Forslund e2a7fe9b2a Load test environment with importlib instead of imp 2020-08-21 08:00:57 +02:00
Kris Gesling d70c425854 switch deprecated EventEmitter to other classes 2020-08-18 15:58:42 +09:30
Åke Forslund 9b4e47567e Add context parameter to wait_for_dialog
This allows wait for dialog to respect the timeout set for the current
scenario.
2020-08-16 23:34:29 +02:00
Åke Forslund 03002bcf47 Add "given a timeout of X seconds"
The new given sets the timeout of the steps in a scenario. The timeout is reset after each scenario.
2020-08-16 23:16:51 +02:00
Kris Gesling d4abc37861 sleep prior to tests to assist in bug diagnosis 2020-07-17 15:53:59 +09:30
Kris Gesling 247c6d30a3 add test - specific skill should not reply 2020-06-18 22:33:22 +09:30
Åke Forslund e08f630bea Minor header fixes in voight_kampff
- Copyright year
- typo
2020-05-18 14:48:19 +02:00
Åke Forslund 46c8a6b51f Add Voight Kampff support setting configurations
Adds the "Given the user's {config} is {value}" step implementation

This will patch the configuration with a section from a dictionary that
can either be a global (shipped in
mycroft/res/{lang}/configurations.json) or shipped with the test
definition. The file should be named the same as the feature file but
instead of ".feature" the extension should be ".config.json".

mycroft/res/text/en-us/configurations.json contains a couple of
pre-defined configurations that can be applied
- units (metric/imperial)
- location (Stockholm)

After each scenario any applied patch will be cleared
2020-05-18 14:48:14 +02:00
Bart Ribbers 4d01269f35
Explicitely run the messagebus test with Python3
/usr/bin/python might not always point to Python 3, and it might not
even exist, depending on the distribution. To make sure we always run
with Python 3, explicitely call /usr/bin/python3

Also update the service start command and remove the outdated message
method tests
2020-05-06 14:28:27 +02:00
Kris Gesling 1a96f04020 Add single Voight Kampff module interface
Takes in arguments for both test_setup.py and behave test runner. Parses
any args for test_setup and passes any remaining arguments to behave.

This moves argparsing out of the test_setup main() allowing the helper commands
to pass in pre-parsed arguments rather than adding logic inside main to
differentiate between a list and a preparsed arument object
2020-03-25 07:40:01 +01:00
Åke Forslund 9fe158d841 Prepare for multi-lang support 2020-03-24 10:42:07 +01:00
Åke Forslund 00c83c5139 Add repo and branch selection for test_setup.py
--url can be added to specify the repo url
--branch can be added to specify a specific branch
2020-03-24 10:42:07 +01:00
Åke Forslund c33f9ee875 Restructure test_setup.py according to review 2020-03-24 10:42:07 +01:00
Åke Forslund f8c6107ea5 Update readme with some new steps 2020-03-24 10:42:07 +01:00
Åke Forslund 8e7e19ecc2 Add help text to test_setup.py parameters 2020-03-24 10:42:07 +01:00
Åke Forslund daeac964e0 Rename tested-skills argument to test-skills 2020-03-24 10:42:07 +01:00
Åke Forslund 5d6cb83899 Make all fields in config optional 2020-03-24 10:42:07 +01:00
Åke Forslund e0dec90d17 Allow test_setup to update skills 2020-03-24 10:42:07 +01:00
Åke Forslund 2a7b0ccef9 Update voight kampff Readme with some extra info 2020-03-24 10:42:07 +01:00
Åke Forslund a6d1e91942 Add auto-retry
This switches behave to the current dev release including the autoretry
system.
2020-03-24 10:42:07 +01:00
Åke Forslund 0ad91ce321 Add an event that can be waited on instead of sleep 2020-03-24 10:42:07 +01:00
Åke Forslund 0f860162e3 Update run_test_suite.sh
- Pulseaudio is launched if on CI
- remove hard-coding of start-mycroft.sh
2020-03-24 10:42:02 +01:00
Åke Forslund 353239cbc2 Move more common functions to voight kampff tools 2020-03-23 11:41:13 +01:00
Åke Forslund 0d5520be4a Reduce sleep time while waiting for response 2020-03-23 11:41:13 +01:00
Åke Forslund 2055b50238 Add before_feature logging current test 2020-03-23 11:41:13 +01:00
Åke Forslund fa88562a8c Fix timeout of wait for message
The counter didn't increment as intended
2020-03-23 11:41:13 +01:00
Åke Forslund 9a5f1f6f7e Add shared tools 2020-03-23 11:41:13 +01:00
Åke Forslund 0ea1af126d Reduce safety timeouts 2020-03-23 11:41:13 +01:00
Åke Forslund d451e1c1e0 Add more info on captured response (skill and dialog) 2020-03-23 11:41:13 +01:00
Åke Forslund b79fe04eb8 Extend timeout after scenario 2020-03-23 11:41:13 +01:00
Åke Forslund 51f07a5d96 Add assert message if no dialog is recorded 2020-03-23 11:41:13 +01:00
Åke Forslund c159377acb Consume matched messages. 2020-03-23 11:41:13 +01:00
Åke Forslund b43785a403 Recreate messed up assert messages 2020-03-23 11:41:13 +01:00
Åke Forslund 1470151c2b Add alternatives for user replies 2020-03-23 11:41:13 +01:00
Åke Forslund 0c873b5065 Update skill list for default skills test 2020-03-23 11:41:13 +01:00
Åke Forslund 75f92a66dd Add handler to capture messages of specific type 2020-03-23 11:41:13 +01:00
Åke Forslund 12f2e63cc3 Share only identity and allure in separate volume
- Sharing only the identity file removes the need for clearing the skill
sandbox dir and padatious cache
- Make things a bit cleaner with separate Allure volume
2020-03-23 11:41:13 +01:00