8b107ce733
Merge pull request #2742 from forslund/bugfix/vk-reset-config-spam
...
Fix Voight kampff reset of patched config
2020-11-06 14:38:28 +09:30
dfe909aa2e
Add a log for when config is patched
...
Since we have a reset log a matching info message for when updating the
config should be shown
2020-10-29 08:05:32 +01:00
3de34003cf
Use custom cleanup to reset patched config
...
original_config will now only live in the scenario part of the context
being automatically cleared at the end of each scenario. To reset the
patch a custom cleanup is added when the patch is performed.
2020-10-29 08:05:28 +01:00
0a9de0ab7c
Update to pyee 8.1.0
...
pyee 8.1.0 adds a small change to make the once call to be more safe in
multithreaded environments.
This switches back from the now deprecated BaseEventEmitter to the
standard EventEmitter.
2020-10-22 11:43:06 +02:00
52b908f350
Merge pull request #2663 from forslund/feature/given-timeout
...
Voight Kampff given timeout
2020-09-09 14:32:25 +09:30
3eee84f053
Merge pull request #2679 from forslund/refactor/remove-imp
...
Refactor/remove imp
2020-08-24 01:28:34 +00:00
e2a7fe9b2a
Load test environment with importlib instead of imp
2020-08-21 08:00:57 +02:00
d70c425854
switch deprecated EventEmitter to other classes
2020-08-18 15:58:42 +09:30
9b4e47567e
Add context parameter to wait_for_dialog
...
This allows wait for dialog to respect the timeout set for the current
scenario.
2020-08-16 23:34:29 +02:00
03002bcf47
Add "given a timeout of X seconds"
...
The new given sets the timeout of the steps in a scenario. The timeout is reset after each scenario.
2020-08-16 23:16:51 +02:00
d4abc37861
sleep prior to tests to assist in bug diagnosis
2020-07-17 15:53:59 +09:30
247c6d30a3
add test - specific skill should not reply
2020-06-18 22:33:22 +09:30
e08f630bea
Minor header fixes in voight_kampff
...
- Copyright year
- typo
2020-05-18 14:48:19 +02:00
46c8a6b51f
Add Voight Kampff support setting configurations
...
Adds the "Given the user's {config} is {value}" step implementation
This will patch the configuration with a section from a dictionary that
can either be a global (shipped in
mycroft/res/{lang}/configurations.json) or shipped with the test
definition. The file should be named the same as the feature file but
instead of ".feature" the extension should be ".config.json".
mycroft/res/text/en-us/configurations.json contains a couple of
pre-defined configurations that can be applied
- units (metric/imperial)
- location (Stockholm)
After each scenario any applied patch will be cleared
2020-05-18 14:48:14 +02:00
4d01269f35
Explicitely run the messagebus test with Python3
...
/usr/bin/python might not always point to Python 3, and it might not
even exist, depending on the distribution. To make sure we always run
with Python 3, explicitely call /usr/bin/python3
Also update the service start command and remove the outdated message
method tests
2020-05-06 14:28:27 +02:00
1a96f04020
Add single Voight Kampff module interface
...
Takes in arguments for both test_setup.py and behave test runner. Parses
any args for test_setup and passes any remaining arguments to behave.
This moves argparsing out of the test_setup main() allowing the helper commands
to pass in pre-parsed arguments rather than adding logic inside main to
differentiate between a list and a preparsed arument object
2020-03-25 07:40:01 +01:00
9fe158d841
Prepare for multi-lang support
2020-03-24 10:42:07 +01:00
00c83c5139
Add repo and branch selection for test_setup.py
...
--url can be added to specify the repo url
--branch can be added to specify a specific branch
2020-03-24 10:42:07 +01:00
c33f9ee875
Restructure test_setup.py according to review
2020-03-24 10:42:07 +01:00
f8c6107ea5
Update readme with some new steps
2020-03-24 10:42:07 +01:00
8e7e19ecc2
Add help text to test_setup.py parameters
2020-03-24 10:42:07 +01:00
daeac964e0
Rename tested-skills argument to test-skills
2020-03-24 10:42:07 +01:00
5d6cb83899
Make all fields in config optional
2020-03-24 10:42:07 +01:00
e0dec90d17
Allow test_setup to update skills
2020-03-24 10:42:07 +01:00
2a7b0ccef9
Update voight kampff Readme with some extra info
2020-03-24 10:42:07 +01:00
a6d1e91942
Add auto-retry
...
This switches behave to the current dev release including the autoretry
system.
2020-03-24 10:42:07 +01:00
0ad91ce321
Add an event that can be waited on instead of sleep
2020-03-24 10:42:07 +01:00
0f860162e3
Update run_test_suite.sh
...
- Pulseaudio is launched if on CI
- remove hard-coding of start-mycroft.sh
2020-03-24 10:42:02 +01:00
353239cbc2
Move more common functions to voight kampff tools
2020-03-23 11:41:13 +01:00
0d5520be4a
Reduce sleep time while waiting for response
2020-03-23 11:41:13 +01:00
2055b50238
Add before_feature logging current test
2020-03-23 11:41:13 +01:00
fa88562a8c
Fix timeout of wait for message
...
The counter didn't increment as intended
2020-03-23 11:41:13 +01:00
9a5f1f6f7e
Add shared tools
2020-03-23 11:41:13 +01:00
0ea1af126d
Reduce safety timeouts
2020-03-23 11:41:13 +01:00
d451e1c1e0
Add more info on captured response (skill and dialog)
2020-03-23 11:41:13 +01:00
b79fe04eb8
Extend timeout after scenario
2020-03-23 11:41:13 +01:00
51f07a5d96
Add assert message if no dialog is recorded
2020-03-23 11:41:13 +01:00
c159377acb
Consume matched messages.
2020-03-23 11:41:13 +01:00
b43785a403
Recreate messed up assert messages
2020-03-23 11:41:13 +01:00
1470151c2b
Add alternatives for user replies
2020-03-23 11:41:13 +01:00
0c873b5065
Update skill list for default skills test
2020-03-23 11:41:13 +01:00
75f92a66dd
Add handler to capture messages of specific type
2020-03-23 11:41:13 +01:00
12f2e63cc3
Share only identity and allure in separate volume
...
- Sharing only the identity file removes the need for clearing the skill
sandbox dir and padatious cache
- Make things a bit cleaner with separate Allure volume
2020-03-23 11:41:13 +01:00
2592c9b1c2
Add clearer feedback on failures
...
Will now print all responses received from Mycroft
2020-03-23 11:41:13 +01:00
15148fadf5
Rework bus hooks
...
Override the bus clients on_message method and collect all messages in a
list. This will make it harder to miss a message during a test
2020-03-23 11:41:13 +01:00
38d43f2bb7
Move Jenkins specific commands into Jenkinsfile
...
Allure commandline and chown command are now run through the Jenkinsfile
instead of through the run_test_suite.sh
2020-03-23 11:41:13 +01:00
b436e5575a
Add allure test reports
...
Behave will generate test results in the allure format, this will be
picked up by Jenkins and sent of to a standalone webserver.
2020-03-23 11:41:13 +01:00
fc9c462a37
Add possibility to send a user response as Then step
2020-03-23 11:41:13 +01:00
4a1dbd7e04
Add dockerfile for running voight_kampff test
2020-03-23 11:41:13 +01:00
b4507b7866
Add Voight Kampff test
...
The Voight kampff test is an integration test collecting and running
behave test of skills.
2020-03-23 11:41:09 +01:00
Kris Gesling
Åke Forslund
Kris Gesling
Bart Ribbers
Chris Veilleux