7f8e4b5fe8
minor code review change
2020-04-08 15:00:39 -05:00
b3ce33ab70
Update test to match change
...
Also minor cleaning up of test code
2020-04-02 19:29:31 +02:00
28c3a61e1c
Merge pull request #2503 from forslund/bugfix/converse-error
...
Bugfix Converse error
2020-04-02 07:45:00 +02:00
1a96f04020
Add single Voight Kampff module interface
...
Takes in arguments for both test_setup.py and behave test runner. Parses
any args for test_setup and passes any remaining arguments to behave.
This moves argparsing out of the test_setup main() allowing the helper commands
to pass in pre-parsed arguments rather than adding logic inside main to
differentiate between a list and a preparsed arument object
2020-03-25 07:40:01 +01:00
9fe158d841
Prepare for multi-lang support
2020-03-24 10:42:07 +01:00
00c83c5139
Add repo and branch selection for test_setup.py
...
--url can be added to specify the repo url
--branch can be added to specify a specific branch
2020-03-24 10:42:07 +01:00
c33f9ee875
Restructure test_setup.py according to review
2020-03-24 10:42:07 +01:00
f8c6107ea5
Update readme with some new steps
2020-03-24 10:42:07 +01:00
8e7e19ecc2
Add help text to test_setup.py parameters
2020-03-24 10:42:07 +01:00
daeac964e0
Rename tested-skills argument to test-skills
2020-03-24 10:42:07 +01:00
5d6cb83899
Make all fields in config optional
2020-03-24 10:42:07 +01:00
e0dec90d17
Allow test_setup to update skills
2020-03-24 10:42:07 +01:00
2a7b0ccef9
Update voight kampff Readme with some extra info
2020-03-24 10:42:07 +01:00
1a643b0d4d
re-order build steps for performance. least likely to change first.
2020-03-24 10:42:07 +01:00
a6d1e91942
Add auto-retry
...
This switches behave to the current dev release including the autoretry
system.
2020-03-24 10:42:07 +01:00
0ad91ce321
Add an event that can be waited on instead of sleep
2020-03-24 10:42:07 +01:00
223274d2ad
Update environment variables for job
...
Set USER and CI
2020-03-24 10:42:07 +01:00
d86e8257a4
Add a basic mycroft.conf
2020-03-24 10:42:07 +01:00
0f860162e3
Update run_test_suite.sh
...
- Pulseaudio is launched if on CI
- remove hard-coding of start-mycroft.sh
2020-03-24 10:42:02 +01:00
353239cbc2
Move more common functions to voight kampff tools
2020-03-23 11:41:13 +01:00
0d5520be4a
Reduce sleep time while waiting for response
2020-03-23 11:41:13 +01:00
2055b50238
Add before_feature logging current test
2020-03-23 11:41:13 +01:00
fa88562a8c
Fix timeout of wait for message
...
The counter didn't increment as intended
2020-03-23 11:41:13 +01:00
9a5f1f6f7e
Add shared tools
2020-03-23 11:41:13 +01:00
0ea1af126d
Reduce safety timeouts
2020-03-23 11:41:13 +01:00
d451e1c1e0
Add more info on captured response (skill and dialog)
2020-03-23 11:41:13 +01:00
b79fe04eb8
Extend timeout after scenario
2020-03-23 11:41:13 +01:00
51f07a5d96
Add assert message if no dialog is recorded
2020-03-23 11:41:13 +01:00
c159377acb
Consume matched messages.
2020-03-23 11:41:13 +01:00
b43785a403
Recreate messed up assert messages
2020-03-23 11:41:13 +01:00
1470151c2b
Add alternatives for user replies
2020-03-23 11:41:13 +01:00
0c873b5065
Update skill list for default skills test
2020-03-23 11:41:13 +01:00
75f92a66dd
Add handler to capture messages of specific type
2020-03-23 11:41:13 +01:00
12f2e63cc3
Share only identity and allure in separate volume
...
- Sharing only the identity file removes the need for clearing the skill
sandbox dir and padatious cache
- Make things a bit cleaner with separate Allure volume
2020-03-23 11:41:13 +01:00
2592c9b1c2
Add clearer feedback on failures
...
Will now print all responses received from Mycroft
2020-03-23 11:41:13 +01:00
15148fadf5
Rework bus hooks
...
Override the bus clients on_message method and collect all messages in a
list. This will make it harder to miss a message during a test
2020-03-23 11:41:13 +01:00
38d43f2bb7
Move Jenkins specific commands into Jenkinsfile
...
Allure commandline and chown command are now run through the Jenkinsfile
instead of through the run_test_suite.sh
2020-03-23 11:41:13 +01:00
d0a6ff4a80
Add mycroft-core to python-path
2020-03-23 11:41:13 +01:00
00acf2b10c
Update docker build
...
Docker build will now perform most actions of the dev-setup making it
possible to use caches in a greater extent speeding up the build
2020-03-23 11:41:13 +01:00
b436e5575a
Add allure test reports
...
Behave will generate test results in the allure format, this will be
picked up by Jenkins and sent of to a standalone webserver.
2020-03-23 11:41:13 +01:00
fc9c462a37
Add possibility to send a user response as Then step
2020-03-23 11:41:13 +01:00
4a1dbd7e04
Add dockerfile for running voight_kampff test
2020-03-23 11:41:13 +01:00
b4507b7866
Add Voight Kampff test
...
The Voight kampff test is an integration test collecting and running
behave test of skills.
2020-03-23 11:41:09 +01:00
6dce1096e3
Test that all skill_id's are processed
...
Including a case where an error occur.
2020-03-15 22:23:16 +01:00
58f0ac8b9e
Simplify the converse callings
...
Remove the use of the separate error message and use the wait_for_reply method
to get the converse result. The error message is left to guarantee
compatibility.
2020-03-07 11:11:21 +01:00
38267dd676
Add basic test case for the converse method
2020-03-03 21:40:59 +01:00
8e12aee1dc
Remove refs to Settings class from skill tester
...
Skill tester used a "mocked" skill test class overriding some methods.
This is no longer necessary since a normal dict will work just as well.
2020-02-27 08:07:12 +01:00
baf194c556
remove deprecated Settings class and any code in core that references it.
2020-02-27 08:07:07 +01:00
22b21d1773
Add test case for Server error
2020-02-17 15:11:55 +01:00
b581766a00
Fallback to mimic for bad http status codes
...
Added a RemoteTTSException exception for non-timeout exceptions, Mimic2
will consider HTTP status code 200-299 as OK while other responses will
trigger raise RemoteTTSException.
2020-02-17 15:08:21 +01:00
Chris Veilleux
Åke Forslund
Kris Gesling