2020-01-07 08:20:37 +00:00
|
|
|
|
# Quick start
|
2019-10-16 10:40:31 +00:00
|
|
|
|
|
2020-01-13 05:56:15 +00:00
|
|
|
|
### Description：
|
2019-10-16 10:40:31 +00:00
|
|
|
|
|
2020-01-13 05:56:15 +00:00
|
|
|
|
- Test cases can be organized with `yaml `
|
|
|
|
|
|
- Test can run with local mode or helm mode
|
2019-10-16 10:40:31 +00:00
|
|
|
|
|
2020-01-13 05:56:15 +00:00
|
|
|
|
### Demos：
|
2019-10-16 10:40:31 +00:00
|
|
|
|
|
2020-01-13 05:56:15 +00:00
|
|
|
|
1. Using jenkins + helm mode：
|
2019-10-16 10:40:31 +00:00
|
|
|
|
|
2020-01-07 08:20:37 +00:00
|
|
|
|
|
2019-10-16 10:40:31 +00:00
|
|
|
|
|
2020-01-13 05:56:15 +00:00
|
|
|
|
2. Local test：
|
2019-10-16 10:40:31 +00:00
|
|
|
|
|
2020-01-07 08:20:37 +00:00
|
|
|
|
`python3 main.py --local --host=*.* --port=19530 --suite=suites/gpu_search_performance_random50m.yaml`
|
|
|
|
|
|
|
2020-01-13 05:56:15 +00:00
|
|
|
|
### Definitions of test suites：
|
2020-01-07 08:20:37 +00:00
|
|
|
|
|
2020-01-13 05:56:15 +00:00
|
|
|
|
Testers need to write test suite config if adding a customizised test into the current test framework
|
2020-01-07 08:20:37 +00:00
|
|
|
|
|
2020-01-13 05:56:15 +00:00
|
|
|
|
The following are the searching performance test suite：
|
2020-01-07 08:20:37 +00:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2020-01-13 05:56:15 +00:00
|
|
|
|
1. search_performance: the test type，also we have`build_performance`,`insert_performance`,`accuracy`,`stability`,`search_stability`
|
|
|
|
|
|
2. tables: list of test cases
|
|
|
|
|
|
3. The following fields are in the `table` field：
|
2020-01-07 08:20:37 +00:00
|
|
|
|
- server: milvus的server_config
|
2020-01-13 05:56:15 +00:00
|
|
|
|
- table_name: currently support one table
|
|
|
|
|
|
- run_count: search count
|
|
|
|
|
|
- search_params: params of search_vectors
|
2020-01-07 08:20:37 +00:00
|
|
|
|
|
2020-01-13 05:56:15 +00:00
|
|
|
|
## Test result：
|
2020-01-07 08:20:37 +00:00
|
|
|
|
|
2020-01-13 05:56:15 +00:00
|
|
|
|
The result of searching performance
|
2020-01-07 08:20:37 +00:00
|
|
|
|
|
2020-01-13 05:56:15 +00:00
|
|
|
|
Test result will be uploaded, and will be used to judge if the test run pass or failed
|
