milvus/tests/milvus_benchmark/README.md

39 lines
1.1 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters!

This file contains ambiguous Unicode characters that may be confused with others in your current locale. If your use case is intentional and legitimate, you can safely ignore this warning. Use the Escape button to highlight these characters.

# Quick start
### Description
- Test cases can be organized with `yaml `
- Test can run with local mode or helm mode
### Demos
1. Using jenkins + helm mode
![](assets/Parameters.png)
2. Local test
`python3 main.py --local --host=*.* --port=19530 --suite=suites/gpu_search_performance_random50m.yaml`
### Definitions of test suites
Testers need to write test suite config if adding a customizised test into the current test framework
The following are the searching performance test suite
![](assets/gpu_search_performance_random50m-yaml.png)
1. search_performance: the test typealso we have`build_performance`,`insert_performance`,`accuracy`,`stability`,`search_stability`
2. tables: list of test cases
3. The following fields are in the `table` field
- server: milvus的server_config
- table_name: currently support one table
- run_count: search count
- search_params: params of search_vectors
## Test result
The result of searching performance![](assets/milvus-nightly-performance-new-jenkins.png)
Test result will be uploaded, and will be used to judge if the test run pass or failed