milvus/tests/python_client/deploy
zhuwenxing 0c33ddb7c5
[skip e2e]Skip creating index when it was already created (#27849)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-10-23 11:48:09 +08:00
..
cluster
scripts [skip e2e]Skip creating index when it was already created (#27849) 2023-10-23 11:48:09 +08:00
standalone
testcases [skip e2e]Update the method whether vector field is indexed (#27820) 2023-10-20 14:02:07 +08:00
README.md
__init__.py
base.py
check_healthy.sh
cluster-values.yaml [skip e2e]Disable debug mode in etcd image (#27212) 2023-09-19 15:29:24 +08:00
common.py Remove ANNOY index type (#23189) 2023-04-04 16:30:27 +08:00
conftest.py
milvus_crd.yaml [skip e2e]Update config of milvus crd for rolling update (#27126) 2023-09-15 15:55:21 +08:00
monitor_rolling_update.py [test]Wait index building complete before rolling update (#26377) 2023-08-17 16:38:18 +08:00
requirements.txt [test]Add method to analyze chaos test result (#26724) 2023-09-01 10:31:01 +08:00
run.sh
standalone-values.yaml [skip e2e]Disable debug mode in etcd image (#27212) 2023-09-19 15:29:24 +08:00
test.sh
utils.sh

README.md

Overview

To test deployment by docker-compose(Both standalone and cluster)

  • re-install milvus to check data persistence
    1. Deploy Milvus
    2. Insert data
    3. Build index
    4. Search
    5. Stop Milvus
    6. Repeat from step #1
  • upgrade milvus to check data compatibility
    1. Deploy Milvus (Previous Release)
    2. Insert data
    3. Search
    4. Stop Milvus
    5. Deploy Milvus (Latest Release/Build)
    6. Build index
    7. Search

Project structure

.
├── README.md
├── cluster # dir to deploy cluster
│   ├── logs # dir to save logs
│   └──docker-compose.yml
├── standalone # dir to deploy standalone
│   ├── logs # dir to save logs
│   └──docker-compose.yml
├── scripts
│   ├── action_after_upgrade.py
│   ├── action_before_upgrade.py
│   ├── action_reinstall.py
│   └── utils.py
├── cluster-values.yaml # config for helm deployment
├── test.sh # script to run a single task
└── run.sh # script to run all tasks

Usage

Make sure you have installed docker,docker-compose and pymilvus! For different version, you should modify the value of latest_tag, latest_rc_tag and Release. Password of root is needed for deleting volumes dir.

single test task

$ bash test.sh -m ${Mode} -t ${Task} -p ${Password}
# Mode, the mode of milvus deploy. standalone or cluster"
# Task, the task type of test. reinstall or upgrade
# Password, the password of root"

run all tasks

$ bash run.sh -p ${Password}
# Password, the password of root"

Integrate deploy test into CI

Provides a way to periodically run docker-compose deployment tests through GitHub actiondeploy-test

  • Parallel testing for four deployment scenarios
  • Upload logs to artifacts for further debug
  • Email notification for test failure
  • Support helm deployment tests
  • Cover more detail information in email notification