milvus/scripts
congqixia f813fb4563
enhance: [GoSDK] Remove example in main pkg to make ut script work (#37472)
Related to #31293

Example with main func/package causes `go list` command failed with vcs
error. This PR removes example files with main package. The example
snippet shall be added back in runnable test format.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-07 10:50:25 +08:00
..
sql
3rdparty_build.sh enhance: refine the pipeline (#37412) 2024-11-06 10:24:30 +08:00
OWNERS
README.md enhance: use docker compose instead of docker-compose (#35208) 2024-08-02 19:32:32 +08:00
antlr-4.13.2-complete.jar enhance: Update antlr version and refine parsing not in (#36745) 2024-10-11 14:03:21 +08:00
azure_build.sh
check_cpp_fmt.sh
check_proto_product.sh
collect_arrow_dep.sh
core_build.sh enhance: enable asan for cpp unittest (#37041) 2024-10-23 17:21:27 +08:00
devcontainer.sh enhance: use docker compose instead of docker-compose (#35208) 2024-08-02 19:32:32 +08:00
docker_image_find_tag.sh
download_milvus_proto.sh
generate_proto.sh feat: Support stats task to sort segment by PK (#35054) 2024-09-02 14:19:03 +08:00
gofmt.sh
install_deps.sh enhance: upgrade conan version (#35215) 2024-08-02 19:22:15 +08:00
install_deps_embd.sh
install_deps_msys.sh enhance: upgrade conan version (#35215) 2024-08-02 19:22:15 +08:00
install_milvus.sh enhance: enable asan for cpp unittest (#37041) 2024-10-23 17:21:27 +08:00
package_windows.sh
run_cpp_codecov.sh enhance: enable asan for cpp unittest (#37041) 2024-10-23 17:21:27 +08:00
run_cpp_unittest.sh enhance: [skip e2e] add make run-test-cpp with support for filter gtest (#35829) 2024-08-29 20:03:02 +08:00
run_docker.sh enhance: use docker compose instead of docker-compose (#35208) 2024-08-02 19:32:32 +08:00
run_go_codecov.sh enhance: [GoSDK] Remove example in main pkg to make ut script work (#37472) 2024-11-07 10:50:25 +08:00
run_go_unittest.sh enhance: streaming service client (#34656) 2024-08-05 21:38:15 +08:00
run_intergration_test.sh
setenv.sh enhance: enable asan for cpp unittest (#37041) 2024-10-23 17:21:27 +08:00
standalone_embed.sh [automated] Bump milvus version to v2.4.15 (#37458) 2024-11-05 21:18:32 +08:00
start_cluster.sh
start_standalone.sh
stop.sh
stop_graceful.sh
update-api-version.sh

README.md

Compile and install milvus cluster

Environment

OS: Ubuntu 20.04
go1.21
cmake: >=3.18
gcc 7.5

Install dependencies

Install compile dependencies

$ sudo apt install -y g++ gcc make libssl-dev zlib1g-dev libboost-regex-dev \
    libboost-program-options-dev libboost-system-dev libboost-filesystem-dev \
    libboost-serialization-dev python3-dev libboost-python-dev libcurl4-openssl-dev gfortran libtbb-dev
$ export GO111MODULE=on
$ go get github.com/golang/protobuf/protoc-gen-go@v1.3.2

Install OpenBlas library

install using apt

sudo apt install -y libopenblas-dev

or build from source code

$ wget https://github.com/xianyi/OpenBLAS/archive/v0.3.9.tar.gz && \
$ tar zxvf v0.3.9.tar.gz && cd OpenBLAS-0.3.9 && \
$ make TARGET=CORE2 DYNAMIC_ARCH=1 DYNAMIC_OLDER=1 USE_THREAD=0 USE_OPENMP=0 FC=gfortran CC=gcc COMMON_OPT="-O3 -g -fPIC" FCOMMON_OPT="-O3 -g -fPIC -frecursive" NMAX="NUM_THREADS=128" LIBPREFIX="libopenblas" INTERFACE64=0 NO_STATIC=1 && \
$ make PREFIX=/usr install

Compile

Generate the go files from proto file

$ make check-proto-product

Check code specifications

$ make verifiers

Compile milvus

$ make milvus

Install docker-compose

refer: https://docs.docker.com/compose/install/

$ sudo curl -L "https://github.com/docker/compose/releases/download/1.27.4/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
$ sudo chmod +x /usr/local/bin/docker-compose
$ sudo ln -s /usr/local/bin/docker-compose /usr/bin/docker-compose
$ docker-compose --version
$ docker compose --version

Start service

Start third-party service:

$ cd [milvus project path]/deployments/docker/cluster
$ docker-compose up -d
$ docker compose up -d

Start milvus cluster:

$ cd [milvus project path]
$ ./scripts/start_cluster.sh

Run unittest

Run all unittest including go and cpp cases:

$ make unittest

You also can run go unittest only:

$ make test-go

Run cpp unittest only:

$ make test-cpp

Run code coverage

Run code coverage including go and cpp:

$ make codecov

You also can run go code coverage only:

$ make codecov-go

Run cpp code coverage only:

$ make codecov-cpp