Commit Graph

509 Commits (4869aaeb94f8a3864a8b0bfa00e5db61379aca88)

Author SHA1 Message Date
Guillaume Moutier d15db7596d
fix: fix permissions on /milvus for OpenShift compatibility (#30775)
OpenShift runs Pods with a random uid and gid 0.
As Milvus needs to write into the /milvus directory, this fix modifies
the group permissions to allow the root group (gid 0) to write into it.
This is a simple solution that allows to run Milvus on OpenShift without
adding security constraints, use special ServiceAccounts or whatever.
This should also not impact any other kubernetes platform as it's a
simple group permission change, nothing regarding the userid.

Note: Other actions are necessary to properly deploy the full stack
(Minio, Pulsar,...) on OpenShift. I will document them in the helm chart
project.

Fixes #25565

Signed-off-by: Guillaume Moutier <guillaume.moutier@gmail.com>
2024-02-28 16:29:05 +08:00
sammy.huang cbfe344ecf
enhance: [skip 2e2]add the option of host network mode into builder_gpu.sh file (#30573)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-19 14:14:55 +08:00
sammy.huang 46d9ac5931
enhance: move the option of network mode into builder.sh file (#30419)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-01 11:49:03 +08:00
sammy.huang fb9d64ab1e
enhance: hotfix container network (#30389)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-31 10:23:05 +08:00
sammy.huang fda6f8d04e
enhance: hotfix docker-compose.yml (#30378)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-30 19:23:04 +08:00
sammy.huang 62fdfe125f
enhance: [skip e2e]to add some comments (#29440)
there are two purposes for this PR
1. to add some comments on variable in the .env file. 
2. avoid git merge conflict when one PR update the value of DATE_VERSION
and LATEST_DATE_VERSION and meanwhile other PR updates the value of
GPU_DATE_VERSION and LATEST_GPU_DATE_VERSION , especailly when github
actions Publish Builder and Publish gpu Builder occur at same time

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-25 10:28:47 +08:00
Jiquan Long 4651f89944
enhance: specify version while rust-init (#29108)
This will reduce the size of builder image.
/kind improvement

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-12 22:10:41 +08:00
Jiquan Long 52594c8596
enhance: add libasan to amazon linux runner (#29039)
fix: #29038

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-07 14:14:42 +08:00
Jiquan Long fccec125b2
enhance: [skip-e2e] add rust to builder image (#28838)
https://github.com/milvus-io/milvus/issues/27704

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-04 10:10:35 +08:00
PowderLi 90997a5ddb
enhance: update the base image: milvusdb/milvus-env (#28505)
issue: #28683
to avoid downloading installation packages in CI workload install vcpkg
and install some packages in advance

Signed-off-by: PowderLi <min.li@zilliz.com>
2023-11-23 19:58:25 +08:00
sammy.huang ca42cbdad1
enhance: update cmake version to 3.27.5 (#28599)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-11-22 12:02:22 +08:00
yah01 6f59510723
Upgrade go to 1.20 (#24390)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-11-10 07:46:18 +08:00
Bennu 8c71e2bd64
Update milvs helm repo for ci (#28042)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-11-01 18:54:16 +08:00
PowderLi a951c7570f
publish builder gpu image (#27861)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-10-25 14:20:12 +08:00
Enwei Jiao 4faba61647
Upgrade conan to 1.61.0 (#27870)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-10-24 17:50:10 +08:00
Bennu 2446aa0cd7
[skip e2e] update gpu builder image (#27835)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-10-24 09:24:23 +08:00
PowderLi 11b521392e
install ninja in advance for arm64 (#27579)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-10-11 11:51:32 +08:00
PowderLi 8e142ff39f
[amazonlinux:2023]install perl-IPC-Cmd (#27049)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-09-13 18:53:18 +08:00
Enwei Jiao 2a755baaa5
Fix amazonlinux cache not work (#26883)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-09-07 15:43:15 +08:00
PowderLi 30ca45868d
install zip because we want to use vcpkg (#26664)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-08-30 14:19:00 +08:00
Bennu b2d980ce3c
Update milvus image publish (#26672)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-29 19:10:28 +08:00
Bennu 148446cfb9
Update milvus gpu image builder version (#26505)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-23 10:54:21 +08:00
xige-16 9131a0aa56
Add default MALLOC_CONF env (#26352)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-08-22 16:32:27 +08:00
Bennu fe16cdbca8
Publish milvus image on arm64 (#26509)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-22 10:44:21 +08:00
liliu-z 1e28c6e356
Update CUDA version to 11.8 (#26492)
Signed-off-by: Li Liu <li.liu@zilliz.com>
2023-08-21 15:36:20 +08:00
Enwei Jiao f2a6683a97
Update doc for remove Centos7 (#26476)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-21 09:54:20 +08:00
Enwei Jiao 533f0ddf6d
Add amazonlinux image, prepare to remove Centos7 image, remove openblas image (#26368)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-18 18:32:19 +08:00
Enwei Jiao c9d9940918
Remove Ubuntu18.04 support (#24666)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-06-06 14:06:36 +08:00
yah01 10c779d3d3
Upgrade image go version to 1.20.4 (#24393)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-05-25 14:51:26 +08:00
Bennu f547c1f8f4
Add ci for milvus gpu (#22845)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-03-20 19:03:57 +08:00
Enwei Jiao 5351fee733
Upgrade gcc11 for centos7 (#22190)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-15 17:16:33 +08:00
Enwei Jiao e1ec24895d
Upgrade gcc in CentOS (#22086)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-09 17:32:31 +08:00
Enwei Jiao 39377fde4e
Upgrade gcc and conan for builder (#22033)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-07 17:58:30 +08:00
Bennu 539d9b52c9
[skip e2e]Update meta-migratition build (#21686)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-01-12 20:01:41 +08:00
Jenny Li b834cce8c3
Add jenkins e2e cache for conan (#20784)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-23 19:09:11 +08:00
Enwei Jiao 958e94f6f0
Use Conan as c++ package manager (#19920)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-23 10:39:11 +08:00
Enwei Jiao 0a289c0052
Prepare builder image for conan (#20482)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-21 14:11:10 +08:00
Jenny Li 091291f99c
Make docker base separate from milvus image (#20473)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-15 15:15:07 +08:00
Jenny Li 0883599af8
[skip e2e]Remove entrypoint for migration image (#19908)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-10-19 21:47:31 +08:00
Jenny Li 6f5ff61ac3
[skip e2e] Add publish migration image (#19869)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-10-18 18:49:26 +08:00
Jenny Li 9aa307d851
Clean unnecessary deps to make milvus (#19711)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-10-12 14:33:23 +08:00
Jenny Li 765c39b3c1
Update docs to 20.04 (#19538)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-09-29 18:36:54 +08:00
xige-16 428840178c
Support diskann index for vector field (#19093)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-09-21 20:16:51 +08:00
zhagnlu a466b9494d
[skip e2e] add unzip tool (#19252)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-09-17 16:10:48 +08:00
Jenny Li d8b11121a8
Decrease build time by removing compiling openblas (#19207)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-09-16 17:46:47 +08:00
Jenny Li 18817a4ef8
[skip e2e] Update builder image for new openblas (#19209)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-09-15 22:06:33 +08:00
presburger 179ea77e6d
[skip e2e] optimize openblas compile in pod (#19202)
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>

Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
2022-09-14 21:28:35 +08:00
xige-16 0bfd2c95b8
[skip e2e] Add diakann index dependency (#19196)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-09-14 17:44:33 +08:00
presburger 4c992c5fc0
optimize openblas compile flags (#19122)
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>

Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
2022-09-13 15:20:32 +08:00
ThreadDao 56693836ae
[test] Add load balance verify in querynode scale test (#19028) (#19054)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-09-07 19:24:35 +08:00