Commit Graph

524 Commits (54797b42860f5917458996b8b5fa734b1f9b15bf)

Author SHA1 Message Date
shaoting-huang d27db99697
enhance: upgrade amazonlinux2023 builder image go version to 1.21 (#33176)
Signed-off-by: shaoting-huang [shaoting-huang@zilliz.com]

issue: https://github.com/milvus-io/milvus/issues/32982

Go 1.21 introduces several improvements and changes over Go 1.20, which
is quite stable now. This PR is mainly for upgrading images Golang
version from 1.20 to 1.21.

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-05-20 21:11:39 +08:00
shaoting-huang c35eaaa358
enhance: upgrade images golang version from 1.20 to 1.21 (#33150)
Signed-off-by: shaoting-huang [shaoting-huang@zilliz.com]

issue: https://github.com/milvus-io/milvus/issues/32982

Go 1.21 introduces several improvements and changes over Go 1.20, which
is quite stable now. This PR is mainly for upgrading images Golang
version from 1.20 to 1.21.

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-05-20 15:01:43 +08:00
Yinzuo Jiang 2cc50d80a3
fix: add openblas in install_deps.sh (#33065)
Install openblas using apt or yum in scripts/install_deps.sh, update
documentations and fix some typos related to build and installation.

issue: #33056, #33066

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
2024-05-17 14:53:37 +08:00
PowderLi 6289f3a9eb
fix: build milvus in rockylinux8 (#32619)
issue: #32299

1. xz utils recovers
2. forget to install ninja

Signed-off-by: PowderLi <min.li@zilliz.com>
2024-04-29 14:53:26 +08:00
sammy.huang d343d2f3fc
enhance: add vcpkg for rockylinux8 (#32300)
issues:#32299

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-18 11:05:20 +08:00
sammy.huang 184d8000a9
enhance: hotfix for pipeline (#32339)
pr: #32338

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-16 22:58:42 +08:00
sammy.huang 15b9319523
enhance: hot fix publish pipeline (#32330)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-16 19:48:15 +08:00
sammy.huang df2ca7f312
enhance: use openblas-devel instead (#32284)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-15 22:14:43 +08:00
sammy.huang 053347637b
enhance: add openblas-devel (#32049)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-15 19:47:20 +08:00
sammy.huang 703fcac819
enhance: add openblas in runtime env (#31974)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-08 14:57:16 +08:00
sammy.huang db698756dc
enhance: make gpu builder both support amd64 and gpu64 (#31888)
the purpose of this pr is to build arm-based and x86-based
milvusdb/milvus-env for milvus gpu. milvusdb/milvus-env would be based
on ubuntu22.04

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-05 10:09:22 +08:00
sammy.huang b11c2da930
enhance: for supporting ARM-based GPU images (#31757)
This PR is for supporting ARM-based GPU images.
issue: #31862

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-03 11:49:14 +08:00
sammy.huang f7a59766df
enhance: support rockylinux8 (#31751)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-01 10:23:12 +08:00
sammy.huang b0a941c2fb
enhance: to reduce container image size (#31576)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-01 09:39:12 +08:00
sammy.huang 1b31824f83
enhance: add openblas dependency (#31437)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-03-21 15:59:12 +08:00
Guillaume Moutier d15db7596d
fix: fix permissions on /milvus for OpenShift compatibility (#30775)
OpenShift runs Pods with a random uid and gid 0.
As Milvus needs to write into the /milvus directory, this fix modifies
the group permissions to allow the root group (gid 0) to write into it.
This is a simple solution that allows to run Milvus on OpenShift without
adding security constraints, use special ServiceAccounts or whatever.
This should also not impact any other kubernetes platform as it's a
simple group permission change, nothing regarding the userid.

Note: Other actions are necessary to properly deploy the full stack
(Minio, Pulsar,...) on OpenShift. I will document them in the helm chart
project.

Fixes #25565

Signed-off-by: Guillaume Moutier <guillaume.moutier@gmail.com>
2024-02-28 16:29:05 +08:00
sammy.huang cbfe344ecf
enhance: [skip 2e2]add the option of host network mode into builder_gpu.sh file (#30573)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-19 14:14:55 +08:00
sammy.huang 46d9ac5931
enhance: move the option of network mode into builder.sh file (#30419)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-01 11:49:03 +08:00
sammy.huang fb9d64ab1e
enhance: hotfix container network (#30389)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-31 10:23:05 +08:00
sammy.huang fda6f8d04e
enhance: hotfix docker-compose.yml (#30378)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-30 19:23:04 +08:00
sammy.huang 62fdfe125f
enhance: [skip e2e]to add some comments (#29440)
there are two purposes for this PR
1. to add some comments on variable in the .env file. 
2. avoid git merge conflict when one PR update the value of DATE_VERSION
and LATEST_DATE_VERSION and meanwhile other PR updates the value of
GPU_DATE_VERSION and LATEST_GPU_DATE_VERSION , especailly when github
actions Publish Builder and Publish gpu Builder occur at same time

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-25 10:28:47 +08:00
Jiquan Long 4651f89944
enhance: specify version while rust-init (#29108)
This will reduce the size of builder image.
/kind improvement

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-12 22:10:41 +08:00
Jiquan Long 52594c8596
enhance: add libasan to amazon linux runner (#29039)
fix: #29038

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-07 14:14:42 +08:00
Jiquan Long fccec125b2
enhance: [skip-e2e] add rust to builder image (#28838)
https://github.com/milvus-io/milvus/issues/27704

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-04 10:10:35 +08:00
PowderLi 90997a5ddb
enhance: update the base image: milvusdb/milvus-env (#28505)
issue: #28683
to avoid downloading installation packages in CI workload install vcpkg
and install some packages in advance

Signed-off-by: PowderLi <min.li@zilliz.com>
2023-11-23 19:58:25 +08:00
sammy.huang ca42cbdad1
enhance: update cmake version to 3.27.5 (#28599)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-11-22 12:02:22 +08:00
yah01 6f59510723
Upgrade go to 1.20 (#24390)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-11-10 07:46:18 +08:00
Bennu 8c71e2bd64
Update milvs helm repo for ci (#28042)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-11-01 18:54:16 +08:00
PowderLi a951c7570f
publish builder gpu image (#27861)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-10-25 14:20:12 +08:00
Enwei Jiao 4faba61647
Upgrade conan to 1.61.0 (#27870)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-10-24 17:50:10 +08:00
Bennu 2446aa0cd7
[skip e2e] update gpu builder image (#27835)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-10-24 09:24:23 +08:00
PowderLi 11b521392e
install ninja in advance for arm64 (#27579)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-10-11 11:51:32 +08:00
PowderLi 8e142ff39f
[amazonlinux:2023]install perl-IPC-Cmd (#27049)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-09-13 18:53:18 +08:00
Enwei Jiao 2a755baaa5
Fix amazonlinux cache not work (#26883)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-09-07 15:43:15 +08:00
PowderLi 30ca45868d
install zip because we want to use vcpkg (#26664)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-08-30 14:19:00 +08:00
Bennu b2d980ce3c
Update milvus image publish (#26672)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-29 19:10:28 +08:00
Bennu 148446cfb9
Update milvus gpu image builder version (#26505)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-23 10:54:21 +08:00
xige-16 9131a0aa56
Add default MALLOC_CONF env (#26352)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-08-22 16:32:27 +08:00
Bennu fe16cdbca8
Publish milvus image on arm64 (#26509)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-22 10:44:21 +08:00
liliu-z 1e28c6e356
Update CUDA version to 11.8 (#26492)
Signed-off-by: Li Liu <li.liu@zilliz.com>
2023-08-21 15:36:20 +08:00
Enwei Jiao f2a6683a97
Update doc for remove Centos7 (#26476)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-21 09:54:20 +08:00
Enwei Jiao 533f0ddf6d
Add amazonlinux image, prepare to remove Centos7 image, remove openblas image (#26368)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-18 18:32:19 +08:00
Enwei Jiao c9d9940918
Remove Ubuntu18.04 support (#24666)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-06-06 14:06:36 +08:00
yah01 10c779d3d3
Upgrade image go version to 1.20.4 (#24393)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-05-25 14:51:26 +08:00
Bennu f547c1f8f4
Add ci for milvus gpu (#22845)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-03-20 19:03:57 +08:00
Enwei Jiao 5351fee733
Upgrade gcc11 for centos7 (#22190)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-15 17:16:33 +08:00
Enwei Jiao e1ec24895d
Upgrade gcc in CentOS (#22086)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-09 17:32:31 +08:00
Enwei Jiao 39377fde4e
Upgrade gcc and conan for builder (#22033)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-07 17:58:30 +08:00
Bennu 539d9b52c9
[skip e2e]Update meta-migratition build (#21686)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-01-12 20:01:41 +08:00
Jenny Li b834cce8c3
Add jenkins e2e cache for conan (#20784)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-23 19:09:11 +08:00