Commit Graph

440 Commits (80c62f8c11824b6e73233b57d086106aac74067b)

Author SHA1 Message Date
congqixia 2dacca7b84
enhance: [skip e2e] use checkout action to get ".git" for codecov (#30014)
Ignoring .git may result "unusable report" in codecov. Use checkout
action to get .git information in upload codecov step

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-16 13:56:53 +08:00
sammy.huang 61acda4948
enhance: [skip e2e]debug why no configuration file when docker-compose up (#29890)
#29889

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-12 10:38:51 +08:00
sammy.huang 0b3b753ef6
enhance: clean .github/workflow/main.yaml (#29524)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-11 18:20:52 +08:00
congqixia 93f87417fd
enhance: remove .git folder for unit test workflow (#29833)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-10 16:46:49 +08:00
sammy.huang 24495bd16f
enhance: [skip e2e]We aim to cancel the previously initiated job or workflow ex… (#29797)
enhance: We aim to cancel the previously initiated job or workflow
exclusively during the Pull Request (PR) stage

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-09 18:28:48 +08:00
sammy.huang cd34de7de5
enhance:[skip e2e] use docker pugin to do same thing instead (#29667)
fix: #29663

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-08 10:10:47 +08:00
sammy.huang acbbabf043
enhance: [skip e2e]abstract bump builder version into a composite action (#29573)
fix: #29608

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-03 19:46:50 +08:00
sammy.huang 3824282d7b
enhance: [skip e2e] use docker/steup-xxx-action plugin to do same thing instead (#29607)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-03 19:08:50 +08:00
sammy.huang 497ced9588
enhance: allow github actions runner run on ubuntu-latest os (#29525)
since milvus's build procedure is in the responding docker enviornment,
this procedure does not bind with particular host os, in turn it allows
milvus build on any os , including latest ubuntu os

background:
our self hosted runner is only using ubuntu-latest os

benefit:
make this github workflow obtain the resource from the self-hosted
runner

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-28 15:48:48 +08:00
sammy.huang 44ed0dff6a
enhance: [skip e2e]use native way from upload-artifact plugin to archive (#29539)
use upload-artifact plugin to archive instead of zip

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-28 09:46:45 +08:00
sammy.huang afd87e0c5f
enhance: [skip e2e]bump tj-actions/changed-files to latest stable version (#29512)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-27 11:58:47 +08:00
sammy.huang d750dd95e6
enhance: [skip e2e]extract cache stuff into a independent composite action (#29499)
fix: #29510

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-27 11:56:57 +08:00
sammy.huang 3e5bc2e517
enhance: [skip e2e]conan lock issue (#29442)
not allow to upload cache when job failure

this PR is to fix issue like below:

openblas/0.3.23@milvus/dev is locked by another concurrent conan
process, wait... If not the case, quit, and do 'conan remove --locks'
Error: The operation was canceled.

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-25 16:34:46 +08:00
sammy.huang 4ee643a984
enhance: [skip e2e]remove-old-builder (#29384)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-21 19:14:42 +08:00
sre-ci-robot bd640754ac
enhance: [skip e2e] skip maximize build space plugin if it is self-hosted runner (#29214)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
Co-authored-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-14 17:44:39 +08:00
Jiquan Long f79c6146bd
enhance: [skip-e2e] auto cancel stale workflows (#29145)
/kind improvement

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-14 11:30:38 +08:00
Jiquan Long 02621e131c
enhance: [skip-e2e] enlarge disk space of action runner (#29077)
/kind improvement

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-08 16:14:07 +08:00
Jiquan Long fccec125b2
enhance: [skip-e2e] add rust to builder image (#28838)
https://github.com/milvus-io/milvus/issues/27704

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-04 10:10:35 +08:00
sammy.huang 1174a7527a
enhance: [skip e2e]delete unsed arch for gpu builder (#28887)
1. disable arm64 arch 
2. only use docker cli instead of docker buildx cli

---------

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-01 14:48:32 +08:00
PowderLi cac802ef7f
enhance: use already installed vcpkg (#28703)
issue #28686
1. Update Builder gpu image changes, see changes #28505
2. update azure-identity-cpp from beta to release

Signed-off-by: PowderLi <min.li@zilliz.com>
2023-11-30 15:58:32 +08:00
yah01 fd3ae4c4b8
enhance: improve the compile speed (#28444)
improve the CI compile speed with mold

Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-11-15 15:08:18 +08:00
yah01 33f17ae5bd
Fix mac code check (#28194)
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-11-06 17:34:19 +08:00
Bennu 8c71e2bd64
Update milvs helm repo for ci (#28042)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-11-01 18:54:16 +08:00
PowderLi 0252871d30
fix azure ListObjects (#27931)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-11-01 11:34:14 +08:00
Enwei Jiao 8ae9c947ae
Use OpenDAL to access object store (#25642)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-11-01 09:00:14 +08:00
Enwei Jiao b3cafeb21e
Fix code checker of MacOS (#28052)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-11-01 05:28:15 +08:00
PowderLi a951c7570f
publish builder gpu image (#27861)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-10-25 14:20:12 +08:00
Enwei Jiao 4faba61647
Upgrade conan to 1.61.0 (#27870)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-10-24 17:50:10 +08:00
Enwei Jiao 0f2f4a0a75
Remove useless parameters for Makefile (#27622)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-10-11 20:45:35 +08:00
Sheldon 5ba158a3f5
fix knowhere version-changing (#27508)
Update KNOWHERE_VERSION for the first occurrence

Signed-off-by: Sheldon <chuanfeng.liu@zilliz.com>
2023-10-08 08:35:32 +08:00
PowderLi 4feb3fa7c6
support azure (#26398)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-09-19 10:01:23 +08:00
Bennu 4ddeddf758
[skip e2e] Add action to check issue (#27135)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-09-15 18:03:20 +08:00
Enwei Jiao 2a755baaa5
Fix amazonlinux cache not work (#26883)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-09-07 15:43:15 +08:00
Bennu a398cf5d69
add action to bump milvus version by robot (#26715)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-30 15:51:00 +08:00
Bennu 32307db557
Add build builder image on arm (#26488)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-23 17:30:23 +08:00
Enwei Jiao 533f0ddf6d
Add amazonlinux image, prepare to remove Centos7 image, remove openblas image (#26368)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-18 18:32:19 +08:00
Bennu 0f9aa5fbec
Update knowhere commit update action (#26272)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-10 20:27:29 +08:00
Enwei Jiao 4aed32ff61
Use librdkafka for all platform (#25538)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-07-13 15:34:33 +08:00
Enwei Jiao c9d9940918
Remove Ubuntu18.04 support (#24666)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-06-06 14:06:36 +08:00
congqixia 96d07edbfb
Add coverage report for integration test (#24428)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-26 13:45:26 +08:00
congqixia 227a770a11
Fix data race in minicluster for nodes add&get (#24336)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-23 21:09:28 +08:00
congqixia e68f5cf08e
Fix integration tests logic (#24063)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-15 14:45:21 +08:00
congqixia 5819e98ebb
Trigger main workflow when integration test changed (#24020)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-11 09:51:19 +08:00
congqixia 38e60804a4
Add integration test workflow (#23976)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-09 19:18:41 +08:00
congqixia 6a48de344c
Change mac code checker timeout to 5h (#23885)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-05 18:18:38 +08:00
Enwei Jiao 2ced6660e2
Simplify makefile (#23583)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-21 14:16:33 +08:00
Bennu 5bda7ca641
Update workflow for update knowhere commit (#23581)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-04-20 18:46:32 +08:00
Bennu 91b9504f99
Add workflow for update knowhere commit (#23568)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-04-20 16:42:38 +08:00
Bennu 99a0713b0c
Revert "Add mac workflow for test" (#23542)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-04-19 19:55:03 +08:00
Bennu 7a6b435b67
Add mac workflow for test (#23535)
* Add  mac workflow for test

Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>


---------

Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-04-19 18:15:51 +08:00
Enwei Jiao f14c221123
Revert "Opt compile time for Mac (#23453)" (#23533)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-19 16:52:30 +08:00
Enwei Jiao e9dcba3050
Opt compile time for Mac (#23453)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-19 10:24:30 +08:00
Enwei Jiao 288582b2d9
Optimize mac build time (#23390)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-14 17:56:29 +08:00
congqixia 5276529524
Make pkg code change trigger ci workflow (#23312)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-11 10:32:31 +08:00
Enwei Jiao bbfa396754
speedup upload (#23306)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-10 08:24:30 +08:00
congqixia dc091166d3
Add .git into upload list (#23280)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-07 15:42:32 +08:00
Enwei Jiao 1fc33e2e22
split go and cpp ut (#23239)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-06 15:56:28 +08:00
Bennu f547c1f8f4
Add ci for milvus gpu (#22845)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-03-20 19:03:57 +08:00
congqixia 29a952ec5e
Trigger code check when linter setting changed (#22679)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-10 13:35:52 +08:00
Enwei Jiao 6fa8d62879
Lock conan version at 1.58.0 (#22503)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-03-01 19:59:47 +08:00
Enwei Jiao 0a9a9058b9
Fix UT timeout (#22261)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-20 21:14:25 +08:00
congqixia 8487f53da5
Install pkg-config for mac os workflow (#22266)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-17 18:20:25 +08:00
Enwei Jiao b25b3ef431
Integreation with Velox (#22102)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-16 17:26:35 +08:00
congqixia 5d83781df3
Fix file diff list for USE_ASAN flag (#22193)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-16 09:18:36 +08:00
congqixia 0480719e1a
Fix useasan format not correct (#21829)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-28 11:43:47 +08:00
congqixia 66feb295da
Use AdressSantizer build when cpp files changed (#21809)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-19 13:43:44 +08:00
Enwei Jiao 4e9fb92d9c
Fix mac ci conan cache not hit (#21568)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-01-10 11:03:38 +08:00
zhuwenxing 5ba9678b3d
[test]Fix github action for chaos test (#21180)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-12-13 15:37:21 +08:00
Enwei Jiao d553b5108e
Fix jemalloc.so not found (#21106)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-13 11:27:21 +08:00
Bennu 1f65c9f337
[skip e2e] Delete windows code-checker (#20783)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>

Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2022-11-23 16:01:12 +08:00
Enwei Jiao 958e94f6f0
Use Conan as c++ package manager (#19920)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-23 10:39:11 +08:00
Jenny Li 8e2083c8a1
[skip e2e]Improve codecov uploader (#20672)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-23 09:53:21 +08:00
Jenny Li 7a413468ab
[skip e2e] Fix replace image tag logic (#20609)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-16 14:21:14 +08:00
Jenny Li 091291f99c
Make docker base separate from milvus image (#20473)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-15 15:15:07 +08:00
Jenny Li b97c36cd41
[skip e2e] Move codecov as separate job (#20381)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-08 19:59:03 +08:00
Jenny Li 7d188ea39a
[skip e2e] Update pytest image tag for the right ci yaml (#20300)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-03 17:47:36 +08:00
Jenny Li f4a9761e6b
[skip e2e] Add sign for auto pytest pr && change the e2e image (#20292)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-03 14:53:35 +08:00
Jenny Li fdefcff84a
Refactor Makefile to reduce duplicate steps for ci-ut (#20288)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-03 14:19:35 +08:00
Jenny Li 3a40ce8028
[skip e2e] Add cache third party for ut (#19994)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-10-23 08:45:28 +08:00
Jenny Li e19e364c21
[skip e2e] Try to improve mac compile (#19992)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-10-23 08:41:33 +08:00
edward.zeng c65bf46b61
Refine weekly release tag (#19914)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-10-20 10:09:28 +08:00
Jenny Li 9aa307d851
Clean unnecessary deps to make milvus (#19711)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-10-12 14:33:23 +08:00
Jenny Li 06f3d1e55b
[skip e2e]Disable rebuild centos env for code checker (#19664)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-10-09 18:13:21 +08:00
Jenny Li b2a8536cb4
[skip e2e] Upload codecov even ut failed (#19645)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-10-09 09:26:57 +08:00
Enwei Jiao 76515126b7
fix mac compile error (#19621)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-10-08 14:02:57 +08:00
Jenny Li 5b4038e9f0
[skip e2e]Export log for mac (#19620)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-10-08 11:52:58 +08:00
Jenny Li 765c39b3c1
Update docs to 20.04 (#19538)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-09-29 18:36:54 +08:00
Jenny Li 289e55ec52
[skip e2e] Remove rebuild env image to decrease failure for download deps (#19481)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-09-27 17:36:54 +08:00
Jenny Li 2c7257c2ee
[skip e2e]Bump codecov action version to 3.1.1 (#19462)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-09-27 11:36:55 +08:00
xige-16 428840178c
Support diskann index for vector field (#19093)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-09-21 20:16:51 +08:00
Jenny Li 8dce723327
[skip e2e] Fail ci when upload codecov report failed (#19036)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-09-06 12:39:11 +08:00
Jenny Li afebd2eeef
Change ci namespace from jenkins to milvus-ci && Remove old Jenkins (#18960)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-09-01 15:16:58 +08:00
Jenny Li f089406ecf
[skip e2e]Remove export logs (#18849)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-08-29 09:57:00 +08:00
Jenny Li c4a9e13e03
Fix cache path for 20.04 (#18859)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-08-26 23:46:54 +08:00
Jenny Li 1436b7affe
Change CI to use ubuntu 20.04 (#18839)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-08-26 10:06:54 +08:00
Jenny Li 0bb6526d1a
[skip e2e] Add 20.04 (#18831)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-08-25 21:24:55 +08:00
Ji Bin f3c755602b
Adaptation for latest MinGW64 (#18699)
Signed-off-by: Ji Bin <matrixji@live.com>

Signed-off-by: Ji Bin <matrixji@live.com>
2022-08-25 10:56:53 +08:00
zhuwenxing d983a068ef
[skip e2e]update milvus version in deploy test (#18650)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-08-15 16:18:48 +08:00
zhuwenxing f0a336a3e2
[skip e2e]Update etcd version (#18587)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-08-10 17:18:38 +08:00
zhuwenxing fcd71930c8
[skip e2e]Add recall test (#18562)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-08-09 13:50:36 +08:00