Commit Graph

598 Commits (80c62f8c11824b6e73233b57d086106aac74067b)

Author SHA1 Message Date
congqixia a938951eea
enhance: [skip e2e] fix upload code cov if syntax (#32128)
The re-upload step is always true since the syntax is wrong

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-11 10:05:19 +08:00
sammy.huang 08bfb431b7
enhance: [skip e2e]add prefix to differentiate (#32025)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-09 10:57:24 +08:00
sammy.huang 2aa6f3d3ec
enhance: bump codecod-action to v4 (#31984)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-08 16:57:17 +08:00
sammy.huang db698756dc
enhance: make gpu builder both support amd64 and gpu64 (#31888)
the purpose of this pr is to build arm-based and x86-based
milvusdb/milvus-env for milvus gpu. milvusdb/milvus-env would be based
on ubuntu22.04

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-05 10:09:22 +08:00
sammy.huang f7a59766df
enhance: support rockylinux8 (#31751)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-01 10:23:12 +08:00
congqixia f399416b92
enhance: Use gotestsum to run go unit test (#31622)
See also #31490

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-03-27 15:29:10 +08:00
congqixia 4da8b6607d
enhance: Add scripts to use `gotestsum` to execute integration test (#31490)
See also #31489

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-03-22 10:29:06 +08:00
congqixia 69486994a9
enhance: [skip e2e] Make "fix:" prefix work for 2.4 branch (#31384)
Other prefixes, say enhance, doc, etc., works for branch 2.4 now, but
"fix" prefix does not, this PR sync "fix: " branch selector to other
prefixes.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-03-19 10:15:12 +08:00
sammy.huang 69e1d612dc
enhance: [skip e2e] change Semantics from 2.3.x to 2.X.X (#31350)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-03-18 12:05:04 +08:00
sammy.huang ed1197ea50
enhance: Revert[skip e2e] bump milvus version for scripts/standalone_embed.sh (#30892)
This reverts commit cdb3f61fc8.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-02-28 16:55:06 +08:00
sammy.huang 74c82b48b4
enhance: [skip e2e] disable macos code checker (#30874)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-02-28 10:46:57 +08:00
sammy.huang 1200bcc65d
enhance: [skip e2e]bump milvus version for scripts/standalone_embed.sh (#30696)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-21 09:32:54 +08:00
sammy.huang ffce03046a
enhance: Remove ci-passed label when ci failed on any changes to source code (#30628)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-18 14:38:49 +08:00
sammy.huang d097d558b6
enhance: Maximize build space at the begin (#30540)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-06 10:29:40 +08:00
XuanYang-cn 73f6ed672d
fix: [skip e2e] Correct check UT for go rules (#30518)
Fixes: #30517

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-02-05 13:56:27 +08:00
sammy.huang 6e78cf2440
enhance: [skip e2e]to use yaml anchor and alias to abstract common part in yaml (#30505)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-04 18:55:05 +08:00
sammy.huang 32914a3ddf
enhance: [skip e2e]cleanup unnecessary part in the github action (#30425)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-01 14:39:04 +08:00
sammy.huang 265453f400
enhance: [skip e2e]revert back to original way to archive, upload and download (#30248)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-01 10:15:04 +08:00
sammy.huang 927d310959
enhance: [skip e2e]change to a better name (#30329)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-29 09:45:08 +08:00
sammy.huang ae4f62ab4b
enhance: [skip e2e]Revert changes from pr 29890 (#29957)
Revert changes from pr #29890

This reverts commit 61acda4948.

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-22 10:00:55 +08:00
sammy.huang e7dc82d8cc
enhance: [skip e2e]to workaround the error "HOME not set" (#30047)
issue: #30046

to workaround the error "HOME not set"  happened in self hosted runner

solution from
https://alexanderhose.com/aws-codecommit-with-instance-role-and-user-data/

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-17 16:12:54 +08:00
sammy.huang 1152838a54
enhance: [skip e2e] when issue is required and when is not (#30063)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-17 15:16:55 +08:00
sammy.huang 750166fd97
enhance: [skip e2e] failed to run all-contributors workflow (#29974)
issue: #30025

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-16 16:24:52 +08:00
congqixia 2dacca7b84
enhance: [skip e2e] use checkout action to get ".git" for codecov (#30014)
Ignoring .git may result "unusable report" in codecov. Use checkout
action to get .git information in upload codecov step

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-16 13:56:53 +08:00
sammy.huang 61acda4948
enhance: [skip e2e]debug why no configuration file when docker-compose up (#29890)
#29889

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-12 10:38:51 +08:00
sammy.huang 0b3b753ef6
enhance: clean .github/workflow/main.yaml (#29524)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-11 18:20:52 +08:00
congqixia 93f87417fd
enhance: remove .git folder for unit test workflow (#29833)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-10 16:46:49 +08:00
sammy.huang 24495bd16f
enhance: [skip e2e]We aim to cancel the previously initiated job or workflow ex… (#29797)
enhance: We aim to cancel the previously initiated job or workflow
exclusively during the Pull Request (PR) stage

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-09 18:28:48 +08:00
sammy.huang cd34de7de5
enhance:[skip e2e] use docker pugin to do same thing instead (#29667)
fix: #29663

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-08 10:10:47 +08:00
sammy.huang acbbabf043
enhance: [skip e2e]abstract bump builder version into a composite action (#29573)
fix: #29608

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-03 19:46:50 +08:00
sammy.huang 3824282d7b
enhance: [skip e2e] use docker/steup-xxx-action plugin to do same thing instead (#29607)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-03 19:08:50 +08:00
sammy.huang 497ced9588
enhance: allow github actions runner run on ubuntu-latest os (#29525)
since milvus's build procedure is in the responding docker enviornment,
this procedure does not bind with particular host os, in turn it allows
milvus build on any os , including latest ubuntu os

background:
our self hosted runner is only using ubuntu-latest os

benefit:
make this github workflow obtain the resource from the self-hosted
runner

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-28 15:48:48 +08:00
sammy.huang 44ed0dff6a
enhance: [skip e2e]use native way from upload-artifact plugin to archive (#29539)
use upload-artifact plugin to archive instead of zip

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-28 09:46:45 +08:00
sammy.huang afd87e0c5f
enhance: [skip e2e]bump tj-actions/changed-files to latest stable version (#29512)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-27 11:58:47 +08:00
sammy.huang d750dd95e6
enhance: [skip e2e]extract cache stuff into a independent composite action (#29499)
fix: #29510

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-27 11:56:57 +08:00
sammy.huang 3e5bc2e517
enhance: [skip e2e]conan lock issue (#29442)
not allow to upload cache when job failure

this PR is to fix issue like below:

openblas/0.3.23@milvus/dev is locked by another concurrent conan
process, wait... If not the case, quit, and do 'conan remove --locks'
Error: The operation was canceled.

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-25 16:34:46 +08:00
sammy.huang 4ee643a984
enhance: [skip e2e]remove-old-builder (#29384)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-21 19:14:42 +08:00
sre-ci-robot bd640754ac
enhance: [skip e2e] skip maximize build space plugin if it is self-hosted runner (#29214)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
Co-authored-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-14 17:44:39 +08:00
Jiquan Long f79c6146bd
enhance: [skip-e2e] auto cancel stale workflows (#29145)
/kind improvement

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-14 11:30:38 +08:00
Jiquan Long 02621e131c
enhance: [skip-e2e] enlarge disk space of action runner (#29077)
/kind improvement

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-08 16:14:07 +08:00
Jiquan Long fccec125b2
enhance: [skip-e2e] add rust to builder image (#28838)
https://github.com/milvus-io/milvus/issues/27704

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-04 10:10:35 +08:00
sammy.huang 1174a7527a
enhance: [skip e2e]delete unsed arch for gpu builder (#28887)
1. disable arm64 arch 
2. only use docker cli instead of docker buildx cli

---------

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-01 14:48:32 +08:00
PowderLi cac802ef7f
enhance: use already installed vcpkg (#28703)
issue #28686
1. Update Builder gpu image changes, see changes #28505
2. update azure-identity-cpp from beta to release

Signed-off-by: PowderLi <min.li@zilliz.com>
2023-11-30 15:58:32 +08:00
Sammy Huang 43680043e3 auto close Update Knowhere Commit PR as long as ci-passed
Assign the 'lgtm' and 'approved' labels following the successful testing of the 'Update Knowhere Commit'
then prow/tide bot will auto merge the PR to master branch.

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-11-30 12:03:55 +08:00
sammy.huang fa66c2829d
enhance: [skip e2e] add auto prefix for the PR from bot (#28705)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-11-24 09:42:23 +08:00
sammy.huang 46a5542d70
feat: [skip e2e] apply PR format enforcement to branch 2.3.x (#28506)
beside master branch, also apply PR format enforcement to branch 2.3.x

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-11-16 18:06:19 +08:00
yah01 1c3e763471
enhance: [skip e2e] remove missing related issue for small enhancement PR (#28503)
remove the missing-related-issue if the PR size is not large and be with
`kind/enhancement`

Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-11-16 17:34:19 +08:00
yah01 b4fa3b9a09
enhance: [skip e2e] add more types for PR classification (#28497)
add 2 more types:
- test: for add tests to existing functionality.
- doc: for modifying documentation.

Also requires related issue for large PR

---------

Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-11-16 17:22:20 +08:00
sammy.huang 47eb76b202
[skip e2e] Transition from Rebase Merging to Squash Merging (#28467)
according to the issue: #28312

below is the feature added 
 
## change 1:
discard the 'kind/improvement' label and instead use the
'kind/enhancement' label"

## change 2:
delete the existing two rule in mergify file, to allow multiple commits
in a PR

- name: Add `needs-rebase` label when more than one commit in pr
- name: Remove `needs-rebase` label when only one commit in pr

## change 3:

add two new rules for  PR format
- name: Add 'do-not-merge/invalid-pr-format' label for invalid PR titles
- name: Remove 'do-not-merge/invalid-pr-format' label for valid PRs

## change 4:
mapping PR type to corresponding label, below is the logic

if PR title start with 'fix:', add 'kind/bug' label
else if  PR title start with 'feat:',add 'kind/feature' label
else if  PR title start with 'enhance:', add 'kind/enhancement' label

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-11-16 16:00:20 +08:00
yah01 fd3ae4c4b8
enhance: improve the compile speed (#28444)
improve the CI compile speed with mold

Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-11-15 15:08:18 +08:00
yah01 33f17ae5bd
Fix mac code check (#28194)
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-11-06 17:34:19 +08:00
Bennu 8c71e2bd64
Update milvs helm repo for ci (#28042)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-11-01 18:54:16 +08:00
PowderLi 0252871d30
fix azure ListObjects (#27931)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-11-01 11:34:14 +08:00
Enwei Jiao 8ae9c947ae
Use OpenDAL to access object store (#25642)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-11-01 09:00:14 +08:00
Enwei Jiao b3cafeb21e
Fix code checker of MacOS (#28052)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-11-01 05:28:15 +08:00
congqixia 34b43db018
Fix mergfy fmt error (#27973)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-10-27 00:04:10 +08:00
congqixia a1d2aa30ae
Fix mergify rules for branch 2.3 (#27968)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-10-26 21:36:11 +08:00
PowderLi a951c7570f
publish builder gpu image (#27861)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-10-25 14:20:12 +08:00
Enwei Jiao 4faba61647
Upgrade conan to 1.61.0 (#27870)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-10-24 17:50:10 +08:00
Enwei Jiao 0f2f4a0a75
Remove useless parameters for Makefile (#27622)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-10-11 20:45:35 +08:00
Sheldon 5ba158a3f5
fix knowhere version-changing (#27508)
Update KNOWHERE_VERSION for the first occurrence

Signed-off-by: Sheldon <chuanfeng.liu@zilliz.com>
2023-10-08 08:35:32 +08:00
PowderLi 4feb3fa7c6
support azure (#26398)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-09-19 10:01:23 +08:00
Bennu 4ddeddf758
[skip e2e] Add action to check issue (#27135)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-09-15 18:03:20 +08:00
Enwei Jiao 2a755baaa5
Fix amazonlinux cache not work (#26883)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-09-07 15:43:15 +08:00
congqixia 8dfa832fa0
Use same mergify rule for branch 2.3.0 (#26896)
Since branch 2.3.0 share same action setup,
rules applied to master shall apply to branch 2.3.0 as well
For now, only branch 2.2.0 uses diferent set of rules

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-09-07 12:03:15 +08:00
congqixia 0844e19505
Fix mergify rules for unit test file changed under pkg folder (#26882)
See #26865
 for only unit test file changed
removed due to exclude rule only apply to _test.go under internal/

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-09-06 18:33:14 +08:00
Bennu a398cf5d69
add action to bump milvus version by robot (#26715)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-30 15:51:00 +08:00
Bennu 32307db557
Add build builder image on arm (#26488)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-23 17:30:23 +08:00
Bennu 44fc906996
Update mergify (#26508)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-22 08:32:22 +08:00
Enwei Jiao 533f0ddf6d
Add amazonlinux image, prepare to remove Centos7 image, remove openblas image (#26368)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-18 18:32:19 +08:00
Bennu 0f9aa5fbec
Update knowhere commit update action (#26272)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-10 20:27:29 +08:00
Bennu 09cf8700a7
Update mergify rule for related pr (#26209)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-08 16:11:08 +08:00
Bennu 82de6befdf
add mergify rule (#26196)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-08 14:19:08 +08:00
Enwei Jiao 4aed32ff61
Use librdkafka for all platform (#25538)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-07-13 15:34:33 +08:00
Enwei Jiao c9d9940918
Remove Ubuntu18.04 support (#24666)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-06-06 14:06:36 +08:00
congqixia 96d07edbfb
Add coverage report for integration test (#24428)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-26 13:45:26 +08:00
congqixia 227a770a11
Fix data race in minicluster for nodes add&get (#24336)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-23 21:09:28 +08:00
congqixia c58bebed6d
Fix go unittest changed getting ci-passed before job done (#24111)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-23 17:47:25 +08:00
congqixia e68f5cf08e
Fix integration tests logic (#24063)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-15 14:45:21 +08:00
congqixia 5819e98ebb
Trigger main workflow when integration test changed (#24020)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-11 09:51:19 +08:00
congqixia 38e60804a4
Add integration test workflow (#23976)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-09 19:18:41 +08:00
congqixia 6a48de344c
Change mac code checker timeout to 5h (#23885)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-05 18:18:38 +08:00
Enwei Jiao 2ced6660e2
Simplify makefile (#23583)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-21 14:16:33 +08:00
Bennu 5bda7ca641
Update workflow for update knowhere commit (#23581)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-04-20 18:46:32 +08:00
Bennu 91b9504f99
Add workflow for update knowhere commit (#23568)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-04-20 16:42:38 +08:00
Bennu 99a0713b0c
Revert "Add mac workflow for test" (#23542)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-04-19 19:55:03 +08:00
Bennu 7a6b435b67
Add mac workflow for test (#23535)
* Add  mac workflow for test

Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>


---------

Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-04-19 18:15:51 +08:00
Enwei Jiao f14c221123
Revert "Opt compile time for Mac (#23453)" (#23533)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-19 16:52:30 +08:00
Enwei Jiao e9dcba3050
Opt compile time for Mac (#23453)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-19 10:24:30 +08:00
Enwei Jiao 288582b2d9
Optimize mac build time (#23390)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-14 17:56:29 +08:00
congqixia 5276529524
Make pkg code change trigger ci workflow (#23312)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-11 10:32:31 +08:00
Enwei Jiao bbfa396754
speedup upload (#23306)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-10 08:24:30 +08:00
congqixia dc091166d3
Add .git into upload list (#23280)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-07 15:42:32 +08:00
Enwei Jiao 1fc33e2e22
split go and cpp ut (#23239)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-06 15:56:28 +08:00
Bennu f547c1f8f4
Add ci for milvus gpu (#22845)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-03-20 19:03:57 +08:00
congqixia 29a952ec5e
Trigger code check when linter setting changed (#22679)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-10 13:35:52 +08:00
Bennu e1c335ad59
[skip e2e] Update mergify for sql_beta branch (#22603)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-03-07 14:41:50 +08:00
Enwei Jiao 6fa8d62879
Lock conan version at 1.58.0 (#22503)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-03-01 19:59:47 +08:00
Enwei Jiao 0a9a9058b9
Fix UT timeout (#22261)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-20 21:14:25 +08:00
congqixia 8487f53da5
Install pkg-config for mac os workflow (#22266)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-17 18:20:25 +08:00