0f514708ff
enhance: Accelerate Build stage by skipping cpp ut compilation ( #37530 )
...
Since master branch run cpp unittest in jenken, the cpp unit test
building could be skipped since the output is not needed in github
runner.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-08 14:06:26 +08:00
139f4e5ab5
enhance: [codecov]split code coverage into components ( #37137 )
...
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-10-25 17:42:14 +08:00
8902e2220e
enhance: enable asan for cpp unittest ( #37041 )
...
https://github.com/milvus-io/milvus/issues/35854
Signed-off-by: chyezh <chyezh@outlook.com>
Co-authored-by: chyezh <chyezh@outlook.com>
2024-10-23 17:21:27 +08:00
a05a37a583
enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) ( #36214 )
...
Native support for Google cloud storage using the Google Cloud Storage
libraries. Authentication is performed using GCS service account
credentials JSON.
Currently, Milvus supports Google Cloud Storage using S3-compatible APIs
via the AWS SDK. This approach has the following limitations:
1. Overhead: Translating requests between S3-compatible APIs and GCS can
introduce additional overhead.
2. Compatibility Limitations: Some features of the original S3 API may
not fully translate or work as expected with GCS.
To address these limitations, This enhancement is needed.
Related Issue: #36212
2024-09-30 13:23:32 +08:00
e373687a07
enhance: turnoff USE_ASAN in ci ( #35721 )
...
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-27 14:01:11 +08:00
241c71fdde
enhance: use docker compose instead of docker-compose ( #35208 )
...
https://github.com/milvus-io/milvus/issues/35209
---------
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-02 19:32:32 +08:00
e62f6b2f4e
enhance: [skip e2e] enlarge timeout of UT for go up to 90 mins ( #35035 )
...
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-07-29 15:51:49 +08:00
1f55061717
feat: [skip e2e] effective way to use cache ( #34774 )
...
issue: https://github.com/milvus-io/milvus/issues/34876
1. try best to download cache
2. upload cache if it is not pull request
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-07-23 10:49:51 +08:00
ac2840243a
enhance: revert dead try on uploading codecov ( #34130 )
...
This reverts commit 19936d9994
2024-06-25 11:51:30 +08:00
2cc9df5c50
[automated] Update cpu Builder image changes ( #34078 )
...
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-25 10:56:10 +08:00
19936d9994
fix:[skip e2e] make more retries on codecov uploader ( #33683 )
...
fix #32235
inspired by
https://github.com/Kong/kubernetes-testing-framework/blob/main/.github/workflows/tests.yaml#L53-L69
### What is changing:
Introducing the
[wretry.action](https://github.com/Wandalen/wretry.action ) to
automatically retry the
[codecov-action](https://github.com/codecov/codecov-action ) in our CI/CD
pipeline. This change is intended to enhance the robustness of our
workflow by mitigating transient failures in the codecov-action.
### Follow-up changes needed:
This retry mechanism will be removed once the issue
[codecov/codecov-action#926 ](https://github.com/codecov/codecov-action/issues/926 )
is resolved or if GitHub Actions provides a built-in retry feature for
actions.
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-07 10:33:52 +08:00
244d2c04f6
feat: Add `milvusclient` package and migrate GoSDK ( #32907 )
...
Related to #31293
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-05-10 18:01:30 +08:00
29d3c576a3
enhance: [skip e2e] Enlarge integration test timeout to 90min ( #32686 )
...
The running time of integration is above 50 minutes and may surpass 60
and timeout in some cases. This PR enlarge timeout first.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-29 11:33:25 +08:00
2a4dfde2de
enhance: revert [skip e2e] use pull_request_target event instead ( #32426 )
...
This reverts commit ab6ddf6929
2024-04-18 17:15:37 +08:00
66fae53cd2
enhance: hotfix HOME variable ( #32411 )
...
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-18 14:49:26 +08:00
70beec3e47
enhance: hotfix HOME variable ( #32405 )
...
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-18 13:08:32 +08:00
ab6ddf6929
enhance: [skip e2e] use pull_request_target event instead ( #32236 )
...
issue: #32235
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-13 21:17:17 +08:00
a938951eea
enhance: [skip e2e] fix upload code cov if syntax ( #32128 )
...
The re-upload step is always true since the syntax is wrong
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-11 10:05:19 +08:00
2aa6f3d3ec
enhance: bump codecod-action to v4 ( #31984 )
...
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-08 16:57:17 +08:00
f399416b92
enhance: Use gotestsum to run go unit test ( #31622 )
...
See also #31490
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-03-27 15:29:10 +08:00
4da8b6607d
enhance: Add scripts to use `gotestsum` to execute integration test ( #31490 )
...
See also #31489
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-03-22 10:29:06 +08:00
d097d558b6
enhance: Maximize build space at the begin ( #30540 )
...
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-06 10:29:40 +08:00
32914a3ddf
enhance: [skip e2e]cleanup unnecessary part in the github action ( #30425 )
...
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-01 14:39:04 +08:00
265453f400
enhance: [skip e2e]revert back to original way to archive, upload and download ( #30248 )
...
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-01 10:15:04 +08:00
ae4f62ab4b
enhance: [skip e2e]Revert changes from pr 29890 ( #29957 )
...
Revert changes from pr #29890
This reverts commit 61acda4948
2024-01-22 10:00:55 +08:00
2dacca7b84
enhance: [skip e2e] use checkout action to get ".git" for codecov ( #30014 )
...
Ignoring .git may result "unusable report" in codecov. Use checkout
action to get .git information in upload codecov step
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-16 13:56:53 +08:00
61acda4948
enhance: [skip e2e]debug why no configuration file when docker-compose up ( #29890 )
...
#29889
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-12 10:38:51 +08:00
0b3b753ef6
enhance: clean .github/workflow/main.yaml ( #29524 )
...
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-11 18:20:52 +08:00
93f87417fd
enhance: remove .git folder for unit test workflow ( #29833 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-10 16:46:49 +08:00
24495bd16f
enhance: [skip e2e]We aim to cancel the previously initiated job or workflow ex… ( #29797 )
...
enhance: We aim to cancel the previously initiated job or workflow
exclusively during the Pull Request (PR) stage
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-09 18:28:48 +08:00
497ced9588
enhance: allow github actions runner run on ubuntu-latest os ( #29525 )
...
since milvus's build procedure is in the responding docker enviornment,
this procedure does not bind with particular host os, in turn it allows
milvus build on any os , including latest ubuntu os
background:
our self hosted runner is only using ubuntu-latest os
benefit:
make this github workflow obtain the resource from the self-hosted
runner
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-28 15:48:48 +08:00
44ed0dff6a
enhance: [skip e2e]use native way from upload-artifact plugin to archive ( #29539 )
...
use upload-artifact plugin to archive instead of zip
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-28 09:46:45 +08:00
afd87e0c5f
enhance: [skip e2e]bump tj-actions/changed-files to latest stable version ( #29512 )
...
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-27 11:58:47 +08:00
d750dd95e6
enhance: [skip e2e]extract cache stuff into a independent composite action ( #29499 )
...
fix : #29510
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-27 11:56:57 +08:00
3e5bc2e517
enhance: [skip e2e]conan lock issue ( #29442 )
...
not allow to upload cache when job failure
this PR is to fix issue like below:
openblas/0.3.23@milvus/dev is locked by another concurrent conan
process, wait... If not the case, quit, and do 'conan remove --locks'
Error: The operation was canceled.
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-25 16:34:46 +08:00
bd640754ac
enhance: [skip e2e] skip maximize build space plugin if it is self-hosted runner ( #29214 )
...
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
Co-authored-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-14 17:44:39 +08:00
f79c6146bd
enhance: [skip-e2e] auto cancel stale workflows ( #29145 )
...
/kind improvement
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-14 11:30:38 +08:00
02621e131c
enhance: [skip-e2e] enlarge disk space of action runner ( #29077 )
...
/kind improvement
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-08 16:14:07 +08:00
fd3ae4c4b8
enhance: improve the compile speed ( #28444 )
...
improve the CI compile speed with mold
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-11-15 15:08:18 +08:00
8ae9c947ae
Use OpenDAL to access object store ( #25642 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-11-01 09:00:14 +08:00
0f2f4a0a75
Remove useless parameters for Makefile ( #27622 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-10-11 20:45:35 +08:00
4feb3fa7c6
support azure ( #26398 )
...
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-09-19 10:01:23 +08:00
96d07edbfb
Add coverage report for integration test ( #24428 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-26 13:45:26 +08:00
227a770a11
Fix data race in minicluster for nodes add&get ( #24336 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-23 21:09:28 +08:00
e68f5cf08e
Fix integration tests logic ( #24063 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-15 14:45:21 +08:00
5819e98ebb
Trigger main workflow when integration test changed ( #24020 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-11 09:51:19 +08:00
38e60804a4
Add integration test workflow ( #23976 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-09 19:18:41 +08:00
2ced6660e2
Simplify makefile ( #23583 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-21 14:16:33 +08:00
5276529524
Make pkg code change trigger ci workflow ( #23312 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-11 10:32:31 +08:00
bbfa396754
speedup upload ( #23306 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-10 08:24:30 +08:00
congqixia
yellow-shine
Rijin-N
sre-ci-robot
Jiquan Long
yah01
Enwei Jiao
PowderLi