Commit Graph

441 Commits (70c53f787ebe8030831ab7dc6eee1e7ec697cd26)

Author SHA1 Message Date
zhikunyao d14bb67c62
enhance: update workflow action upload-artifact to v4 (#39391)
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-01-17 15:47:01 +08:00
presburger c73ca14a9b
enhence: update git workflows macos (#37819)
Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
2024-11-20 14:51:55 +08:00
congqixia 0f514708ff
enhance: Accelerate Build stage by skipping cpp ut compilation (#37530)
Since master branch run cpp unittest in jenken, the cpp unit test
building could be skipped since the output is not needed in github
runner.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-08 14:06:26 +08:00
foxspy c27f477b6c
enhance: Update Knowhere version (#37333)
issue: #37269

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2024-11-04 11:56:31 +08:00
yellow-shine 139f4e5ab5
enhance: [codecov]split code coverage into components (#37137)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-10-25 17:42:14 +08:00
yellow-shine 8902e2220e
enhance: enable asan for cpp unittest (#37041)
https://github.com/milvus-io/milvus/issues/35854

Signed-off-by: chyezh <chyezh@outlook.com>
Co-authored-by: chyezh <chyezh@outlook.com>
2024-10-23 17:21:27 +08:00
yellow-shine 5b2658327d
enhance: change way to bump milvus bersion (#36776)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-10-12 10:41:25 +08:00
Rijin-N a05a37a583
enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214)
Native support for Google cloud storage using the Google Cloud Storage
libraries. Authentication is performed using GCS service account
credentials JSON.

Currently, Milvus supports Google Cloud Storage using S3-compatible APIs
via the AWS SDK. This approach has the following limitations:

1. Overhead: Translating requests between S3-compatible APIs and GCS can
introduce additional overhead.
2. Compatibility Limitations: Some features of the original S3 API may
not fully translate or work as expected with GCS.

To address these limitations, This enhancement is needed.

Related Issue: #36212
2024-09-30 13:23:32 +08:00
yellow-shine 2694551757
enhance: fix a security vulnerability (#36154)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-09-10 19:09:27 +08:00
congqixia 97ca65c732
enhance: [skip e2e] Add git safe dir for code check env (#36009)
Related to #36008

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-09-05 18:09:11 +08:00
zhuwenxing e34b0c43a1
enhance: add GitHub Actions to delete spam issues comments (#35807)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-08-29 13:19:00 +08:00
yellow-shine e373687a07
enhance: turnoff USE_ASAN in ci (#35721)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-27 14:01:11 +08:00
yellow-shine 2b6e6f4040
feat: [skip e2e] effective way to use cache (#35598)
issue: https://github.com/milvus-io/milvus/issues/34876

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-21 18:46:55 +08:00
yellow-shine 1275005fc1
enhance: [skip e2e] enable ubuntu20.04 os (#35482)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-16 10:06:58 +08:00
ThreadDao a62118ca33
test: update cases for index describe and upsert with autoID (#35191)
issue: #33419

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-08-05 18:00:16 +08:00
sthuang d8668fe405
enhance: upgrade go version to 1.21.11 (#35257)
issue: #35142

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-08-05 16:12:15 +08:00
yellow-shine 241c71fdde
enhance: use docker compose instead of docker-compose (#35208)
https://github.com/milvus-io/milvus/issues/35209

---------

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-02 19:32:32 +08:00
yellow-shine 7bf68d8657
enhance: upgrade conan version (#35215)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-02 19:22:15 +08:00
yellow-shine 273e9203f4
feat: [skip e2e] effective way to use cache (#34774) (#35109)
See also #34483

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-07-30 18:41:51 +08:00
congqixia b787bb4783
enhance: [skip e2e] Skip Amazon&Rockylinux instead of commenting job (#35108)
Related to #35084

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-07-30 16:23:49 +08:00
congqixia de8a266d8a
enhance: Enable linux code checker (#35084)
See also #34483

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-07-30 15:53:51 +08:00
yellow-shine e62f6b2f4e
enhance: [skip e2e] enlarge timeout of UT for go up to 90 mins (#35035)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-07-29 15:51:49 +08:00
yellow-shine 1f55061717
feat: [skip e2e] effective way to use cache (#34774)
issue: https://github.com/milvus-io/milvus/issues/34876
1. try best to download cache
2. upload cache if it is not pull request

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-07-23 10:49:51 +08:00
sammy.huang ac2840243a
enhance: revert dead try on uploading codecov (#34130)
This reverts commit 19936d9994.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-25 11:51:30 +08:00
sammy.huang 2cc9df5c50
[automated] Update cpu Builder image changes (#34078)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-25 10:56:10 +08:00
sammy.huang 5be9929d64
enhance: upgrade build-env to ubuntu 22.04 and gcc12 (#33959)
issue: #33960

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-20 15:22:02 +08:00
sammy.huang 19936d9994
fix:[skip e2e] make more retries on codecov uploader (#33683)
fix #32235

inspired by
https://github.com/Kong/kubernetes-testing-framework/blob/main/.github/workflows/tests.yaml#L53-L69

### What is changing:
Introducing the
[wretry.action](https://github.com/Wandalen/wretry.action) to
automatically retry the
[codecov-action](https://github.com/codecov/codecov-action) in our CI/CD
pipeline. This change is intended to enhance the robustness of our
workflow by mitigating transient failures in the codecov-action.

### Follow-up changes needed:
This retry mechanism will be removed once the issue
[codecov/codecov-action#926](https://github.com/codecov/codecov-action/issues/926)
is resolved or if GitHub Actions provides a built-in retry feature for
actions.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-07 10:33:52 +08:00
shaoting-huang 3c7d0209d4
enhance: update checker for go version (#33351)
Signed-off-by: shaoting-huang [shaoting-huang@zilliz.com]

issue: https://github.com/milvus-io/milvus/issues/32982

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-05-24 14:23:40 +08:00
congqixia ef41f80bd0
enhance: Sync go.mod version & dep to main pkg (#32973)
Related to #31293
See also #32951 #32952 #32953 #32954

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-05-13 10:25:32 +08:00
congqixia 244d2c04f6
feat: Add `milvusclient` package and migrate GoSDK (#32907)
Related to #31293

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-05-10 18:01:30 +08:00
congqixia 29d3c576a3
enhance: [skip e2e] Enlarge integration test timeout to 90min (#32686)
The running time of integration is above 50 minutes and may surpass 60
and timeout in some cases. This PR enlarge timeout first.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-29 11:33:25 +08:00
sammy.huang 2a4dfde2de
enhance: revert [skip e2e] use pull_request_target event instead (#32426)
This reverts commit ab6ddf6929.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-18 17:15:37 +08:00
sammy.huang 66fae53cd2
enhance: hotfix HOME variable (#32411)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-18 14:49:26 +08:00
sammy.huang 70beec3e47
enhance: hotfix HOME variable (#32405)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-18 13:08:32 +08:00
sammy.huang ab6ddf6929
enhance: [skip e2e] use pull_request_target event instead (#32236)
issue: #32235

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-13 21:17:17 +08:00
congqixia a938951eea
enhance: [skip e2e] fix upload code cov if syntax (#32128)
The re-upload step is always true since the syntax is wrong

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-11 10:05:19 +08:00
sammy.huang 08bfb431b7
enhance: [skip e2e]add prefix to differentiate (#32025)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-09 10:57:24 +08:00
sammy.huang 2aa6f3d3ec
enhance: bump codecod-action to v4 (#31984)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-08 16:57:17 +08:00
sammy.huang db698756dc
enhance: make gpu builder both support amd64 and gpu64 (#31888)
the purpose of this pr is to build arm-based and x86-based
milvusdb/milvus-env for milvus gpu. milvusdb/milvus-env would be based
on ubuntu22.04

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-05 10:09:22 +08:00
sammy.huang f7a59766df
enhance: support rockylinux8 (#31751)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-01 10:23:12 +08:00
congqixia f399416b92
enhance: Use gotestsum to run go unit test (#31622)
See also #31490

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-03-27 15:29:10 +08:00
congqixia 4da8b6607d
enhance: Add scripts to use `gotestsum` to execute integration test (#31490)
See also #31489

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-03-22 10:29:06 +08:00
sammy.huang ed1197ea50
enhance: Revert[skip e2e] bump milvus version for scripts/standalone_embed.sh (#30892)
This reverts commit cdb3f61fc8.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-02-28 16:55:06 +08:00
sammy.huang 1200bcc65d
enhance: [skip e2e]bump milvus version for scripts/standalone_embed.sh (#30696)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-21 09:32:54 +08:00
sammy.huang d097d558b6
enhance: Maximize build space at the begin (#30540)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-06 10:29:40 +08:00
sammy.huang 32914a3ddf
enhance: [skip e2e]cleanup unnecessary part in the github action (#30425)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-01 14:39:04 +08:00
sammy.huang 265453f400
enhance: [skip e2e]revert back to original way to archive, upload and download (#30248)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-01 10:15:04 +08:00
sammy.huang 927d310959
enhance: [skip e2e]change to a better name (#30329)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-29 09:45:08 +08:00
sammy.huang ae4f62ab4b
enhance: [skip e2e]Revert changes from pr 29890 (#29957)
Revert changes from pr #29890

This reverts commit 61acda4948.

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-22 10:00:55 +08:00
sammy.huang e7dc82d8cc
enhance: [skip e2e]to workaround the error "HOME not set" (#30047)
issue: #30046

to workaround the error "HOME not set"  happened in self hosted runner

solution from
https://alexanderhose.com/aws-codecommit-with-instance-role-and-user-data/

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-17 16:12:54 +08:00