Commit Graph

102 Commits (905c3b81dd621a23761f10a53fc3a4b960383137)

Author SHA1 Message Date
Rijin-N a05a37a583
enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) ()
Native support for Google cloud storage using the Google Cloud Storage
libraries. Authentication is performed using GCS service account
credentials JSON.

Currently, Milvus supports Google Cloud Storage using S3-compatible APIs
via the AWS SDK. This approach has the following limitations:

1. Overhead: Translating requests between S3-compatible APIs and GCS can
introduce additional overhead.
2. Compatibility Limitations: Some features of the original S3 API may
not fully translate or work as expected with GCS.

To address these limitations, This enhancement is needed.

Related Issue: 
2024-09-30 13:23:32 +08:00
Zhen Ye 99dff06391
enhance: using streaming service in insert/upsert/flush/delete/querynode ()
issue: 

- using streaming service in insert/upsert/flush/delete/querynode
- fixup flusher bugs and refactor the flush operation
- enable streaming service for dml and ddl
- pass the e2e when enabling streaming service
- pass the integration tst when enabling streaming service

---------

Signed-off-by: chyezh <chyezh@outlook.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-08-29 10:03:08 +08:00
sammy.huang 11687dce60
enhance: [skip e2e]upgrade minio version ()
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-05 14:14:34 +08:00
PowderLi cac802ef7f
enhance: use already installed vcpkg ()
issue 
1. Update Builder gpu image changes, see changes 
2. update azure-identity-cpp from beta to release

Signed-off-by: PowderLi <min.li@zilliz.com>
2023-11-30 15:58:32 +08:00
PowderLi a951c7570f
publish builder gpu image ()
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-10-25 14:20:12 +08:00
PowderLi 4feb3fa7c6
support azure ()
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-09-19 10:01:23 +08:00
Enwei Jiao 533f0ddf6d
Add amazonlinux image, prepare to remove Centos7 image, remove openblas image ()
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-18 18:32:19 +08:00
fan yang 927cd6dff3
Fix redundant comment ()
Signed-off-by: fan.yang <julyyangfan@gmail.com>
2023-05-11 09:11:19 +08:00
Bennu f547c1f8f4
Add ci for milvus gpu ()
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-03-20 19:03:57 +08:00
Bennu ac6e879811
[skip e2e] fix etcd image for healthcheck ()
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-02-20 17:08:25 +08:00
Bennu 15220f32e5
Bump etcd version ()
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-02-16 15:56:35 +08:00
Jenny Li b834cce8c3
Add jenkins e2e cache for conan ()
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-23 19:09:11 +08:00
Enwei Jiao 958e94f6f0
Use Conan as c++ package manager ()
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-23 10:39:11 +08:00
xige-16 428840178c
Support diskann index for vector field ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-09-21 20:16:51 +08:00
edward.zeng fa45dee543
Refine etcd config for docker-compose ()
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-09-21 09:14:50 +08:00
edward.zeng 086e8968ef
Upgrade minio version to RELEASE.2022-03-17T06-34-49Z ()
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-04-06 15:47:32 +08:00
edward.zeng 1e4d2a37d4
Add health check to docker-compose etcd and service dependencies ()
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-03-08 09:13:58 +08:00
edward.zeng 576d293936
[skip ci] Fix etcd in docker-compose ()
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-09-30 16:32:11 +08:00
edward.zeng 24dc03aad6
[skip ci] Replace etcd docker image ()
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-09-30 15:38:11 +08:00
Xiaofan 5a2d7c0b8a
[skip ci] Add comments about how to expose milvus in dev container ()
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-28 22:48:03 +08:00
edward.zeng 9d790d4d70
[skip ci] Enable etcd auto compaction for dev environment ()
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-09-24 14:45:54 +08:00
Lari Hotari 32d41b176b
Improve docker-compose config for Pulsar ()
- fix graceful shutdown by using "exec bin/pulsar" when starting in a shell script
  so that OS signals can get delivered to Pulsar process to fix graceful shutdown
- simplify and fix configuration issues
- disable Pulsar Functions worker and related key-value storage service so that
  resource usage is reduced
- upgrade to use Pulsar 2.7.3 since 2.6.x isn't actively maintained

Signed-off-by: Lari Hotari <lari@hotari.net>
2021-08-29 11:39:57 +08:00
quicksilver 76b92c3b69
Upgrade ETCD version to 3.5.0 ()
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-08-11 11:50:11 +08:00
quicksilver da628863bc
Update main.yaml for Github Action ()
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-09 11:59:09 +08:00
quicksilver 7d920e9c9c
Fix compile error on CentOS ()
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-08 15:43:45 +08:00
quicksilver c468ff30cf
Update networks in docker-compose.yml ()
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-28 13:50:14 +08:00
quicksilver b177f9e52b
Publish Milvus dev images to Dockerhub ()
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-22 11:56:03 +08:00
quicksilver d13cf2da2f
Cache cpp thirdparty package ()
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-19 13:28:07 +08:00
Cai Yudong 0f4bd50ce3 Support ETCD endpoints array () 2021-06-15 16:36:36 +08:00
quicksilver 7a188a8ae5
Update openblas images ()
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-29 11:28:27 +08:00
quicksilver 27af87e4d8
Used for local development or CI in Kubernetes in Docker ()
* Used for local development or CI in Kubernetes in Docker
2021-04-27 19:27:50 +08:00
Xiangyu Wang 82ccd4cec0
Rename module ()
* Rename module

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
quicksilver 4b0210d723 Avoid vscode extension reinstalls on container rebuild
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-17 15:51:28 +08:00
quicksilver 3cc071c1b5 Reap zombie processes and perform singal forward in dev container
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-02-23 19:34:41 +08:00
GuoRentong f3d2afa4f4 Update doc:detailed interface definition
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-11 18:35:54 +08:00
quicksilver a6690dbc99 Fix syntax error: Bad fd number
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-11 15:25:19 +08:00
yukun 18cfd31d40 Fix Load and Remove with prefix
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-11 15:17:06 +08:00
sunby 5dfe9448ae Modify test_index
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-08 16:00:16 +08:00
GuoRentong 82ad488555 Update doc: rocksmq
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 18:37:24 +08:00
XuanYang-cn 65089ea362 Fix flush sync test bug and remove unecessary lock in meta_table
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-08 17:20:59 +08:00
GuoRentong c4599e26de Update doc: node api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 16:59:19 +08:00
bigsheeper e13822043d Fix search test when partition not exists, add binary vector search validation
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-08 16:41:27 +08:00
godchen fa73f17f94 Add opentracing doc
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-08 15:32:38 +08:00
dragondriver ced56c84f8 Add support to build binary vector index
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-07 14:56:17 +08:00
godchen 8f1f118b26 Add query opentracing
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-07 14:24:35 +08:00
quicksilver 6bcca0a9b7 Connect to multiple containers at once with VSCode
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-06 18:16:37 +08:00
bigsheeper a1e2ff3c26 Add gcNode to write node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-06 16:44:12 +08:00
neza2017 4015d7245d Merge operation
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-06 14:45:50 +08:00
zhenshan.cao b06e01f523 Initmate querynode collection manager
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-06 11:31:36 +08:00
godchen 1c87faf8b3 Add insert request opentracing
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-06 11:17:35 +08:00