Commit Graph

243 Commits (7385770014fd4862860cd4fa471da778d8e365bd)

Author SHA1 Message Date
groot e4dc44b41f
[skip ci] Modify script description (#9337)
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-10-06 19:26:54 +08:00
groot e2a3d0a71c
[skip ci] Modify script/readme (#9336)
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-10-06 19:25:06 +08:00
groot 418c195ae9
[skip ci] Modify description of script (#9256)
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-10-05 12:32:26 +08:00
groot 9982e107de
[skip ci] Modify description of script (#9255)
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-10-05 12:28:13 +08:00
groot f4aaf4ee04
[skip ci] Modify description of script (#9254)
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-10-05 12:26:02 +08:00
groot 7b5d9a3c7a
[skip ci] Modify description of script (#9186)
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-10-04 09:06:06 +08:00
groot 033befa2bc
[skip ci] Modify description of script (#9185)
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-10-04 09:03:55 +08:00
groot 94af9ec47d
[skip ci] Add description to coverage script (#9138)
Signed-off-by: Yihua <michaelmo@YihuadeMacBook-Pro.local>

Co-authored-by: Yihua <michaelmo@YihuadeMacBook-Pro.local>
2021-10-03 17:48:10 +08:00
groot 234fd9b512
[skip ci] Fix script comment (#9062)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-02 11:21:56 +08:00
groot 33776cdabb
[skip ci] Fix scripts/README (#9061)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-02 11:20:05 +08:00
groot d51d8ce39b
[skip ci] Comment for go coverage script (#9060)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-02 11:18:13 +08:00
groot 9cd291d2a6
[skip ci] Macro for go coverage script (#8999)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-01 20:28:33 +08:00
groot 5d4c59d3c4
[skip ci] Print out cpp coverage report path (#8998)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-01 12:26:10 +08:00
BUPTAnderson f918fe18c1
Fix compile protocol buffer files error (#8045) (#8833)
Signed-off-by: BUPTAnderson <yunlongkong@126.com>
2021-09-29 20:44:09 +08:00
groot 7aa210f595
[skip ci] Update script comment (#8857)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-29 17:36:01 +08:00
groot b62b13040b
[skip ci] Update script comment (#8859)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-29 17:20:00 +08:00
groot bfec8269a1
[skip ci] Update script comment (#8858)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-29 17:18:01 +08:00
ZhiShen 0e767f0e1b
Change cmake version (#8666)
Change cmake version from 3.16 to 3.18

1. Change the CMakeList's minimum require version.

2. Change the describtion document of cmake version.

Resolves: milvus-io#8407

Signed-off-by: Shen Zhi <m13120163046@163.com>
2021-09-28 14:00:03 +08:00
groot 69d683c693
Update codecov api to v2 (#8471)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-24 16:41:55 +08:00
Jael Gu c412fd76b6
[skip ci]Fix typo for scripts/README (#8455)
Signed-off-by: Jael Gu <mengjia.gu@zilliz.com>
2021-09-24 16:10:30 +08:00
Xiangyu Wang 43ad33ecea
Support to get nproc on macOS in the compilation (#8281)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-22 17:09:53 +08:00
groot 77e88144fc
Update code coverage script (#8280)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-22 16:01:53 +08:00
groot 334297b49d
[skip ci] Update OWNERS files (#8211)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-18 15:30:37 +08:00
groot cd0ca6727a
[skip ci] Update cpp codecov script (#8158)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-17 18:21:52 +08:00
groot 2a528e31d0
[skip ci] script typo (#7966)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 16:47:48 +08:00
groot f12fa50f6f
Prepare for cpp codecoverage (#7900)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-14 19:05:52 +08:00
edward.zeng b37f33cb61
Add daily release (#7626)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-09-09 16:05:56 +08:00
wt 780a4d2c8e
Update script of run_go_codecov (#7248)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2021-08-23 22:01:51 +08:00
Xiangyu Wang 5e78fd6a97
[skip ci]Update approvers (#7063)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-12 19:36:09 +08:00
quicksilver 9322cf7484
[skip ci] Update DEVELOPMENT.md for compile on CentOS (#6407)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-09 16:24:39 +08:00
quicksilver da628863bc
Update main.yaml for Github Action (#6381)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-09 11:59:09 +08:00
quicksilver 7d920e9c9c
Fix compile error on CentOS (#6359)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-08 15:43:45 +08:00
quicksilver 2834c8532f
[skip ci] Update README.md and DEVELOPMENT.md (#6173)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-28 16:30:17 +08:00
Cai Yudong a09a3a1905
rename service to coord (#6020)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-23 16:14:08 +08:00
Cai Yudong 7dbf33b788
Update component names in config files (#5989)
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 19:08:03 +08:00
xige-16 2af1c27811
Rename queryservice to querycoordinator (#5931)
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 16:44:09 +08:00
Cai Yudong d5f4ee6f44
Rename proto master/index_service/proxy_service (#5973)
* rename proto proxy_service to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto index_service to index_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto master to root_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 16:14:09 +08:00
sunby c863a193de
Rename filename from dataservice to datacoordinator (#5946)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-22 10:42:07 +08:00
Cai Yudong 92e429d812
Rename IndexService to IndexCoord (#5932)
* rename package indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix queryservice static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/indexservice to distributed/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/indexservice to internal/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename MasterComponent to RootCoordComponent

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for queryservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for dataservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for datanode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for proxynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for querynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix rebase issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-21 17:28:03 +08:00
quicksilver d13cf2da2f
Cache cpp thirdparty package (#5891)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-19 13:28:07 +08:00
Cai Yudong 5a1f7e4feb
rename masterservice to rootcoord (#5875)
* rename masterservice to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix build error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename package

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename masterservice to rootcoord under distributed

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update scripts

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* enable more unittests

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-18 21:30:08 +08:00
bigsheeper 710ac1a4f1
remove query node id env dependency and fix start script (#5874)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-18 19:00:15 +08:00
zhenshan.cao f74ea3beee [skip ci] Remove ProxyService (#5738)
* [skip ci] Remove ProxyService

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Change helm branch

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fix bug: paramstable crashed

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:36:35 +08:00
FluorineDog bec9f2c182
Split segcore and plan proto for future feature (#5767)
* Split segcore and plan proto for future feature

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* lint

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-15 14:43:57 +08:00
zhenshan.cao b0b8f58192
Fix bug: search timeout (#5557)
* Fix bug: search timeout

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Add log and fix unittest bug

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-03 14:58:34 +08:00
quicksilver cc517570ab
Load variables into shell scripts (#5518)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-01 14:52:31 +08:00
quicksilver 9e91860ae9
Fix install dependencies scripts file bug (#5511)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-31 16:33:30 +08:00
Xiangyu Wang ca0993c274 Update OWNERS
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-30 18:58:47 +08:00
yukun c63524deb9
Add dablooms (#5440)
* Add dablooms cwrapper

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix undefined reference bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add cwrapper_dablooms_build shell script

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-28 10:23:30 +08:00
quicksilver 6204e4546a
Update devcontainer.sh (#5351)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-22 01:20:41 +00:00
godchen ccc0130bb4
Add exclusive parameter (#5278)
Add exclusive parameter.
Issue #5174 

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-18 11:07:27 +00:00
godchen cca75583a6
Add session util (#5269)
Add session util.
Issue #5174 

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-18 03:39:21 +00:00
FluorineDog 88f5642603
Add plan proto and support basic boolean expr parser (#5088)
**What type of PR is this?**
- [x] Feature

**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
    like `A > 3 && not B < 5 or C in [1, 2, 3]`. 
2. Defines `plan.proto`, as Intermediate Representation (IR) 
    used between go and cpp. 
3. Support expr parser, convert predicate expr to IR
    in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
2021-04-29 08:48:06 +00:00
quicksilver 136cd7a704
Run KinD Inside A Kubernetes Cluster For Continuous Integration (#5085)
**What type of PR is this?**

- [x] Improvement

**Which issue(s) this PR fixes:**

Fixes #5038

**What this PR does / why we need it:**

Run KinD Inside A Kubernetes Cluster For Continuous Integration
2021-04-29 08:45:17 +00:00
quicksilver eb338d4620
Provide install dependencies for Ubuntu and CentOS (#5076)
* Provide install dependencies for Ubuntu and CentOS

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update scripts/install_deps.sh

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-28 14:46:18 +08:00
quicksilver 3b529f3b5d
Update milvus project name (#5032)
* Update milvus project name
2021-04-26 13:59:28 +08:00
Xiangyu Wang 746fc556a0
[skip ci]Add go code coverage (#5024)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-24 15:10:24 +08:00
cai.zhang a54097708d Adjust the DropIndex logic of the indexservice
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-04-16 15:37:13 +08:00
godchen f3649f0419 Refactor interface and proto
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
quicksilver e30b18a8f1 Add publish test images workflows
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-08 19:32:46 +08:00
neza2017 2835bcdc4e Update masterservice unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-05 20:41:34 +08:00
zhenshan.cao 007e7ea858 Add tso unittest and EnableMaxLogic
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-26 13:05:52 +08:00
quicksilver e3e68f7fef Add build option in devcontainer.sh
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-02-26 11:37:03 +08:00
quicksilver c249137757 Optimize the workflow for build Devcontainer
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-02-25 19:22:21 +08:00
neza2017 c36c532c70 Remove unused test code
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-02-25 19:12:40 +08:00
zhenshan.cao bbfcbbdd68 Fix ci: paramstable and startup logic refactor
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-23 11:40:30 +08:00
cai.zhang 4c5a898e9a Add masterservice docker
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-20 11:15:19 +08:00
zhenshan.cao 2c9e226703 Add log for segment logic in proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-07 16:44:11 +08:00
dragondriver 7e1887da12 Add start.sh and stop.sh, remove them later
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-05 14:31:40 +08:00
neza2017 854accf95b Remove master and writenode
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-30 16:41:47 +08:00
Xiangyu Wang 99cef4b5c8 Add Distributed main entrypoint
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-29 17:08:31 +08:00
bigsheeper 73d2b6a101 Get index param from minio and filter by vector fields
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-29 15:22:24 +08:00
neza2017 bdf84f08ab Add watcher_test and fix some bugs
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-29 14:40:19 +08:00
sunby f088467dde Add watcher_test and fix some bugs
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-28 10:14:31 +08:00
XuanYang-cn b597a637f3 Add datanode metatable tests
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-29 12:03:10 +08:00
zhenshan.cao ee0faddb07 Refactor proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-29 09:27:26 +08:00
dragondriver c6a6b1436c Add soft time tick in proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-26 13:41:41 +08:00
XuanYang-cn b794921b7e Add enum Role in internal.proto
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-23 18:56:08 +08:00
neza2017 e2b45f9866 Init param table and open unittest at ci
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-23 17:56:57 +08:00
dragondriver eba6bb288c Refactor the sructure of proto file
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 09:36:18 +08:00
xige-16 d22c2cd203 Add proto for query service loading collection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-18 19:32:08 +08:00
xige-16 0164e78bb5 Add query service module
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-16 15:31:10 +08:00
zhenshan.cao bfe720bfec Update doc
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-15 18:03:16 +08:00
godchen 0971cf65b2 Remove opentracing stdlog
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-15 15:28:27 +08:00
quicksilver 7fe061b846 Raneme init_devcontainer.sh to devcontainer.sh
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-15 14:38:36 +08:00
neza2017 56ab2bda2d Update proto:add partition id
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-15 11:53:22 +08:00
zhenshan.cao 63b21321d6 Refactor indexservice and update doc
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-15 13:50:27 +08:00
XuanYang-cn fb63983eb2 Modify rocksdb compilation
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-14 15:12:08 +08:00
yukun 6e36f10a26 Fix rocksdb illegal instruction in some machine
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-14 14:24:14 +08:00
FluorineDog 63ca5f8031 Add span and segment interface, rename segment_growing and use interface as base
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-01-13 18:46:25 +08:00
GuoRentong 1104f059ee Update doc:module interfaces
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-13 11:08:03 +08:00
quicksilver 8e9d8e36e1 Update run_go_unittest.sh
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-13 10:40:46 +08:00
bigsheeper 2d2af1505a Improve mutex usage in query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-12 18:03:24 +08:00
GuoRentong f3d2afa4f4 Update doc:detailed interface definition
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-11 18:35:54 +08:00
quicksilver a6690dbc99 Fix syntax error: Bad fd number
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-11 15:25:19 +08:00
yukun 18cfd31d40 Fix Load and Remove with prefix
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-11 15:17:06 +08:00
quicksilver 0c2f40f580 Archive milvus distributed server logs in Jenkins CI
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-10 12:10:11 +08:00
zhenshan.cao 02df310fa5 Fix data race
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-09 12:30:22 +08:00
sunby 5dfe9448ae Modify test_index
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-08 16:00:16 +08:00
yukun d11f00cd9f Add rocksdb in kv
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-08 19:07:57 +08:00