Commit Graph

123 Commits (ecdbc12678d715c039433ba24f8a20dc6457787b)

Author SHA1 Message Date
zhenshan.cao 0ac4bc32a5
Add logic of autoindex (#19570)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-10-08 15:38:58 +08:00
SimFG d7f38a803d
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
Jiquan Long a5e2d6b6fb
Refactor RootCoord (#18930)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Co-authored-by: xaxys <tpnnghd@163.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Co-authored-by: xaxys <tpnnghd@163.com>
2022-09-05 13:29:11 +08:00
cai.zhang c924f73105
Refactor for IndexCoord to support cloud (#18643)
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
2022-08-25 15:48:54 +08:00
Zach 0c9a10e8f8
1. refine logging interfaces (#18692)
2. adjust logs for query/search requests

Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>

Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>
2022-08-23 10:44:52 +08:00
aoiasd 8a70f2badb
Add ShowConfigurations for all remaining session (#18594)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-08-12 13:20:39 +08:00
SimFG ff0200210a
Support Role-Based Access Control (#18425)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-08-04 11:04:34 +08:00
cai.zhang 53a49a9255
GetIndexState only get the state generated call CreateIndex (#17549)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-16 20:12:11 +08:00
SimFG 731870211a
Support role-based access control (only pb) (#16987)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-05-28 00:04:01 +08:00
bigsheeper 9eeec4a2d5
Add collection load cache and InvalidateCollMetaCache by collID (#16882)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-19 10:13:56 +08:00
groot bc5e9ec929
Add list import tasks api (#16605)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-04-25 17:37:46 +08:00
codeman 4e12271d79
Support login with username and password (#15656) (#16341)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-04-11 19:49:34 +08:00
godchen bb7a0766fe
Add dependency factory (#16204)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-04-07 22:05:32 +08:00
Jiquan Long ba37531456
Add support for loading multiple indexes (#16138)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-30 21:11:28 +08:00
groot 89356ebcb9
Modify import rpc interfaces (#16006)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-11 17:13:59 +08:00
jaime 7a3a721380
Reconstruct mqstream module (#15784)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
Cai Yudong f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
cai.zhang f564ea7fc7
RootCoord set healthy state after registered service (#15261)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-01-18 12:09:37 +08:00
Cai Yudong f8f61fb116
Use BaseParams etcd configuration for all components (#15012)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
Xiaofan 69087ff8dd
Support embedded etcd (#14333)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
Cai Yudong a101d1d3c5
[skip e2e] Unify component import alias (#13765)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 16:43:05 +08:00
Cai Yudong cf50e9ac55
Use GrpcServerConfig and GrpcClientConfig for distributed components (#13469)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-17 10:23:15 +08:00
cai.zhang 9f23fc7f2a
Register the service when the component state is healthy (#13248)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
Cai Yudong 973b98c721
Update parameter of API startGrpc (#13282)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-13 21:39:10 +08:00
jaime 2a1e8614b3
[skip ci]Add comment when stop rpc server in rootcoord service (#12603)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-02 18:13:49 +08:00
Xiaofan 1d9f4e0a5c
Add log when server is stopped (#12233)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-30 10:59:42 +08:00
cai.zhang d54a6a408b
[skip ci]Fix golint error for SegmentFlushCompleted in rootcoord (#12377)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-30 09:47:47 +08:00
cai.zhang 015bf4585d
[skip ci]Fix golint error for GetMetrics in rootcoord (#12379)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-29 19:27:45 +08:00
cai.zhang f3de0ca2e7
[skip ci]Fix golint error for ReleaseDQLMessageStream in rootcoord (#12378)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-29 19:23:45 +08:00
zhenshan.cao 6831589b0b
Enable keepalive on the grpc (#12328)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-29 14:25:17 +08:00
cai.zhang cdf8e79a70
[skip ci]Fix golint for DescribeSegment in rootcoord (#12035)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-18 09:27:12 +08:00
cai.zhang 240e8a3258
[skip ci]Fix golint for AllocID in rootcoord (#12038)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-17 22:07:13 +08:00
cai.zhang 7b65cfb6ab
[skip ci]Fix golint for ShowSegments in rootcoord (#12036)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-17 22:05:19 +08:00
cai.zhang 95bd08961e
[skip ci]Fix golint for DescribeIndex in rootcoord (#11927)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-16 21:34:05 +08:00
cai.zhang 247049a65e
[skip ci]Fix golint for DropIndex in rootcoord (#11926)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-16 21:32:15 +08:00
cai.zhang 171228f3ec
[skip ci]Fix golint for ShowPartitions in rootcoord (#11925)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-16 21:28:00 +08:00
cai.zhang 2ea70b6ead
[skip ci]Fix golint error for HasPartition in rootcoord (#11850)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-16 09:18:00 +08:00
cai.zhang a7be2e1943
[skip ci]Fix golint error for DropPartition in rootcoord (#11849)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-16 09:16:08 +08:00
cai.zhang 42ffb26e64
[skip ci]Fix golint error for GetComponentStates in rootcoord (#11848)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-16 09:14:00 +08:00
cai.zhang 55e9fa1cfd
[skip ci]Fix golint error for Run in rootcoord (#11727)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-12 18:01:14 +08:00
cai.zhang 3b3cd61be6
[skip ci]Fix golint for NewServer in rootcoord (#11726)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-12 17:59:18 +08:00
cai.zhang 9e936ebac1
[skip ci]Fix golint for AlterAlias in rootcoord (#11725)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-12 17:57:22 +08:00
cai.zhang 3dfa706887
[skip ci]Fix golint for DropAlias in rootcoord (#11660)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-11 21:05:20 +08:00
cai.zhang 2c508a2fdd
[skip ci]Fix golint for CreateAlias in rootcoord (#11659)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-11 21:03:23 +08:00
groot f5323de208
Add log (#10720)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-27 17:32:33 +08:00
XuanYang-cn d3cd3fc2af
[skip ci]Update license for distributed rc (#10423)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:01:21 +08:00
Xiaofan f5173b595f
Add a channel prefix for all channels (#8166)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-23 10:53:53 +08:00
sunby 1cb8c31794
Add comment for CreateCollection (#8023)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 17:11:54 +08:00
sunby fe1e1ce523
Add comment for DropCollection (#8024)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 10:05:58 +08:00
sunby ab55a39b7d
Add comment for DescribeCollection (#8030)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:46:01 +08:00
sunby 3dad7b5aa8
Add comment for HasCollection (#8025)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:27:51 +08:00
Yusup ccb57ba4b2
add collection alias (#7255)
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-18 11:13:51 +08:00
sunby b84f017dde
Add comment for CreatePartition (#8031)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-17 17:35:53 +08:00
sunby c0ede30c6e
Add comment for ShowCollections (#8032)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-17 11:15:53 +08:00
dragondriver f0dbdd7f13
Expose metrics of root coordinator (#7228)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-31 11:45:59 +08:00
dragondriver ad77a6e0d4
Fix #6859, increase the MaxCallRecvMsgSize and MaxCallSendMsgSize of grpc client (#6861)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-04 13:03:24 +08:00
neza2017 111a24a49f
remove msgstream of segment info (#6280)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-03 14:36:18 +08:00
sunby 07b0989628
Add GetFlushedSegments in data coordinator (#6253)
Send segment flush message by grpc and add a new interface
`GetFlushedSegments`

Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-02 11:16:20 +08:00
neza2017 6019c193fc
add grpc interface to process NewSegment And FlushSegmentCompleted (#6247)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-01 14:58:17 +08:00
neza2017 da12e55c6c
rootcoord connect to other components in go routines (#6117)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-25 16:48:10 +08:00
godchen 3785bb6330
Change retry times (#6083)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-24 19:05:06 +08:00
Cai Yudong a09a3a1905
rename service to coord (#6020)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-23 16:14:08 +08:00
Cai Yudong ba5aacd3f2
Remove GetChanNameByVirtualChan (#5999)
* remove redundant ctx

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove GetChanNameByVirtualChan

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-23 11:18:05 +08:00
godchen 99be4c09a5
change retry (#5996)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-23 09:24:10 +08:00
Cai Yudong 7dbf33b788
Update component names in config files (#5989)
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 19:08:03 +08:00
xige-16 2af1c27811
Rename queryservice to querycoordinator (#5931)
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 16:44:09 +08:00
Cai Yudong d5f4ee6f44
Rename proto master/index_service/proxy_service (#5973)
* rename proto proxy_service to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto index_service to index_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto master to root_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 16:14:09 +08:00
Cai Yudong 2926a78968
Rename proxynode to proxy (#5961)
* rename package name from proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/proxynode to distributed/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/proxynode to internal/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 14:40:07 +08:00
sunby c863a193de
Rename filename from dataservice to datacoordinator (#5946)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-22 10:42:07 +08:00
sunby 7f2d7c1da3
Rename dataservice to datacoordinator (#5912)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 18:22:13 +08:00
Cai Yudong 92e429d812
Rename IndexService to IndexCoord (#5932)
* rename package indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix queryservice static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/indexservice to distributed/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/indexservice to internal/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename MasterComponent to RootCoordComponent

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for queryservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for dataservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for datanode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for proxynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for querynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix rebase issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-21 17:28:03 +08:00
Cai Yudong 5a1f7e4feb
rename masterservice to rootcoord (#5875)
* rename masterservice to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix build error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename package

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename masterservice to rootcoord under distributed

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update scripts

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* enable more unittests

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-18 21:30:08 +08:00