111a24a49f
remove msgstream of segment info ( #6280 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-03 14:36:18 +08:00
07b0989628
Add GetFlushedSegments in data coordinator ( #6253 )
...
Send segment flush message by grpc and add a new interface
`GetFlushedSegments`
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-02 11:16:20 +08:00
a364d7303b
Implement calculate vectors distance in server ( #6219 )
...
* calc distance stage 3
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* calc distance stage 5
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* calc distance stage 6
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* code style
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-07-01 18:56:17 +08:00
2a07124885
Change default grpc retry config ( #6233 )
...
* Change default grpc retry config
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change timeout
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* add retry code
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change time
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-01 15:24:17 +08:00
6019c193fc
add grpc interface to process NewSegment And FlushSegmentCompleted ( #6247 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-01 14:58:17 +08:00
f146d3825f
Fix search hang after querynode restart ( #6212 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-30 17:48:19 +08:00
49a0528d53
Fix trace ( #6218 )
...
* Fix trace
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-30 16:18:13 +08:00
ae072b4f1d
Add candidate management for datacoord dn cluster ( #6196 )
...
* Add candidate management for datacoord dn cluster
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* Fix test cases
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-30 10:20:15 +08:00
1c1ffc8b32
Add connect err log ( #6186 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-29 14:30:17 +08:00
3a202cad2b
Reduce connect timeout time ( #6181 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-29 09:30:17 +08:00
6d7edc6015
fix typo ( #6142 )
...
* fix typo
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* add log
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-26 18:04:12 +08:00
a1d0e5c980
remove task scheduler ( #6123 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-26 09:22:11 +08:00
da12e55c6c
rootcoord connect to other components in go routines ( #6117 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-25 16:48:10 +08:00
73996aba91
Change client init timeout ( #6107 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-25 15:50:23 +08:00
3785bb6330
Change retry times ( #6083 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-24 19:05:06 +08:00
064f8f76cd
change_coord_connect_retry ( #6064 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-24 15:20:08 +08:00
5417fee45f
fix releasePartition not work after loadCollection ( #6025 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-23 17:44:12 +08:00
46f86a0354
Return sealed segments when calling flush ( #6011 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-23 16:56:11 +08:00
a09a3a1905
rename service to coord ( #6020 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-23 16:14:08 +08:00
fd07a44dba
Fix error in retry refactor ( #6000 )
...
* Fix error in retry refactor
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-23 11:48:06 +08:00
ba5aacd3f2
Remove GetChanNameByVirtualChan ( #5999 )
...
* remove redundant ctx
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* remove GetChanNameByVirtualChan
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-23 11:18:05 +08:00
99be4c09a5
change retry ( #5996 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-23 09:24:10 +08:00
7dbf33b788
Update component names in config files ( #5989 )
...
* rename master/indexService in .yaml
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename proxyNode to proxy in config files
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move proto/query_service.proto to proto/query_coord.proto
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move proxy_node_manager.go to proxy_manager.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add query_coord.pb.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update ci
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 19:08:03 +08:00
0978b93a21
Refactor data coordinator ( #5982 )
...
Rename variable name and make error msg more clear
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-22 18:24:08 +08:00
2af1c27811
Rename queryservice to querycoordinator ( #5931 )
...
* Rename queryservice to querycoordinator
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix param table
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* code format
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix unittest
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* service to coordinator
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* code format
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* set querycoord in ci
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 16:44:09 +08:00
d5f4ee6f44
Rename proto master/index_service/proxy_service ( #5973 )
...
* rename proto proxy_service to proxy
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename proto index_service to index_coord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename proto master to root_coord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 16:14:09 +08:00
80bb418136
Release partition ( #5971 )
...
* add debug info
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* notify query coord to release partitions after drop partition
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-22 16:08:08 +08:00
2926a78968
Rename proxynode to proxy ( #5961 )
...
* rename package name from proxynode to proxy
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move distributed/proxynode to distributed/proxy
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move internal/proxynode to internal/proxy
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename proxynode to proxy
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 14:40:07 +08:00
7039fb7c82
Fix the problem of stuck after loadBalance and loadFieldData error ( #5960 )
...
* delete nodeInfo after nodeDown
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix load balance can's stop
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix load field data error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* contiue task loop after error in queryService
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 14:10:09 +08:00
c863a193de
Rename filename from dataservice to datacoordinator ( #5946 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-22 10:42:07 +08:00
8643127e99
Change grpc retry ( #5925 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-22 09:46:06 +08:00
7f2d7c1da3
Rename dataservice to datacoordinator ( #5912 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 18:22:13 +08:00
0300b682f8
Remove deprecated interfaces in data coordinator ( #5929 )
...
* Remove derecated interfaces in data coordinator
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Remove RegisterNode in data coordinator
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 17:40:05 +08:00
92e429d812
Rename IndexService to IndexCoord ( #5932 )
...
* rename package indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix queryservice static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move distributed/indexservice to distributed/indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move internal/indexservice to internal/indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename MasterComponent to RootCoordComponent
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for queryservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for dataservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for datanode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for proxynode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for querynode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename IndexService to IndexCoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename IndexService to IndexCoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix rebase issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-21 17:28:03 +08:00
2642415bc3
Redefine the auto_id and primary_key ( #5903 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-21 11:42:18 +08:00
da1f9f9241
Rename dataservice to datacoordinator ( #5904 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 11:40:15 +08:00
e4c51aae36
Add recovery logic for querynode and queryservice ( #5843 )
...
* merge milvus/recovery2
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add recovery logic in queryservice
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* debug smoke case
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add etcd to querynode
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix release partition error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix load balance error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* debug querynode down and recovery
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add log
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix showCollection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* skip smoke test search without insert
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-19 11:45:09 +08:00
5a1f7e4feb
rename masterservice to rootcoord ( #5875 )
...
* rename masterservice to rootcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix build error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename package
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename masterservice to rootcoord under distributed
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update scripts
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* enable more unittests
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-18 21:30:08 +08:00
710ac1a4f1
remove query node id env dependency and fix start script ( #5874 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-18 19:00:15 +08:00
2f8bccda8d
Improve help message ( #5870 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-18 16:16:06 +08:00
676a30e418
Use channelsMgr to manage search message stream ( #5819 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-18 10:33:58 +08:00
b2908c4780
Release collection ( #5839 )
...
* relese collection
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* gen-proto
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* release collection
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* release collection
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-17 17:45:56 +08:00
ae3daff5e4
Rename Master to RootCoord ( #5830 )
...
* rename master_service.go to root_coordinator.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coordinator under cmd
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coord under cmd
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coord for metrics
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coord for masterservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix metrics unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* roll back cmd
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-17 16:47:57 +08:00
b7bf26b486
Update grpc trace ( #5817 )
...
* Update grpc trace
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove useless code in mod
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-17 14:17:56 +08:00
5ce06de3d1
Add context usage and fix defer issue ( #5796 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-16 18:35:59 +08:00
5c69c6902d
Refactor proxy channelTimeTick and fix search timeout ( #5760 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:36:36 +08:00
0f4bd50ce3
Support ETCD endpoints array ( #5755 )
2021-06-15 16:36:36 +08:00
17b19233dc
add BroadcastMany, send DdMsg to collection channels only ( #5734 )
...
* add BroadcastMany, send DdMsg to collection channels only
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix master unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix time tick of masterservice
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* fix time tick unittest of masterservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* skip dataservice ut
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix format issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update timeticksync
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update timeticksync
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update SendDdXXXReq interface
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update master unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* roll back unecessary change
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* enable ut
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-15 16:36:36 +08:00
f74ea3beee
[skip ci] Remove ProxyService ( #5738 )
...
* [skip ci] Remove ProxyService
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Change helm branch
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fix bug: paramstable crashed
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:36:35 +08:00
33a43f48c8
[skip ci] Fix bug: Search timeout and refactor client init logic ( #5735 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:24:48 +08:00
neza2017
sunby
groot
godchen
xige-16
congqixia
Cai Yudong
dragondriver
bigsheeper
zhenshan.cao