Commit Graph

192 Commits (1b4f7e3ac118b812f03c4cb84a281d3d5a3fa574)

Author SHA1 Message Date
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
shaoyue c65bb0d3c6
[skip e2e] Add comment for datacoord/client.Client (#14029)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-23 11:07:14 +08:00
Cai Yudong a101d1d3c5
[skip e2e] Unify component import alias (#13765)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 16:43:05 +08:00
Cai Yudong 966119526a
Rename Params to ClientParams for all component clients (#13743)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 14:25:25 +08:00
Cai Yudong cf50e9ac55
Use GrpcServerConfig and GrpcClientConfig for distributed components (#13469)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-17 10:23:15 +08:00
cai.zhang 9f23fc7f2a
Register the service when the component state is healthy (#13248)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
congqixia 61f2db3102
Remove debug log from DataCoord client (#13313)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-15 11:09:24 +08:00
jaime a1b907313f
[skip ci] Add graceful stop grpc server log in datacoord (#12825)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-08 15:04:00 +08:00
zhenshan.cao 3d8a0453b7
Remove unused log (#12793)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-08 14:45:04 +08:00
zhenshan.cao af22977cd3
Fixbug: grpc connection is closed by mistake (#12307)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-03 15:15:32 +08:00
shaoyue 2a0d646196
[skip ci] Add comment for datacoord methods (#12367)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-30 14:28:20 +08:00
Xiaofan 1d9f4e0a5c
Add log when server is stopped (#12233)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-30 10:59:42 +08:00
Bingyi Sun fb2e8b0870
[skip ci]Add comment for WatchChannels in client.go (#12416)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@gmail.com>
2021-11-29 23:13:41 +08:00
congqixia 06ced4d1d1
Add DropVirtualChannel for DataCoord (#12361)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-29 22:35:41 +08:00
dragondriver 3850979308
Show stack trace info when rpc fail (#12290)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-29 14:29:24 +08:00
zhenshan.cao 6831589b0b
Enable keepalive on the grpc (#12328)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-29 14:25:17 +08:00
Bingyi Sun 01be91116e
Add GetFlushState interface (#12170)
issue: #12075
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-23 10:55:14 +08:00
zhenshan.cao 543c4891b3
Prevent the client from closing grpc connection by mistake (#11918)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-18 11:17:12 +08:00
shaoyue 513ea9fa40
[skip ci] Add Comments for exported datacoord.Server methods (#11797)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-15 19:30:38 +08:00
Xiaofan 71e814f796
Remove common.yaml and component.yaml (#11661)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-12 21:25:08 +08:00
godchen 5357e301f4
Fix retrieve search error (#11501)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
Bingyi Sun c3f0c5a3ff
Add compaction interfaces in proxy (#11431)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-09 14:47:02 +08:00
zhenshan.cao fbb9a5a790
[skip ci]Fix golint error in datacoord (#11351)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-05 23:03:10 +08:00
sunby c26cd79532
Add compaction (#9906)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-05 22:25:00 +08:00
sunby 1f2e0c68db
[skip ci]Add comment for Start in datacoord client (#11200)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-03 23:26:12 +08:00
sunby 8eb2700fa7
[skip ci]Add comment for Init (#11199)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-03 23:24:21 +08:00
sunby 087f05bca5
[skip ci]Add comment for GetMetrics (#11198)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-03 23:22:31 +08:00
sunby 3c5ef43783
[skip ci]Add comment for SaveBinlogPaths (#10777)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-27 20:36:24 +08:00
sunby f797c1e094
[skip ci]Add comment for GetFlushedSegments (#10776)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-27 20:34:33 +08:00
groot 2c09891137
Add log (#10717)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-27 14:54:59 +08:00
sunby 42480da5d3
[skip ci]Add comment for GetSegmentInfoChannel (#10606)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 21:24:22 +08:00
sunby 1888b7e1a1
[skip ci]Add comment for GetRecoveryInfo (#10605)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 21:22:31 +08:00
sunby e98dee296f
[skip ci]Add comment for GetCollectionStatistics (#10393)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-21 21:55:40 +08:00
sunby dcd6c1f2b2
[skip ci]Add comment for GetPartitionStatistics (#10392)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-21 21:53:48 +08:00
sunby 4adccbf03e
[skip ci]Add comment for GetSegmentInfo (#10391)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-21 21:51:55 +08:00
sunby 3fe0604b18
[skip ci]Add comment for GetInsertBinlogPaths (#10321)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 21:30:43 +08:00
sunby d60cd6ec6e
[skip ci]Add comment for GetSegmentStates (#10320)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 21:28:49 +08:00
sunby 95644f71e8
[skip ci]Add comment for AssignSegmentID (#10319)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 21:26:55 +08:00
XuanYang-cn cc8a526105
[skip ci]Update license for distributed dc client (#10162)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-19 20:25:17 +08:00
XuanYang-cn d0710c5f7f
[skip ci]Update license for distributed dc (#10161)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-19 20:23:22 +08:00
groot 7205fd3d9b
Remove unused interface (#9877)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-14 17:42:35 +08:00
sunby aac60959d0
[skip ci]Add comment for NewClient (#9753)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-12 20:34:33 +08:00
sunby a0e1189333
[skip ci]Add comment for datacoord client (#9752)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-12 20:32:41 +08:00
groot 1277bb659a
Add unittest for distributed/querycoord (#9567)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-11 10:02:25 +08:00
zhenshan.cao 3b8ed4774d
[skip ci]Fix golint error in datacoord (#9598)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-09 21:03:29 +08:00
groot dd09ded49a
Modify package name of distributed/datacoord (#9551)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-09 16:00:56 +08:00
groot 69194a3047
Add unittest for distributed/datacoord (#9490)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-08 19:10:54 +08:00
zhenshan.cao 76d062bfe6
[skip ci] Fix golint error in datacoord (#9280)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-05 20:52:27 +08:00
sunby f798fd8a17
[skip ci]Add comment for grpcdatacoordclient (#9209)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-04 18:02:02 +08:00
sunby 2ed1e825f4
Check error in param test (#9210)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-04 17:32:15 +08:00
zhenshan.cao e64b18ccd0
[skip ci] Fix golint error in datacoord (#9192)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-04 13:22:42 +08:00
zhenshan.cao 32fd117a36
[skip ci] fix golint error in datacoord (#9040)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-01 23:38:31 +08:00
sunby b80061955a
Add comment for GetSegmentInfo (#8898)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-30 11:08:03 +08:00
sunby 98fa078c39
[skip ci]Add comment for GetSegmentInfoChannel (#8897)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-29 23:42:00 +08:00
sunby 299a83b10d
[skip ci]Add comment for datacoord Server (#8899)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-29 23:18:01 +08:00
groot c982e368dd
Add unittest for distributed/datanode (#8695)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-27 19:00:22 +08:00
sunby cd923a4a98
Check error in param table test (#8620)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-26 21:55:58 +08:00
sunby 61874c1a96
[skip ci] Add comment for GetMetrics (#8529)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-24 23:21:57 +08:00
sunby 9a7780369e
Add comment for GetFlushedSegments (#8527)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-24 23:20:03 +08:00
sunby 5e6e0feeff
Add comment for GetRecoveryInfo (#8526)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-24 23:18:11 +08:00
Xiaofan 34157a4943
Unify Param Table name (#8491)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-24 21:35:57 +08:00
sunby 7ba18a7653
Add comment for GetCollectionStatistics (#8433)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-23 21:52:02 +08:00
sunby 3296475517
Add comment for GetInsertBinlogPaths (#8432)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-23 21:42:03 +08:00
sunby 3cfa34e225
Add comment for GetPartitionStatistics (#8434)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-23 21:39:55 +08:00
Xiaofan f5173b595f
Add a channel prefix for all channels (#8166)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-23 10:53:53 +08:00
sunby b46307388f
Add comment for GetTimeTickChannel (#8217)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 18:21:53 +08:00
sunby 5c5c4b004c
Add comment for GetComponentStates (#8216)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 10:43:53 +08:00
sunby c0331eba6a
Add comment for AssignSegmentID (#8152)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 10:07:53 +08:00
sunby a16fb4cf39
Add comment for GetSegmentStates (#8153)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:49:51 +08:00
sunby 9daf9dce1a
Add comment for flush (#8151)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:47:56 +08:00
sunby 77634c473d
Add comment for GetStatisticsChannel (#8218)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:35:51 +08:00
dragondriver 4f9d124ed4
Fix data race of proxy ut (#8119)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 19:45:42 +08:00
groot 1fd0e79add
Add unittest for distributed datacoord (#7982)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-16 14:17:49 +08:00
dragondriver 89748ac639
Expose metrics of data cluster (#7177)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-01 10:13:15 +08:00
godchen bf2c427609
Fix connection timeout (#7203)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-20 17:52:11 +08:00
dragondriver b3f10ae5cc
Fix 6990, enhance the log when parsing grpc recv/send parameters (#6993)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-12 16:16:09 +08:00
godchen 7557616fea
Change client timeout (#6982)
* Change client timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout time

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix conflicts

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix ut

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove ut

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-06 14:09:26 +08:00
dragondriver ad77a6e0d4
Fix #6859, increase the MaxCallRecvMsgSize and MaxCallSendMsgSize of grpc client (#6861)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-04 13:03:24 +08:00
sunby b98b30b96f
Fix datacoord_test.go failed (#6558)
Create a mock rootcoord when testing datacoord to hide the network layer
issue: #6557
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-19 10:41:15 +08:00
紫晴 4c7b57ffc5
Upload codecov report in GitHub Actions (#6565)
* Upload codecov report in GitHub Actions

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2021-07-16 14:52:21 +08:00
neza2017 8b89744c6b
search with exp (#6409)
* process float vector and binary vector field
on the search result

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add more debug info on etcd

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add debug info when grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-10 10:21:52 +08:00
sunby 07b0989628
Add GetFlushedSegments in data coordinator (#6253)
Send segment flush message by grpc and add a new interface
`GetFlushedSegments`

Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-02 11:16:20 +08:00
godchen 2a07124885
Change default grpc retry config (#6233)
* Change default grpc retry config

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* add retry code

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change time

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-01 15:24:17 +08:00
godchen 49a0528d53
Fix trace (#6218)
* Fix trace

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-30 16:18:13 +08:00
godchen 1c1ffc8b32
Add connect err log (#6186)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-29 14:30:17 +08:00
godchen 73996aba91
Change client init timeout (#6107)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-25 15:50:23 +08:00
godchen 3785bb6330
Change retry times (#6083)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-24 19:05:06 +08:00
godchen 064f8f76cd
change_coord_connect_retry (#6064)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-24 15:20:08 +08:00
sunby 46f86a0354
Return sealed segments when calling flush (#6011)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-23 16:56:11 +08:00
godchen 99be4c09a5
change retry (#5996)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-23 09:24:10 +08:00
Cai Yudong 7dbf33b788
Update component names in config files (#5989)
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 19:08:03 +08:00
sunby c863a193de
Rename filename from dataservice to datacoordinator (#5946)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-22 10:42:07 +08:00