milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
13,184 Commits
130 Branches
115 Tags
556 MiB
Commit Graph

629 Commits (7ce71870ce7a1a1090d387086ffe19f263764417)

Author SHA1 Message Date
XuanYang-cn bb1086659b
Remove not in use datanode_test.go (#10164) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-20 19:13:26 +08:00
XuanYang-cn a7429cdd3a
[skip ci]Update license for distributed in (#10296) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-20 19:02:41 +08:00
cai.zhang a6ce06de6f
[skip ci]Fix golint error for NewClient in QueryNode (#10220) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-19 20:42:35 +08:00
cai.zhang 1d0e9dc6d7
[skip ci]Fix golint error for Client in QueryNode (#10219) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-19 20:40:40 +08:00
cai.zhang 9585aaa188
[skip ci]Fix golint error for GetMetrics in QueryNode (#10218) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-19 20:38:47 +08:00
XuanYang-cn cc8a526105
[skip ci]Update license for distributed dc client (#10162) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-19 20:25:17 +08:00
XuanYang-cn d0710c5f7f
[skip ci]Update license for distributed dc (#10161) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-19 20:23:22 +08:00
XuanYang-cn 75cdba134b
[skip ci]update license for distributed dn (#10163) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-19 16:53:23 +08:00
XuanYang-cn 52e9d57f91
[skip ci]Update license for distributed dn client (#10160) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-19 16:51:32 +08:00
zhenshan.cao d4e48fc4d1
[skip ci]Fix golint error in querycoord (#10137) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-18 21:24:34 +08:00
cai.zhang cbb8236c05
[skip ci]Fix golint error for ReleaseSegments in QueryNode (#10064) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-18 20:20:53 +08:00
cai.zhang aba26a888a
[skip ci]Fix golint error for ReleasePartitions in QueryNode (#10063) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-18 20:19:01 +08:00
cai.zhang 62446f63d4
[skip ci]Fix golint error for GetSegmentInfo in QueryNode (#10065) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-18 20:17:03 +08:00
cai.zhang b8d37034e7
[skip ci]Fix golint error for LoadSegments in QueryNode (#10004) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-16 17:16:45 +08:00
cai.zhang 3b13111280
[skip ci]Fix golint error for WatchDmChannels in QueryNode (#10003) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-16 17:14:51 +08:00
cai.zhang ea24a10dca
[skip ci]Fix golint error for ReleaseCollection in QueryNode (#10005) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-16 17:12:46 +08:00
cai.zhang ac7bacbbcc
[skip ci]Fix golint error for QueryNode (#9969) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-15 18:10:54 +08:00
cai.zhang 148b26cf40
[skip ci]Fix golint error for QueryNode (#9968) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-15 17:57:07 +08:00
cai.zhang af40606037
[skip ci]Fix golint error for QueryNode (#9970) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-15 17:52:56 +08:00
cai.zhang 971e0ea91f
[skip ci]Fix golint for GetStatisticsChannel in distributed/querynode/service.go (#9909) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-14 19:38:36 +08:00
cai.zhang f054c82f7c
[skip ci]Fix golint for GetTimeTickChannel in distributed/querynode/service.go (#9908) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-14 19:36:41 +08:00
cai.zhang 02b65f7179
[skip ci]Fix golint for SetIndexCoord in distributed/querynode/service.go (#9907) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-14 19:34:51 +08:00
congqixia 6b8ff60de3
Close event channel when watch event found error (#9819) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-14 19:20:35 +08:00
groot 95502ce0ca
Rename test object (#9887) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-14 18:48:56 +08:00
groot bd7baf8912
Add unittest for distributed/proxy (#9875) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-14 17:48:34 +08:00
groot 7205fd3d9b
Remove unused interface (#9877) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-14 17:42:35 +08:00
cai.zhang 711dad2eae
[skip ci]Fix golint for SetRootCoord in distributed/querynode/service.go (#9814) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-13 19:36:33 +08:00
cai.zhang ba6ea3df7e
[skip ci]Fix golint for Run in distributed/querynode/service.go (#9816) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-13 19:30:34 +08:00
cai.zhang 0d03a2066e
[skip ci]Fix golint for Stop in distributed/querynode/service.go (#9815) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-13 19:24:41 +08:00
zhenshan.cao 09421e6312
Fix golint error in datanode (#9746) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-13 10:56:40 +08:00
sunby aac60959d0
[skip ci]Add comment for NewClient (#9753) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-12 20:34:33 +08:00
sunby a0e1189333
[skip ci]Add comment for datacoord client (#9752) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-12 20:32:41 +08:00
sunby 2a5f94b4dc
[skip ci]Fix typo (#9751) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-12 20:30:49 +08:00
cai.zhang 3437761108
[skip ci]Fix golint for UniqueID in distributed/querynode/service.go (#9730) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-12 19:29:22 +08:00
cai.zhang aae7e978af
[skip ci]Fix golint for init in distributed/querynode/service.go (#9729) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-12 19:27:30 +08:00
cai.zhang 806973fe83
[skip ci]Fix golint for Server in distributed/querynode/service.go (#9728) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-12 19:21:08 +08:00
cai.zhang 62c65d234a
[skip ci]Fix golint error in distributed/querynode/client/param_table.go (#9645) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-11 21:38:49 +08:00
cai.zhang f73c04915b
[skip ci]Fix golint error in distributed/querynode/param_table.go (#9639) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-11 21:33:11 +08:00
sunby 4b7e024245
[skip ci]Add comment for Client (#9669) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-11 19:28:37 +08:00
groot 2cba5053a8
Add comment for QueryCoordComponent (#9648) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-11 19:00:46 +08:00
groot 0d49316103
Add unittest for distributed/querynode (#9608) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-11 17:16:30 +08:00
groot 1277bb659a
Add unittest for distributed/querycoord (#9567) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-11 10:02:25 +08:00
zhenshan.cao 3b8ed4774d
[skip ci]Fix golint error in datacoord (#9598) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-09 21:03:29 +08:00
groot dd09ded49a
Modify package name of distributed/datacoord (#9551) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-09 16:00:56 +08:00
groot 735b02cf2b
Add unittest for distributed/datanode (#9503) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-09 10:10:59 +08:00
groot 69194a3047
Add unittest for distributed/datacoord (#9490) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-08 19:10:54 +08:00
cai.zhang e6eff2dfea
[skip ci]Fix golint in indexcoord/prama_table.go (#9298) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-05 22:42:18 +08:00
zhenshan.cao a1f040cd97
[skip ci] Fix golint error in rootcoord (#9291) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-05 21:44:05 +08:00
zhenshan.cao 6cf049130d
[skip ci] Fix golint error in proxy (#9283) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-05 21:12:13 +08:00
zhenshan.cao cbbdbc699c
[skip ci] Fix golint error in datanode (#9282) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-05 20:56:06 +08:00
zhenshan.cao a7a7941458
[skip ci] Fix golint error in datanode (#9281) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-05 20:54:22 +08:00
zhenshan.cao 76d062bfe6
[skip ci] Fix golint error in datacoord (#9280) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-05 20:52:27 +08:00
cai.zhang 325dbc59cf
[skip ci]Fix golint in indexcoord/prama_table.go (#9229) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-04 21:36:01 +08:00
cai.zhang a441e29c82
[skip ci]Fix golint in indexcoord/prama_table.go (#9227) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-04 21:34:12 +08:00
cai.zhang a5408be308
[skip ci]Fix golint in indexcoord/prama_table.go (#9228) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-04 21:32:10 +08:00
sunby f798fd8a17
[skip ci]Add comment for grpcdatacoordclient (#9209) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-04 18:02:02 +08:00
sunby 2ed1e825f4
Check error in param test (#9210) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-04 17:32:15 +08:00
zhenshan.cao 267fbe74e6
[skip ci] Fix golint error in querycoord (#9189) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-04 17:22:41 +08:00
zhenshan.cao 2d3824e6e2
[skip ci] Fix golint error in proxy (#9188) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-04 17:20:49 +08:00
zhenshan.cao e64b18ccd0
[skip ci] Fix golint error in datacoord (#9192) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-04 13:22:42 +08:00
zhenshan.cao d34a138f19
[skip ci] Fix golint error in rootcoord (#9190) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-04 13:18:26 +08:00
cai.zhang 95a0cc8741
[skip ci]Fix golint in indexnode/client/param_table.go (#9119) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-04 08:21:00 +08:00
cai.zhang 35aa54dcd9
[skip ci]Fix golint in indexcoord/prama_table.go (#9125) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-03 10:28:09 +08:00
cai.zhang efabe9ecd1
[skip ci]Fix golint in indexcoord/server.go (#9123) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-03 10:26:07 +08:00
cai.zhang 8f4a735676
[skip ci]Fix golint in indexnode/client/client.go (#9121) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-03 10:24:01 +08:00
zhenshan.cao 32fd117a36
[skip ci] fix golint error in datacoord (#9040) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-01 23:38:31 +08:00
groot ac7c22d84e
Add unittest for distributed/proxy (#8907) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-01 22:54:09 +08:00
cai.zhang ef244bd9c0
[skip ci]Fix golint in indexcoord/client/client.go (#8973) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-30 19:01:21 +08:00
sunby b80061955a
Add comment for GetSegmentInfo (#8898) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-30 11:08:03 +08:00
groot b17d253db1
Add unittest for distributed/querynode (#8834) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-30 10:02:02 +08:00
sunby 98fa078c39
[skip ci]Add comment for GetSegmentInfoChannel (#8897) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-29 23:42:00 +08:00
sunby 299a83b10d
[skip ci]Add comment for datacoord Server (#8899) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-29 23:18:01 +08:00
groot a7a6ff1236
Remove unnecessary connection of indexcoord (#8874) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-29 18:50:00 +08:00
zhenshan.cao 577d3c76df
[skip ci] Fix golint error in configs.go (#8808) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-28 23:04:12 +08:00
cai.zhang 85cf0624ac
[skip ci]Fix golint in indexcoord/client (#8784) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-09-28 21:56:32 +08:00
groot c982e368dd
Add unittest for distributed/datanode (#8695) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-27 19:00:22 +08:00
groot 693994c6db
Add unittest for distributed/querycoord/indexnode (#8680) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-27 18:41:58 +08:00
congqixia 88e319acda
Save start position in collection meta (#8682) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-27 18:10:00 +08:00
groot cd03da2a9d
Add unittest for distributed/querynode (#8648) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-27 14:12:08 +08:00
groot 26cdbb24f8
Add unittest for distributed/rootcoord (#8643) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-27 11:07:58 +08:00
sunby cd923a4a98
Check error in param table test (#8620) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-26 21:55:58 +08:00
sunby 61874c1a96
[skip ci] Add comment for GetMetrics (#8529) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-24 23:21:57 +08:00
sunby 9a7780369e
Add comment for GetFlushedSegments (#8527) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-24 23:20:03 +08:00
sunby 5e6e0feeff
Add comment for GetRecoveryInfo (#8526) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-24 23:18:11 +08:00
Xiaofan 34157a4943
Unify Param Table name (#8491) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-24 21:35:57 +08:00
cai.zhang 803a083b60
Fix golint for distributed indexnode (#8504) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-24 20:41:56 +08:00
cai.zhang 459174d78a
Fix golint for distributed indexcoord (#8496) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-24 20:39:56 +08:00
sunby 7ba18a7653
Add comment for GetCollectionStatistics (#8433) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-23 21:52:02 +08:00
sunby 3296475517
Add comment for GetInsertBinlogPaths (#8432) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-23 21:42:03 +08:00
sunby 3cfa34e225
Add comment for GetPartitionStatistics (#8434) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-23 21:39:55 +08:00
cai.zhang d308661f63
Add comment for indexcoord server (#8416) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-23 21:35:55 +08:00
Cai Yudong bc7fc50493
Clean golint warnings for distributed/rootcoord (#8357) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-23 11:41:53 +08:00
Xiaofan f5173b595f
Add a channel prefix for all channels (#8166) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-23 10:53:53 +08:00
sunby b46307388f
Add comment for GetTimeTickChannel (#8217) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-22 18:21:53 +08:00
sunby 1cb8c31794
Add comment for CreateCollection (#8023) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-22 17:11:54 +08:00
dragondriver 6345d05bf4
Fix collection alias ut (#8292) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-22 16:10:07 +08:00
sunby 5c5c4b004c
Add comment for GetComponentStates (#8216) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-22 10:43:53 +08:00
sunby c0331eba6a
Add comment for AssignSegmentID (#8152) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-22 10:07:53 +08:00
sunby fe1e1ce523
Add comment for DropCollection (#8024) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-22 10:05:58 +08:00
sunby a16fb4cf39
Add comment for GetSegmentStates (#8153) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-18 16:49:51 +08:00
sunby 9daf9dce1a
Add comment for flush (#8151) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-18 16:47:56 +08:00
sunby ab55a39b7d
Add comment for DescribeCollection (#8030) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-18 16:46:01 +08:00
sunby 77634c473d
Add comment for GetStatisticsChannel (#8218) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-18 16:35:51 +08:00
sunby 3dad7b5aa8
Add comment for HasCollection (#8025) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-18 16:27:51 +08:00
Yusup ccb57ba4b2
add collection alias (#7255) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-09-18 11:13:51 +08:00
dragondriver 4f9d124ed4
Fix data race of proxy ut (#8119) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-17 19:45:42 +08:00
congqixia a972fafb5f
Fix proxy ut may hang with dn graceful stop (#8124) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-17 17:49:58 +08:00
sunby b84f017dde
Add comment for CreatePartition (#8031) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-17 17:35:53 +08:00
sunby c0ede30c6e
Add comment for ShowCollections (#8032) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-17 11:15:53 +08:00
dragondriver ca2d09a167
Fix data race of proxy grpc client (#8091) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-16 19:31:59 +08:00
dragondriver 9bbff86c81
Fix data race of rootcoord grpc client (#8078) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-16 18:15:49 +08:00
groot 1fd0e79add
Add unittest for distributed datacoord (#7982) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-16 14:17:49 +08:00
groot c40cdb599a
Add unittest for distributed rootcoord (#7997) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-16 12:33:49 +08:00
groot e6450b0d96
Add unittest for distributed indexnode (#7991) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-16 12:31:53 +08:00
groot 75c80c12cb
Add unittest for distributed datanode (#7987) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-16 12:29:53 +08:00
cai.zhang 4814f9cb1c
Add opentrace log for index component (#7946) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-16 10:07:48 +08:00
groot 8fb961a0b0
Add unittest for distributed querynode (#7996) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-15 22:15:53 +08:00
groot 0404e3c243
Add unittest for distributed querycoord (#7993) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-15 22:13:57 +08:00
groot ed322cfd8e
Add unittest for distributed indexcoord (#7990) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-15 22:12:02 +08:00
groot 2398dafbca
Add unittest for distributed proxy (#7976) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-15 17:29:49 +08:00
Xiangyu Wang 42aafdc407
Remove unused msg from msg.go (#7612) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-09 19:56:00 +08:00
dragondriver 9b21b3b5fd
Initialize test framework of proxy (#7563) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-09 10:06:29 +08:00
Cai Yudong d15d3fa0ac
Improve rootcoord codecov (#7518) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-07 11:16:37 +08:00
dragondriver 42b687bf48
Add unittest for task scheduler (#7508) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-06 20:49:04 +08:00
cai.zhang e6e03fc93f
Add unittest for index component (#7475) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-06 17:54:41 +08:00
dragondriver 89748ac639
Expose metrics of data cluster (#7177) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-01 10:13:15 +08:00
dragondriver f0dbdd7f13
Expose metrics of root coordinator (#7228) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-31 11:45:59 +08:00
dragondriver 84bddd0a03
Add unittest cases for proxy (#7364) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-31 10:25:59 +08:00
xige-16 af574d17d5
Fix querycoord panic when stop nil conn of querynoClient (#7346) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-08-28 12:51:57 +08:00
Xiangyu Wang c62f23e201
[skip ci]Remove neza2017 from reviewers (#7324) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-27 00:27:36 +08:00
xige-16 055d94ede1
Add ut for queryCoord (#7212) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-08-26 14:17:54 +08:00
groot 8701c477e2
Add delete api into proto (#7304) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-08-26 12:15:52 +08:00
Xiaofan 58b2089692
Import Embedded Etcd Kv Part 1(#7112) (#7174) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-08-24 09:45:51 +08:00
godchen 33583525c5
Add connection manager (#6867) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-23 10:00:12 +08:00
godchen bf2c427609
Fix connection timeout (#7203) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-20 17:52:11 +08:00
dragondriver 648d22ee40
Expose metrics of IndexCoord and IndexNodes (#7157) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-19 10:28:10 +08:00
Cai Yudong 305fa9c17e
Fix timestamp go back issue for timeticksync (#7123) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-18 14:36:10 +08:00
dragondriver e45cb6c644
Expose system topology information by proxy (#7137) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-18 10:12:10 +08:00
dragondriver 7eb8a665b2
Expose metrics of QueryCoord and QueryNodes (#7113) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-17 10:06:11 +08:00
yukun 671b2737d2
Remove RetrieveRequest and RetrieveTask (#6848) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-08-16 17:06:10 +08:00
cai.zhang 382fa6f274
IndexNode dose not need to wait for IndexCoord to start to comlete (#7074) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-08-13 18:12:08 +08:00
Xiangyu Wang 5e78fd6a97
[skip ci]Update approvers (#7063) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-12 19:36:09 +08:00
dragondriver b3f10ae5cc
Fix 6990, enhance the log when parsing grpc recv/send parameters (#6993) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-12 16:16:09 +08:00
godchen 7557616fea
Change client timeout (#6982) 
* Change client timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout time

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix conflicts

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix ut

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove ut

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-06 14:09:26 +08:00
dragondriver ad77a6e0d4
Fix #6859, increase the MaxCallRecvMsgSize and MaxCallSendMsgSize of grpc client (#6861) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-04 13:03:24 +08:00
sunby b98b30b96f
Fix datacoord_test.go failed (#6558) 
Create a mock rootcoord when testing datacoord to hide the network layer
issue: #6557
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-07-19 10:41:15 +08:00
紫晴 4c7b57ffc5
Upload codecov report in GitHub Actions (#6565) 
* Upload codecov report in GitHub Actions

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2021-07-16 14:52:21 +08:00
cai.zhang f469a315d6
Refactor the logic of assign tasks in IndexCoord (#6328) 
* Refactor the logic of assign tasks in IndexCoord

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bugs

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for unittest

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Add lock for map

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Improve code

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix unittest bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reduce duriation for timetick

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Update orm version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset sdk version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset orm version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset test ip

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for unissued

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Rename some variables

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Use break instead of continue in select::case

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
 2021-07-14 14:15:55 +08:00
neza2017 b66157358c
add more log for create collection (#6478) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-13 22:19:55 +08:00
xige-16 2b720fd2f7
Fix load hang when restart querynode many time in short time (#6351) 
* fix load hang when restart querynode many time in short time

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add multi queryNode ut

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add ut for restart querynode

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set queryCoord contex to load collection

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-07-13 14:16:00 +08:00
neza2017 8b89744c6b
search with exp (#6409) 
* process float vector and binary vector field
on the search result

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add more debug info on etcd

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add debug info when grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-10 10:21:52 +08:00
neza2017 111a24a49f
remove msgstream of segment info (#6280) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-03 14:36:18 +08:00
sunby 07b0989628
Add GetFlushedSegments in data coordinator (#6253) 
Send segment flush message by grpc and add a new interface
`GetFlushedSegments`

Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-07-02 11:16:20 +08:00
groot a364d7303b
Implement calculate vectors distance in server (#6219) 
* calc distance stage 3

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 5

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 6

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* code style

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-07-01 18:56:17 +08:00
godchen 2a07124885
Change default grpc retry config (#6233) 
* Change default grpc retry config

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* add retry code

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change time

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-07-01 15:24:17 +08:00
neza2017 6019c193fc
add grpc interface to process NewSegment And FlushSegmentCompleted (#6247) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-01 14:58:17 +08:00
xige-16 f146d3825f
Fix search hang after querynode restart (#6212) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-30 17:48:19 +08:00
godchen 49a0528d53
Fix trace (#6218) 
* Fix trace

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-30 16:18:13 +08:00
congqixia ae072b4f1d
Add candidate management for datacoord dn cluster (#6196) 
* Add candidate management for datacoord dn cluster

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* Fix test cases

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-06-30 10:20:15 +08:00
godchen 1c1ffc8b32
Add connect err log (#6186) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-29 14:30:17 +08:00
congqixia 3a202cad2b
Reduce connect timeout time (#6181) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-06-29 09:30:17 +08:00
neza2017 6d7edc6015
fix typo (#6142) 
* fix typo

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add log

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-26 18:04:12 +08:00
neza2017 a1d0e5c980
remove task scheduler (#6123) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-26 09:22:11 +08:00
neza2017 da12e55c6c
rootcoord connect to other components in go routines (#6117) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-25 16:48:10 +08:00
godchen 73996aba91
Change client init timeout (#6107) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-25 15:50:23 +08:00
godchen 3785bb6330
Change retry times (#6083) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-24 19:05:06 +08:00
godchen 064f8f76cd
change_coord_connect_retry (#6064) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-24 15:20:08 +08:00
xige-16 5417fee45f
fix releasePartition not work after loadCollection (#6025) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-23 17:44:12 +08:00
sunby 46f86a0354
Return sealed segments when calling flush (#6011) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-23 16:56:11 +08:00
Cai Yudong a09a3a1905
rename service to coord (#6020) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-23 16:14:08 +08:00
godchen fd07a44dba
Fix error in retry refactor (#6000) 
* Fix error in retry refactor

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-23 11:48:06 +08:00
Cai Yudong ba5aacd3f2
Remove GetChanNameByVirtualChan (#5999) 
* remove redundant ctx

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove GetChanNameByVirtualChan

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-23 11:18:05 +08:00
godchen 99be4c09a5
change retry (#5996) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-23 09:24:10 +08:00
Cai Yudong 7dbf33b788
Update component names in config files (#5989) 
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 19:08:03 +08:00
sunby 0978b93a21
Refactor data coordinator (#5982) 
Rename variable name and make error msg more clear

Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-22 18:24:08 +08:00
xige-16 2af1c27811
Rename queryservice to querycoordinator (#5931) 
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-22 16:44:09 +08:00
Cai Yudong d5f4ee6f44
Rename proto master/index_service/proxy_service (#5973) 
* rename proto proxy_service to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto index_service to index_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto master to root_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 16:14:09 +08:00
neza2017 80bb418136
Release partition (#5971) 
* add debug info

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* notify query coord to release partitions after drop partition

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-22 16:08:08 +08:00
Cai Yudong 2926a78968
Rename proxynode to proxy (#5961) 
* rename package name from proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/proxynode to distributed/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/proxynode to internal/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 14:40:07 +08:00
xige-16 7039fb7c82
Fix the problem of stuck after loadBalance and loadFieldData error (#5960) 
* delete nodeInfo after nodeDown

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix load balance can's stop

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix load field data error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* contiue task loop after error in queryService

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-22 14:10:09 +08:00
sunby c863a193de
Rename filename from dataservice to datacoordinator (#5946) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-22 10:42:07 +08:00
godchen 8643127e99
Change grpc retry (#5925) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-22 09:46:06 +08:00
sunby 7f2d7c1da3
Rename dataservice to datacoordinator (#5912) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-21 18:22:13 +08:00
sunby 0300b682f8
Remove deprecated interfaces in data coordinator (#5929) 
* Remove derecated interfaces in data coordinator

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Remove RegisterNode in data coordinator

Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-21 17:40:05 +08:00
Cai Yudong 92e429d812
Rename IndexService to IndexCoord (#5932) 
* rename package indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix queryservice static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/indexservice to distributed/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/indexservice to internal/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename MasterComponent to RootCoordComponent

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for queryservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for dataservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for datanode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for proxynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for querynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix rebase issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-21 17:28:03 +08:00
dragondriver 2642415bc3
Redefine the auto_id and primary_key (#5903) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-06-21 11:42:18 +08:00
sunby da1f9f9241
Rename dataservice to datacoordinator (#5904) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-21 11:40:15 +08:00
xige-16 e4c51aae36
Add recovery logic for querynode and queryservice (#5843) 
* merge milvus/recovery2

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add recovery logic in queryservice

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* debug smoke case

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add etcd to querynode

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix release partition error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix load balance error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* debug querynode down and recovery

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add log

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix showCollection

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* skip smoke test search without insert

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-19 11:45:09 +08:00
Cai Yudong 5a1f7e4feb
rename masterservice to rootcoord (#5875) 
* rename masterservice to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix build error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename package

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename masterservice to rootcoord under distributed

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update scripts

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* enable more unittests

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-18 21:30:08 +08:00
bigsheeper 710ac1a4f1
remove query node id env dependency and fix start script (#5874) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-06-18 19:00:15 +08:00
congqixia 2f8bccda8d
Improve help message (#5870) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-06-18 16:16:06 +08:00
dragondriver 676a30e418
Use channelsMgr to manage search message stream (#5819) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-06-18 10:33:58 +08:00
neza2017 b2908c4780
Release collection (#5839) 
* relese collection

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* gen-proto

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* release collection

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* release collection

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-17 17:45:56 +08:00
Cai Yudong ae3daff5e4
Rename Master to RootCoord (#5830) 
* rename master_service.go to root_coordinator.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coordinator under cmd

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord under cmd

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord for metrics

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord for masterservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix metrics unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* roll back cmd

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-17 16:47:57 +08:00
godchen b7bf26b486
Update grpc trace (#5817) 
* Update grpc trace

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove useless code in mod

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-17 14:17:56 +08:00
congqixia 5ce06de3d1
Add context usage and fix defer issue (#5796) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-06-16 18:35:59 +08:00
zhenshan.cao 5c69c6902d Refactor proxy channelTimeTick and fix search timeout (#5760) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-15 16:36:36 +08:00
Cai Yudong 0f4bd50ce3 Support ETCD endpoints array (#5755) 2021-06-15 16:36:36 +08:00
Cai Yudong 17b19233dc add BroadcastMany, send DdMsg to collection channels only (#5734) 
* add BroadcastMany, send DdMsg to collection channels only

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix master unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix time tick of masterservice

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* fix time tick unittest of masterservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* skip dataservice ut

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix format issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update timeticksync

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update timeticksync

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update SendDdXXXReq interface

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update master unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* roll back unecessary change

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* enable ut

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-15 16:36:36 +08:00
zhenshan.cao f74ea3beee [skip ci] Remove ProxyService (#5738) 
* [skip ci] Remove ProxyService

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Change helm branch

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fix bug: paramstable crashed

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-15 16:36:35 +08:00
zhenshan.cao 33a43f48c8 [skip ci] Fix bug: Search timeout and refactor client init logic (#5735) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-15 16:24:48 +08:00
congqixia 7d9f299ff6 Change default unregister policy (#5710) 
* Change default unassign policy

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* Fix gofmt

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-06-15 16:06:13 +08:00
sunby 189ac881f3 Fix bugs (#5676) 
* Remove redundant session startup

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Register datanode after start success

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* fix meta snap shot

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* fix datanode message stream channel

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* Fix bugs when drop empty collection

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Fix bug of getting pchan statistics from task scheduler

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* Fix i/dist/dataservice test code

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* Fix epoch lifetime not applied

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* fix datanode flowgraph dd node

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* Fix handle datanode timetick bug

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Remove repack function of dml stream

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* fix proxynode

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* Apply extended seal policy

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* add check for time tick

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* fix check

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* Fix the repack function of dml stream

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* Fix the bug when send statistics of pchan

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* Fix the repack function when craete dml stream

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* fix bugs

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* fix describe collection

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* Fix bug when send timestamp statistics

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* fix data node

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* Add length check before flush request

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* add log for data node

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* Fix SaveBinlog bugs

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Add more log in datanode

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* Put SegmentState.Flushing as the last one in enum to fit the client

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Fix params in GetInsertBinlogPaths

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Rename policy

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Remove unused ddl functions and fields

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* Remove pchan when drop collection

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* Add balanced assignment policy

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* fix master ut

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* Add lock in session manager

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* add log for debug

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* Fix some logic bug and typo

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* Fix recover bugs

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Get collection scheme of a specific timestamp

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* Change CheckPoint to SegmentInfo in VchannelInfo

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Recover Unflushed segment numOfRows

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* Fix dataservice unit tests

Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-06-15 16:06:11 +08:00
Cai Yudong a948b71e06 Support to send dd msg to all dml channels (#5597) 
* send dd msg to dml channel

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add dml_channels.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix race

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-15 16:04:48 +08:00
godchen 275881dbdb Remove address param (#5556) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-15 16:04:46 +08:00
godchen 54ab03e28f Fix queryservice connect error (#5526) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-15 15:59:04 +08:00
congqixia 62eaa0390a Add dataservice metrics with grpc prometheus middleware (#5523) 
* Add dataservice metrics with grpc prometheus middleware

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* register server metrics

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-06-15 15:59:04 +08:00
Cai Yudong 2cc330b117 Remove proxy service from master (#5510) 
* remove proxy service

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* remove time sync

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* remove proxy service

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* remove proxy service

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* remove proxy service

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* remove proxy service from distributed/masterservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-15 15:59:04 +08:00
sunby a14c35274f Fix bugs in dataservice (#5457) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-15 15:59:04 +08:00
XuanYang-cn 55eac3ee7f Complete Flush procedure in DataNode (#5454) 
* Complete Flush proceduer in DataNode

Resolves: #5220

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix unittest

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-06-15 15:59:04 +08:00
bigsheeper cdbc6d2c94
Refactor query node and query service (#5751) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-15 12:41:40 +08:00
sunby 50b3d39370
Add GetRecoveryInfo interface and proto (#5598) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-07 14:16:36 +08:00
zhenshan.cao 03e3b4beb4
Add log to startup process (#5594) 
* Add log to startup process

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fixbug: avoid ctx exceed deadline

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fmt code

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fix bug: wrong time unit

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fixbug: datanservice client reconnect use time ctx

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-04 16:29:35 +08:00
Cai Yudong 2ba93deb5e
Support master get segment info channel name from config file (#5606) 
* optimize msgstream unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* get data service segment info channel name from config file directly

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-04 16:28:34 +08:00
Xiangyu Wang afa5da7df0
Add query rpc into proto (#5592) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-06-04 12:02:34 +08:00
zhenshan.cao b0b8f58192
Fix bug: search timeout (#5557) 
* Fix bug: search timeout

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Add log and fix unittest bug

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-03 14:58:34 +08:00
Xiangyu Wang ca0993c274 Update OWNERS 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-05-30 18:58:47 +08:00
cai.zhang a606ab9c67
Add power-off restart logic for IndexService and IndexNode (#5395) 
Add power-off restart logic for IndexService and IndexNode


Signed-off-by: <xiaocai2333> <cai.zhang@zilliz.com>
 2021-05-27 14:24:29 +00:00
godchen 6e3a0d2a8e
Add queryservice grpc retry (#5437) 
Add queryservice grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-27 10:44:36 +00:00
godchen 220c12e12f
Add indexservice grpc retry (#5425) 
Add indexservice grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
 2021-05-27 07:12:13 +00:00
godchen 279d77020a
Change proxy grpc retry (#5431) 
Change proxy grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
 2021-05-27 07:10:39 +00:00
godchen 9aa1fd25fa
Add indexnode grpc retry (#5418) 
Add indexnode grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-27 02:30:11 +00:00
neza2017 f80dbab6ec
watch proxynode (#5424) 
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

Resolves: #5423
 2021-05-26 12:14:30 +00:00
godchen 5fd92ec80c
Add querynode grpc retry (#5428) 
Add querynode grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-26 11:37:34 +00:00
godchen bfa683ce79
Change dataservice grpc retry (#5411) 
Change dataservice grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
 2021-05-26 10:55:05 +00:00
godchen 5f0f840782
Remove datanode client code (#5427) 
Remove datanode client code.

Signed-off-by: godchen qingxiang.chen@zilliz.com
 2021-05-26 10:41:37 +00:00
godchen 200801271d
Fix GetSession error (#5401) 
Fix GetSession error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-25 12:15:46 +00:00
godchen 17cabfbed3
Add datanode client retry (#5394) 
Add datanode client retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-25 07:47:08 +00:00
neza2017 c28c34e852
let master use session.ServerID as nodeID (#5385) 
let master use session.ServerID as nodeID

also see #5386 

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-05-25 07:06:05 +00:00
Xiangyu Wang 88b42304ef
Add dummy RPC (#5376) 
Adding a dummy RPC makes it easier to develop new RPCs in the future.
When developing a new function, the SDK is often implemented last. 
At this time, this is helpful for debugging.

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-05-25 06:44:43 +00:00
Cai Yudong dab536a6cf
Rename some field names in master for better code readability (#5389) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-05-25 06:03:06 +00:00
Cai Yudong 4058350e30
update AddIndex not return error when fail (#5372) 
Resolves: #5332 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-05-25 03:42:23 +00:00
Cai Yudong 39f8c9dd56
Save msg start position and end position when AddSegment and AddIndex (#5358) 
Resolves: #5332 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-05-24 06:19:52 +00:00
neza2017 e326eaad1e
master client,reconnect if grpc failed (#5360) 
master client,reconnect if grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-05-24 01:44:49 +00:00
godchen 0eee7e5252
Change session (#5329) 
Change session.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-21 11:28:52 +00:00
Cai Yudong 761350e44d
Refactor timetick msg handling between proxy node and master (#5321) 
Proxy node send channel timetick msg to master, master reduce timetick
msg for each channel and send the min timetick to msg stream.

Resolves: #5276 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-05-21 08:08:12 +00:00
neza2017 c0daf8e41d
set timestamp on dd requests (#5298) 
- set dd request's time tick on master
- send time tick into dd channel

See also: #5291

Signed-off-by: yefu.chen yefu.chen@zilliz.com
 2021-05-20 06:14:14 +00:00
congqixia 38f5b0826f
Add SaveBinlogPaths grpc in dataservice (#5277) 
* Add SaveBinlogPaths grpc in dataservice

* fix merged compile error

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-05-20 11:34:45 +08:00
yukun a7bb701f73
Add Retrieve method grpc definition (#5294) 
See also: #5253 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-05-19 10:45:15 +00:00
godchen e224d1e725
Add SessionManager (#5288) 
Add SessionManager.
Resolves: #5174 

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-19 10:36:05 +00:00
neza2017 49f6542b1d
query master service's with timestamp (#5275) 
let meta support snapshot
so collection could query meta with timestamp

Resolves: #5219

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-05-18 06:18:02 +00:00
Cai Yudong 001795ee70
Optimize CreateIndex routine in master service (#5238) 
Remove CreateIndexTask struct and indexTaskQueue

Resolves: #5228 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-05-15 10:08:08 +00:00
Cai Yudong 08bb1b2ec3
Resend unsuccessful ddMsg when master start (#5214) 
Resend unsuccessful ddMsg when master start

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-05-14 21:26:06 +08:00
Cai Yudong 5f0006d0f9
Improve code coverage for distributed/datanode (#5133) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-05-08 06:07:04 +00:00
Cai Yudong d66a5acca3
improve code coverage for distributed/dataservice (#5123) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
improve code coverage for distributed/dataservice
 2021-05-07 07:43:52 +00:00
xige-16 1e7205fa03
fix querynode's port not set correctly when conflict with other node (#5066) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-05-07 12:03:53 +08:00
XuanYang-cn cebdfb34f7
Enable multiple datanode (#5068) 
Now it's able to start multiple datanode, however, they will process the same insert data.
Further changes are needed to truly enable multiple datanode:

While registering, dataservice need to return different insert channels for different datanode.

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-04-28 18:43:48 +08:00
godchen 060f7ca0d2
Add get index build progress proto (#5049) 
Add get index build progress proto.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-04-27 07:46:45 +00:00
neza2017 262c484cec
the return struct of "DescribeIndex" should contain "filed_name" (#5055) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-04-27 02:30:55 +00:00
neza2017 d7c0a72611
index name is unique in collection scope (#5046) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-04-26 15:53:47 +08:00