Commit Graph

1995 Commits (792aac9f732ec7daec5195cdd05eaf598c97cce7)

Author SHA1 Message Date
dragondriver 7a76022f3b
[skip ci] Update doc of descriptor event format (#8487)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-24 18:17:56 +08:00
yukun a8a0ae27ae
Add rocksmq client comments (#8475)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-24 16:05:55 +08:00
groot d28341932e
Reduce go unittest time cost (#8448)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-24 15:27:54 +08:00
Cai Yudong 4fba738bec
Update internal proto DeleteRequest (#8466)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-24 15:21:55 +08:00
bigsheeper 52126f2d5a
Dynamic add tSafe watcher, use sync.Cond instead of selectCase, add ref count (#8050)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-24 13:57:54 +08:00
congqixia ca62b1e149
Use clone instead of ShadowClone when update pb data (#8461)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-24 12:53:54 +08:00
congqixia a182326c60
Fix liveness check not quit after canceled (#8454)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-24 12:47:54 +08:00
dragondriver 208f32547f
[skip ci] Fix healthz router path (#8446)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-24 11:29:54 +08:00
Cai Yudong ee3eaa2966
Rename CreateQueryExprPlan to CreateExprPlan (#8438)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-24 10:27:54 +08:00
Cai Yudong 74d5bb3eef
Update comments for indexparamcheck/utils.go (#8437)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-24 09:41:54 +08:00
zhenshan.cao 98c423480e
[skip ci] Add comments for indexparamcheck (#8436)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-23 22:37:54 +08:00
Xiangyu Wang eb413f1396
Add comments for exposed structures and functions (#8435)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-23 21:57:55 +08:00
xige-16 93c945d076
Init querycoord once (#8106)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-23 21:56:02 +08:00
NotRyan e3d3834243
Fix debug typos in sesion_util (#8020)
Signed-off-by: NotRyan <ryan.chan@zilliz.com>

Co-authored-by: NotRyan <ryan.chan@zilliz.com>
2021-09-23 21:54:03 +08:00
sunby 7ba18a7653
Add comment for GetCollectionStatistics (#8433)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-23 21:52:02 +08:00
groot 985e63cbf2
Reduce cpp unittest time cost (#8424)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-23 21:50:11 +08:00
bigsheeper 1b7056d3c2
[skip ci] Add comment for dataSyncService in query node (#8418)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-23 21:48:12 +08:00
bigsheeper a6060e4481
[skip ci] Add comment for errors in query node (#8417)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-23 21:46:16 +08:00
bigsheeper 322f4ec80f
[skip ci] Add comment for type def in query node (#8415)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-23 21:44:17 +08:00
sunby 3296475517
Add comment for GetInsertBinlogPaths (#8432)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-23 21:42:03 +08:00
sunby 3cfa34e225
Add comment for GetPartitionStatistics (#8434)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-23 21:39:55 +08:00
cai.zhang bd48f6f2db
Add comment for metaTable of indexcoord (#8411)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-23 21:37:55 +08:00
cai.zhang d308661f63
Add comment for indexcoord server (#8416)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-23 21:35:55 +08:00
cai.zhang 1d16930a03
Init once for indexnode (#8027)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-23 21:27:54 +08:00
xige-16 85c2b4d0f6
Add log for releasePartion task (#8222)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-23 21:06:02 +08:00
xige-16 689e41066f
Add log for cluster reload in queryCoord (#8413)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-23 21:03:55 +08:00
XuanYang-cn faeb1bf50f
Add comment on exposed struct (#8348)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-23 20:15:54 +08:00
Xiangyu Wang 884d0d672e
Improve unit test in mq_msgstream.go (#8427)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-23 20:07:55 +08:00
XuanYang-cn 2b82482679
Fix golint and ruleguard (#8347)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-23 19:14:01 +08:00
XuanYang-cn a830c28bd8
Fix golint in datanode (#8345)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-23 19:05:55 +08:00
yukun 3c77eda7ac
Add error msgs in segcore (#8410)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-23 18:59:54 +08:00
congqixia 2aa9deda1c
Improve logic when watch dm channel fails (#8386)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-23 18:31:55 +08:00
congqixia da6d93527d
Add session liveness check (#8408)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-23 18:29:55 +08:00
groot af1bdaf202
Reduce cpp unittest time cost (#8409)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-23 17:55:54 +08:00
godchen 10c07a3041
Add description event extras. (#8264)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-23 17:23:54 +08:00
yukun f34e5205f7
Fix some memleak in rocksmq (#8405)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-23 17:21:54 +08:00
godchen b47ff1f97f
[skip ci]Add chunk manager interface comment (#8350)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-23 17:13:56 +08:00
godchen 3c8f031968
[skip ci]Add msgstream trace comment (#8349)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-23 17:11:54 +08:00
yukun 78e8e4aa22
Add rocksmq comments (#8362)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-23 16:59:54 +08:00
groot 8b81ceb5d7
Reduce cpp unittest time cost (#8403)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-23 16:55:54 +08:00
SS 58a178fdf5
[skip ci] Fix grammar in comment (#8382)
Signed-off-by: sida shen <sida@sidas-MacBook-Pro.local>

Co-authored-by: sida shen <sida@sidas-MacBook-Pro.local>
2021-09-23 16:50:16 +08:00
Xiangyu Wang 57618ac624
Remove unused codes in msgstream (#8368)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-23 16:29:55 +08:00
XuanYang-cn d816a81ee3
Make FlushSegments async (#8159)
Resolves: #8122

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-23 16:03:54 +08:00
Cai Yudong 177a465913
Clean golint warnings for rootcoord (#8383)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-23 15:10:00 +08:00
congqixia 6469d83072
Add datanode etcd alive check (#8363)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-23 14:29:54 +08:00
groot b897ca5703
Fix unittest build problem (#8369)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-23 14:19:54 +08:00
Cai Yudong bc7fc50493
Clean golint warnings for distributed/rootcoord (#8357)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-23 11:41:53 +08:00
dragondriver fb98f06de8
Expose simd type to index node metrics (#8300)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-23 11:29:54 +08:00
dragondriver b3f6bd2088
Expose simd type to query node metrics (#8299)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-23 11:27:54 +08:00
Xiaofan f5173b595f
Add a channel prefix for all channels (#8166)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-23 10:53:53 +08:00
Cai Yudong a62bce360b
Replace MarshalTextString with Marshal in rootcoord (#8341)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-23 10:37:54 +08:00
Cai Yudong 340f92ab16
Update querycoord proto (#8342)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-23 00:41:53 +08:00
congqixia 9ebfd43195
Add comment for proxyManager (#8266)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-22 23:55:53 +08:00
XuanYang-cn 4ee8275b88
Fix master compile error (#8333)
Resolves: #8336

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-22 20:31:54 +08:00
Xiaofan 2f92f78e7b
Remove meaningless Etcd kv logs (#8019)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-22 20:27:54 +08:00
yukun 9e17fdb598
Improve rocksmq codecov (#8328)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-22 20:16:04 +08:00
nameczz b6cea6539b
[skip ci] Improve ShowCollections in milvus.proto (#8200)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-09-22 20:14:08 +08:00
sunby 3fc1b9cf9f
Change copyright (#8318)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 20:12:08 +08:00
bigsheeper 220d17500c
[skip ci] Add comment for query node flow graph (#8326)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-22 20:10:09 +08:00
bigsheeper 11a4109747
[skip ci] Add comment for query coord proto (#8325)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-22 20:06:09 +08:00
bigsheeper f8ca5dbf55
[skip ci] Add comment for query coord proto (#8322)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-22 20:04:13 +08:00
godchen 050e27cbcf
[skip ci]Add delete node comment (#8323)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-22 20:02:09 +08:00
sunby 82dd762ef0
Change copyright (#8317)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 19:59:59 +08:00
congqixia c676979217
Add error detail when ddl fail (#8304)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-22 19:50:15 +08:00
cai.zhang 0d9ab7ab7d
Remove useless debug message in indexbuilder (#8303)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-22 19:37:53 +08:00
cai.zhang 729d409a32
Add trace log for search (#8302)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-22 19:36:00 +08:00
cai.zhang 79b7dcc75a
Add trace log for insert (#8301)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-22 19:33:54 +08:00
cai.zhang 41a6f9b5f7
Init once for IndexCoord (#8028)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-22 19:31:54 +08:00
sunby b46307388f
Add comment for GetTimeTickChannel (#8217)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 18:21:53 +08:00
yukun c5beef16a9
Add error msgs in segcore visitors (#8306)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-22 18:07:54 +08:00
godchen 75672abab4
Add lease time (#8064)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-22 17:50:00 +08:00
Cai Yudong 83ffa18c37
[skip ci] Update test_concurrent_vector (#8273)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-22 17:21:53 +08:00
yukun 06c9f03c59
Refactor rocksmq close logic and improve codecov (#8278)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-22 17:21:00 +08:00
Cai Yudong 07aa453270
[skip ci] Update test_segcore (#8270)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-22 17:19:53 +08:00
sunby 1cb8c31794
Add comment for CreateCollection (#8023)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 17:11:54 +08:00
Yusup bdfb78e936
Add aliases to DescribeCollection (#8268)
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-22 16:20:48 +08:00
dragondriver 85a6953330
Support healthz check api (#8228)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-22 16:18:21 +08:00
dragondriver 6345d05bf4
Fix collection alias ut (#8292)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-22 16:10:07 +08:00
dragondriver 78fe530d87
Initialize the simd type when initialize an indexnode (#8276)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-22 16:05:59 +08:00
xige-16 2e160f51bc
Add default test nodeID in querycoord's mock test (#8224)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-22 11:31:59 +08:00
bigsheeper 0e2b4a7cd8
Add comment for queryCoordMock (#8223)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-22 11:30:07 +08:00
bigsheeper 36dd794986
Add comment for type def in query node (#8220)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-22 11:28:04 +08:00
sunby 5c5c4b004c
Add comment for GetComponentStates (#8216)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 10:43:53 +08:00
dragondriver b2e8ba7b33
Fix reduce algorithm in proxy search task (#8206)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-22 10:15:54 +08:00
Cai Yudong c1e229cb7e
Add segcore logger (#8262)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-22 10:11:52 +08:00
sunby c0331eba6a
Add comment for AssignSegmentID (#8152)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 10:07:53 +08:00
sunby fe1e1ce523
Add comment for DropCollection (#8024)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 10:05:58 +08:00
Xiaofan 0c35cd57b0
Unify param table to the same naming format (#8254)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-20 23:27:52 +08:00
Xiaofan acfd7c7911
[skip ci] Fix typo in binlog writer (#8255)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-18 22:55:51 +08:00
yukun 269e041e34
[skip ci]Fix typo (#8251)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-18 19:53:51 +08:00
congqixia 21f15d66bb
Add option for DataNode creation (#8240)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-18 19:10:07 +08:00
Xiangyu Wang f203f750aa
Improve import statements in msgstream (#8237)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-18 19:06:09 +08:00
Xiangyu Wang 32c6033f4a
Add unit tests for msg.go (#8227)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-18 19:04:04 +08:00
godchen d1d3993689
[skip ci]Add binlog reader comment (#8230)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:57:51 +08:00
xige-16 e75693e1a3
Add log for release collection task (#8226)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-18 18:45:51 +08:00
godchen 3f5e876188
[skip ci]Add binlog writer comment (#8231)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:39:56 +08:00
godchen 0cf0217ed5
[skip ci]Add event data comment (#8232)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:37:56 +08:00
bigsheeper 1f1c738016
Add loadFieldData unittest for query node (#8219)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-18 18:32:07 +08:00
Xiangyu Wang c314b2b4a8
Remove unused label rules (#7929)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-18 18:19:51 +08:00
bigsheeper 11c65dc2b3
Add comment for collection replica (#8147)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-18 18:15:51 +08:00
bigsheeper 223044a7ca
Rename name of unittests in query node (#8225)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-18 18:05:51 +08:00
sunby a16fb4cf39
Add comment for GetSegmentStates (#8153)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:49:51 +08:00
sunby 9daf9dce1a
Add comment for flush (#8151)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:47:56 +08:00
sunby ab55a39b7d
Add comment for DescribeCollection (#8030)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:46:01 +08:00
sunby 77634c473d
Add comment for GetStatisticsChannel (#8218)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:35:51 +08:00
sunby 3dad7b5aa8
Add comment for HasCollection (#8025)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:27:51 +08:00
groot b6e43e0439
Fix cpp code coverage bug (#8203)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-18 16:15:51 +08:00
yukun 82e48fb379
Add more error messages in segcore visitors (#8195)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-18 15:53:51 +08:00
xige-16 5046cbe5d8
Fix logic error in release collection (#8188)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-18 15:51:51 +08:00
groot 334297b49d
[skip ci] Update OWNERS files (#8211)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-18 15:30:37 +08:00
congqixia bdfb8768d4
Enable gosec (#8202)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-18 14:45:50 +08:00
Cai Yudong 2a946707b9
[skip ci] Update test_concurrent_vector.cpp (#8205)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 14:41:50 +08:00
XuanYang-cn 46c72c57c2
Add BufferData in insertbufferNode (#8138)
Optimize bufferInsertMsg param to avoid a second transfer
of endposition

See also: #8058, #7741

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-18 14:25:50 +08:00
Yusup ccb57ba4b2
add collection alias (#7255)
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-18 11:13:51 +08:00
cai.zhang a6b6d16381
Delete unused code in indexnode (#8169)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-18 11:05:50 +08:00
godchen b3f965c7d4
Add unrecoverable error for retry. (#7828)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 10:49:51 +08:00
Cai Yudong 83bf9c5efb
Add knowhere.yaml to support knowhere configuration (#7967)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 10:37:51 +08:00
godchen c8c10bb3d6
Remove performanceTest (#8164)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 10:13:52 +08:00
bigsheeper 338e32362b
Return error if setSegment failed when loadSegment (#8075)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-18 10:03:50 +08:00
nameczz d5d063df7c
[skip ci] improve milvus.proto comments (#8063)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-09-18 09:33:51 +08:00
Cai Yudong d10c6abc9e
Apply for msgstream from pool when creating collection (#7738)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 09:13:50 +08:00
cai.zhang 8d5dc5ba07
Add comment for CreateIndex in indexnode (#8168)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-18 00:01:51 +08:00
godchen 74bb712527
[skip ci]Add minio comment (#8165)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 23:59:47 +08:00
congqixia 266db4c883
Add readme for datacoord (#8141)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-17 23:57:55 +08:00
Xiangyu Wang 8b21a4b596
Add unit tests for msg.go (#8150)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-17 23:55:50 +08:00
yukun 46871fcaec
Remove unused code in queryTask (#8077)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-17 21:57:58 +08:00
bigsheeper ee3ab7a783
Add comment for dataSyncService (#8157)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-17 21:55:53 +08:00
dragondriver c3eb6f9761
Expose created time and updated time to rootcoord metrics (#8174)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 21:52:00 +08:00
dragondriver daf001f683
Expose created time and updated time to datanode metrics (#8173)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 21:32:47 +08:00
cai.zhang 57e46c5f2c
Start once for indexcoord (#8026)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-17 20:17:53 +08:00
dragondriver 4f9d124ed4
Fix data race of proxy ut (#8119)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 19:45:42 +08:00
Xiangyu Wang b7b28abd77
Remove mem_msgstream that is no longer needed (#8155)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-17 18:43:54 +08:00
congqixia a972fafb5f
Fix proxy ut may hang with dn graceful stop (#8124)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-17 17:49:58 +08:00
sunby b84f017dde
Add comment for CreatePartition (#8031)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-17 17:35:53 +08:00
godchen 9e1b4dcd6f
Make init private (#8104)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 16:29:51 +08:00
XuanYang-cn 6c434b4801
Improve codes in insertbuffernode (#8054)
Add error handling in insertbuffernode

See also: #7624, #7684

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-17 16:27:56 +08:00
XuanYang-cn 82d4d19337
Remove not in use segmentCheckPoints (#8039)
Resolves: #8037

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-17 16:25:55 +08:00
Xiangyu Wang 422b7dcf3e
Add unit tests for mq_factory (#8140)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-17 16:23:51 +08:00
congqixia 05efb3a029
Fix use address of loop var (#7433)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-17 16:21:50 +08:00
godchen 31df0faaf5
[skip ci]Add chunk manager comment (#7833)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 14:49:50 +08:00
Xiangyu Wang 1ee17464e8
Fix possible datarace in rootcoord (#8120)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-17 12:37:50 +08:00
bigsheeper 9601cb2ee6
Add failed streming unittest for query node (#7960)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-17 11:37:49 +08:00
bigsheeper c9b6a92366
Add release failed case unittest for query node (#7971)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-17 11:35:49 +08:00
godchen 295ee49472
Add trace comment (#7994)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 11:17:57 +08:00
sunby c0ede30c6e
Add comment for ShowCollections (#8032)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-17 11:15:53 +08:00
godchen 96539f02d8
Add data codec comment (#7998)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 11:05:49 +08:00
zhenshan.cao 4c184921f0
Add comments and enchanme unittest for retrieve (#8114)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-16 23:43:49 +08:00
Xiaofan d6f0c5069f
[skip ci] Add comments for memory message queue (#8018)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-16 23:41:49 +08:00
zhenshan.cao 5cd9ea5f04
Fixbug: init optional retrieve_ret_ when query result is empty (#8068)
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-16 20:11:49 +08:00
congqixia 4fe22bcaaa
Fix query task panicking (#8060)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-16 20:03:50 +08:00
cai.zhang fa00f1f48a
It is also correct to get the failed index status in indexcoord ut (#8059)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-16 19:56:41 +08:00
congqixia 01c8341a2e
[skip ci]Add comments for SegmentManager (#8087)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-16 19:55:49 +08:00
dragondriver ca2d09a167
Fix data race of proxy grpc client (#8091)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-16 19:31:59 +08:00
dragondriver 9bbff86c81
Fix data race of rootcoord grpc client (#8078)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-16 18:15:49 +08:00
groot 1fd0e79add
Add unittest for distributed datacoord (#7982)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-16 14:17:49 +08:00
dragondriver 10321e0a1a
Cover error cases that timeout is too small (#8038)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-16 14:09:49 +08:00
groot c40cdb599a
Add unittest for distributed rootcoord (#7997)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-16 12:33:49 +08:00
groot e6450b0d96
Add unittest for distributed indexnode (#7991)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-16 12:31:53 +08:00
groot 75c80c12cb
Add unittest for distributed datanode (#7987)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-16 12:29:53 +08:00
dragondriver bf2ebc794d
Cover error cases that task queue is full (#8033)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-16 11:29:49 +08:00
yukun 8b3893e030
Add more error messages in segcore (#8012)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-16 10:23:53 +08:00
nameczz 8ee55aad0a
[skip ci] improve DescribeCollection comments (#7882)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-09-16 10:21:53 +08:00
cai.zhang 4814f9cb1c
Add opentrace log for index component (#7946)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-16 10:07:48 +08:00
bigsheeper b465e8f9a4
Remove redundant check and add addQueryChannel unittest for query node (#7944)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-16 09:47:48 +08:00
yukun e0761271dd
[skip ci]Add rocksmq_retention comment (#8016)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-15 23:29:48 +08:00
Xiangyu Wang 0aa65f559a
Rename unit tests to meet new naming conventions (#8017)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-15 23:11:49 +08:00
xige-16 2bcb3f4916
Modify querycoord's log info (#8005)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-15 22:17:49 +08:00
groot 8fb961a0b0
Add unittest for distributed querynode (#7996)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 22:15:53 +08:00
groot 0404e3c243
Add unittest for distributed querycoord (#7993)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 22:13:57 +08:00
groot ed322cfd8e
Add unittest for distributed indexcoord (#7990)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 22:12:02 +08:00
cai.zhang 130817d8c6
Add comment for indexcoord (#7950)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-15 22:09:50 +08:00
congqixia 675b71cc30
Replace metaSnapshot with suffixSnapshot (#7975)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 22:05:49 +08:00
yukun 9a6f2e618c
Change Assert to AssertInfo in SegmentGrowing (#7952)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-15 22:04:39 +08:00
XuanYang-cn 3db76e8e59
[skip-ci]Add comment in data sync service (#8002)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-15 21:25:49 +08:00
congqixia 2bca69596e
Add some comment for SegmentsInfo (#7995)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 21:07:53 +08:00
congqixia c76f91233f
Put errors together (#7958)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 21:05:52 +08:00
xige-16 c63086fefa
Add ut for querycoord's cluster (#7894)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-15 20:40:07 +08:00
godchen 863444cc45
Delete performance (#8000)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-15 20:29:48 +08:00
dragondriver 7f048ea8c8
Support to set max task number of task queue (#7974)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 19:09:50 +08:00
XuanYang-cn ff8fef6ad0
Upgrade pulsar-client-go to 0.6.0 (#7909)
MessageID interface of pulsar-client-go adds
4 more methods. So I add these methods into
`MessageID` interface.

Resolves: #7770

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-15 18:13:49 +08:00
dragondriver 502cb68c08
Fix the logic of waiting for collection to be loaded (#7978)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 17:34:02 +08:00
yukun 13f9b32452
Improve global_rmq code coverage (#7928)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-15 17:31:49 +08:00
groot 2398dafbca
Add unittest for distributed proxy (#7976)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 17:29:49 +08:00
dragondriver d2e18fd53b
Cover error cases that proxy is unhealthy (#7951)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 15:46:06 +08:00
bigsheeper 18431c1549
Add historical failed unittest for querynode (#7941)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-15 15:25:49 +08:00
congqixia 55c47ab508
Add suffixSnapshot implementing SnapshotKV (#7948)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 15:23:49 +08:00
Cai Yudong 14ef405a6b
Rename chunk_size to chunk_rows for better code readability (#7953)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 15:15:52 +08:00
Cai Yudong ab84f95e66
[skip ci] Update debug log (#7956)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 14:39:48 +08:00
dragondriver 5f3b961502
Add test case for delete task (#7939)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 14:04:54 +08:00
Cai Yudong a0fd2707cb
Support config SIMD type (#7942)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 12:57:48 +08:00
sunby 095b7c12c1
Add insert codec comment (#7891)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-15 10:47:48 +08:00
Cai Yudong e6c384b4d4
Move segcore chunk_size configuration to querynode.yaml (#7913)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 10:35:52 +08:00
XuanYang-cn 376d39fa02
[skip-ci]Add comment for Cache and allocator (#7924)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-15 10:33:37 +08:00
dragondriver cf1d773259
Add test cases for metrics info of proxy (#7927)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 10:13:49 +08:00
bigsheeper 0b849d3089
Add insert node failed unittests for query node (#7914)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-15 10:11:48 +08:00
bigsheeper bc1f39bb55
Remove deprecated replica interface in query node (#7908)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-15 10:09:53 +08:00
bigsheeper dfc2535aaa
Use different schema generation functions (#7884)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-15 10:07:56 +08:00
Cai Yudong c16ab5b35c
Use better segcoe variable name (#7869)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 10:06:00 +08:00
Xiaofan c72cff2dc2
[skip ci] Remove Unnecessary logs in pickCanDoFunc (#7932)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-15 10:01:48 +08:00
Xiaofan d0667b58d7
Change Error Msg When dimension of vector field not exist (#7931)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-15 10:01:30 +08:00
dragondriver 2382be82a5
Add test case for the workflow of insert task (#7912)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-14 19:07:48 +08:00
yukun 80ae6b7d31
Change Assert to AssertInfo in SegmentSealedImpl (#7903)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-14 18:43:48 +08:00
congqixia 7d53e44f3b
Depress gosec false positive (#7899)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-14 18:37:48 +08:00
congqixia 06d4faf771
Fix G109 from gosec, prevents overflow (#7896)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-14 18:35:48 +08:00
sunby eed856d626
Change error message to lower case (#7890)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-14 17:33:48 +08:00
sunby 9c2fb0bccb
Recorrect comment for Allocation (#7887)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-14 17:27:55 +08:00
congqixia 98732b3d43
Remove duplicated code in msgs (#7801)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-14 17:07:48 +08:00
dragondriver ec776a30dc
Add test case for the workflow of query task (#7886)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-14 16:19:08 +08:00
yukun 4bf3c6889c
Support bool field filter in search and query expression (#7814)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-14 16:15:47 +08:00
Cai Yudong 4dc9a64f01
Improve segcore code readability (#7868)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 16:07:48 +08:00
cai.zhang b965767e5c
Increase code coverage rate for indexcoord (#7857)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-14 14:09:48 +08:00
dragondriver f122e93383
Proxy ut cover case that search task process the fields data (#7874)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-14 14:09:05 +08:00
zhenshan.cao e5e4b24954
Fix bug: describe collection return wrong shard number (#7841)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-14 11:59:47 +08:00
Cai Yudong b5923ff27d
Update segcore unittest format (#7860)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 11:22:57 +08:00
Cai Yudong 74ac528095
Improve segcore (#7851)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 10:53:04 +08:00
cai.zhang 63a83f027f
Reduce running unit test time for indexcoord (#7779)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-14 10:41:21 +08:00
cai.zhang 8a458b7a38
Add log for building index about num rows (#7811)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-14 10:27:06 +08:00
bigsheeper 691e4c5bc9
Use definitional type instead of raw type (#7797)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-14 10:25:26 +08:00
bigsheeper 27beb033de
Add task unittest for query node (#7820)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-14 10:24:48 +08:00
dragondriver bcf9b4e240
Coverage error case of searchTask.PreExecute (#7826)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-14 10:24:00 +08:00
bigsheeper 664d4ca923
Fix index loader test (#7805)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-14 10:21:08 +08:00
yukun 5c997710ab
Change Assert() to AssertInfo() to return error messages (#7843)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-14 10:06:40 +08:00
yukun f1366b9451
Rename rocksmq unittests (#7846)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-14 09:55:00 +08:00
Xiaofan 00a5c39c2f
Remove unnecessary variables in allocator (#7849)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-14 09:54:31 +08:00
nameczz 87460665e0
improve HasCollectionRequest and DropCollectionRequest comments (#7693)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-09-14 09:53:21 +08:00
Xiangyu Wang 60c11c85ad
[skip ci]Rename unit tests (#7844)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-13 21:24:58 +08:00
dragondriver 8d239b6473
Add test cases for search task (#7796)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-13 17:12:19 +08:00
congqixia 85d73358cc
Remove ctx from LongTermChecker (#7792)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-13 16:50:57 +08:00
bigsheeper 73ab06c628
Decrease unittests execution time in query node (#7791)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-13 16:37:01 +08:00
groot c242b8bb25
Rename unittest for flowgraph (#7794)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-13 16:34:26 +08:00
groot 203010524d
Rename unittest for metricsinfo (#7795)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-13 16:33:27 +08:00
groot a953c912b2
Add unittest for timeticksync (#7793)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-13 16:32:44 +08:00
congqixia e2c15d5b01
[skip ci]Add comment for ClusterStore (#7785)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-13 15:59:55 +08:00
cai.zhang b1805d980c
Reduce running unit test time for indexnode (#7773)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-13 12:00:08 +08:00
cai.zhang 9b0aacd07a
Increase code coverage rate for proxy (#7727)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-13 11:58:11 +08:00
sunby 4c18910acd
Improve log print in rootcoord (#7354)
issue: #7306
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-13 11:56:42 +08:00
zhenshan.cao db7fdefcd0
Add unittest for proxy (#7764)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-13 10:56:03 +08:00
Xiaofan 619c4393f3
Refine logs in proxy search path(#7357) (#7753)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-12 17:54:01 +08:00
dragondriver 5a3fc37584
Add test cases for create collection (#7759)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-11 18:06:02 +08:00
bigsheeper ab7ded2202
Add loader and streaming unittests for query node (#7762)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-11 17:56:01 +08:00
bigsheeper 44bc0af063
Add node and queryCollection unittests for query node (#7719)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-11 17:26:01 +08:00
bigsheeper 3c01839d0d
Add impl and plan unittests for query node (#7712)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-11 17:22:01 +08:00
Cai Yudong 27dcf698d3
Support set segcore chunk_size via config file (#7635)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-11 14:40:01 +08:00
dragondriver a872a4357c
Add more test cases for proxy implementation (#7685)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-11 11:36:22 +08:00
yukun 92295b77a1
Add DestroyTopic and DestroyConsumerGroup for CloseRocksMQ (#7730)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-10 20:54:01 +08:00
xige-16 15a6f30ac4
Add ut for querycoord's impl (#7728)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-10 19:14:01 +08:00
bigsheeper 0e81c62031
Check collection and plan before calling cgo functions (#7733)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-10 18:12:01 +08:00
groot c8f860dcfb
Add unittest for proxy_client_manager (#7729)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-10 18:10:00 +08:00
yukun d60ea8bc21
Change prefix length to FixedChannelNameLen + 1 (#7717)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-10 17:42:10 +08:00
bigsheeper cb5cd1cf12
Add index unittests for query node (#7674)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-10 17:11:09 +08:00