milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,004 Commits
136 Branches
115 Tags
568 MiB
Commit Graph

2049 Commits (939afc866bfd63ca26fe46ee882641b5874e360d)

Author SHA1 Message Date
Cai Yudong bc7fc50493
Clean golint warnings for distributed/rootcoord (#8357) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-23 11:41:53 +08:00
dragondriver fb98f06de8
Expose simd type to index node metrics (#8300) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-23 11:29:54 +08:00
dragondriver b3f6bd2088
Expose simd type to query node metrics (#8299) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-23 11:27:54 +08:00
Xiaofan f5173b595f
Add a channel prefix for all channels (#8166) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-23 10:53:53 +08:00
Cai Yudong a62bce360b
Replace MarshalTextString with Marshal in rootcoord (#8341) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-23 10:37:54 +08:00
Cai Yudong 340f92ab16
Update querycoord proto (#8342) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-23 00:41:53 +08:00
congqixia 9ebfd43195
Add comment for proxyManager (#8266) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-22 23:55:53 +08:00
XuanYang-cn 4ee8275b88
Fix master compile error (#8333) 
Resolves: #8336

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-22 20:31:54 +08:00
Xiaofan 2f92f78e7b
Remove meaningless Etcd kv logs (#8019) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-22 20:27:54 +08:00
yukun 9e17fdb598
Improve rocksmq codecov (#8328) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-22 20:16:04 +08:00
nameczz b6cea6539b
[skip ci] Improve ShowCollections in milvus.proto (#8200) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-09-22 20:14:08 +08:00
sunby 3fc1b9cf9f
Change copyright (#8318) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-22 20:12:08 +08:00
bigsheeper 220d17500c
[skip ci] Add comment for query node flow graph (#8326) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-22 20:10:09 +08:00
bigsheeper 11a4109747
[skip ci] Add comment for query coord proto (#8325) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-22 20:06:09 +08:00
bigsheeper f8ca5dbf55
[skip ci] Add comment for query coord proto (#8322) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-22 20:04:13 +08:00
godchen 050e27cbcf
[skip ci]Add delete node comment (#8323) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-22 20:02:09 +08:00
sunby 82dd762ef0
Change copyright (#8317) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-22 19:59:59 +08:00
congqixia c676979217
Add error detail when ddl fail (#8304) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-22 19:50:15 +08:00
cai.zhang 0d9ab7ab7d
Remove useless debug message in indexbuilder (#8303) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-22 19:37:53 +08:00
cai.zhang 729d409a32
Add trace log for search (#8302) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-22 19:36:00 +08:00
cai.zhang 79b7dcc75a
Add trace log for insert (#8301) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-22 19:33:54 +08:00
cai.zhang 41a6f9b5f7
Init once for IndexCoord (#8028) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-22 19:31:54 +08:00
sunby b46307388f
Add comment for GetTimeTickChannel (#8217) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-22 18:21:53 +08:00
yukun c5beef16a9
Add error msgs in segcore visitors (#8306) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-22 18:07:54 +08:00
godchen 75672abab4
Add lease time (#8064) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-22 17:50:00 +08:00
Cai Yudong 83ffa18c37
[skip ci] Update test_concurrent_vector (#8273) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-22 17:21:53 +08:00
yukun 06c9f03c59
Refactor rocksmq close logic and improve codecov (#8278) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-22 17:21:00 +08:00
Cai Yudong 07aa453270
[skip ci] Update test_segcore (#8270) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-22 17:19:53 +08:00
sunby 1cb8c31794
Add comment for CreateCollection (#8023) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-22 17:11:54 +08:00
Yusup bdfb78e936
Add aliases to DescribeCollection (#8268) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-09-22 16:20:48 +08:00
dragondriver 85a6953330
Support healthz check api (#8228) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-22 16:18:21 +08:00
dragondriver 6345d05bf4
Fix collection alias ut (#8292) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-22 16:10:07 +08:00
dragondriver 78fe530d87
Initialize the simd type when initialize an indexnode (#8276) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-22 16:05:59 +08:00
xige-16 2e160f51bc
Add default test nodeID in querycoord's mock test (#8224) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-09-22 11:31:59 +08:00
bigsheeper 0e2b4a7cd8
Add comment for queryCoordMock (#8223) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-22 11:30:07 +08:00
bigsheeper 36dd794986
Add comment for type def in query node (#8220) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-22 11:28:04 +08:00
sunby 5c5c4b004c
Add comment for GetComponentStates (#8216) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-22 10:43:53 +08:00
dragondriver b2e8ba7b33
Fix reduce algorithm in proxy search task (#8206) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-22 10:15:54 +08:00
Cai Yudong c1e229cb7e
Add segcore logger (#8262) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-22 10:11:52 +08:00
sunby c0331eba6a
Add comment for AssignSegmentID (#8152) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-22 10:07:53 +08:00
sunby fe1e1ce523
Add comment for DropCollection (#8024) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-22 10:05:58 +08:00
Xiaofan 0c35cd57b0
Unify param table to the same naming format (#8254) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-20 23:27:52 +08:00
Xiaofan acfd7c7911
[skip ci] Fix typo in binlog writer (#8255) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-18 22:55:51 +08:00
yukun 269e041e34
[skip ci]Fix typo (#8251) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-18 19:53:51 +08:00
congqixia 21f15d66bb
Add option for DataNode creation (#8240) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-18 19:10:07 +08:00
Xiangyu Wang f203f750aa
Improve import statements in msgstream (#8237) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-18 19:06:09 +08:00
Xiangyu Wang 32c6033f4a
Add unit tests for msg.go (#8227) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-18 19:04:04 +08:00
godchen d1d3993689
[skip ci]Add binlog reader comment (#8230) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-18 18:57:51 +08:00
xige-16 e75693e1a3
Add log for release collection task (#8226) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-09-18 18:45:51 +08:00
godchen 3f5e876188
[skip ci]Add binlog writer comment (#8231) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-18 18:39:56 +08:00
godchen 0cf0217ed5
[skip ci]Add event data comment (#8232) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-18 18:37:56 +08:00
bigsheeper 1f1c738016
Add loadFieldData unittest for query node (#8219) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-18 18:32:07 +08:00
Xiangyu Wang c314b2b4a8
Remove unused label rules (#7929) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-18 18:19:51 +08:00
bigsheeper 11c65dc2b3
Add comment for collection replica (#8147) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-18 18:15:51 +08:00
bigsheeper 223044a7ca
Rename name of unittests in query node (#8225) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-18 18:05:51 +08:00
sunby a16fb4cf39
Add comment for GetSegmentStates (#8153) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-18 16:49:51 +08:00
sunby 9daf9dce1a
Add comment for flush (#8151) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-18 16:47:56 +08:00
sunby ab55a39b7d
Add comment for DescribeCollection (#8030) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-18 16:46:01 +08:00
sunby 77634c473d
Add comment for GetStatisticsChannel (#8218) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-18 16:35:51 +08:00
sunby 3dad7b5aa8
Add comment for HasCollection (#8025) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-18 16:27:51 +08:00
groot b6e43e0439
Fix cpp code coverage bug (#8203) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-18 16:15:51 +08:00
yukun 82e48fb379
Add more error messages in segcore visitors (#8195) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-18 15:53:51 +08:00
xige-16 5046cbe5d8
Fix logic error in release collection (#8188) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-09-18 15:51:51 +08:00
groot 334297b49d
[skip ci] Update OWNERS files (#8211) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-18 15:30:37 +08:00
congqixia bdfb8768d4
Enable gosec (#8202) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-18 14:45:50 +08:00
Cai Yudong 2a946707b9
[skip ci] Update test_concurrent_vector.cpp (#8205) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-18 14:41:50 +08:00
XuanYang-cn 46c72c57c2
Add BufferData in insertbufferNode (#8138) 
Optimize bufferInsertMsg param to avoid a second transfer
of endposition

See also: #8058, #7741

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-18 14:25:50 +08:00
Yusup ccb57ba4b2
add collection alias (#7255) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-09-18 11:13:51 +08:00
cai.zhang a6b6d16381
Delete unused code in indexnode (#8169) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-18 11:05:50 +08:00
godchen b3f965c7d4
Add unrecoverable error for retry. (#7828) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-18 10:49:51 +08:00
Cai Yudong 83bf9c5efb
Add knowhere.yaml to support knowhere configuration (#7967) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-18 10:37:51 +08:00
godchen c8c10bb3d6
Remove performanceTest (#8164) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-18 10:13:52 +08:00
bigsheeper 338e32362b
Return error if setSegment failed when loadSegment (#8075) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-18 10:03:50 +08:00
nameczz d5d063df7c
[skip ci] improve milvus.proto comments (#8063) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-09-18 09:33:51 +08:00
Cai Yudong d10c6abc9e
Apply for msgstream from pool when creating collection (#7738) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-18 09:13:50 +08:00
cai.zhang 8d5dc5ba07
Add comment for CreateIndex in indexnode (#8168) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-18 00:01:51 +08:00
godchen 74bb712527
[skip ci]Add minio comment (#8165) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-17 23:59:47 +08:00
congqixia 266db4c883
Add readme for datacoord (#8141) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-17 23:57:55 +08:00
Xiangyu Wang 8b21a4b596
Add unit tests for msg.go (#8150) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-17 23:55:50 +08:00
yukun 46871fcaec
Remove unused code in queryTask (#8077) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-17 21:57:58 +08:00
bigsheeper ee3ab7a783
Add comment for dataSyncService (#8157) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-17 21:55:53 +08:00
dragondriver c3eb6f9761
Expose created time and updated time to rootcoord metrics (#8174) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-17 21:52:00 +08:00
dragondriver daf001f683
Expose created time and updated time to datanode metrics (#8173) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-17 21:32:47 +08:00
cai.zhang 57e46c5f2c
Start once for indexcoord (#8026) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-17 20:17:53 +08:00
dragondriver 4f9d124ed4
Fix data race of proxy ut (#8119) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-17 19:45:42 +08:00
Xiangyu Wang b7b28abd77
Remove mem_msgstream that is no longer needed (#8155) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-17 18:43:54 +08:00
congqixia a972fafb5f
Fix proxy ut may hang with dn graceful stop (#8124) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-17 17:49:58 +08:00
sunby b84f017dde
Add comment for CreatePartition (#8031) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-17 17:35:53 +08:00
godchen 9e1b4dcd6f
Make init private (#8104) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-17 16:29:51 +08:00
XuanYang-cn 6c434b4801
Improve codes in insertbuffernode (#8054) 
Add error handling in insertbuffernode

See also: #7624, #7684

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-17 16:27:56 +08:00
XuanYang-cn 82d4d19337
Remove not in use segmentCheckPoints (#8039) 
Resolves: #8037

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-17 16:25:55 +08:00
Xiangyu Wang 422b7dcf3e
Add unit tests for mq_factory (#8140) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-17 16:23:51 +08:00
congqixia 05efb3a029
Fix use address of loop var (#7433) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-17 16:21:50 +08:00
godchen 31df0faaf5
[skip ci]Add chunk manager comment (#7833) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-17 14:49:50 +08:00
Xiangyu Wang 1ee17464e8
Fix possible datarace in rootcoord (#8120) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-17 12:37:50 +08:00
bigsheeper 9601cb2ee6
Add failed streming unittest for query node (#7960) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-17 11:37:49 +08:00
bigsheeper c9b6a92366
Add release failed case unittest for query node (#7971) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-17 11:35:49 +08:00
godchen 295ee49472
Add trace comment (#7994) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-17 11:17:57 +08:00
sunby c0ede30c6e
Add comment for ShowCollections (#8032) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-17 11:15:53 +08:00
godchen 96539f02d8
Add data codec comment (#7998) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-17 11:05:49 +08:00
zhenshan.cao 4c184921f0
Add comments and enchanme unittest for retrieve (#8114) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-16 23:43:49 +08:00
Xiaofan d6f0c5069f
[skip ci] Add comments for memory message queue (#8018) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-16 23:41:49 +08:00
zhenshan.cao 5cd9ea5f04
Fixbug: init optional retrieve_ret_ when query result is empty (#8068) 
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-16 20:11:49 +08:00
congqixia 4fe22bcaaa
Fix query task panicking (#8060) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-16 20:03:50 +08:00
cai.zhang fa00f1f48a
It is also correct to get the failed index status in indexcoord ut (#8059) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-16 19:56:41 +08:00
congqixia 01c8341a2e
[skip ci]Add comments for SegmentManager (#8087) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-16 19:55:49 +08:00
dragondriver ca2d09a167
Fix data race of proxy grpc client (#8091) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-16 19:31:59 +08:00
dragondriver 9bbff86c81
Fix data race of rootcoord grpc client (#8078) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-16 18:15:49 +08:00
groot 1fd0e79add
Add unittest for distributed datacoord (#7982) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-16 14:17:49 +08:00
dragondriver 10321e0a1a
Cover error cases that timeout is too small (#8038) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-16 14:09:49 +08:00
groot c40cdb599a
Add unittest for distributed rootcoord (#7997) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-16 12:33:49 +08:00
groot e6450b0d96
Add unittest for distributed indexnode (#7991) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-16 12:31:53 +08:00
groot 75c80c12cb
Add unittest for distributed datanode (#7987) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-16 12:29:53 +08:00
dragondriver bf2ebc794d
Cover error cases that task queue is full (#8033) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-16 11:29:49 +08:00
yukun 8b3893e030
Add more error messages in segcore (#8012) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-16 10:23:53 +08:00
nameczz 8ee55aad0a
[skip ci] improve DescribeCollection comments (#7882) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-09-16 10:21:53 +08:00
cai.zhang 4814f9cb1c
Add opentrace log for index component (#7946) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-16 10:07:48 +08:00
bigsheeper b465e8f9a4
Remove redundant check and add addQueryChannel unittest for query node (#7944) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-16 09:47:48 +08:00
yukun e0761271dd
[skip ci]Add rocksmq_retention comment (#8016) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-15 23:29:48 +08:00
Xiangyu Wang 0aa65f559a
Rename unit tests to meet new naming conventions (#8017) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-15 23:11:49 +08:00
xige-16 2bcb3f4916
Modify querycoord's log info (#8005) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-09-15 22:17:49 +08:00
groot 8fb961a0b0
Add unittest for distributed querynode (#7996) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-15 22:15:53 +08:00
groot 0404e3c243
Add unittest for distributed querycoord (#7993) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-15 22:13:57 +08:00
groot ed322cfd8e
Add unittest for distributed indexcoord (#7990) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-15 22:12:02 +08:00
cai.zhang 130817d8c6
Add comment for indexcoord (#7950) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-15 22:09:50 +08:00
congqixia 675b71cc30
Replace metaSnapshot with suffixSnapshot (#7975) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-15 22:05:49 +08:00
yukun 9a6f2e618c
Change Assert to AssertInfo in SegmentGrowing (#7952) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-15 22:04:39 +08:00
XuanYang-cn 3db76e8e59
[skip-ci]Add comment in data sync service (#8002) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-15 21:25:49 +08:00
congqixia 2bca69596e
Add some comment for SegmentsInfo (#7995) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-15 21:07:53 +08:00
congqixia c76f91233f
Put errors together (#7958) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-15 21:05:52 +08:00
xige-16 c63086fefa
Add ut for querycoord's cluster (#7894) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-09-15 20:40:07 +08:00
godchen 863444cc45
Delete performance (#8000) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-15 20:29:48 +08:00
dragondriver 7f048ea8c8
Support to set max task number of task queue (#7974) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-15 19:09:50 +08:00
XuanYang-cn ff8fef6ad0
Upgrade pulsar-client-go to 0.6.0 (#7909) 
MessageID interface of pulsar-client-go adds
4 more methods. So I add these methods into
`MessageID` interface.

Resolves: #7770

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-15 18:13:49 +08:00
dragondriver 502cb68c08
Fix the logic of waiting for collection to be loaded (#7978) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-15 17:34:02 +08:00
yukun 13f9b32452
Improve global_rmq code coverage (#7928) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-15 17:31:49 +08:00
groot 2398dafbca
Add unittest for distributed proxy (#7976) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-15 17:29:49 +08:00
dragondriver d2e18fd53b
Cover error cases that proxy is unhealthy (#7951) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-15 15:46:06 +08:00
bigsheeper 18431c1549
Add historical failed unittest for querynode (#7941) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-15 15:25:49 +08:00
congqixia 55c47ab508
Add suffixSnapshot implementing SnapshotKV (#7948) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-15 15:23:49 +08:00
Cai Yudong 14ef405a6b
Rename chunk_size to chunk_rows for better code readability (#7953) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 15:15:52 +08:00
Cai Yudong ab84f95e66
[skip ci] Update debug log (#7956) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 14:39:48 +08:00
dragondriver 5f3b961502
Add test case for delete task (#7939) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-15 14:04:54 +08:00
Cai Yudong a0fd2707cb
Support config SIMD type (#7942) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 12:57:48 +08:00
sunby 095b7c12c1
Add insert codec comment (#7891) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-15 10:47:48 +08:00
Cai Yudong e6c384b4d4
Move segcore chunk_size configuration to querynode.yaml (#7913) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 10:35:52 +08:00
XuanYang-cn 376d39fa02
[skip-ci]Add comment for Cache and allocator (#7924) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-15 10:33:37 +08:00
dragondriver cf1d773259
Add test cases for metrics info of proxy (#7927) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-15 10:13:49 +08:00
bigsheeper 0b849d3089
Add insert node failed unittests for query node (#7914) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-15 10:11:48 +08:00
bigsheeper bc1f39bb55
Remove deprecated replica interface in query node (#7908) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-15 10:09:53 +08:00
bigsheeper dfc2535aaa
Use different schema generation functions (#7884) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-15 10:07:56 +08:00
Cai Yudong c16ab5b35c
Use better segcoe variable name (#7869) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 10:06:00 +08:00
Xiaofan c72cff2dc2
[skip ci] Remove Unnecessary logs in pickCanDoFunc (#7932) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-15 10:01:48 +08:00
Xiaofan d0667b58d7
Change Error Msg When dimension of vector field not exist (#7931) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-15 10:01:30 +08:00
dragondriver 2382be82a5
Add test case for the workflow of insert task (#7912) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-14 19:07:48 +08:00
yukun 80ae6b7d31
Change Assert to AssertInfo in SegmentSealedImpl (#7903) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-14 18:43:48 +08:00
congqixia 7d53e44f3b
Depress gosec false positive (#7899) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-14 18:37:48 +08:00
congqixia 06d4faf771
Fix G109 from gosec, prevents overflow (#7896) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-14 18:35:48 +08:00
sunby eed856d626
Change error message to lower case (#7890) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-14 17:33:48 +08:00
sunby 9c2fb0bccb
Recorrect comment for Allocation (#7887) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-14 17:27:55 +08:00
congqixia 98732b3d43
Remove duplicated code in msgs (#7801) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-14 17:07:48 +08:00
dragondriver ec776a30dc
Add test case for the workflow of query task (#7886) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-14 16:19:08 +08:00
yukun 4bf3c6889c
Support bool field filter in search and query expression (#7814) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-14 16:15:47 +08:00
Cai Yudong 4dc9a64f01
Improve segcore code readability (#7868) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-14 16:07:48 +08:00
cai.zhang b965767e5c
Increase code coverage rate for indexcoord (#7857) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-14 14:09:48 +08:00
dragondriver f122e93383
Proxy ut cover case that search task process the fields data (#7874) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-14 14:09:05 +08:00
zhenshan.cao e5e4b24954
Fix bug: describe collection return wrong shard number (#7841) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-14 11:59:47 +08:00
Cai Yudong b5923ff27d
Update segcore unittest format (#7860) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-14 11:22:57 +08:00
Cai Yudong 74ac528095
Improve segcore (#7851) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-14 10:53:04 +08:00
cai.zhang 63a83f027f
Reduce running unit test time for indexcoord (#7779) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-14 10:41:21 +08:00
cai.zhang 8a458b7a38
Add log for building index about num rows (#7811) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-14 10:27:06 +08:00
bigsheeper 691e4c5bc9
Use definitional type instead of raw type (#7797) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-14 10:25:26 +08:00
bigsheeper 27beb033de
Add task unittest for query node (#7820) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-14 10:24:48 +08:00
dragondriver bcf9b4e240
Coverage error case of searchTask.PreExecute (#7826) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-14 10:24:00 +08:00
bigsheeper 664d4ca923
Fix index loader test (#7805) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-14 10:21:08 +08:00
yukun 5c997710ab
Change Assert() to AssertInfo() to return error messages (#7843) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-14 10:06:40 +08:00
yukun f1366b9451
Rename rocksmq unittests (#7846) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-14 09:55:00 +08:00
Xiaofan 00a5c39c2f
Remove unnecessary variables in allocator (#7849) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-14 09:54:31 +08:00
nameczz 87460665e0
improve HasCollectionRequest and DropCollectionRequest comments (#7693) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-09-14 09:53:21 +08:00
Xiangyu Wang 60c11c85ad
[skip ci]Rename unit tests (#7844) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-13 21:24:58 +08:00
dragondriver 8d239b6473
Add test cases for search task (#7796) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-13 17:12:19 +08:00
congqixia 85d73358cc
Remove ctx from LongTermChecker (#7792) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-13 16:50:57 +08:00
bigsheeper 73ab06c628
Decrease unittests execution time in query node (#7791) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-13 16:37:01 +08:00
groot c242b8bb25
Rename unittest for flowgraph (#7794) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-13 16:34:26 +08:00
groot 203010524d
Rename unittest for metricsinfo (#7795) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-13 16:33:27 +08:00
groot a953c912b2
Add unittest for timeticksync (#7793) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-13 16:32:44 +08:00
congqixia e2c15d5b01
[skip ci]Add comment for ClusterStore (#7785) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-13 15:59:55 +08:00
cai.zhang b1805d980c
Reduce running unit test time for indexnode (#7773) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-13 12:00:08 +08:00
cai.zhang 9b0aacd07a
Increase code coverage rate for proxy (#7727) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-13 11:58:11 +08:00
sunby 4c18910acd
Improve log print in rootcoord (#7354) 
issue: #7306
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-13 11:56:42 +08:00
zhenshan.cao db7fdefcd0
Add unittest for proxy (#7764) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-13 10:56:03 +08:00
Xiaofan 619c4393f3
Refine logs in proxy search path(#7357) (#7753) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-12 17:54:01 +08:00
dragondriver 5a3fc37584
Add test cases for create collection (#7759) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-11 18:06:02 +08:00
bigsheeper ab7ded2202
Add loader and streaming unittests for query node (#7762) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-11 17:56:01 +08:00
bigsheeper 44bc0af063
Add node and queryCollection unittests for query node (#7719) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-11 17:26:01 +08:00
bigsheeper 3c01839d0d
Add impl and plan unittests for query node (#7712) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-11 17:22:01 +08:00
Cai Yudong 27dcf698d3
Support set segcore chunk_size via config file (#7635) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-11 14:40:01 +08:00
dragondriver a872a4357c
Add more test cases for proxy implementation (#7685) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-11 11:36:22 +08:00
yukun 92295b77a1
Add DestroyTopic and DestroyConsumerGroup for CloseRocksMQ (#7730) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-10 20:54:01 +08:00
xige-16 15a6f30ac4
Add ut for querycoord's impl (#7728) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-09-10 19:14:01 +08:00
bigsheeper 0e81c62031
Check collection and plan before calling cgo functions (#7733) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-10 18:12:01 +08:00
groot c8f860dcfb
Add unittest for proxy_client_manager (#7729) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-10 18:10:00 +08:00
yukun d60ea8bc21
Change prefix length to FixedChannelNameLen + 1 (#7717) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-10 17:42:10 +08:00
bigsheeper cb5cd1cf12
Add index unittests for query node (#7674) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-10 17:11:09 +08:00
groot 020f109dd8
Add unittest for rootcoord util (#7688) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-10 16:41:48 +08:00
sunby db01040b53
Fix query request lost bug (#7715) 
Issue: #7633
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-10 16:34:44 +08:00
XuanYang-cn ce33855652
[skip-ci]Fix datanode comment typo (#7689) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-10 14:46:00 +08:00
Xiangyu Wang 494600c37c
Add unit tests for msg.go (#7691) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-10 14:24:02 +08:00
cai.zhang be9427e8b9
Increase covd coverage for paramtable (#7583) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-10 14:14:12 +08:00
Cai Yudong 4e23ed9a18
Revert apply physical channels from pool (d5f7e358 and 3b960969) (#7687) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-10 13:00:00 +08:00
congqixia d3be316bc2
Add Comment for datacoord cluster (#7676) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-10 11:26:00 +08:00
Xiangyu Wang 6b86a18a7e
Comments unused msg from msg.go (#7686) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-10 11:12:05 +08:00
groot 16a6afa9bd
Fix build version typo (#7639) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-10 11:10:00 +08:00
yukun 5a303e7672
Fix rocksmq load with prefix (#7678) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-10 10:22:01 +08:00
yukun 34228eb74b
Add topic lock for DestroyConsumerGroup (#7636) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-10 10:20:00 +08:00
nameczz a392f1005c
improve CreateCollectionRequest comment in milvus.proto (#7590) 
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
 2021-09-10 10:06:00 +08:00
bigsheeper 8216478b3d
Add replica and insertNode unittests for query node (#7638) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-10 09:33:43 +08:00
Xiangyu Wang 42aafdc407
Remove unused msg from msg.go (#7612) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-09 19:56:00 +08:00
sunby 49b6c3101d
Remove datacoord useless code (#7673) 
Issue: #7624
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-09 19:08:03 +08:00
Xiangyu Wang 624ea2f676
Add unit tests for msg.go (#7659) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-09 19:03:40 +08:00
dragondriver 596357dc85
Add more data definition test cases (#7623) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-09 19:02:08 +08:00
Cai Yudong d5f7e358aa
Let dml tolerant physical channels generated by old version (#7644) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-09 18:08:02 +08:00
zwd1208 02d5397c6f
[skip ci] Remove useless commets (#7662) 
Signed-off-by: Weida Zhu <weida.zhu@zilliz.com>
 2021-09-09 18:00:19 +08:00
zhenshan.cao 29e5138274
Fix unittest: timeout caused by excessive use of resources (#7653) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-09 17:39:30 +08:00
bigsheeper 1a5e5989c8
Add segment unittests for query node (#7632) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-09 17:36:02 +08:00
groot 314eed2172
Update storage unittest (#7637) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-09 17:12:55 +08:00
congqixia 8e814a2972
Make flowgraph Close only once (#7631) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-09 17:12:38 +08:00
groot a3666c843f
Add unittest for chunk manager (#7628) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-09 17:12:15 +08:00
cai.zhang f6621dc847
Increase code coverage for indexnode component (#7520) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Co-authored-by: edward.zeng <jie.zeng@zilliz.com>
 2021-09-09 17:09:08 +08:00
sunby 06cee85a39
Add data node unit tests (#7622) 
Issue: #6357
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-09 16:40:00 +08:00
XuanYang-cn 64aad49959
Add ut in datasync service to 88% (#7615) 
See also: #6357

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-09 15:36:01 +08:00
congqixia 69794fd32d
Refactor insertBufferNode and add unit tests (#7621) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-09 15:00:00 +08:00
groot dbd2a02462
Add unittest for VectorChunkManager (#7610) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-09 14:34:00 +08:00
zhenshan.cao 89358ad91e
Deep copy rocksdb data to byte slice (#7605) 
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-09 10:56:00 +08:00
congqixia c96b19a640
Add datacoord metricsinfo unit test (#7595) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-09 10:16:00 +08:00
XuanYang-cn 762060e670
Add ut for segmentReplica to 100% (#7589) 
See also: #6357
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-09 10:14:00 +08:00
bigsheeper 5906551f41
Add task unittest for query node (#7599) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-09 10:10:00 +08:00
dragondriver 9b21b3b5fd
Initialize test framework of proxy (#7563) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-09 10:06:29 +08:00
godchen 3c2821e5e2
Add rmq consumer close (#7596) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-08 21:49:59 +08:00
bigsheeper d3a18a66b5
Add tSafeReplica and task scheduler unittests (#7587) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-08 20:50:00 +08:00
XuanYang-cn 074b610811
Add ut for dmstream_input_node to 100% (#7593) 
See also: #6357

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-08 19:12:00 +08:00
groot 159d3702a0
Rename unittest for indexparamcheck (#7580) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-08 19:10:03 +08:00
bigsheeper 50c677f72b
Remove useless message and add service time node unittest (#7565) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-08 17:10:15 +08:00
Xiangyu Wang 2224099f22
Add unit tests for msg.go (#7577) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-08 16:54:00 +08:00
groot ae3a43cf37
Rename unittest for funcutil (#7581) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-08 16:53:30 +08:00
groot 618fef0a43
Add unittest for mqclient (#7578) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-08 16:52:35 +08:00
sunby 79516dacd2
Add log unit tests (#7561) 
Issue: #7491
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-08 15:03:59 +08:00
zhenshan.cao b0524adbd8
Support specified shard number when create collection (#7482) 
Add shards_num to CollectionInfo

Modify dmlChannelNum config

Compatible with old meta

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-08 15:00:00 +08:00
cai.zhang e1081b6783
Increase indexcoord component code coverage (#7558) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-08 14:23:59 +08:00
yukun a560aefc36
Fix search result is wrong when the term content in expression is not in order (#7557) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-08 11:49:59 +08:00
congqixia 664aeb09c6
Add ut and comments for datacoord meta (#7560) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-08 11:35:59 +08:00
groot 58700dedbc
Update unittest name of distance (#7537) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-08 11:28:25 +08:00
yukun fbc352263c
Improve rocksmq client code coverage (#7540) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-08 11:03:59 +08:00
XuanYang-cn 4785e452be
Fix Arrow unable to find Boost error (#7552) 
Resolve: #7549

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-08 10:59:59 +08:00
sunby bbb6051cdc
Remove time-consuming test (#7551) 
issue: #7491
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-08 10:59:52 +08:00
XuanYang-cn a5767e05c6
Add ut for flowgraph_delete_node to 100% (#7550) 
See also: #6357
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-08 10:41:59 +08:00
congqixia 76f5264e79
Fix MqMsgStream Seek logic (#7536) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-07 16:35:59 +08:00
sunby 62f4cb5e1b
Remove stats watcher (#7501) 
issue: #7500
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-07 16:11:07 +08:00
sunby 668d10d1da
Add log unit tests (#7524) 
issue: #7491
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-07 16:07:58 +08:00
bigsheeper bcccd767ac
Add unittests for querynode (#7510) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-07 15:45:59 +08:00
XuanYang-cn 29756c6ce8
Add ut for flow_graph_dd_node to 100% (#7511) 
This PR:
- Change mutex to sync.Map
- Add ut for flow_graph_dd_node.go to 100%

See also: #6357

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-07 15:41:59 +08:00
groot 89815a64d7
Update unittest name of paramtable (#7526) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-07 15:20:40 +08:00
xige-16 468bef4478
Fix dataset's memory leak in knowWhere when search (#7527) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-09-07 14:25:59 +08:00
congqixia 5b22697ec4
Add segment manager unit tests (#7525) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-07 13:59:58 +08:00
bigsheeper b7103357fd
Load failed if collection beyonds the memory limit (#7434) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-07 11:35:18 +08:00
Cai Yudong d15d3fa0ac
Improve rootcoord codecov (#7518) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-07 11:16:37 +08:00
groot 1401ed516d
Add unittest for flowgraph (#7512) 2021-09-07 09:39:47 +08:00
dragondriver 42b687bf48
Add unittest for task scheduler (#7508) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-06 20:49:04 +08:00
yukun 7025a6e925
Improve rocksmq code coverage (#7483) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-06 19:36:42 +08:00
cai.zhang e6e03fc93f
Add unittest for index component (#7475) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-06 17:54:41 +08:00
congqixia fb4e23bc79
Add datacoord server unit tests (#7499) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-06 17:02:41 +08:00
sunby 5e0d724738
Add log unit tests (#7492) 
issue: #7491
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-06 16:50:42 +08:00
Xiangyu Wang 79a0a5482f
Add unit test for mq_factory (#7477) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-06 14:59:21 +08:00
zhenshan.cao 86afde4598
Fix unittest for rootcoord, should filter out timetick msg first (#7490) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-06 11:52:41 +08:00
groot af7b7537f0
Update unittest for calc_distance (#7488) 2021-09-06 11:35:02 +08:00
congqixia 1f590d6c26
Add datacoord services related unit tests (#7467) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-06 11:12:42 +08:00
groot ccfb350bd1
Unittest for funcutil (#7473) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-04 12:13:25 +08:00
Cai Yudong 5a16236768
Improve codecov for paramtable and typeutil (#7471) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-04 10:22:41 +08:00
dragondriver 960741ee16
Support more detailed metrics information (#7472) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 19:35:47 +08:00
dragondriver 1db573731b
Cache the system information metrics (#7436) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 17:15:26 +08:00
yukun 94272bba87
Support query by expression (#7386) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-03 17:12:55 +08:00
godchen db8067d61c
Add trace ut (#7445) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-03 15:41:25 +08:00
groot 229965a9bb
Unittest for indexparamcheck (#7464) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-03 14:22:17 +08:00
Xiangyu Wang acf4354b83
Add logs in rootcoord (#7457) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-03 14:10:10 +08:00
dragondriver 9b87da1ee8
Fix deadlock of channels time ticker (#7444) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 11:53:29 +08:00
godchen 8b1ae98fa9
Add id allocator ut (#7440) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-03 09:44:10 +08:00
Cai Yudong 7edd96989f
Improve codecov for paramtable and typeutil (#7451) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-02 22:18:10 +08:00
yukun d5d73833b2
Add some logs in rocksmq retention (#7403) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-02 20:04:10 +08:00
congqixia d3027c0d28
Fix possible deadlock (#7428) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-02 14:56:10 +08:00
Cai Yudong bd3056fcbe
Improve tso codecov (#7407) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-01 18:29:59 +08:00
dragondriver 3721cbfea1
Proxy metrics integrates with other coordinators (#7400) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-01 17:35:00 +08:00
yukun 71aa300499
Fix rocksmq retention panic when delete by message size (#7393) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-01 12:03:58 +08:00
dragondriver 89748ac639
Expose metrics of data cluster (#7177) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-01 10:13:15 +08:00
Cai Yudong 3b9609692b
Apply for msgstream from pool when creating collection (#7377) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-31 18:35:58 +08:00
godchen 08a31010e9
Change log (#7366) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-31 12:07:58 +08:00
dragondriver f0dbdd7f13
Expose metrics of root coordinator (#7228) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-31 11:45:59 +08:00
sunby 8f660ae4e6
Add log print in proxy (#7369) 
issue: #7316
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-31 11:17:59 +08:00
Cai Yudong f4b53df727
Revert "Apply for msgstream from pool when creating collection (#7323)" (#7376) 
This reverts commit e6de86a433.
 2021-08-31 11:07:58 +08:00
dragondriver 5b354313df
Add unittest for timestamp allocator (#7367) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-31 10:33:58 +08:00
dragondriver 84bddd0a03
Add unittest cases for proxy (#7364) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-31 10:25:59 +08:00
Cai Yudong e6de86a433
Apply for msgstream from pool when creating collection (#7323) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-31 09:47:58 +08:00
congqixia 1c88c8b0a5
Clean fmt.Println in util/flowgraph (#7355) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-30 15:29:57 +08:00
congqixia 65f168eac1
Fix datanode corner cases (#7336) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-30 10:03:58 +08:00
xige-16 af574d17d5
Fix querycoord panic when stop nil conn of querynoClient (#7346) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-08-28 12:51:57 +08:00
zhenshan.cao cc99bae250
Add unittest for proxy (#7342) 
Fix unittest data race

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-08-28 10:21:57 +08:00
cai.zhang 880aa540e6
Fix bug for expression boundary (#7339) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-08-28 10:13:57 +08:00
godchen c333af0dcf
Add query node segment filter (#7303) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-28 10:12:00 +08:00
godchen 2dc2cb1a28
Fix collection nil when add query collection (#7311) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-27 17:51:56 +08:00
bigsheeper 14391fe9a2
Release flowgraphs properly (#7266) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-08-27 17:03:56 +08:00
bigsheeper 1e60cccaf9
Set inMemoryPercentage to 0 when releasing partition (#7310) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-08-27 16:51:11 +08:00
congqixia 0281bd8d22
Change context to correct package (#7331) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-27 15:37:56 +08:00
zhenshan.cao 7c60e6aa00
Avoid port conflicts between embedded etcd and external etcd (#7320) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-08-27 10:13:57 +08:00
sunby 920b09cf7d
Print insert log once receive a request (#7318) 
issue: #7316
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-27 10:08:47 +08:00
Xiangyu Wang c62f23e201
[skip ci]Remove neza2017 from reviewers (#7324) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-27 00:27:36 +08:00
xige-16 055d94ede1
Add ut for queryCoord (#7212) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-08-26 14:17:54 +08:00
groot 8701c477e2
Add delete api into proto (#7304) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-08-26 12:15:52 +08:00
congqixia 4d9f89df09
Add unit test for 7150 fix (#7276) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-25 14:41:52 +08:00
godchen b4c55f6b3c
Add delete node (#7261) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-25 11:41:52 +08:00
congqixia daae05641a
Construct bloom filter when inserting (#7268) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-25 10:29:52 +08:00
congqixia d83bc7fb54
Fix 0 ts when build index (#7272) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-24 21:15:52 +08:00
sunby 4d56d53c0b
Add a tool to move binlog path to SegmentInfo (#7243) 
issue: #7214
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-24 15:51:51 +08:00
bigsheeper 653ec6cedb
Remove service time check in streaming search (#7253) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-08-24 15:07:52 +08:00
Cai Yudong 0ab70271a6
correct empty search result handle (#7244) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-24 11:13:52 +08:00
Xiaofan 58b2089692
Import Embedded Etcd Kv Part 1(#7112) (#7174) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-08-24 09:45:51 +08:00
wt 780a4d2c8e
Update script of run_go_codecov (#7248) 
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2021-08-23 22:01:51 +08:00
congqixia f5451d12f3
Refactor datacoord allocator (#7226) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-23 17:59:51 +08:00
godchen db25550fd0
Add segment filter interface (#7231) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-23 17:49:50 +08:00
Cai Yudong 8405d90f5e
proxy add illegal check for search result (#7227) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-23 17:03:51 +08:00
godchen 33583525c5
Add connection manager (#6867) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-23 10:00:12 +08:00
godchen bf2c427609
Fix connection timeout (#7203) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-20 17:52:11 +08:00
congqixia be5c492e5a
Add datacoord unit tests (#7197) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-20 17:50:12 +08:00
congqixia 881d0af1fc
Add sync logic in TestWatchChannel (#7188) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-20 17:48:13 +08:00
XuanYang-cn 9e71daa759
Fix rocksdb not installed problem (#7200) 2021-08-20 17:46:48 +08:00
groot 1c6f5104f7
Improper error returned by calc_distance (#7175) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-08-20 16:19:42 +08:00
sunby 6e34f4c7f1
Add a seal policy which restrict the lifetime of a segment (#7172) 
issue: #7164
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-20 15:42:12 +08:00
紫晴 7233b62dad
Enable 70% of delta condition judgment for codecov (#7160) 
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2021-08-19 15:50:12 +08:00
congqixia ec9ccd8bd1
Fix DropCollection not processed by datanode (#7151) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-19 15:06:12 +08:00
cai.zhang 171088409b
Increase the timeout for grpc connection when create index (#7163) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-08-19 14:32:11 +08:00
xige-16 76066b5659
Fix IVF_FLAT index's wrong meta_data (#7167) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-08-19 14:26:11 +08:00
sunby 3cc210da26
Add flush interval (#6996) 
Time tick message is sent about per 0.2 seconds. DataCoord will call
`FlushSegment` too frequently. We add a min interval for segment flush. A
segment will called `FlushSegment` only once between the interval.

issue: #6995
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-19 14:08:10 +08:00
sunby 4f7c3e7d3a
Save binlog path in SegmentInfo (#6590) 
issue: #6589
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-19 13:00:12 +08:00
dragondriver 648d22ee40
Expose metrics of IndexCoord and IndexNodes (#7157) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-19 10:28:10 +08:00
godchen 8cc24e09c9
Make users get vectors without using local storage (#7134) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-18 16:30:11 +08:00
紫晴 09525f5723
Update file of codecov (#7144) 
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2021-08-18 14:48:11 +08:00
Cai Yudong 305fa9c17e
Fix timestamp go back issue for timeticksync (#7123) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-18 14:36:10 +08:00
groot b4eb20f2c0
Fix calc_distance TANIMOTO bug (#7140) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-08-18 11:16:10 +08:00
dragondriver e45cb6c644
Expose system topology information by proxy (#7137) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-18 10:12:10 +08:00
Cai Yudong 21117241ec
Let system panic if kv operation fail (#7143) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-17 23:06:10 +08:00
cai.zhang 3d83e99a99
Adding indexnode should be processed asynchronously (#7141) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-08-17 20:26:11 +08:00
cai.zhang c2a4bd3e9c
Lock when writing meta instead of trying to connect to indexnode (#7136) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-08-17 17:54:10 +08:00