Commit Graph

2049 Commits (939afc866bfd63ca26fe46ee882641b5874e360d)

Author SHA1 Message Date
bigsheeper 4b68be2d36
[skip ci] Add comment for addCollectionFlowGraph (#8606)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-26 20:18:03 +08:00
bigsheeper 78604cc1e1
[skip ci] Add comment for query node (#8605)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-26 20:16:12 +08:00
godchen 5eb1a449d2
Make retry config private (#8613)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-26 20:13:58 +08:00
Xiaofan 31ec399edb
Move channel configuration from channel.yaml to milvus.yaml (#8420)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-26 19:46:17 +08:00
yukun 174c6275ca
golint rocksmq client (#8604)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-26 19:35:57 +08:00
dragondriver 8091e76666
Remove old time tick logic (#8596)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-26 19:23:56 +08:00
cai.zhang 0fa38d5d93
Add root path for index files in minio (#8212)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-26 19:19:57 +08:00
cai.zhang ea1e2dd63f
Add comment for indexcoord nodemanager (#8603)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-26 18:55:58 +08:00
yukun c4c89a639a
Fix go lint in rocksmq (#8559)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-26 18:29:56 +08:00
dragondriver 68b9da219a
Expose created time and updated time to indexnode metrics (#8592)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-26 17:56:08 +08:00
dragondriver 0d41efe154
Expose created time and updated time to indexcoord metrics (#8591)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-26 17:54:06 +08:00
dragondriver 019f18ddf9
Expose created time and updated time to datacoord metrics (#8172)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-26 17:50:07 +08:00
congqixia 353eeab8b9
Add MessageID return value in producers (#8586)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-26 17:38:07 +08:00
Xiangyu Wang cbe8c03224
Fix golint warnings in msg.go (#8590)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-26 17:36:07 +08:00
yukun 075d6880a4
Fix rocksmq memleak (#8564)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-26 15:31:56 +08:00
congqixia de3fd15aee
Fix tsafe close deadlock (#8567)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-26 14:29:57 +08:00
Xiangyu Wang cd980dd13b
Add unit test for mq_msgstream.go (#8548)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-26 13:09:56 +08:00
groot a20a9c71e2
Reduce go unittest time cost (#8556)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-26 12:56:07 +08:00
groot e4e762f2e8
Reduce go unittest time cost (#8503)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-26 12:50:24 +08:00
groot a6a64692f8
Reduce go unittest time cost (#8502)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-26 12:48:32 +08:00
groot 6168c0b9c7
Reduce go unittest time cost (#8555)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-26 12:42:14 +08:00
congqixia 6f7f71fdc0
Add lock before reading tSafeWatcher map (#8562)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-26 12:37:56 +08:00
congqixia c72f074009
Add waitgroup for tsafe close logic (#8545)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-26 11:07:56 +08:00
Cai Yudong b2e5627061
Rename insertMsg to flowGraphMsg in datanode flow graph (#8546)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-26 10:43:57 +08:00
groot 03ca388fb8
Reduce go unittest time cost (#8490)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-26 10:22:03 +08:00
Cai Yudong 28d305148a
Update ddnode insert (#8536)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-26 09:43:57 +08:00
Cai Yudong 68f73302a5
Let plan_parser err out when modulo zero (#8535)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-26 09:42:02 +08:00
Cai Yudong 9497ba5523
Add more unittest for proxy/plan_parser (#8534)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-25 13:43:56 +08:00
Cai Yudong 3e487bde0b
Clean test_concurrent_vector.cpp (#8532)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-25 12:13:56 +08:00
zhenshan.cao 7c4aff0ea2
Fixbug: load last saved timestamp when rootcoord restart (#8137)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-25 11:43:56 +08:00
Cai Yudong 3938d68034
Optimize proxy query execute (#8479)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-25 00:21:57 +08:00
sunby 61874c1a96
[skip ci] Add comment for GetMetrics (#8529)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-24 23:21:57 +08:00
sunby 9a7780369e
Add comment for GetFlushedSegments (#8527)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-24 23:20:03 +08:00
sunby 5e6e0feeff
Add comment for GetRecoveryInfo (#8526)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-24 23:18:11 +08:00
yukun 1913ec9e94
Add segcore error messages (#8515)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-24 22:17:56 +08:00
zhenshan.cao 54331f4aac
[skip ci] Add comments for utility function CompareIndexParams (#8525)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-24 22:05:55 +08:00
yukun 5e25041254
Add rocksmq comments (#8474)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-24 21:45:56 +08:00
XuanYang-cn 3aabc1d3ee
[skip-ci]Fix golint in type_def.go (#8464)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-24 21:43:56 +08:00
zhenshan.cao 2d9b4fedc9
[skip ci] Add comments for flow_graph_message.go (#8523)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-24 21:37:57 +08:00
Xiaofan 34157a4943
Unify Param Table name (#8491)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-24 21:35:57 +08:00
zhenshan.cao 5390136cd6
[skip ci] Fix golint error of services.go in datacoord (#8524)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-24 21:33:55 +08:00
bigsheeper e61bafc6f5
Init query node once (#8086)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-24 21:03:56 +08:00
bigsheeper d7f311a208
[skip ci] Add comment for streaming (#8498)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-24 20:54:01 +08:00
bigsheeper 977d55b66c
[skip ci] Add comment for task (#8497)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-24 20:53:49 +08:00
bigsheeper 6bc4379de5
[skip ci] Add comment for tSafe replica (#8495)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-24 20:52:13 +08:00
sunby 816bac82ec
Add root path in minio and replace etcd.rootPath in datanode (#8272)
issue: #7905
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-24 20:50:23 +08:00
jingkl 12fb8290b9
add log to produce.go (#8489)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-09-24 20:48:22 +08:00
XuanYang-cn e4f0d4bab6
[skip-ci]Fix golint in flow_graph_message.go (#8463)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-24 20:46:04 +08:00
XuanYang-cn 2539dd4593
[skip-ci]Fix golint in data_node.go (#8462)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-24 20:44:05 +08:00
cai.zhang 803a083b60
Fix golint for distributed indexnode (#8504)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-24 20:41:56 +08:00
cai.zhang 459174d78a
Fix golint for distributed indexcoord (#8496)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-24 20:39:56 +08:00
cai.zhang 93c912e681
Start once for IndexNode (#8170)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-24 20:37:56 +08:00
dragondriver 82c28d225c
Fix golint warning of metrics info (#8501)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-24 20:35:56 +08:00
groot 96fd7e9399
Reduce go unittest time cost (#8492)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-24 18:29:55 +08:00
dragondriver 7a76022f3b
[skip ci] Update doc of descriptor event format (#8487)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-24 18:17:56 +08:00
yukun a8a0ae27ae
Add rocksmq client comments (#8475)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-24 16:05:55 +08:00
groot d28341932e
Reduce go unittest time cost (#8448)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-24 15:27:54 +08:00
Cai Yudong 4fba738bec
Update internal proto DeleteRequest (#8466)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-24 15:21:55 +08:00
bigsheeper 52126f2d5a
Dynamic add tSafe watcher, use sync.Cond instead of selectCase, add ref count (#8050)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-24 13:57:54 +08:00
congqixia ca62b1e149
Use clone instead of ShadowClone when update pb data (#8461)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-24 12:53:54 +08:00
congqixia a182326c60
Fix liveness check not quit after canceled (#8454)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-24 12:47:54 +08:00
dragondriver 208f32547f
[skip ci] Fix healthz router path (#8446)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-24 11:29:54 +08:00
Cai Yudong ee3eaa2966
Rename CreateQueryExprPlan to CreateExprPlan (#8438)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-24 10:27:54 +08:00
Cai Yudong 74d5bb3eef
Update comments for indexparamcheck/utils.go (#8437)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-24 09:41:54 +08:00
zhenshan.cao 98c423480e
[skip ci] Add comments for indexparamcheck (#8436)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-23 22:37:54 +08:00
Xiangyu Wang eb413f1396
Add comments for exposed structures and functions (#8435)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-23 21:57:55 +08:00
xige-16 93c945d076
Init querycoord once (#8106)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-23 21:56:02 +08:00
NotRyan e3d3834243
Fix debug typos in sesion_util (#8020)
Signed-off-by: NotRyan <ryan.chan@zilliz.com>

Co-authored-by: NotRyan <ryan.chan@zilliz.com>
2021-09-23 21:54:03 +08:00
sunby 7ba18a7653
Add comment for GetCollectionStatistics (#8433)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-23 21:52:02 +08:00
groot 985e63cbf2
Reduce cpp unittest time cost (#8424)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-23 21:50:11 +08:00
bigsheeper 1b7056d3c2
[skip ci] Add comment for dataSyncService in query node (#8418)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-23 21:48:12 +08:00
bigsheeper a6060e4481
[skip ci] Add comment for errors in query node (#8417)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-23 21:46:16 +08:00
bigsheeper 322f4ec80f
[skip ci] Add comment for type def in query node (#8415)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-23 21:44:17 +08:00
sunby 3296475517
Add comment for GetInsertBinlogPaths (#8432)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-23 21:42:03 +08:00
sunby 3cfa34e225
Add comment for GetPartitionStatistics (#8434)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-23 21:39:55 +08:00
cai.zhang bd48f6f2db
Add comment for metaTable of indexcoord (#8411)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-23 21:37:55 +08:00
cai.zhang d308661f63
Add comment for indexcoord server (#8416)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-23 21:35:55 +08:00
cai.zhang 1d16930a03
Init once for indexnode (#8027)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-23 21:27:54 +08:00
xige-16 85c2b4d0f6
Add log for releasePartion task (#8222)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-23 21:06:02 +08:00
xige-16 689e41066f
Add log for cluster reload in queryCoord (#8413)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-23 21:03:55 +08:00
XuanYang-cn faeb1bf50f
Add comment on exposed struct (#8348)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-23 20:15:54 +08:00
Xiangyu Wang 884d0d672e
Improve unit test in mq_msgstream.go (#8427)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-23 20:07:55 +08:00
XuanYang-cn 2b82482679
Fix golint and ruleguard (#8347)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-23 19:14:01 +08:00
XuanYang-cn a830c28bd8
Fix golint in datanode (#8345)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-23 19:05:55 +08:00
yukun 3c77eda7ac
Add error msgs in segcore (#8410)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-23 18:59:54 +08:00
congqixia 2aa9deda1c
Improve logic when watch dm channel fails (#8386)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-23 18:31:55 +08:00
congqixia da6d93527d
Add session liveness check (#8408)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-23 18:29:55 +08:00
groot af1bdaf202
Reduce cpp unittest time cost (#8409)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-23 17:55:54 +08:00
godchen 10c07a3041
Add description event extras. (#8264)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-23 17:23:54 +08:00
yukun f34e5205f7
Fix some memleak in rocksmq (#8405)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-23 17:21:54 +08:00
godchen b47ff1f97f
[skip ci]Add chunk manager interface comment (#8350)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-23 17:13:56 +08:00
godchen 3c8f031968
[skip ci]Add msgstream trace comment (#8349)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-23 17:11:54 +08:00
yukun 78e8e4aa22
Add rocksmq comments (#8362)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-23 16:59:54 +08:00
groot 8b81ceb5d7
Reduce cpp unittest time cost (#8403)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-23 16:55:54 +08:00
SS 58a178fdf5
[skip ci] Fix grammar in comment (#8382)
Signed-off-by: sida shen <sida@sidas-MacBook-Pro.local>

Co-authored-by: sida shen <sida@sidas-MacBook-Pro.local>
2021-09-23 16:50:16 +08:00
Xiangyu Wang 57618ac624
Remove unused codes in msgstream (#8368)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-23 16:29:55 +08:00
XuanYang-cn d816a81ee3
Make FlushSegments async (#8159)
Resolves: #8122

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-23 16:03:54 +08:00
Cai Yudong 177a465913
Clean golint warnings for rootcoord (#8383)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-23 15:10:00 +08:00
congqixia 6469d83072
Add datanode etcd alive check (#8363)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-23 14:29:54 +08:00
groot b897ca5703
Fix unittest build problem (#8369)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-23 14:19:54 +08:00
Cai Yudong bc7fc50493
Clean golint warnings for distributed/rootcoord (#8357)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-23 11:41:53 +08:00
dragondriver fb98f06de8
Expose simd type to index node metrics (#8300)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-23 11:29:54 +08:00
dragondriver b3f6bd2088
Expose simd type to query node metrics (#8299)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-23 11:27:54 +08:00
Xiaofan f5173b595f
Add a channel prefix for all channels (#8166)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-23 10:53:53 +08:00
Cai Yudong a62bce360b
Replace MarshalTextString with Marshal in rootcoord (#8341)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-23 10:37:54 +08:00
Cai Yudong 340f92ab16
Update querycoord proto (#8342)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-23 00:41:53 +08:00
congqixia 9ebfd43195
Add comment for proxyManager (#8266)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-22 23:55:53 +08:00
XuanYang-cn 4ee8275b88
Fix master compile error (#8333)
Resolves: #8336

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-22 20:31:54 +08:00
Xiaofan 2f92f78e7b
Remove meaningless Etcd kv logs (#8019)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-22 20:27:54 +08:00
yukun 9e17fdb598
Improve rocksmq codecov (#8328)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-22 20:16:04 +08:00
nameczz b6cea6539b
[skip ci] Improve ShowCollections in milvus.proto (#8200)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-09-22 20:14:08 +08:00
sunby 3fc1b9cf9f
Change copyright (#8318)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 20:12:08 +08:00
bigsheeper 220d17500c
[skip ci] Add comment for query node flow graph (#8326)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-22 20:10:09 +08:00
bigsheeper 11a4109747
[skip ci] Add comment for query coord proto (#8325)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-22 20:06:09 +08:00
bigsheeper f8ca5dbf55
[skip ci] Add comment for query coord proto (#8322)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-22 20:04:13 +08:00
godchen 050e27cbcf
[skip ci]Add delete node comment (#8323)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-22 20:02:09 +08:00
sunby 82dd762ef0
Change copyright (#8317)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 19:59:59 +08:00
congqixia c676979217
Add error detail when ddl fail (#8304)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-22 19:50:15 +08:00
cai.zhang 0d9ab7ab7d
Remove useless debug message in indexbuilder (#8303)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-22 19:37:53 +08:00
cai.zhang 729d409a32
Add trace log for search (#8302)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-22 19:36:00 +08:00
cai.zhang 79b7dcc75a
Add trace log for insert (#8301)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-22 19:33:54 +08:00
cai.zhang 41a6f9b5f7
Init once for IndexCoord (#8028)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-22 19:31:54 +08:00
sunby b46307388f
Add comment for GetTimeTickChannel (#8217)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 18:21:53 +08:00
yukun c5beef16a9
Add error msgs in segcore visitors (#8306)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-22 18:07:54 +08:00
godchen 75672abab4
Add lease time (#8064)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-22 17:50:00 +08:00
Cai Yudong 83ffa18c37
[skip ci] Update test_concurrent_vector (#8273)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-22 17:21:53 +08:00
yukun 06c9f03c59
Refactor rocksmq close logic and improve codecov (#8278)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-22 17:21:00 +08:00
Cai Yudong 07aa453270
[skip ci] Update test_segcore (#8270)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-22 17:19:53 +08:00
sunby 1cb8c31794
Add comment for CreateCollection (#8023)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 17:11:54 +08:00
Yusup bdfb78e936
Add aliases to DescribeCollection (#8268)
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-22 16:20:48 +08:00
dragondriver 85a6953330
Support healthz check api (#8228)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-22 16:18:21 +08:00
dragondriver 6345d05bf4
Fix collection alias ut (#8292)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-22 16:10:07 +08:00
dragondriver 78fe530d87
Initialize the simd type when initialize an indexnode (#8276)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-22 16:05:59 +08:00
xige-16 2e160f51bc
Add default test nodeID in querycoord's mock test (#8224)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-22 11:31:59 +08:00
bigsheeper 0e2b4a7cd8
Add comment for queryCoordMock (#8223)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-22 11:30:07 +08:00
bigsheeper 36dd794986
Add comment for type def in query node (#8220)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-22 11:28:04 +08:00
sunby 5c5c4b004c
Add comment for GetComponentStates (#8216)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 10:43:53 +08:00
dragondriver b2e8ba7b33
Fix reduce algorithm in proxy search task (#8206)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-22 10:15:54 +08:00
Cai Yudong c1e229cb7e
Add segcore logger (#8262)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-22 10:11:52 +08:00
sunby c0331eba6a
Add comment for AssignSegmentID (#8152)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 10:07:53 +08:00
sunby fe1e1ce523
Add comment for DropCollection (#8024)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-22 10:05:58 +08:00
Xiaofan 0c35cd57b0
Unify param table to the same naming format (#8254)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-20 23:27:52 +08:00
Xiaofan acfd7c7911
[skip ci] Fix typo in binlog writer (#8255)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-18 22:55:51 +08:00
yukun 269e041e34
[skip ci]Fix typo (#8251)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-18 19:53:51 +08:00
congqixia 21f15d66bb
Add option for DataNode creation (#8240)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-18 19:10:07 +08:00
Xiangyu Wang f203f750aa
Improve import statements in msgstream (#8237)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-18 19:06:09 +08:00
Xiangyu Wang 32c6033f4a
Add unit tests for msg.go (#8227)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-18 19:04:04 +08:00
godchen d1d3993689
[skip ci]Add binlog reader comment (#8230)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:57:51 +08:00
xige-16 e75693e1a3
Add log for release collection task (#8226)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-18 18:45:51 +08:00
godchen 3f5e876188
[skip ci]Add binlog writer comment (#8231)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:39:56 +08:00
godchen 0cf0217ed5
[skip ci]Add event data comment (#8232)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:37:56 +08:00
bigsheeper 1f1c738016
Add loadFieldData unittest for query node (#8219)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-18 18:32:07 +08:00
Xiangyu Wang c314b2b4a8
Remove unused label rules (#7929)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-18 18:19:51 +08:00
bigsheeper 11c65dc2b3
Add comment for collection replica (#8147)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-18 18:15:51 +08:00
bigsheeper 223044a7ca
Rename name of unittests in query node (#8225)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-18 18:05:51 +08:00
sunby a16fb4cf39
Add comment for GetSegmentStates (#8153)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:49:51 +08:00
sunby 9daf9dce1a
Add comment for flush (#8151)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:47:56 +08:00
sunby ab55a39b7d
Add comment for DescribeCollection (#8030)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:46:01 +08:00
sunby 77634c473d
Add comment for GetStatisticsChannel (#8218)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:35:51 +08:00
sunby 3dad7b5aa8
Add comment for HasCollection (#8025)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-18 16:27:51 +08:00
groot b6e43e0439
Fix cpp code coverage bug (#8203)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-18 16:15:51 +08:00
yukun 82e48fb379
Add more error messages in segcore visitors (#8195)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-18 15:53:51 +08:00
xige-16 5046cbe5d8
Fix logic error in release collection (#8188)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-18 15:51:51 +08:00
groot 334297b49d
[skip ci] Update OWNERS files (#8211)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-18 15:30:37 +08:00
congqixia bdfb8768d4
Enable gosec (#8202)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-18 14:45:50 +08:00
Cai Yudong 2a946707b9
[skip ci] Update test_concurrent_vector.cpp (#8205)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 14:41:50 +08:00
XuanYang-cn 46c72c57c2
Add BufferData in insertbufferNode (#8138)
Optimize bufferInsertMsg param to avoid a second transfer
of endposition

See also: #8058, #7741

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-18 14:25:50 +08:00
Yusup ccb57ba4b2
add collection alias (#7255)
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-18 11:13:51 +08:00
cai.zhang a6b6d16381
Delete unused code in indexnode (#8169)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-18 11:05:50 +08:00
godchen b3f965c7d4
Add unrecoverable error for retry. (#7828)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 10:49:51 +08:00
Cai Yudong 83bf9c5efb
Add knowhere.yaml to support knowhere configuration (#7967)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 10:37:51 +08:00
godchen c8c10bb3d6
Remove performanceTest (#8164)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 10:13:52 +08:00
bigsheeper 338e32362b
Return error if setSegment failed when loadSegment (#8075)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-18 10:03:50 +08:00
nameczz d5d063df7c
[skip ci] improve milvus.proto comments (#8063)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-09-18 09:33:51 +08:00
Cai Yudong d10c6abc9e
Apply for msgstream from pool when creating collection (#7738)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 09:13:50 +08:00
cai.zhang 8d5dc5ba07
Add comment for CreateIndex in indexnode (#8168)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-18 00:01:51 +08:00
godchen 74bb712527
[skip ci]Add minio comment (#8165)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 23:59:47 +08:00
congqixia 266db4c883
Add readme for datacoord (#8141)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-17 23:57:55 +08:00
Xiangyu Wang 8b21a4b596
Add unit tests for msg.go (#8150)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-17 23:55:50 +08:00
yukun 46871fcaec
Remove unused code in queryTask (#8077)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-17 21:57:58 +08:00
bigsheeper ee3ab7a783
Add comment for dataSyncService (#8157)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-17 21:55:53 +08:00
dragondriver c3eb6f9761
Expose created time and updated time to rootcoord metrics (#8174)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 21:52:00 +08:00
dragondriver daf001f683
Expose created time and updated time to datanode metrics (#8173)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 21:32:47 +08:00
cai.zhang 57e46c5f2c
Start once for indexcoord (#8026)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-17 20:17:53 +08:00
dragondriver 4f9d124ed4
Fix data race of proxy ut (#8119)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 19:45:42 +08:00
Xiangyu Wang b7b28abd77
Remove mem_msgstream that is no longer needed (#8155)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-17 18:43:54 +08:00
congqixia a972fafb5f
Fix proxy ut may hang with dn graceful stop (#8124)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-17 17:49:58 +08:00
sunby b84f017dde
Add comment for CreatePartition (#8031)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-17 17:35:53 +08:00
godchen 9e1b4dcd6f
Make init private (#8104)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 16:29:51 +08:00
XuanYang-cn 6c434b4801
Improve codes in insertbuffernode (#8054)
Add error handling in insertbuffernode

See also: #7624, #7684

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-17 16:27:56 +08:00
XuanYang-cn 82d4d19337
Remove not in use segmentCheckPoints (#8039)
Resolves: #8037

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-17 16:25:55 +08:00
Xiangyu Wang 422b7dcf3e
Add unit tests for mq_factory (#8140)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-17 16:23:51 +08:00
congqixia 05efb3a029
Fix use address of loop var (#7433)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-17 16:21:50 +08:00
godchen 31df0faaf5
[skip ci]Add chunk manager comment (#7833)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 14:49:50 +08:00
Xiangyu Wang 1ee17464e8
Fix possible datarace in rootcoord (#8120)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-17 12:37:50 +08:00
bigsheeper 9601cb2ee6
Add failed streming unittest for query node (#7960)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-17 11:37:49 +08:00
bigsheeper c9b6a92366
Add release failed case unittest for query node (#7971)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-17 11:35:49 +08:00
godchen 295ee49472
Add trace comment (#7994)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 11:17:57 +08:00
sunby c0ede30c6e
Add comment for ShowCollections (#8032)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-17 11:15:53 +08:00
godchen 96539f02d8
Add data codec comment (#7998)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 11:05:49 +08:00
zhenshan.cao 4c184921f0
Add comments and enchanme unittest for retrieve (#8114)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-16 23:43:49 +08:00
Xiaofan d6f0c5069f
[skip ci] Add comments for memory message queue (#8018)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-16 23:41:49 +08:00
zhenshan.cao 5cd9ea5f04
Fixbug: init optional retrieve_ret_ when query result is empty (#8068)
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-16 20:11:49 +08:00
congqixia 4fe22bcaaa
Fix query task panicking (#8060)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-16 20:03:50 +08:00
cai.zhang fa00f1f48a
It is also correct to get the failed index status in indexcoord ut (#8059)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-16 19:56:41 +08:00
congqixia 01c8341a2e
[skip ci]Add comments for SegmentManager (#8087)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-16 19:55:49 +08:00
dragondriver ca2d09a167
Fix data race of proxy grpc client (#8091)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-16 19:31:59 +08:00
dragondriver 9bbff86c81
Fix data race of rootcoord grpc client (#8078)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-16 18:15:49 +08:00
groot 1fd0e79add
Add unittest for distributed datacoord (#7982)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-16 14:17:49 +08:00
dragondriver 10321e0a1a
Cover error cases that timeout is too small (#8038)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-16 14:09:49 +08:00
groot c40cdb599a
Add unittest for distributed rootcoord (#7997)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-16 12:33:49 +08:00
groot e6450b0d96
Add unittest for distributed indexnode (#7991)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-16 12:31:53 +08:00
groot 75c80c12cb
Add unittest for distributed datanode (#7987)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-16 12:29:53 +08:00
dragondriver bf2ebc794d
Cover error cases that task queue is full (#8033)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-16 11:29:49 +08:00
yukun 8b3893e030
Add more error messages in segcore (#8012)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-16 10:23:53 +08:00
nameczz 8ee55aad0a
[skip ci] improve DescribeCollection comments (#7882)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-09-16 10:21:53 +08:00
cai.zhang 4814f9cb1c
Add opentrace log for index component (#7946)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-16 10:07:48 +08:00
bigsheeper b465e8f9a4
Remove redundant check and add addQueryChannel unittest for query node (#7944)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-16 09:47:48 +08:00
yukun e0761271dd
[skip ci]Add rocksmq_retention comment (#8016)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-15 23:29:48 +08:00
Xiangyu Wang 0aa65f559a
Rename unit tests to meet new naming conventions (#8017)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-15 23:11:49 +08:00
xige-16 2bcb3f4916
Modify querycoord's log info (#8005)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-15 22:17:49 +08:00
groot 8fb961a0b0
Add unittest for distributed querynode (#7996)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 22:15:53 +08:00
groot 0404e3c243
Add unittest for distributed querycoord (#7993)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 22:13:57 +08:00
groot ed322cfd8e
Add unittest for distributed indexcoord (#7990)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 22:12:02 +08:00
cai.zhang 130817d8c6
Add comment for indexcoord (#7950)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-15 22:09:50 +08:00
congqixia 675b71cc30
Replace metaSnapshot with suffixSnapshot (#7975)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 22:05:49 +08:00
yukun 9a6f2e618c
Change Assert to AssertInfo in SegmentGrowing (#7952)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-15 22:04:39 +08:00
XuanYang-cn 3db76e8e59
[skip-ci]Add comment in data sync service (#8002)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-15 21:25:49 +08:00
congqixia 2bca69596e
Add some comment for SegmentsInfo (#7995)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 21:07:53 +08:00
congqixia c76f91233f
Put errors together (#7958)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 21:05:52 +08:00
xige-16 c63086fefa
Add ut for querycoord's cluster (#7894)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-15 20:40:07 +08:00
godchen 863444cc45
Delete performance (#8000)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-15 20:29:48 +08:00
dragondriver 7f048ea8c8
Support to set max task number of task queue (#7974)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 19:09:50 +08:00
XuanYang-cn ff8fef6ad0
Upgrade pulsar-client-go to 0.6.0 (#7909)
MessageID interface of pulsar-client-go adds
4 more methods. So I add these methods into
`MessageID` interface.

Resolves: #7770

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-15 18:13:49 +08:00
dragondriver 502cb68c08
Fix the logic of waiting for collection to be loaded (#7978)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 17:34:02 +08:00
yukun 13f9b32452
Improve global_rmq code coverage (#7928)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-15 17:31:49 +08:00
groot 2398dafbca
Add unittest for distributed proxy (#7976)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 17:29:49 +08:00
dragondriver d2e18fd53b
Cover error cases that proxy is unhealthy (#7951)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 15:46:06 +08:00
bigsheeper 18431c1549
Add historical failed unittest for querynode (#7941)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-15 15:25:49 +08:00
congqixia 55c47ab508
Add suffixSnapshot implementing SnapshotKV (#7948)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 15:23:49 +08:00
Cai Yudong 14ef405a6b
Rename chunk_size to chunk_rows for better code readability (#7953)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 15:15:52 +08:00
Cai Yudong ab84f95e66
[skip ci] Update debug log (#7956)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 14:39:48 +08:00
dragondriver 5f3b961502
Add test case for delete task (#7939)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 14:04:54 +08:00
Cai Yudong a0fd2707cb
Support config SIMD type (#7942)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 12:57:48 +08:00
sunby 095b7c12c1
Add insert codec comment (#7891)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-15 10:47:48 +08:00
Cai Yudong e6c384b4d4
Move segcore chunk_size configuration to querynode.yaml (#7913)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 10:35:52 +08:00
XuanYang-cn 376d39fa02
[skip-ci]Add comment for Cache and allocator (#7924)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-15 10:33:37 +08:00
dragondriver cf1d773259
Add test cases for metrics info of proxy (#7927)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-15 10:13:49 +08:00
bigsheeper 0b849d3089
Add insert node failed unittests for query node (#7914)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-15 10:11:48 +08:00
bigsheeper bc1f39bb55
Remove deprecated replica interface in query node (#7908)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-15 10:09:53 +08:00