Commit Graph

3540 Commits (4d72a6fa6ef37517b2d3c667ac4f567d4ac38e99)

Author SHA1 Message Date
xige-16 300027b0d2
[skip ci]Add comment for getNumDmChannels (#12491)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-30 21:19:43 +08:00
dragondriver 6d92b8499c
Revert #11901, Fix wrong jaccard distance (#12487)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-30 20:31:35 +08:00
bigsheeper 37e6398ed6
[skip ci] Add comment for filterDeleteNode (#12490)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-30 20:15:35 +08:00
bigsheeper 6d93beb57f
[skip ci] Add comment for newDeleteNode (#12489)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-30 20:13:41 +08:00
bigsheeper c749427bca
[skip ci] Add comment for flowGraph delete (#12488)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-30 20:09:37 +08:00
dragondriver f86bf2c2eb
Add ut for CreateAlias when proxy is unhealthy (#12483)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-30 20:07:34 +08:00
dragondriver 4056b414f5
Refine the log of CreateCollection (#12385)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-30 20:05:40 +08:00
dragondriver 36ef91f412
Refine log of Insert (#12380)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-30 20:03:35 +08:00
edward.zeng bd6b4807cc
[skip ci] Refine connection manager comment (#12486)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-11-30 19:47:35 +08:00
edward.zeng 566de56131
[skip ci] Refine logutil comment (#12482)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-11-30 19:45:41 +08:00
yukun fea1126946
[skip ci]Fix golint (#12481)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-30 19:43:46 +08:00
edward.zeng f90e75d19d
[skip ci] Refine metrics comment (#12479)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-11-30 19:41:50 +08:00
jaime 90a1d016a0
Refine return value (#11730)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-11-30 19:32:17 +08:00
congqixia 4dd3dc7aa9
Improve rocksmq CreateConsumerGroup log (#12473)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-30 19:09:33 +08:00
Cai Yudong 7f9a41496d
Reorder header files for segcore/SegmentSealedImpl.h (#12439)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-30 18:45:35 +08:00
Cai Yudong f899644e88
Update header files for segcore/SegmentSealedImpl.cpp (#12438)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-30 18:43:40 +08:00
Cai Yudong 97c2d2aec2
Reorder header files for segcore/SegmentSealed.h (#12435)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-30 18:41:44 +08:00
Cai Yudong d24cc8f846
Reorder header files for segcore/SegmentInterface.h (#12434)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-30 18:39:49 +08:00
Cai Yudong 8f1e75718c
Clean code (#12433)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-30 18:37:41 +08:00
shaoyue bbdd1dbef9
[skip ci] Add comment for etcd_kv.go (#12449)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-30 16:58:14 +08:00
shaoyue f00ee2a3b1
[skip ci] Add comment for mem_kv.go (#12448)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-30 16:08:59 +08:00
shaoyue 2b3762fa63
[skip ci] Add comments for pulsar_consumer.go (#12446)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-30 16:05:59 +08:00
shaoyue 2a0d646196
[skip ci] Add comment for datacoord methods (#12367)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-30 14:28:20 +08:00
yukun 7bb9ae8802
Deleted data could not be searched using timestamp before delete time (#12437)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-30 12:39:41 +08:00
Xiaofan 1d9f4e0a5c
Add log when server is stopped (#12233)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-30 10:59:42 +08:00
dragondriver 074c36de2d
[skip ci] Fix golang format error (#12432)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-30 10:37:44 +08:00
bigsheeper 496f3d0009
Move AddQueryChannel to taskScheduler in query node (#12294)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-30 10:29:43 +08:00
congqixia 001752eb91
Fix zero length slice declaration in storage/util.go (#12412)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-30 09:57:44 +08:00
Cai Yudong 486ceca7fb
Remove useless type (#12375)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-30 09:53:52 +08:00
congqixia f834e220c1
Fix zero length slice declaration in flowgraph/node.go (#12393)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-30 09:51:51 +08:00
cai.zhang d54a6a408b
[skip ci]Fix golint error for SegmentFlushCompleted in rootcoord (#12377)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-30 09:47:47 +08:00
congqixia dd134e02d9
[skip ci] Add comment in types.go for DataCoord.GetCompactionStateWithPlans (#12422)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-30 00:03:43 +08:00
jaime 2576cf796f
[skip ci] Add comments for Task interface (#12418)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-11-30 00:01:49 +08:00
yukun 47f1f51bca
[skip ci]Add comment for rocksmq reader (#12403)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-29 23:59:53 +08:00
jaime 832b771dcd
[skip ci] Add comments for Task interface (#12420)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-11-29 23:57:45 +08:00
yukun 6439887eb7
[skip ci]Add license in reader.go in mqclient (#12402)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-29 23:19:42 +08:00
shaoyue f796bce1ed
[skip ci] Fix golint for rocketsmq_impl.go (#12363)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-29 23:15:41 +08:00
Bingyi Sun fb2e8b0870
[skip ci]Add comment for WatchChannels in client.go (#12416)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@gmail.com>
2021-11-29 23:13:41 +08:00
Bingyi Sun b790f1fe0c
[skip ci]Add comment for WatchChannels in types.go (#12415)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@gmail.com>
2021-11-29 23:11:49 +08:00
Bingyi Sun 27898928b0
[skip ci]Modify WatchChannels comment in services.go (#12417)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@gmail.com>
2021-11-29 23:09:41 +08:00
congqixia 06ced4d1d1
Add DropVirtualChannel for DataCoord (#12361)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-29 22:35:41 +08:00
godchen c4f0837d84
Fix insert pks overwrite (#12365)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-29 22:01:41 +08:00
xige-16 b1da696767
[skip ci]Add comment for getSegmentInfoByNode (#12411)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-29 21:21:41 +08:00
xige-16 a4cfd1cb46
[skip ci]Add comment for releasePartitions (#12410)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-29 21:17:46 +08:00
xige-16 fa26804279
[skip ci]Add comment for releaseCollection (#12409)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-29 21:15:49 +08:00
yukun 9ae7e19b82
[skip ci]Add comment for rocksmq reader seek (#12405)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-29 21:10:01 +08:00
congqixia 9af7e179f2
Fix zero length slice declaration in timeticksync.go (#12372)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-29 20:21:41 +08:00
XuanYang-cn 5797e6b3ac
[skip ci]Update license for qn fg filterdm node (#12398)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-29 20:17:41 +08:00
XuanYang-cn 37ae8e4283
[skip ci]Update license for qn fg deletenode (#12397)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-29 20:15:45 +08:00
XuanYang-cn 84f7f90f06
[skip ci]Update license for qn collection (#12396)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-29 20:13:50 +08:00
bigsheeper 65608836e6
Remove vChannel for collection in historical (#12359)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-29 20:11:49 +08:00
bigsheeper ed4660b7de
[skip ci] Add comment for deleteNode Operate (#12388)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-29 20:01:49 +08:00
bigsheeper 1e92ac48d5
[skip ci] Add comment for getSegmentInfosByColID (#12386)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-29 19:59:54 +08:00
shaoyue 8bd7365172
[skip ci] Add Comments for exported items in proxy/service.go (#12376)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-29 19:57:57 +08:00
bigsheeper f79e85cb36
[skip ci] Add comment for deleteNode Name (#12387)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-29 19:45:49 +08:00
cai.zhang 015bf4585d
[skip ci]Fix golint error for GetMetrics in rootcoord (#12379)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-29 19:27:45 +08:00
edward.zeng c9d31f0b73
[skip ci] Refine etcd kv comment (#12374)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-11-29 19:25:49 +08:00
cai.zhang f3de0ca2e7
[skip ci]Fix golint error for ReleaseDQLMessageStream in rootcoord (#12378)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-29 19:23:45 +08:00
dragondriver d90aeafa79
Refine the log of CalcDistance (#12371)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-29 19:21:41 +08:00
dragondriver 6cd3427805
Refine the log of Search (#12333)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-29 18:07:42 +08:00
edward.zeng 772857d9c1
[skip ci] Refine minio kv comment (#12369)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-11-29 17:55:41 +08:00
Bingyi Sun a05a74fca2
Improve proxy manager in rootcoord (#12303)
issue: #11275
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-29 17:33:41 +08:00
Cai Yudong 365b5a5d01
Rename SubSearchResult fields for better readability (#12341)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-29 17:07:40 +08:00
Cai Yudong cb952d6036
Rename SearchResult fields for better readability (#12327)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-29 14:57:18 +08:00
zhenshan.cao bdd39c0623
Fix bug: check message payload before unmarshaling (#12315)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-29 14:31:18 +08:00
dragondriver 3850979308
Show stack trace info when rpc fail (#12290)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-29 14:29:24 +08:00
dragondriver 243af903c4
Refine the log of ShowCollections (#12300)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-29 14:27:24 +08:00
zhenshan.cao 6831589b0b
Enable keepalive on the grpc (#12328)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-29 14:25:17 +08:00
bigsheeper cad61ea47e
Fix tSafe replica unit test (#12325)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-29 14:17:17 +08:00
godchen 8cd1fccfb1
Return rocksdb reader timeout error (#12317)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-29 13:27:17 +08:00
Cai Yudong 45fac75889
Fix segcore unittest fail (#12326)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-29 12:27:17 +08:00
Cai Yudong 74a4a4e15b
Fix golint warnings for proxy (#11895)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-29 12:25:17 +08:00
Cai Yudong 33bfd96d9f
Fix golint warnings for proxy (#11894)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-29 12:23:17 +08:00
Cai Yudong e62e7bb801
Fix golint warnings for proxy (#11892)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-29 11:57:17 +08:00
cai.zhang 2c484c7c7d
Parallel execution between segments (#12199)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-27 20:05:16 +08:00
Cai Yudong cbbeb2a383
Add debug log when proxy idle for a long time (#12319)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-27 13:57:16 +08:00
godchen 48bdeb56d8
Merge watch delta channel positions (#12309)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-26 22:47:17 +08:00
godchen f31ed089b5
Add timeout for reader next (#12308)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-26 22:45:24 +08:00
XuanYang-cn 48b45d82e5
Add ut for binlog_io to 100 coverage (#12283)
Make DN ut coverage upto 90%
Resolves: #8058

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-26 17:43:17 +08:00
bigsheeper dbcb153687
Fix delete failed in query node (#12302)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-26 16:15:16 +08:00
dragondriver b6d0150dc5
Fix health check when disconnect to etcd (#12292)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-26 11:39:16 +08:00
yukun 080eaa9a5c
Add isClosed for rocksmq (#12267)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-26 11:27:16 +08:00
bigsheeper 58964621a5
Remove tSafeWatcher and vChannel when release (#12264)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-26 01:33:16 +08:00
godchen ad83090925
Merge delta channels when load partition (#12274)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-25 18:49:16 +08:00
Cai Yudong 6188ac280b
Fix drop alias error (#12281)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-25 18:03:17 +08:00
bigsheeper db3ad2bc5f
Disable log print in GetSgementInfo (#12139)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 17:49:19 +08:00
godchen 88012acb86
Clear useless segments info. (#12262)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-25 17:37:15 +08:00
congqixia eb48013042
Set start position for compact result segment (#12280)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-25 17:19:17 +08:00
congqixia 2ee0c7c074
Add compacted segment into check list when drop collection (#12272)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-25 15:13:15 +08:00
bigsheeper d2dae89f4c
Return success if query node is unhealthy in GetComponentStates (#12202)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 15:03:16 +08:00
bigsheeper e245ba87a9
Add excluded segments for dropped segemnts (#12247)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 14:25:15 +08:00
Cai Yudong 858e95f377
Move dmlChannel and deltaChannel into timeticksync (#12254)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-25 10:07:15 +08:00
XuanYang-cn 8a8ebed23d
Fix DN GC bug (#12258)
Fixes: #12249

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-25 09:43:15 +08:00
xige-16 1a8e2e5e85
Establish a grpc connection When init queryNode client (#12236)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-24 19:27:15 +08:00
congqixia 59d19384dc
Fix flush manager injection logic with multiple segments (#12260)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-24 18:41:16 +08:00
godchen e3f49858c5
Add subscription prefix (#12251)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-24 17:47:15 +08:00
godchen f07ac99438
Add calc distance log (#12253)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-24 16:09:15 +08:00
godchen 927f72d588
Add delete task channel stats interface (#12250)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-24 16:01:17 +08:00
dragondriver 6c4c0ef6b5
Add more deploy metrics (#12248)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-24 15:43:15 +08:00
XuanYang-cn e72c5b9351
Filter dropped segments in DN (#12242)
See also: #12131, #12230

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-24 14:11:15 +08:00