milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
12,071 Commits
139 Branches
115 Tags
576 MiB
Commit Graph

3645 Commits (91554e35483b22664da651b6734012fa958136d8)

Author SHA1 Message Date
dragondriver aa154e023c
Add ut for CreateAlias when ctx is short (#12485) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-01 10:13:34 +08:00
congqixia e813867652
Implement Drop mode for flush manager (#12469) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-01 10:11:39 +08:00
Bingyi Sun 7ff15490c9
[skip ci]Add comment for GetVChanPosition (#12495) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-30 23:15:33 +08:00
xige-16 60831cae99
[skip ci]Add comment for getNodeInfoByID (#12493) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-30 21:23:34 +08:00
xige-16 0abc0ecf20
[skip ci]Add comment for registerNode (#12492) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-30 21:21:39 +08:00
xige-16 300027b0d2
[skip ci]Add comment for getNumDmChannels (#12491) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-30 21:19:43 +08:00
dragondriver 6d92b8499c
Revert #11901, Fix wrong jaccard distance (#12487) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-30 20:31:35 +08:00
bigsheeper 37e6398ed6
[skip ci] Add comment for filterDeleteNode (#12490) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-30 20:15:35 +08:00
bigsheeper 6d93beb57f
[skip ci] Add comment for newDeleteNode (#12489) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-30 20:13:41 +08:00
bigsheeper c749427bca
[skip ci] Add comment for flowGraph delete (#12488) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-30 20:09:37 +08:00
dragondriver f86bf2c2eb
Add ut for CreateAlias when proxy is unhealthy (#12483) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-30 20:07:34 +08:00
dragondriver 4056b414f5
Refine the log of CreateCollection (#12385) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-30 20:05:40 +08:00
dragondriver 36ef91f412
Refine log of Insert (#12380) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-30 20:03:35 +08:00
edward.zeng bd6b4807cc
[skip ci] Refine connection manager comment (#12486) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-30 19:47:35 +08:00
edward.zeng 566de56131
[skip ci] Refine logutil comment (#12482) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-30 19:45:41 +08:00
yukun fea1126946
[skip ci]Fix golint (#12481) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-30 19:43:46 +08:00
edward.zeng f90e75d19d
[skip ci] Refine metrics comment (#12479) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-30 19:41:50 +08:00
jaime 90a1d016a0
Refine return value (#11730) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-11-30 19:32:17 +08:00
congqixia 4dd3dc7aa9
Improve rocksmq CreateConsumerGroup log (#12473) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-30 19:09:33 +08:00
Cai Yudong 7f9a41496d
Reorder header files for segcore/SegmentSealedImpl.h (#12439) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-30 18:45:35 +08:00
Cai Yudong f899644e88
Update header files for segcore/SegmentSealedImpl.cpp (#12438) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-30 18:43:40 +08:00
Cai Yudong 97c2d2aec2
Reorder header files for segcore/SegmentSealed.h (#12435) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-30 18:41:44 +08:00
Cai Yudong d24cc8f846
Reorder header files for segcore/SegmentInterface.h (#12434) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-30 18:39:49 +08:00
Cai Yudong 8f1e75718c
Clean code (#12433) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-30 18:37:41 +08:00
shaoyue bbdd1dbef9
[skip ci] Add comment for etcd_kv.go (#12449) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-30 16:58:14 +08:00
shaoyue f00ee2a3b1
[skip ci] Add comment for mem_kv.go (#12448) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-30 16:08:59 +08:00
shaoyue 2b3762fa63
[skip ci] Add comments for pulsar_consumer.go (#12446) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-30 16:05:59 +08:00
shaoyue 2a0d646196
[skip ci] Add comment for datacoord methods (#12367) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-30 14:28:20 +08:00
yukun 7bb9ae8802
Deleted data could not be searched using timestamp before delete time (#12437) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-30 12:39:41 +08:00
Xiaofan 1d9f4e0a5c
Add log when server is stopped (#12233) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-30 10:59:42 +08:00
dragondriver 074c36de2d
[skip ci] Fix golang format error (#12432) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-30 10:37:44 +08:00
bigsheeper 496f3d0009
Move AddQueryChannel to taskScheduler in query node (#12294) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-30 10:29:43 +08:00
congqixia 001752eb91
Fix zero length slice declaration in storage/util.go (#12412) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-30 09:57:44 +08:00
Cai Yudong 486ceca7fb
Remove useless type (#12375) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-30 09:53:52 +08:00
congqixia f834e220c1
Fix zero length slice declaration in flowgraph/node.go (#12393) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-30 09:51:51 +08:00
cai.zhang d54a6a408b
[skip ci]Fix golint error for SegmentFlushCompleted in rootcoord (#12377) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-11-30 09:47:47 +08:00
congqixia dd134e02d9
[skip ci] Add comment in types.go for DataCoord.GetCompactionStateWithPlans (#12422) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-30 00:03:43 +08:00
jaime 2576cf796f
[skip ci] Add comments for Task interface (#12418) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-11-30 00:01:49 +08:00
yukun 47f1f51bca
[skip ci]Add comment for rocksmq reader (#12403) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-29 23:59:53 +08:00
jaime 832b771dcd
[skip ci] Add comments for Task interface (#12420) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-11-29 23:57:45 +08:00
yukun 6439887eb7
[skip ci]Add license in reader.go in mqclient (#12402) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-29 23:19:42 +08:00
shaoyue f796bce1ed
[skip ci] Fix golint for rocketsmq_impl.go (#12363) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-29 23:15:41 +08:00
Bingyi Sun fb2e8b0870
[skip ci]Add comment for WatchChannels in client.go (#12416) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@gmail.com>
 2021-11-29 23:13:41 +08:00
Bingyi Sun b790f1fe0c
[skip ci]Add comment for WatchChannels in types.go (#12415) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@gmail.com>
 2021-11-29 23:11:49 +08:00
Bingyi Sun 27898928b0
[skip ci]Modify WatchChannels comment in services.go (#12417) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@gmail.com>
 2021-11-29 23:09:41 +08:00
congqixia 06ced4d1d1
Add DropVirtualChannel for DataCoord (#12361) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-29 22:35:41 +08:00
godchen c4f0837d84
Fix insert pks overwrite (#12365) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-29 22:01:41 +08:00
xige-16 b1da696767
[skip ci]Add comment for getSegmentInfoByNode (#12411) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-29 21:21:41 +08:00
xige-16 a4cfd1cb46
[skip ci]Add comment for releasePartitions (#12410) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-29 21:17:46 +08:00
xige-16 fa26804279
[skip ci]Add comment for releaseCollection (#12409) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-29 21:15:49 +08:00
yukun 9ae7e19b82
[skip ci]Add comment for rocksmq reader seek (#12405) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-29 21:10:01 +08:00
congqixia 9af7e179f2
Fix zero length slice declaration in timeticksync.go (#12372) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-29 20:21:41 +08:00
XuanYang-cn 5797e6b3ac
[skip ci]Update license for qn fg filterdm node (#12398) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-29 20:17:41 +08:00
XuanYang-cn 37ae8e4283
[skip ci]Update license for qn fg deletenode (#12397) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-29 20:15:45 +08:00
XuanYang-cn 84f7f90f06
[skip ci]Update license for qn collection (#12396) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-29 20:13:50 +08:00
bigsheeper 65608836e6
Remove vChannel for collection in historical (#12359) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-29 20:11:49 +08:00
bigsheeper ed4660b7de
[skip ci] Add comment for deleteNode Operate (#12388) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-29 20:01:49 +08:00
bigsheeper 1e92ac48d5
[skip ci] Add comment for getSegmentInfosByColID (#12386) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-29 19:59:54 +08:00
shaoyue 8bd7365172
[skip ci] Add Comments for exported items in proxy/service.go (#12376) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-29 19:57:57 +08:00
bigsheeper f79e85cb36
[skip ci] Add comment for deleteNode Name (#12387) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-29 19:45:49 +08:00
cai.zhang 015bf4585d
[skip ci]Fix golint error for GetMetrics in rootcoord (#12379) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-11-29 19:27:45 +08:00
edward.zeng c9d31f0b73
[skip ci] Refine etcd kv comment (#12374) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-29 19:25:49 +08:00
cai.zhang f3de0ca2e7
[skip ci]Fix golint error for ReleaseDQLMessageStream in rootcoord (#12378) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-11-29 19:23:45 +08:00
dragondriver d90aeafa79
Refine the log of CalcDistance (#12371) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-29 19:21:41 +08:00
dragondriver 6cd3427805
Refine the log of Search (#12333) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-29 18:07:42 +08:00
edward.zeng 772857d9c1
[skip ci] Refine minio kv comment (#12369) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-29 17:55:41 +08:00
Bingyi Sun a05a74fca2
Improve proxy manager in rootcoord (#12303) 
issue: #11275
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-29 17:33:41 +08:00
Cai Yudong 365b5a5d01
Rename SubSearchResult fields for better readability (#12341) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 17:07:40 +08:00
Cai Yudong cb952d6036
Rename SearchResult fields for better readability (#12327) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 14:57:18 +08:00
zhenshan.cao bdd39c0623
Fix bug: check message payload before unmarshaling (#12315) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-29 14:31:18 +08:00
dragondriver 3850979308
Show stack trace info when rpc fail (#12290) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-29 14:29:24 +08:00
dragondriver 243af903c4
Refine the log of ShowCollections (#12300) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-29 14:27:24 +08:00
zhenshan.cao 6831589b0b
Enable keepalive on the grpc (#12328) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-29 14:25:17 +08:00
bigsheeper cad61ea47e
Fix tSafe replica unit test (#12325) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-29 14:17:17 +08:00
godchen 8cd1fccfb1
Return rocksdb reader timeout error (#12317) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-29 13:27:17 +08:00
Cai Yudong 45fac75889
Fix segcore unittest fail (#12326) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 12:27:17 +08:00
Cai Yudong 74a4a4e15b
Fix golint warnings for proxy (#11895) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 12:25:17 +08:00
Cai Yudong 33bfd96d9f
Fix golint warnings for proxy (#11894) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 12:23:17 +08:00
Cai Yudong e62e7bb801
Fix golint warnings for proxy (#11892) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-29 11:57:17 +08:00
cai.zhang 2c484c7c7d
Parallel execution between segments (#12199) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-11-27 20:05:16 +08:00
Cai Yudong cbbeb2a383
Add debug log when proxy idle for a long time (#12319) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-27 13:57:16 +08:00
godchen 48bdeb56d8
Merge watch delta channel positions (#12309) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-26 22:47:17 +08:00
godchen f31ed089b5
Add timeout for reader next (#12308) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-26 22:45:24 +08:00
XuanYang-cn 48b45d82e5
Add ut for binlog_io to 100 coverage (#12283) 
Make DN ut coverage upto 90%
Resolves: #8058

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-26 17:43:17 +08:00
bigsheeper dbcb153687
Fix delete failed in query node (#12302) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-26 16:15:16 +08:00
dragondriver b6d0150dc5
Fix health check when disconnect to etcd (#12292) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-26 11:39:16 +08:00
yukun 080eaa9a5c
Add isClosed for rocksmq (#12267) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-26 11:27:16 +08:00
bigsheeper 58964621a5
Remove tSafeWatcher and vChannel when release (#12264) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-26 01:33:16 +08:00
godchen ad83090925
Merge delta channels when load partition (#12274) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-25 18:49:16 +08:00
Cai Yudong 6188ac280b
Fix drop alias error (#12281) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-25 18:03:17 +08:00
bigsheeper db3ad2bc5f
Disable log print in GetSgementInfo (#12139) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-25 17:49:19 +08:00
godchen 88012acb86
Clear useless segments info. (#12262) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-25 17:37:15 +08:00
congqixia eb48013042
Set start position for compact result segment (#12280) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-25 17:19:17 +08:00
congqixia 2ee0c7c074
Add compacted segment into check list when drop collection (#12272) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-25 15:13:15 +08:00
bigsheeper d2dae89f4c
Return success if query node is unhealthy in GetComponentStates (#12202) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-25 15:03:16 +08:00
bigsheeper e245ba87a9
Add excluded segments for dropped segemnts (#12247) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-25 14:25:15 +08:00
Cai Yudong 858e95f377
Move dmlChannel and deltaChannel into timeticksync (#12254) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-25 10:07:15 +08:00
XuanYang-cn 8a8ebed23d
Fix DN GC bug (#12258) 
Fixes: #12249

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-25 09:43:15 +08:00
xige-16 1a8e2e5e85
Establish a grpc connection When init queryNode client (#12236) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-24 19:27:15 +08:00
congqixia 59d19384dc
Fix flush manager injection logic with multiple segments (#12260) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-24 18:41:16 +08:00
godchen e3f49858c5
Add subscription prefix (#12251) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-24 17:47:15 +08:00
godchen f07ac99438
Add calc distance log (#12253) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-24 16:09:15 +08:00
godchen 927f72d588
Add delete task channel stats interface (#12250) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-24 16:01:17 +08:00
dragondriver 6c4c0ef6b5
Add more deploy metrics (#12248) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-24 15:43:15 +08:00
XuanYang-cn e72c5b9351
Filter dropped segments in DN (#12242) 
See also: #12131, #12230

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-24 14:11:15 +08:00
bigsheeper 62bbc9cd1d
Add excluded segments for flushed segments in query node (#12188) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-24 11:27:15 +08:00
Xiaofan 0aaa87a79a
Fix MsgStream inconsistent seek (#12042) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-24 10:25:15 +08:00
xige-16 99397535be
Fix update rollBackTask after triggerTask fail (#12228) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-24 10:19:15 +08:00
congqixia 7b870e3392
Limit datacoord gc scan prefixes (#12231) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-24 09:55:15 +08:00
Cai Yudong 1f27eb604e
Remove all index when drop collection (#12227) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-23 23:01:15 +08:00
zhenshan.cao f95ef2260b
Add GetFlushState grpc method (#12220) 
Update sdk version

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-23 22:57:17 +08:00
dragondriver 653369ee63
[skip ci] Refine the log of GetPersistentSegmentInfo (#12234) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-23 21:07:16 +08:00
yukun 6a167f8579
Fix rocksmq produce hang when do search repeatedly (#12225) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-23 19:15:22 +08:00
congqixia 8e0c8febe9
Add dropped segment ids in vchaninfo (#12230) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-23 18:59:15 +08:00
godchen 3fa5b4a9ce
Delete for segment indexing (#12197) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-23 17:17:16 +08:00
XuanYang-cn 6bf0c4326d
Fix compaction generates wrong insert binlogs (#12204) 
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug

Fixes: #12146

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-23 17:09:15 +08:00
bigsheeper 18463ebde4
Reduce memory cost when load from minio (#12055) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-23 14:49:15 +08:00
Cai Yudong dd0b36f3fb
Clean debug log (#12205) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-23 14:25:15 +08:00
Bingyi Sun 3be9442c0f
Clear dropped segment meta on etcd (#12191) 
issue: #9613
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-23 11:23:15 +08:00
godchen d7cc1c1e36
Check load segments length before watch delta channel (#12200) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-23 11:21:15 +08:00
yukun adf9530ed7
Bool expr not support numerica (#12184) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-23 10:57:16 +08:00
Bingyi Sun 01be91116e
Add GetFlushState interface (#12170) 
issue: #12075
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-23 10:55:14 +08:00
dragondriver 73f18c564f
Refine logs when search with unsupported metric type (#12185) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-23 10:13:14 +08:00
yukun 7a0d5ed6c4
Fix delete after create index (#12174) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-22 23:11:14 +08:00
congqixia 8c107ab15f
Set segment DroppedAt when compacted (#12182) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-22 20:11:14 +08:00
yukun 835451e331
Update rocksmq consume slowly log (#12179) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-22 18:51:14 +08:00
godchen 9d5bcd3e3a
Close event and binlog reader (#12173) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-22 17:27:14 +08:00
yukun e9585625e6
Add error return with invalid bool expr (#12168) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-22 16:57:15 +08:00
congqixia 4121e31df1
Send SIGINT to runner goroutine after etcd disconnects (#12163) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-22 16:23:17 +08:00
godchen 02bf77aabf
Close reader stream (#12167) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-22 16:17:14 +08:00
Cai Yudong 99b3c56b3e
Update rootcoord debug log (#12160) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-22 16:01:14 +08:00
zhenshan.cao 0f2b7d1790
Fix deadlock caused by not releasing the lock in time (#12161) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-22 12:19:14 +08:00
yukun f5bb180adb
Support multiple readers on one topic (#12155) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-22 10:35:14 +08:00
Bingyi Sun a3d4cbdd4c
Convert c array to a golang slice (#12066) 
issue: #11974
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-22 10:05:14 +08:00
edward.zeng 3cfc740a05
Refine minio kv FGetObject function (#12078) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-21 22:53:13 +08:00
Cai Yudong d4c297b1a8
Enhance dml channel operations (#12143) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-21 21:33:13 +08:00
yukun ac175b6f00
Add rocksmq produce slowly hint log (#12156) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-21 15:33:13 +08:00
godchen 116a503b4a
From dml cp load delete msg (#12144) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-21 07:33:14 +08:00
dragondriver bf391f2449
Make indexparamcheck thread-safe (#11916) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-21 00:39:13 +08:00
yukun 2147507e89
Add reader implementation in rocksmq (#12137) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-20 20:57:13 +08:00
xige-16 03f63b7ec1
Start querycoord after root/datacoord healthy (#12145) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-20 08:23:13 +08:00
yukun 8c947109a9
Add log in rocksmq (#12138) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-20 00:11:13 +08:00
congqixia 8a9fb9b287
Fix CMakeLists.txt comment error (#12141) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-19 19:33:13 +08:00
xige-16 e66537f9c9
Parallel estimate segment size (#12136) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-19 18:09:13 +08:00
shaoyue cec1b0cb77
[skip ci] Add comments for exported items (#12127) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-19 18:07:18 +08:00
shaoyue 6777d24c65
[skip ci] Add comment for exported items (#12126) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-19 18:05:25 +08:00
shaoyue 888aad120c
[skip ci] Fix comment typo (#12122) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-19 17:59:39 +08:00
jaime 11110906a4
[skip ci] Add a TODO for a faiss cpp file (#12117) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-11-19 17:57:46 +08:00
jaime c6fea64aa7
[skip ci] Add a comment to faiss CMakeLists (#12116) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-11-19 17:55:40 +08:00
Cai Yudong 3aca73969f
Optimize segcore API arrangement (#12135) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-19 17:23:12 +08:00
godchen 51b353b52c
Add msgstream reader (#12130) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-19 15:57:12 +08:00
congqixia 7e91bcf115
Normalize datanode dminput node log (#12128) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-19 14:21:13 +08:00
dragondriver ee0f753f7a
Fix datarace between GetComponentStates and Register (#11935) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-19 13:57:12 +08:00
Cai Yudong 074687e32e
Unify rootcoord debug log (#12080) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-19 12:11:12 +08:00
congqixia 27715c15f4
Fix 0 len slice declaration for dml_channels.go (#12094) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-18 22:33:26 +08:00
congqixia dfc70108c4
Add load collection for AssignSegmentID (#12077) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-18 22:31:34 +08:00
congqixia b99164f43d
Add datacoord GC configuration (#12061) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-18 22:29:40 +08:00
xige-16 38afc63c16
Add ut for loadbalanceTask when index created (#11981) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-18 22:21:55 +08:00
dragondriver e00976fddb
[skip ci] Add comment for GetPersistentSegmentInfo (#12097) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-18 22:13:28 +08:00
bigsheeper d4254f876a
[skip ci] Add comment for msgQueryNodeIsUnhealthy (#12111) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-18 21:45:12 +08:00
bigsheeper 98b0f73c46
[skip ci] Add comment for deleteNode (#12110) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-18 21:43:20 +08:00
bigsheeper b35c2f60ea
[skip ci] Add comment for errQueryNodeIsUnhealthy (#12109) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-18 21:41:27 +08:00
dragondriver 951d9a2f96
[skip ci] Add comment for GetDdChannel (#12096) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-18 21:26:28 +08:00
dragondriver 5dc85727a7
[skip ci] Add comment for CalcDistance (#12095) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-18 21:24:38 +08:00
xige-16 d666c2a190
Fix txn limit error when querycoord remove task from etcd (#12084) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-18 19:35:15 +08:00
edward.zeng 8f40450d93
[skip ci] Refine rocksdb kv comment (#12093) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-18 19:27:13 +08:00
edward.zeng a92a6f34b4
[skip ci] Fix typo in etcd kv comment (#12091) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-18 19:25:19 +08:00
edward.zeng 77264ae493
[skip ci] Refine etcd kv comment (#12090) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-18 19:23:25 +08:00
shaoyue acef6b9750
[skip ci] Add comments for exported item in calc_distance.go (#12088) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-18 19:21:27 +08:00
shaoyue fc6bc48e3b
[skip ci] Add comments for exported items in proxy/client.go (#12087) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-18 19:19:32 +08:00
shaoyue 1587214676
[skip ci] Add comment for exported items in data_codec.go (#12089) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-18 19:15:27 +08:00
XuanYang-cn 7066e75112
Add global mutex for global map (#12071) 
Fixes: #12070

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-18 15:35:12 +08:00
dragondriver d35bd761b1
[skip ci] Enhance log when load failed (#12054) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-18 11:31:12 +08:00
zhenshan.cao 543c4891b3
Prevent the client from closing grpc connection by mistake (#11918) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-18 11:17:12 +08:00
cai.zhang 6d652263a2
[skip ci]Add comment for startGrpcLoop in indexnode (#12046) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-11-18 10:45:12 +08:00
cai.zhang da0e5b7b0b
[skip ci]Fix golint for initPort in indexcoord (#12045) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-11-18 10:43:20 +08:00
cai.zhang 732cb95339
[skip ci]Fix golint for LoadFromEnv in indexcoord (#12044) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-11-18 10:41:25 +08:00
Bingyi Sun 038f42851e
Add more log for debug (#11893) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-18 10:37:41 +08:00
cai.zhang cdf8e79a70
[skip ci]Fix golint for DescribeSegment in rootcoord (#12035) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-11-18 09:27:12 +08:00
bigsheeper be1602f769
[skip ci] Add comment for dataSyncService close (#12028) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-18 09:25:17 +08:00
godchen f91e9c6dda
Add pulsar reader implementation (#11990) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-17 23:47:11 +08:00
bigsheeper 152d55dbfa
Fix the deadlock of the querycoord cluster (#11796) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: xige-16 <xi.ge@zilliz.com>
 2021-11-17 23:37:11 +08:00
Bingyi Sun 175a656ff1
Unwatch dropped channel when init channel manager (#11986) 
issue: #11558
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-17 23:25:12 +08:00
cai.zhang 240e8a3258
[skip ci]Fix golint for AllocID in rootcoord (#12038) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-11-17 22:07:13 +08:00
cai.zhang 7b65cfb6ab
[skip ci]Fix golint for ShowSegments in rootcoord (#12036) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-11-17 22:05:19 +08:00
yukun 3b51232d59
[skip ci]Format rocksdbkv (#12034) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-17 22:03:24 +08:00
yukun 18b9f7810c
[skip ci]Format rocksdbkv (#12033) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-17 22:01:31 +08:00
yukun d482f8aa9f
[skip ci]Add license in reader.go (#12032) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-17 21:59:38 +08:00
congqixia b7de3bda3b
Fix mem_kv.go slice 0 length declaration (#11996) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-17 20:57:17 +08:00
bigsheeper 7df9600e5d
[skip ci] Add comment for removePartitionFlowGraph (#12027) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-17 20:27:24 +08:00
bigsheeper f07b3ff8cb
[skip ci] Add comment for startPartitionFlowGraph (#12026) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-17 20:25:29 +08:00
dragondriver aa17f561fe
[skip ci] Add comment for AlterAlias (#12020) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-17 19:57:12 +08:00
congqixia bc765ea65b
Fix start position for seek into a mark (#12008) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-17 19:55:16 +08:00
dragondriver c4adca9773
[skip ci] Add comment for DropAlias (#12019) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-17 19:53:18 +08:00
dragondriver 2d4f691905
[skip ci] Add comment for CreateAlias (#12018) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-17 19:51:24 +08:00
XuanYang-cn 3acb73ebe6
[skip ci]Update license for qc task (#12016) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-17 19:49:32 +08:00
XuanYang-cn de95a6c866
[skip ci]Update license for qc qn (#12015) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-17 19:47:36 +08:00
XuanYang-cn ed8cfed18a
[skip ci]Update license for qc mock (#12014) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-17 19:45:45 +08:00
XuanYang-cn 403be89420
[skip ci]Update license for qc meta (#12013) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-17 19:43:50 +08:00
XuanYang-cn e8398eb02d
[skip ci]Update license for qc impl (#12012) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-17 19:41:41 +08:00