Commit Graph

15023 Commits (e8f53af74928ba51b60d945a0191b14ee9d4fb25)

Author SHA1 Message Date
cai.zhang e8f53af749
When the task is canceled, reduce the load of node (#17735)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-23 19:22:15 +08:00
Jiquan Long 90ca61d948
Fix double-freed global variable in easylogging lib (#17730)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-23 19:12:14 +08:00
Cai Yudong e78269f450
Optimize search related interface in segcore (#17568)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-06-23 18:16:13 +08:00
XuanYang-cn 21b52bfcf2
Enhance channel manager ut (#17682)
Resolves: #17676

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-06-23 18:08:14 +08:00
codeman 294f7e4408
fix: log datapb.SegmentInfo is too large #17685 (#17727)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-06-23 14:36:13 +08:00
xige-16 8ff1a2c4c2
Print expr when proxy receive qyery req (#17662)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-23 13:42:13 +08:00
Jiquan Long 216e2f80aa
Add msg id to log in query path (#17677)
/kind improvement

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-23 10:46:13 +08:00
cai.zhang 1fbdafc943
IndexCoord does not assign task to IndexNode prematurely (#17717)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-23 10:40:13 +08:00
SimFG 50d5d04552
Refine some codes about the datanode (#17720)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-06-23 09:58:14 +08:00
SimFG f4c6a6734e
Fix rpc retry policy not taking effect (#17673)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-06-22 22:22:13 +08:00
SimFG 3fadf4c5d7
Return the unavailable error to make the client's retry policy take effect (#17719)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-06-22 21:56:13 +08:00
codeman 6cb00aa5bb
fix: log datapb.SegmentInfo is too large #17685 (#17693)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-06-22 21:46:13 +08:00
yah01 b4f21259ef
Fix SegmentChangeInfo is not set properly (#17701)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-22 21:08:13 +08:00
zhuwenxing 16075d358b
[skip e2e]Update deploy test deployment and etcd version (#17716)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-22 20:34:14 +08:00
binbin 379bd7846d
Add data consistency case after parallel insert (#17714)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-06-22 20:32:18 +08:00
Xiaofan 6fdf88f452
Fix compaction selection policy (#17690)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-22 19:00:14 +08:00
bigsheeper 1722431699
Checking for existence in map in segcore (#17700)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-22 18:16:14 +08:00
Jiquan Long fdccfb4273
Fix ut heap overflow (#17706)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-22 16:56:13 +08:00
zhuwenxing 69ad70b35b
[skip e2e]Add kafka standalone for chaos and deploy test (#17707)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-22 16:46:13 +08:00
bigsheeper 8cf54137cf
Add nil check in reduce and add collection rwmutex when release segments (#17698)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-22 16:12:14 +08:00
yah01 a077bad84a
Make updating replica atomic, balance plan idempotent (#17686)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-22 13:40:13 +08:00
Xiaofan 7d51b65260
Estimate varchar length more reasonablly (#17688)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-22 13:02:13 +08:00
Jenny Li 1b86dc7303
Upgrade set-tools to fix python install issue (#17695)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-06-22 11:04:13 +08:00
XuanYang-cn 12158432bb
Clear segment cache when closing flowgraph (#17671)
See also: #17537

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-06-22 10:16:14 +08:00
zhuwenxing f23690af48
[skip e2e]Update deploy test (#17683)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-21 22:46:13 +08:00
sre-ci-robot 2d6956b1e3 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-06-21 12:06:51 +00:00
Enwei Jiao 746aeea35b
fix typo (#17668)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-06-21 18:54:13 +08:00
cai.zhang 4efdd0929c
Get index status based on segment generation time (#17659)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-21 18:44:12 +08:00
XuanYang-cn e43f487f02
Make LoadCollection compatible (#17669)
See also: #17656

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-06-21 17:26:15 +08:00
yah01 1e87b54542
Add the offlines nodes previously crashed to offline nodes channel (#17663)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-21 16:08:13 +08:00
binbin 9ad67e99dd
Update pymilvus version (#17667)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-06-21 15:24:13 +08:00
ThreadDao eeaae0799f
[test] Update some compaction test cases (#17658)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-06-21 15:10:12 +08:00
Jiquan Long 0282f69eb4
Add msg id to log in search path. (#17654)
issue: #17513
Add msg id to log in search path,
which should help us to trace a detailed request more easier.

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-21 13:30:12 +08:00
congqixia 37464a281d
Fix datasorter swap vector logic (#17661)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-21 11:38:12 +08:00
SimFG eb1f0bc805
Add the consistency check tool (#17136)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-06-21 10:28:12 +08:00
shaoyue 32a3ed0791
Add e2e test for RESTful APIs, fix json encoding for on proto_oneof fields (#17362)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-06-20 22:06:12 +08:00
cai.zhang ed94ecf847
Segments can't be compacted when they have reference lock (#17649)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-20 21:56:12 +08:00
cai.zhang 3610cc77bf
Fix bug for align segments (#17652)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-20 20:16:12 +08:00
zhuwenxing c185747552
[skip e2e]Fix etcd version in first deployment for upgrading test (#17650)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-20 19:12:12 +08:00
Bingyi Sun 4333a30f97
Use pulsar client go v0.6.8 (#17642)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-06-20 17:54:12 +08:00
cai.zhang f123d657ed
Fix bug for dropping index (#17635)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-20 15:22:13 +08:00
Xiaofan e36fce1fd4
Add log for mqtt msgstream seek (#17640)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-20 15:18:13 +08:00
wayblink f2bd910df5
[skip e2e]Fix log mistake: WatchDmChannels -> WatchDeltaChannels (#17643)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-06-20 15:10:12 +08:00
congqixia 12b3a29db8
Fix segments info in drop virtual channel request is not set (#17641)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-20 13:40:12 +08:00
zhuwenxing 0bb415f593
[skip e2e]Update jenkinsfile for chaos and deploy test (#17630)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-20 11:16:13 +08:00
Xiaofan d70f483806
Support rocksmq dynamic lru cache size (#17626)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-20 10:56:12 +08:00
ThreadDao b491673218
[test] Add some compaction test cases (#17628)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-06-20 09:58:12 +08:00
Xiaofan 516d91470f
Fix Delta log loss after compaction (#17634)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-19 20:12:11 +08:00
congqixia 50cecc65ed
Fix mock querynode server session not revoked (#17229)
Revoke mock querynode server session when it's stopped
This PR reduces the running time of TestLoadBalanceIndexedSegmentsAfterNodeDown from 60+ seconds to less than 1+ seconds
Also related to #17212 #17215

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-18 18:22:12 +08:00
Xiaofan 144f7a2d80
Refine meta, remove redundant proxy data (#17631)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-18 12:50:11 +08:00