Commit Graph

15223 Commits (perf)

Author SHA1 Message Date
binbin 0e7ddce635
Update test cases for code change (#18038)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-07-04 19:58:23 +08:00
xige-16 e9cf804b85
Log querynode's runtime cpu num (#18039)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-07-04 19:12:20 +08:00
Jiquan Long f6ce05590c
Fix search successfully with invalid metric type (#17977) (#18026)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-07-04 10:28:20 +08:00
zhenshan.cao c4d3677956
Count growing segment number to estimate cpu usage (#17820)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-07-01 22:28:23 +08:00
yah01 cee427b4dd
Fix LoadBalance Sync all segments to shard leaders (#18002) (#18018)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-07-01 20:54:18 +08:00
yah01 4e14184f27
Clean segments as releasing collection (#17932) (#18017)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-07-01 20:50:19 +08:00
yah01 b1c97b3b3c
Fix the scheduler enqueues concurrent load tasks (#17950) (#18020)
Signed-off-by: yah01 <yang.cen@zilliz.com>

related to #17850
2022-07-01 20:48:19 +08:00
congqixia 54c8b762da
Make querynode handle segmentChangeInfo with multiple vchannel (#18010)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-01 19:04:18 +08:00
zhenshan.cao b3a1a60f8e
Fix bug: datarace in proxy unittest (#17992)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-07-01 17:56:21 +08:00
Jiquan Long 1e8e164a18
Fix querycoord ut data race (#17980) (#17983)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-07-01 14:42:18 +08:00
bigsheeper ad2526a039
Return malloc_trim result and log if malloc_trim successfully (#17960)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-01 10:40:19 +08:00
congqixia 49d9e5facb
Remove growing according to offline as well (#17968) (#17974)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-30 22:32:19 +08:00
zhenshan.cao ade1f45c34
Fix bugs in monitoring metrics (#17975)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-06-30 21:32:19 +08:00
zhenshan.cao baf1d728c5
Fix bug: get correct number of cpu (#17973)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-06-30 21:12:17 +08:00
congqixia a875e75557
Wait last version search to release growing safely (#17713) (#17808)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-30 20:22:18 +08:00
codeman dccb5da5c3
Fix update credential failure (#17963) (#17964)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-06-30 19:26:19 +08:00
cai.zhang 8d072181a6
Handle etcd compacted error (#17908)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-30 18:56:20 +08:00
Xiaofan 78fc8b8a18
Fix msgstream datarace (#17944)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-30 17:20:19 +08:00
bigsheeper 8c4c3f26f4
Log delta channel timetick in DataNode (#17948)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-30 16:12:18 +08:00
xige-16 622a6952e7
Fix query not empty after delete string (#17949)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-30 15:20:22 +08:00
yah01 98d71051e2
Refactor handoff handler (#17806) (#17933)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-30 13:24:18 +08:00
ThreadDao 1c204ebef4
[test] Update xfail skip cases and scale test cases (#17927)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-06-30 11:38:19 +08:00
Bingyi Sun e1e80024ca
Fix msgstream close block. (#17880) (#17909)
issue: #17513
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-06-30 11:14:06 +08:00
binbin a959bc4aae
[skip e2e] Increase compaction timeout for test case in 2.1.0 (#17921)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-06-30 09:02:18 +08:00
codeman e3a5595b79
fix password comparison too slow (#17874) (#17915)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-06-29 20:27:25 +08:00
xige-16 0318f150af
Print log after segment search done (#17877)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-29 20:08:18 +08:00
congqixia 20af4dbe2d
Fix querycoord cannot update deltaChannel info (#17901) (#17906)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-29 16:14:18 +08:00
zhenshan.cao e8efa7896a
Fix mingw: update pacman-key in case of first failure (#17882)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-06-28 22:40:17 +08:00
ThreadDao 6b77bf4b06
[test] Update insert cases (#17867)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-06-28 19:58:25 +08:00
bigsheeper 2e63738884
Log segment type as much as possible in QueryNode (#17869)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-28 17:00:18 +08:00
XuanYang-cn 8d915c9c68
Fix compaction panic (#17841)
See also: #17823

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-06-28 16:58:20 +08:00
bigsheeper 34b855c57b
Remove temporary variable to prevent memory fragmentation (#17743)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-28 16:30:23 +08:00
ThreadDao 3a1b15bf35
[test][skip-e2e] Update scale test image tag to 2.1 and update operator apiVersion (#17837)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-06-28 16:24:17 +08:00
cai.zhang 69cad38ade
IndexNode still writes finished state to ETCD when task was deleted (#17826)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-28 12:10:17 +08:00
cai.zhang a36e163903
Make sure indexes are successfully dropped when DropCollection (#17827)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-28 11:24:21 +08:00
Bingyi Sun 5b26b310d2
Fix missing dml nodeIDs when recovering from old version (#17800) (#17842)
issue: #17416
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-06-28 10:14:17 +08:00
wayblink 03027dfe49
Move datacoord related methods from meta to globalMetaBroker (#17847)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-06-28 09:56:17 +08:00
cai.zhang 22b3c27cb1
Fixed the bug that IndexCoord lost some meta information (#17825)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-28 08:52:17 +08:00
yah01 2dd1dc092b
Fix handoff isn't processed correctly (#17738) (#17848)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>

Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>

Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-27 23:18:17 +08:00
congqixia 7a10ca02d2
Fix load progress complete before syncReplica (#17845)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-27 20:56:16 +08:00
shaoyue 7f23c21c48
RESTful api use same port as metrics & healthcheck (#17732) (#17817)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-06-27 15:58:16 +08:00
bigsheeper 4e2b2bfa3b
Check duplication before adding channel info in DataCoord (#17784)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-25 14:00:15 +08:00
binbin 62036e3373
[skip e2e] Update test case for code change (#17795)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-06-25 13:38:15 +08:00
zhagnlu ce67ad3524
Fix: Miss channel info when load growing segment (#17789)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-06-25 11:38:15 +08:00
yah01 0d8e0e1326
SyncReplicaSegments syncs all segments (#17774) (#17790)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-25 11:20:15 +08:00
yah01 9589eb4345
Fix LoadBalance removes source nodes from DmChannel (#17744) (#17783)
Only NodeDown LoadBalance should remove source nodes

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-24 21:08:15 +08:00
ThreadDao 4b9ec5f506
Upgrade set-tools to fix scale python install (#17765)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-06-24 17:14:18 +08:00
wayblink 6c47ea2f85
Fix: WatchDmChannelsRequest can be too large to save in etcd (#17755)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-06-24 15:12:16 +08:00
zhenshan.cao 1fb2b9fed8
Refine logs to reduce print (#17759)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-06-24 11:56:17 +08:00
SimFG 08c576762d
Remove the `WithOptions` for avoiding the log object being cloned continuously (#17745) (#17752)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-06-24 11:18:14 +08:00