cfab3e4072
Add more logs for debugging load balance ( #21390 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-27 15:59:30 +08:00
62668b891c
fix leader observer sync logic ( #20478 ) ( #21315 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-12-20 16:33:26 +08:00
69b7eeb7b7
Fix observers may update current target to a unfinished next target ( #21107 ) ( #21280 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-19 15:03:25 +08:00
642d63c57d
update target ( #19296 ) ( #21202 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: wei liu <wei.liu@zilliz.com>
2022-12-16 15:23:25 +08:00
0c8aaa5d0b
Handler ErrCompacted for handler observer ( #21226 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-14 18:27:23 +08:00
df8c67fe87
Check whether segments are fully loaded while fetching shard leaders ( #20991 ) ( #21139 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-12 21:49:22 +08:00
f868144c46
Make progress if any channel/segment was loaded on node ( #20775 ) ( #21163 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-12 19:33:22 +08:00
124ff014da
Load should base on the accurate loaded number ( #21133 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
2022-12-12 18:15:22 +08:00
2823d23db0
Use channel-cp as seekPosition when FromDmlCPLoadDelete ( #21150 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-12-12 17:47:22 +08:00
5bf76a8fef
Refine log level ( #20896 ) ( #20902 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-12-02 10:11:16 +08:00
b4115c65ff
Optimize scheduler, increase merge tasks probability ( #20922 ) ( #20931 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-01 17:33:16 +08:00
802f512161
Etcd config source support TLS ( #20874 ) ( #20910 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-01 14:19:16 +08:00
c5f215da67
Refactor task scheduler and executor ( #20828 ) ( #20900 )
...
Make the performance able to scale out
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-30 16:37:17 +08:00
61baf7dada
Remove some logs from debug to info ( #20699 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-29 21:09:15 +08:00
64e9cb3061
Only balance segement in targets ( #20709 ) ( #20750 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-11-22 09:49:11 +08:00
efa1cf7f23
fix mannual balance with empty segment list ( #20739 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-21 19:31:12 +08:00
3a42122b63
Task/Action won't finish util the RPC returned ( #20669 ) ( #20691 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
2022-11-17 20:41:09 +08:00
8b682fdeac
fix duplicate watch channel task ( #20670 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-17 15:31:09 +08:00
15ae68faa5
Refresh targets atomically ( #20666 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-17 14:15:08 +08:00
6b1bb85426
Only balance segments in targets ( #20636 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-16 14:33:11 +08:00
a28edf9643
Add version for subscribed channel ( #20585 ) ( #20592 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 14:53:07 +08:00
69cbbfc44a
Record load latency for loaded collection ( #20538 ) ( #20590 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 14:25:08 +08:00
bb19bf20d8
Scheduler should returns err if the queue is full ( #20539 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-14 10:27:07 +08:00
7c502601b1
skip balance on loading collection ( #20507 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-11 16:01:04 +08:00
8f13fcd612
Only log if the refresh actually happens ( #20505 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-11 14:37:05 +08:00
faa2df3aac
Clear stale replicas ( #20487 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-11 10:25:06 +08:00
ea45a2aa4b
Refine QueryCoordV2 metrics ( #20471 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-10 17:09:06 +08:00
13dbc0902b
Fix querycoord metrics ( #20429 ) ( #20448 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-09 22:13:04 +08:00
2e78872be8
Refresh targets if haven't make progress for 5mins ( #20382 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-08 19:05:03 +08:00
e9d34d421d
skip handoff event on unloaded partition ( #20379 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-08 14:41:02 +08:00
261bfeebfd
Refine task's priority ( #20364 ) ( #20370 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-07 17:23:03 +08:00
c08f11420f
Fix Release tasks may end with incorrect status ( #20263 )
...
If the resource has been removed, the release tasks should end with
Succeeded status, not stale
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-03 15:01:35 +08:00
56605980df
Make sure the query node isn't created repeatedly in concurrent situation ( #20197 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-11-02 09:37:34 +08:00
4f6b87311e
Refine request merger ( #20189 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-01 14:27:34 +08:00
0b939c5735
Check whether ubsubscribe/release task is stale ( #20165 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-01 12:33:35 +08:00
9293524de4
remove outdated handoff event ( #20181 )
...
Signed-off-by: wei.liu <wei.liu@zilliz.com>
Signed-off-by: wei.liu <wei.liu@zilliz.com>
2022-10-31 19:11:40 +08:00
2ff21f0e10
Fix querycoord stop panic ( #20155 )
...
Signed-off-by: sunby <sunbingyi1992@gmail.com>
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2022-10-31 12:05:34 +08:00
4412cfcaaf
reduce querycoord unnecessary panic ( #19925 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-10-28 17:15:32 +08:00
8bfa55e560
Fix memory & goroutine leak ( #20152 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-28 14:55:32 +08:00
3ff0112e49
Fix querynode panic occasionally ( #20106 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-10-27 10:05:31 +08:00
976e9940bf
Add some logs for handoff observer ( #20097 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-10-26 19:37:31 +08:00
d8ca56e084
Fix empty segment handoff fails ( #20073 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-10-26 16:49:31 +08:00
5429a973b4
Fix forget to fill the channel name ( #20070 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-25 21:49:32 +08:00
f0c616050a
Reduce and improve quota center log ( #20058 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-25 19:39:30 +08:00
3d316fc052
Fix Query Log Level ( #19995 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-25 19:29:36 +08:00
aa6b8af80d
Migrate metadata of QueryCoord from 2.1 to 2.2 ( #19986 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-24 23:41:35 +08:00
581e1d8c35
Fill MsgBase ALL ( #19912 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-10-21 15:57:28 +08:00
470e8ef419
Store index ID to filter out invalid handoff event ( #19703 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-20 11:29:27 +08:00
87248dc1a9
fix clean handoff event ( #19903 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-10-19 20:41:26 +08:00
52cd40fbc4
Remove codes related to deprecated field ( #19897 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-19 18:29:26 +08:00
Xiaofan
wei liu
yah01
Bingyi Sun
congqixia
smellthemoon
bigsheeper
Jiquan Long
Enwei Jiao
Jenny Li
SimFG
jaime