Commit Graph

21 Commits (0f514708ff8e50116fad2ea40061f876d06921d4)

Author SHA1 Message Date
wei liu c056620899
fix: Skip unnecessary query node health check in proxy (#36491)
issue: #36490
After the query node changes from a delegator to a worker, proxy should
skip this querynode's health check.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-09-26 18:13:15 +08:00
wei liu 3b10085f61
enhance: Optimize workload based replica selection policy (#36181)
issue: #35859

This PR introduce two new param: toleranceFactor and checkRequestNum,
after every checkRequestNum request has been assigned, try to compute
querynode's workload score.

if the diff is less than the toleranceFactor, replica selection policy
will fallback to round_robin, which reduce the average cost to about
500ns.

if the diff is larger than the toleranceFactor, replica selection policy
will compute querynode's score to select the target node with smallest
score in every assigment.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-09-20 12:33:11 +08:00
wei liu ca8eee2c47
fix: Set node unreachable when get shard client failed (#31277)
issue: #30531

cause get client from `shardClientMgr`, doesn't means query node is
unavailable. because of the ref counter policy in `shardClientMgr`,
which will clean the client, if no collection use qn as shard leader.

This PR fix that set node unreachable when get shard client failed.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-03-15 10:23:03 +08:00
jaime 7f7c71ea7d
Decoupling client and server API in types interface (#27186)
Co-authored-by:: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-09-26 09:57:25 +08:00
SimFG 26f06dd732
Format the code (#27275)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-09-21 09:45:27 +08:00
wei liu 1097776477
stop heartbeat if reach heartbeat limit (#26728)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-09-04 17:51:48 +08:00
wei liu 2aab9b3234
fix proxy to querynode heartbeat failed counter logic (#26563)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-08-30 16:31:01 +08:00
wei liu 05c87af146
fix unexpected score in look aside balancer (#26213)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-08-10 19:45:16 +08:00
wei liu 518b6310a2
refine retry times on replica (#26043)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-08-03 15:55:09 +08:00
wei liu 302897f866
refine look aside balance logic (#25837)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-25 18:51:01 +08:00
aoiasd 77a9553c3f
Add some log when node being reachable or unreachable (#25572)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-07-18 10:35:20 +08:00
yah01 948d1f1f4a
Handle errors by merr for QueryCoord (#24926)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-07-17 14:59:34 +08:00
wei liu 04a2ddda17
refine rated log of look aside balancer (#25637)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-17 14:49:34 +08:00
wei liu fc9a6dc241
fix compute score on replica selection (#25582)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-14 10:02:31 +08:00
wei liu b7b249770c
enable metrics expire for replica selection (#25360)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-06 19:04:25 +08:00
wei liu 951c312ef9
refine grafana metrics for replica selection (#25319)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-05 17:00:25 +08:00
smellthemoon b30517d303
Enlarge timeout to prevent health check failure (#25173)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-06-29 17:10:23 +08:00
wei liu 9b91519c88
fix search cost metrics on replica selection (#25059)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-06-27 19:02:44 +08:00
congqixia 0fefc52aac
Make lookAsideBalancer checkHealth in parallel (#25155)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-27 15:18:45 +08:00
wei liu 17796743dd
add metrics for replica selection (#25037)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-06-27 09:52:44 +08:00
wei liu 46f7d903a3
enable look aside balancer on replica selection (#24791)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-06-16 18:38:39 +08:00