ea89a5d8b2
Fix QueryNode may panics when stopped ( #21406 ) ( #21419 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-29 15:49:31 +08:00
d75104445a
Avoid Sync when the segment open ( #21398 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-28 10:51:34 +08:00
cfab3e4072
Add more logs for debugging load balance ( #21390 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-27 15:59:30 +08:00
7d1ef09344
Add some debug log for segment creating ( #21369 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-27 15:07:29 +08:00
38f9ea5122
Fix invalid single compaction ( #21328 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-12-22 16:05:28 +08:00
3d1f7a88a7
[Cherry-pick] Refine json parser for import ( #21332 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-12-22 10:03:27 +08:00
62668b891c
fix leader observer sync logic ( #20478 ) ( #21315 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-12-20 16:33:26 +08:00
01e609daff
Fix proxy doesn't update shard leaders cache for some types of error ( #21185 ) ( #21303 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-20 13:29:27 +08:00
69b7eeb7b7
Fix observers may update current target to a unfinished next target ( #21107 ) ( #21280 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-19 15:03:25 +08:00
642d63c57d
update target ( #19296 ) ( #21202 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: wei liu <wei.liu@zilliz.com>
2022-12-16 15:23:25 +08:00
7e85971a58
Small candidate compaction should only happen with >1 segments ( #21250 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-16 10:03:27 +08:00
d3c7921fca
Upgrade Knowhere to 1.3.6 to fix bugs ( #21241 )
...
Signed-off-by: Li Liu <li.liu@zilliz.com>
Signed-off-by: Li Liu <li.liu@zilliz.com>
2022-12-15 09:19:23 +08:00
cf1490403b
Fixbug: proxy meta_cache partially update ( #21232 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-12-14 19:41:23 +08:00
001536d621
Fix panic while concurrent releasing payload writer/reader ( #21218 ) ( #21233 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-14 18:59:22 +08:00
0c8aaa5d0b
Handler ErrCompacted for handler observer ( #21226 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-14 18:27:23 +08:00
1c309a74ee
Fix metric with wrong label ( #21127 ) ( #21174 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-12-13 11:47:22 +08:00
184d3c3583
Make TopK Limit configurable ( #21155 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-12 23:01:24 +08:00
df8c67fe87
Check whether segments are fully loaded while fetching shard leaders ( #20991 ) ( #21139 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-12 21:49:22 +08:00
0dc9a0311c
Fill collection schema after DataCoord restarts ( #21161 ) ( #21164 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-12 20:25:22 +08:00
f868144c46
Make progress if any channel/segment was loaded on node ( #20775 ) ( #21163 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-12 19:33:22 +08:00
124ff014da
Load should base on the accurate loaded number ( #21133 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
2022-12-12 18:15:22 +08:00
2823d23db0
Use channel-cp as seekPosition when FromDmlCPLoadDelete ( #21150 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-12-12 17:47:22 +08:00
eb313d75ce
Move sync delete policy from deleteNode to insertBufferNode ( #21137 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-12-12 16:45:21 +08:00
0be9ba11d0
Use the copy method to get the casbin `Model` for every request ( #21145 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-12-12 16:41:21 +08:00
cc8cc985e6
Refine search logs in querynode ( #21136 )
...
- Make sure all logs logging with ctx
- Add an info log for searching on not-indexed segments
- Separate log prefix of shardleader and non-shardleaders
See also: #20975
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-12-12 15:23:22 +08:00
f209c9cc21
Fix the unsafe casbin `Model` ( #21132 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-12-12 14:19:22 +08:00
a974d72e84
Upgrade Knowhere to 1.3.5 to fix DiskANN aio issue ( #21135 )
...
Signed-off-by: Li Liu <li.liu@zilliz.com>
Signed-off-by: Li Liu <li.liu@zilliz.com>
2022-12-12 13:53:22 +08:00
38e699482d
Update healthz to support standby state and fix rootcoord active-standby ( #21130 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-12-12 12:21:25 +08:00
3a6eff32f4
Fix search failed on disk index when search_list equal to limit ( #21114 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-12-12 11:57:21 +08:00
f02ad7b71a
Fix flush didn't respect binaryvector and other schemas ( #21119 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-12 10:33:26 +08:00
50c7a80b2b
Add ut for ListWithPrefix of minio chunk manager ( #21105 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-12-11 16:37:22 +08:00
8d55a2cefa
Add indexCountLabel for metric QueryNodeNumEntities ( #21081 ) ( #21121 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-12-11 01:01:20 +08:00
41f7b10abb
Fix empty retrieve result ( #21032 ) ( #21066 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-12-09 16:37:20 +08:00
714782fce1
Add more test for file reader ( #21083 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-09 11:53:21 +08:00
61592cdecc
Fix start of DataCoord ( #20581 ) ( #21079 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-12-08 20:03:19 +08:00
7149b01c86
Fix the concurrent write issue when init privilege policy ( #21073 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-12-08 19:45:20 +08:00
a334853475
Fix group checker ut ( #21038 ) ( #21067 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-12-08 19:43:23 +08:00
368686e149
Prevent flushWatcher watches new segment just after GetFlushedSegments ( #21058 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-12-08 11:19:19 +08:00
d758a09490
Fix Group Checker test fail ( #20911 ) ( #21054 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-12-08 10:03:19 +08:00
5f77dbd00a
Forbid gc index meta when creating index ( #21024 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-12-07 19:15:20 +08:00
2f16432eea
Improve error message when target id not match ( #21043 ) ( #21048 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-07 18:27:21 +08:00
6041e5b805
Fix bug for ListWithPrefix from minio with recursive is false ( #21040 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-12-07 17:11:19 +08:00
93876c39dc
Remove bad & duplicate metric ( #21030 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 14:33:19 +08:00
9692f4ed0e
Fix compaction handler may double release and block forever ( #21015 ) ( #21019 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-07 14:31:26 +08:00
35173aa35c
Refine segment stat metrics on QueryNode ( #21029 )
...
issue: #20760
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 14:29:26 +08:00
790d6c324d
Fix segment_num, stored_rows_num and stored_rows_count metrics ( #21028 )
...
TODO: better track segment with state other than flushed and dropped.
/kind bug
issue: #20146 , #20145
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 14:27:20 +08:00
6dee58685e
Increase MaxWatchDuration and make it configurable ( #21010 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 10:19:19 +08:00
3e62688eb6
Split small segment proportion and small segment compactable proportion ( #21012 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 10:15:19 +08:00
b8be79fe27
Limit the rpc to 64M ( #20844 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-07 10:09:19 +08:00
7ea86ed3a3
Add ut for rootcoord/kv/kv_catalog.go ( #20909 ) ( #20974 )
...
Add ut for CreateCredential, GetCredential, Dropcredential,
ListCredentials, CreateRole, DropRole AlterUserRole, ListRole,
ListUser, ListUserRole, DeleteGrant, AlterGrant, ListGrant, and, ListPolicy
Fixes : #20833
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-12-05 15:39:22 +08:00
congqixia
Xiaofan
xige-16
groot
wei liu
yah01
Bingyi Sun
Ten Thousand Leaves
liliu-z
zhenshan.cao
Enwei Jiao
smellthemoon
bigsheeper
SimFG
XuanYang-cn
wayblink
cai.zhang
Jiquan Long