a2365e4b2a
enhance: [2.3] Add concurrency for datacoord segment GC ( #29557 )
...
issue: #29553
pr: https://github.com/milvus-io/milvus/pull/29561
/kind improvement
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-01-03 13:16:57 +08:00
5ba0f476d5
fix: [2.3]parse logID from logPath if copyDeltalog find logID not provided ( #29276 )
...
Cherry-pick from master
pr: #29273
See also: #29272
This PR add `getDeltaLogID` to safely return logID when Binlog struct
has zero value logID. It parses logID from logPath if the format is
valid. Otherwise, this function shall return error.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-12-27 14:42:46 +08:00
26b1853c54
fix: Auto balance param can't be updated by dynamic( #29501 ) ( #29502 )
...
pr: #29501
This PR fixed that auto balance param can't be updated by dynamic
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-12-27 14:30:53 +08:00
908e075fdb
enhance: [Cherry-pick] pack datacoord Cluster and SessionManager with interface and mock them ( #29171 )
...
relate: https://github.com/milvus-io/milvus/issues/28861
https://github.com/milvus-io/milvus/issues/28854
pr: https://github.com/milvus-io/milvus/pull/28869
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-12-25 14:42:44 +08:00
b69543c7dc
fix: [2.3] Clean the compaction plan info to avoid the object leak ( #29368 )
...
issue: https://github.com/milvus-io/milvus/issues/29296
pr: #29365
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-12-22 12:02:44 +08:00
74e72ce27e
enhance: [2.3] Support to get the param value in the runtime ( #29298 )
...
pr: #29297
/kind improvement
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-12-21 20:36:43 +08:00
9acf32a0b7
enhance: [cherry-pick] change cp metric to absolute unix ts ( #29328 ) ( #29337 )
...
Cherry pick from master
pr: #29328
See also #29327
Change channel checkpoint metrics to unix seconds instead of checkpoint
timestamp lag value
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-12-20 15:04:42 +08:00
3182b9df5b
fix: [Pick]Set the default index name to the name of the existing index ( #29281 )
...
issue: #29269
master pr: #29275
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2023-12-20 14:10:40 +08:00
7facaa0c40
fix: [Cherry-pick] fix unstable ConsistencyHashPolicy ut ( #28375 ) ( #29235 )
...
Fixes : #28372 , #29234
pr: #28375
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-12-15 18:34:38 +08:00
d8d699401b
enhance: [cherry-pick] Add http method to control datacoord garbage collection ( #29212 )
...
Cherry-pick from master
pr: #29052
See also #29051
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi.Xia <congqi.xia@zilliz.com>
2023-12-15 02:16:38 +08:00
d3cb489154
enhance: Change channel to Interface ( #27839 ) ( #29161 )
...
This PR changes `*channel` into RWChannel interface
See also: #25309
pr: #27839
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-12-14 11:50:36 +08:00
286dce0d3a
enhance: Add config for auto upgrade segment index ( #29112 ) ( #29133 )
...
pr: #29112
This PR add config for auto upgrade segment index to index engine's
version.
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-12-12 17:26:38 +08:00
5f4ac437b2
enhance: [Cherry-pick] Moving etcd client into session ( #27069 ) ( #28996 )
...
relate: #26694
pr: https://github.com/milvus-io/milvus/pull/27069
Signed-off-by: Filip Haltmayer <filip.haltmayer@zilliz.com>
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
Co-authored-by: Filip Haltmayer <81822489+filip-halt@users.noreply.github.com>
2023-12-07 16:22:34 +08:00
de28b73fe0
enhance: [2.3] Use a non-blocking method to trigger compaction when saveBinlogPath is executed ( #28977 )
...
/kind improvement
issue: #28924
pr: #28941
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-12-07 13:14:34 +08:00
f4468dfd15
fix: [cherry-pick] Check whether compaction plan exist before update( #28826 ) ( #28892 )
...
pr: #28826
Fix #28825
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-12-04 10:02:33 +08:00
0688ec4d83
enhance: [cherry-pick] Add channel checkpoint ts lag metric ( #28767 ) ( #28776 )
...
Cherry-pick from master
pr: #28767
See also #28765
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-11-28 19:28:28 +08:00
7afd7553ed
feat: trigger compaction to handle index version ( #28442 ) ( #28754 )
...
issue: https://github.com/milvus-io/milvus/issues/28441
pr: https://github.com/milvus-io/milvus/pull/28442
---------
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-11-28 10:24:26 +08:00
9378f78218
enhance: Add logs for each step during service initialization ( #28687 )
...
/kind improvement
pr: #28624
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-11-27 17:54:26 +08:00
6512b12fba
enhance: [cherry-pick] Make etcd kv request timeout configurable ( #28661 ) ( #28701 )
...
Cherry-pick from master
pr: #28661
See also #28660
This pr add request timeout config item for etcd kv request timeout
Sync the default timeout value to same value for etcdKV & tikv config
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-11-24 21:16:26 +08:00
1b86efbafb
fix: [cherry-pick] error root path for catalog when using tikv ( #28463 )
...
Related Issue: #28162
Related pr: #28163
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2023-11-24 14:28:24 +08:00
968d6fdcde
fix: Fix bug for parse expression that include quotes ( #28418 )
...
master pr: #28416
issue: #28365
Fix bug for parsing error when a string enclosed in single quotes in an
expression contains multiple double quotes.
such as:
```
expr = "tag == '\"blue\"'"
```
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2023-11-24 11:02:24 +08:00
33bbdf6c88
fix: Fix channel manager bg checker exit when disable auto balance ( #28459 ) ( #28606 )
...
issue: #28454
pr: #28459
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-11-23 19:18:29 +08:00
1383680b3a
add internal storage metrics ( #28279 )
...
/kind improvement
issue: #28277
pr: #28278
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-11-19 17:22:25 +08:00
fe7c87592c
Fix auto balance block channel reassign after datanode restart ( #28276 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-11-09 13:52:19 +08:00
d3f149c403
fix unstable auto balance config ut ( #28289 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-11-09 10:02:19 +08:00
12a09231f1
fix datacoord unstable ut ( #28282 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-11-08 18:44:58 +08:00
918333817e
Disable auto balance when old node exists ( #28191 ) ( #28224 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-11-08 07:10:17 +08:00
304f232a02
Fix bug for setting index state when indexnode connecting failed ( #28221 )
...
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2023-11-07 23:34:26 +08:00
d10a82dba4
Fix getting incorrect CPU num ( #28178 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-11-07 11:52:22 +08:00
7b55860566
remove binlog/delta log from getRecoveryInfoV2 ( #27895 ) ( #28090 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-11-02 10:06:14 +08:00
6749957e71
Refine RPC call in unwatch drop channel ( #27864 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-10-24 17:46:15 +08:00
2ea7579dbb
Reduce rpc size for GetRecoveryInfoV2 ( #27483 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-10-23 21:44:09 +08:00
6060dd7ea8
Add chunk manager request timeout ( #27692 )
...
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2023-10-23 20:08:08 +08:00
d2dbbbc11b
Reduce write lock scope in channel manager ( #27823 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-10-21 07:58:16 +08:00
9b0ecbdca7
Support to replicate the mq message ( #27240 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-10-20 14:26:09 +08:00
49516d44b4
Add ctx parameter and log tracer for watch and selectNodes ( #27809 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-10-20 04:22:11 +08:00
c0edc22a6e
Limiting the idempotence check for index to user index params ( #27615 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-10-18 20:18:24 +08:00
49b3a12804
Return newly defined merr instead of grpc unimplemented err ( #27751 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-10-18 15:32:11 +08:00
efe8984eca
Fix Flush error message typo ( #27729 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-10-17 17:18:09 +08:00
b7bfccaf21
Add channel name paramter in `FlushSegmentsRequest` ( #27725 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-10-17 12:00:10 +08:00
e3f2122618
Expose metrics of stanby coordinators ( #27698 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-10-16 15:04:09 +08:00
e386a62fae
Remove recollect segment stats during starting datacoord ( #27410 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-10-16 10:26:09 +08:00
ec1fe3549e
Add a stop hook to clean session ( #27564 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-10-16 10:24:10 +08:00
c882e9c87b
Fix compatibility of Flush ( #27543 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-10-13 18:01:39 +08:00
be980fbc38
Refine state check ( #27541 )
...
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-10-11 21:01:35 +08:00
cb71a3e235
rm dependency to rc when getting recovery info( #25363 ) ( #27405 )
...
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
2023-10-09 18:51:32 +08:00
41495ed266
Improve the error message for getting all indexes of collection ( #27389 )
...
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-10-08 21:23:32 +08:00
a3188231b3
Remove the log for GetFlushableSegments in the datacoord ( #27503 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-10-08 10:05:31 +08:00
5d558623fe
Add revive sub-lints and fix existing problems ( #27495 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-10-07 20:53:38 +08:00
8394b3a1ec
Block creating new error from status reason ( #27426 )
...
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-10-07 11:29:32 +08:00
SimFG
congqixia
wei liu
aoiasd
cai.zhang
XuanYang-cn
MrPresent-Han
Enwei Jiao
jaime
chyezh
PowderLi
yah01
Xiaofan
zhagnlu
zhenshan.cao
yihao.dai
wayblink