bc91b2a4ad
fix: [2.5] metastore privilege name check with privilege name all ( #39492 )
...
cherry-pick from master: https://github.com/milvus-io/milvus/pull/39476
related: https://github.com/milvus-io/milvus/issues/39365
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-01-26 12:17:19 +08:00
8934672687
enhance: [2.5] Skip update index metrics if index dropped ( #39458 ) ( #39572 )
...
Cherry-pick from master
pr: #39458
Related to #39457
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-24 18:21:06 +08:00
a48749cc11
enhance: [2.5] Use mockery pkg config for datacoord&datanode ( #39567 ) ( #39577 )
...
Cherry-pick from master
pr: #39567
Related to #38339
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-24 17:21:13 +08:00
c8327934a6
fix: [2.5]not enable rate limiter for restful v1 ( #39555 )
...
issue: #39556
pr: #39553
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-01-24 14:05:13 +08:00
6f7b2b4e75
enhance: [2.5] Refine error msg for schema & index checking ( #39533 ) ( #39565 )
...
Cherry-pick from master
pr: #39533
The error message was malformated or missing some meta info, say field
name. This PR recitfies some message format and add field name in error
message when type param check fails.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-24 13:43:06 +08:00
758ac5a492
fix: [2.5]Adjust segment loader's memory estimate for intermin indexes ( #39509 )
...
issue: https://github.com/milvus-io/milvus/issues/27678
related 2.4 pr: https://github.com/milvus-io/milvus/pull/39508
related 2.5 pr: https://github.com/milvus-io/milvus/pull/39509
related master pr: https://github.com/milvus-io/milvus/pull/39507
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2025-01-24 11:19:14 +08:00
3789c9088a
[automated] Bump milvus version to v2.5.4 ( #39547 )
...
Bump milvus version to v2.5.4
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-01-24 10:29:15 +08:00
6cdabd9002
fix:fix GetValueFromConfig for bool type ( #39527 )
...
pr: #39526
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-01-23 00:03:07 +08:00
30411d6d3a
fix: [2.5] deny to set the mmap param for the alter index api ( #39520 )
...
- issue: #39517
- pr: #39518
Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-01-22 23:55:06 +08:00
4602e97888
fix: [2.5] Set the stating state correctly ( #39514 )
...
issue: #39333
master pr: #39503
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-01-22 18:38:29 +08:00
cbf1161177
fix: [2.5] Set deltalogs for stats task after set segment stating ( #39502 )
...
issue: #39333
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-01-22 16:29:06 +08:00
e46c8ba7fb
fix: [2.5]Set isStating to ensuer mutual exclusive between L0 compacting and stats ( #39490 )
...
issue: #39333
master pr: #39489
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2025-01-22 10:27:05 +08:00
c1c1f2df4e
test: [2.5] add test cases for template param ( #39475 )
...
issue: #33419
pr: #38867
- add case for Get
- add case for TemplateParam
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2025-01-22 09:55:24 +08:00
a90bd9e417
test:[cp2.5] add search iterator v2 case for milvus client ( #39447 )
...
issue: #37548
pr: #39400
Signed-off-by: qixuan <673771573@qq.com>
2025-01-22 09:53:06 +08:00
8475d8b193
fix: cherry pick warmup async ( #39402 ) ( #39474 )
...
related pr: https://github.com/milvus-io/milvus/pull/38690
issue: https://github.com/milvus-io/milvus/issues/38692
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-01-21 15:25:05 +08:00
20c6de156e
feat: update milvusproto version to 2.5.5 ( #39478 )
...
feat: update milvusproto version to 2.5
issue: https://github.com/milvus-io/milvus/issues/39093
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-01-21 15:11:05 +08:00
f912cbf86d
enhance:[Cherry-pick] skip load bm25 sparse row data ( #39207 )
...
pr: https://github.com/milvus-io/milvus/pull/39078
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-01-21 11:05:04 +08:00
f7799f0add
fix:[2.5] check utf-8 format for varchar with analyzer open ( #39439 )
...
relate: https://github.com/milvus-io/milvus/issues/39285
pr: https://github.com/milvus-io/milvus/pull/39299
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-01-21 10:57:03 +08:00
83666f1bff
enhance: [2.5] Enable hook for importv2 ( #39430 )
...
/kind improvement
pr: https://github.com/milvus-io/milvus/pull/39429
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-21 10:29:04 +08:00
3b3959c625
enhance: [2.5]Add schema update time verification for insert and upsert to use cache ( #39382 )
...
enhance: Add schema update time verification for insert and upsert to
use cache
issue: https://github.com/milvus-io/milvus/issues/39093
Related to pr: https://github.com/milvus-io/milvus/pull/39096
---------
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-01-21 10:19:11 +08:00
817b616eb4
fix: [2.5]Restore the compacting state for stats task during recovery ( #39460 )
...
issue: #39333
master pr: #39459
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-01-21 01:03:05 +08:00
15d60c60c2
enhance: [2.5] remain token after authorize ( #39455 )
...
relate: https://github.com/milvus-io/milvus/issues/39285
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-01-20 20:27:04 +08:00
f62eca09a0
enhance: set materializedView.enabled default to true ( #39450 )
...
pr: #39449
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-01-20 19:55:04 +08:00
e4c6ef9d57
enhance: [2.5] serializes the resp body and attach some details ( #39401 )
...
issue: #37611
pr: #39140
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-01-20 18:17:10 +08:00
ff53d4f742
enhance: [2.5]add some apis in Restful ( #39425 )
...
pr: #39105
issue: #38709
---------
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-01-20 18:15:22 +08:00
8e2e828a78
enhance: [2.5] Skip loading pk index for sorted segment in loader ( #39438 )
...
Cherry pick from master
pr: #39437
Related to #39339
Previous PR #39389 only skips append index into segment
Also related to #39428
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-20 18:07:04 +08:00
964000f645
fix: deleted the sealed segment data accidentally ( #39422 )
...
issue:https://github.com/milvus-io/milvus/issues/39333
pr: https://github.com/milvus-io/milvus/pull/39421
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2025-01-20 17:49:03 +08:00
6342237ca8
enhance: add workaround for concurrent tantivy reload and directory removal ( #39441 )
...
related pr: https://github.com/milvus-io/milvus/pull/39440
issue: https://github.com/milvus-io/milvus/issues/39428
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-01-20 17:33:05 +08:00
3893f24323
fix: apply custom producer config for kafkaHealthCheck ( #39364 )
...
issue: https://github.com/milvus-io/milvus/issues/39287
pr: https://github.com/milvus-io/milvus/pull/39283
Signed-off-by: DLT1412 <tuduc93@gmail.com>
2025-01-20 17:27:04 +08:00
6f9f840080
fix: Fix panic caused by removing directory ( #38622 ) ( #39434 )
...
related pr: https://github.com/milvus-io/milvus/pull/38622
issue: https://github.com/milvus-io/milvus/issues/39428
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-01-20 16:13:03 +08:00
8c35064d01
enhance: [2.5] clean up logs of empty op key ( #39394 )
...
cherry-pick from master: https://github.com/milvus-io/milvus/pull/39335
related: https://github.com/milvus-io/milvus/issues/39334
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-01-20 12:15:10 +08:00
4464966462
enhance: [2.5] Remove frequent observe log ( #39414 )
...
/kind improvement
pr: https://github.com/milvus-io/milvus/pull/39413
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-20 11:01:10 +08:00
6d5f174142
enhance: [2.5] add recalls response for restful api ( #39409 )
...
issue: #37899
pr: #39408
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-01-20 10:59:10 +08:00
efe76905c5
fix: correct remote centroids path in clustering compaction ( #39399 )
...
issue: https://github.com/milvus-io/milvus/issues/39353
pr: #39398
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-01-20 10:57:21 +08:00
c9b0859b16
fix: [cp25]Record active collections for l0Policy ( #39217 ) ( #39383 )
...
By recording the active collection lists, The l0 compaction trigger of
view change and idle won't influence each other.
Also this pr replaces the L0View cache with real L0 segments' change.
Save some memory and make L0 compaction triggers more accurate.
See also: #39187
pr: #39217
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-01-20 10:47:03 +08:00
57bcb1bfc0
fix: sparse: add inverted_index_algo and dim_max_score_ratio config ( #39362 )
...
issue: #39332
pr: #39358
Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
2025-01-18 12:17:03 +08:00
f704e3edef
test: [skip e2e][cherry-pick]fix pytest_addoption type ( #39397 )
...
pr: https://github.com/milvus-io/milvus/pull/38860
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-01-17 16:59:02 +08:00
b2f4df49d6
test: [cherry-pick]add scalar index for compatibility testing ( #39380 )
...
pr: https://github.com/milvus-io/milvus/pull/39291
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-01-17 16:11:02 +08:00
0c00f94965
fix: [2.5] Skip load extra indexes for sorted segment pk field ( #39390 )
...
Cherry-pick from master
pr: #39389
Related to #39339
Extra indexes can be ignored for most cases since sorted pk column
already provided indexing features
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-17 14:53:03 +08:00
bb32bda423
enhance: [2.5] Sync multipleChunkEnabled default value & milvus yaml ( #39373 )
...
Cherry-pick from master
pr: #39372
The default value and yaml have different values which may cause
confusion when upgrading from older version.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-17 12:07:02 +08:00
89a183c7c2
enhance: [2.5] enable task delta cache ( #39349 )
...
When there are many segment tasks in the querycoord scheduler, the
traversal in GetSegmentTaskDelta checks becomes time-consuming. This PR
adds caching for segment deltas.
issue: https://github.com/milvus-io/milvus/issues/37630
pr: https://github.com/milvus-io/milvus/pull/39307
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
2025-01-17 12:01:03 +08:00
5330fc981c
fix: panic when streaming release if using msgstream ( #39375 )
...
issue: #39367
pr: #39374
Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-17 11:55:03 +08:00
56cb1683eb
fix: Fix performance issue and use after free bug ( #39343 )
...
cherry pick some fixes in https://github.com/milvus-io/milvus/pull/39249
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-01-17 11:51:03 +08:00
47e410feb1
fix: [2.5] fix assignment operator in AssertInfo to comparison operator ( #39351 )
...
cp https://github.com/milvus-io/milvus/pull/39347
issue: #39346
Signed-off-by: SpadeA-Tang <tangchenjie1210@gmail.com>
2025-01-17 11:27:02 +08:00
0391b8c7d3
fix: update rg failed when alter database ( #39356 )
...
issue: #36933
pr: #39355
Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-17 10:37:03 +08:00
b69994272f
enhance: [2.5] Limit the maximum number of segments restored and fail the job if saving the binlog fails ( #39359 )
...
1. Limit the maximum number of restored segments to 1024.
2. Fail the import job if saving binlog fails.
3. Fail the import job if saving the import task fails to prevent
repeatedly generating dirty importing segments.
issue: https://github.com/milvus-io/milvus/issues/39331
pr: https://github.com/milvus-io/milvus/pull/39344
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-17 10:27:04 +08:00
e7520599df
fix: [2.5] remove param num_build_thread ( #39341 )
...
issue: #39090
pr: #39340
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-01-16 18:05:01 +08:00
6773fb10a8
enhance: [2.5] Read metadata concurrently to accelerate recovery ( #38900 )
...
Read metadata such as segments, binlogs, and partitions concurrently at
the collection level.
issue: https://github.com/milvus-io/milvus/issues/37630
pr: https://github.com/milvus-io/milvus/pull/38403
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-16 17:53:01 +08:00
9d2a0e775c
fix: [2.5] Fix slow dist handle and slow observe ( #38905 )
...
1. Provide partition&channel level indexing in the collection target.
2. Make SegmentAction not wait for distribution.
3. Remove scheduler and target manager mutex
4. Optimize logging to reduce CPU overhead.
issue: https://github.com/milvus-io/milvus/issues/37630
pr: https://github.com/milvus-io/milvus/pull/38566
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-16 17:07:02 +08:00
e68d161e60
enhance: Bump milvus & proto version to v2.5.4 ( #39330 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-16 15:39:03 +08:00
sthuang
congqixia
smellthemoon
cqy123456
sre-ci-robot
zhagnlu
SimFG
cai.zhang
ThreadDao
qixuan
Bingyi Sun
Xianhui Lin
aoiasd
yihao.dai
Gao
zhenshan.cao
Duc Le Tu
XuanYang-cn
sparknack
zhuwenxing
Zhen Ye
Spade A
foxspy