Commit Graph

21786 Commits (f83567c0d0a5b2428d8fef711f344eb32842b924)

Author SHA1 Message Date
Ted Xu f83567c0d0
fix: correct memory size estimation on arrays (#40377)
See: #40342
pr: #40312

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-03-06 17:42:04 +08:00
congqixia 89bc94595d
fix: [2.5] Pass Knapsnak ptr to avoid compact multiple times (#40401)
Cherry-pick from master
pr: #40400 
Related to #40388

The small segments may be put into bucket twice due to value parameter
of Knapsnap.packWith

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-06 14:16:03 +08:00
congqixia 1df4631a3f
enhance: [2.5] Remove debug log in rg handler v2 (#40376) (#40393)
Cherry-pick from master
pr: #40376
Remove debug log in resource group handler

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-06 14:14:12 +08:00
groot a1b9e3ccb6
fix: Fix a crash issue of bulkinsert (#40304)
issue: https://github.com/milvus-io/milvus/issues/40291
pr: https://github.com/milvus-io/milvus/pull/40331

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2025-03-05 21:36:08 +08:00
nico 493b7a5bc3
test: update teardown collection after rename[2.5] (#40380)
pr: #40379

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-03-05 20:30:03 +08:00
aoiasd ebf3416245
fix: main dispatcher not terminate cause messsage stream leak. (#40061) (#40351)
Main dispatcher will leak when we remove solo dispatcher in the end.
relate: https://github.com/milvus-io/milvus/issues/40046
pr: https://github.com/milvus-io/milvus/pull/40061

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-03-05 20:14:02 +08:00
Spade A 345ca01634
fix: [2.5]fix concurrent issues in null offset #40363 (#40365)
issue: https://github.com/milvus-io/milvus/issues/40308
cherry-pick: https://github.com/milvus-io/milvus/pull/40363

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-03-05 16:54:09 +08:00
Zhen Ye a0f18e8c88
enhance: better logging for grpc resolver (#40338)
issue: #40311
pr: #40337

- better logging for grpc resolver
- remove the redundant streaming node manage client when streaming
service is disable

Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-05 15:14:01 +08:00
nico dddd2075bc
test: update sdk version and test cases[2.5] (#40359)
pr: #39960

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-03-05 12:56:01 +08:00
yihao.dai 7cbd40c7a1
fix: [2.5] Fix parsing import endTs (#40333)
Parsing import beginTs, endTs as a hybrid timestamp.

issue: https://github.com/milvus-io/milvus/issues/40326

pr: https://github.com/milvus-io/milvus/pull/40332

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-05 11:40:13 +08:00
sre-ci-robot 9a42d3dc37
[automated] Update cpu Builder image changes (#40345)
Update cpu Builder image changes
See changes:
825316670d
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-03-05 11:24:02 +08:00
sre-ci-robot 1832fcdd4e
[automated] Update gpu Builder image changes (#40344)
Update gpu Builder image changes
See changes:
825316670d
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-03-05 11:22:15 +08:00
SimFG 6ab8e84f1e
fix: [2.5] improve error handling and unit tests for InitMetaCache function (#40324)
- issue: #40320
- pr: #40322

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-05 11:08:13 +08:00
congqixia cc7d4ce399
fix: [2.5] Add duplication param check for create index (#40254) (#40330)
Cherry-pick from master
pr: #40254 
Related to #40156

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-05 10:10:01 +08:00
Zhen Ye 34f2bc0a68
enhance: add more metrics for async cgo component (#40232)
issue: #40014
pr: #40136

Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-05 09:16:00 +08:00
Ted Xu f02e549840
fix: compaction task cannot be genereted if size greater than max size (#40350)
See: #40343
pr: #40348

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-05 00:40:01 +08:00
Bingyi Sun 825316670d
enhance: upgrade rust version to 1.83 (#39295) (#40317)
issue: #39254
pr: https://github.com/milvus-io/milvus/pull/39295

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-04 17:42:04 +08:00
Zhen Ye b55327046f
fix: duplicate consuming from stream for invisible segment (#40318)
issue: #40207
pr: #40316

Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-04 16:10:05 +08:00
zhuwenxing 29c2354593
test: [cherry-pick]fix text match (#40296)
pr: https://github.com/milvus-io/milvus/pull/40295

/kind improvement
2025-03-03 21:24:01 +08:00
congqixia 4272703de4
enhance: Bump milvus & proto version to v2.5.6 (#40293)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-03 16:52:00 +08:00
liliu-z 6fd5af3605
fix: [2.5] Change CMake variable for switch to knowhere-cuvs (#40289)
issue: #39883
pr: #40105

Signed-off-by: Mickael Ide <mide@nvidia.com>
Signed-off-by: Li Liu <li.liu@zilliz.com>
Co-authored-by: Micka <ide.mickael@gmail.com>
2025-03-03 14:48:00 +08:00
yanliang567 2f7cce11a3
test: Update get index params method (#40244)
related issue: #40156
remove the old get index params method and update the new one

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-03-03 14:40:05 +08:00
nico b046d44065
test: update drop collection in teardown method[2.5] (#40286)
pr: #40271

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-03-03 14:23:59 +08:00
Chun Han d754e0bb7e
fix: restful drop db properties failed(#39953) (#40260)
related: #39953
pr: https://github.com/milvus-io/milvus/pull/40257

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-03-03 10:22:02 +08:00
SimFG a945345110
fix: [2.5] use the different msg type for the OperatePrivilegeV2 api (#40193)
- issue: #40178
- pr: #40192

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-03 10:20:01 +08:00
yihao.dai 893caee467
fix: [2.5] Fix task delta cache data race (#40262)
issue: https://github.com/milvus-io/milvus/issues/40258

pr: https://github.com/milvus-io/milvus/pull/40259

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-02 16:52:10 +08:00
congqixia 3f76e1c6d1
enhance: [GoSDK][2.5] Use pkg v2 module path (#40134) (#40269)
Cherry-pick from master
pr: #40134
Related to #39095
Previous PR #39990 update pkg module path using "/v2" package name, this
PR update milvusclient go sdk dependency for this update

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-01 11:00:01 +08:00
wei liu 82c000a4b2
fix: task delta cache leak due to duplicate task id (#40184)
issue: #40052
pr: #40183

task delta cache rely on the taskID is unique, so it incDeltaCache at
AddTask, and decDeltaCache at RemoveTask, but the taskID allocator is
not atomic, which cause two task with same taskID, in such case, it will
call incDeltaCache twice, but call decDeltaCacheOnce, which cause delta
cache leak.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-28 10:22:08 +08:00
zhuwenxing 00eda6fe31
test: [cherry-pick]add concurrent index creation verification (#40175)
pr: https://github.com/milvus-io/milvus/pull/40174

/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-27 20:11:59 +08:00
zhuwenxing bc318732ad
test: fix checker function name, release mistake and add nullable (#40092)
pr: https://github.com/milvus-io/milvus/pull/40135

/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-27 20:10:09 +08:00
wei liu 14f05650e3
enhance: clean shard location cache after collection released (#40228)
issue: #40077
pr: #40088

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-27 19:42:05 +08:00
congqixia 2f4f5945cb
enhance: [2.5] Unify milvus version def (#40229)
Cherry-pick from master
pr: #40227 
Related to #40216

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-27 14:17:58 +08:00
zhikunyao 0ff731487f
enhance: bump etcd version to 3.5.18 (#40230)
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-02-27 11:52:00 +08:00
sre-ci-robot bc77bc18c9
[automated] Bump milvus version to v2.5.5 (#40224)
Bump milvus version to v2.5.5
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-02-27 10:56:06 +08:00
nico 1d048cb25a
enhance: [skip e2e] change nightly running time[2.5] (#40218)
pr: #40219

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-02-26 19:18:08 +08:00
yanliang567 84f7e2d895
test: Update search iterator result check for dup ids (#40190)
Related issue: #40161 
1. fix the search iterator result assertion for dup ids
2. use normalized vectors for iterator tests

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-02-26 16:49:59 +08:00
zhuwenxing 32c00dbc1b
test: fix duplicate import file names in tests (#40182)
pr: https://github.com/milvus-io/milvus/pull/40181

/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-26 14:02:05 +08:00
zhenshan.cao 27fb8d9512
fix: create multiple identical indexes by accident (#40180)
issue: https://github.com/milvus-io/milvus/issues/40163
pr: https://github.com/milvus-io/milvus/pull/40179

---------

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2025-02-25 22:19:56 +08:00
yihao.dai eee98fd044
fix: [2.5] Fix collections with duplicate names can be created (#40147)
This PR introduces two restrictions:

1. Before dropping a collection, all aliases associated with that
collection must be dropped.
2. When creating a collection, if the collection name duplicates any
alias, the collection creation will fail.

issue: https://github.com/milvus-io/milvus/issues/40142

pr: https://github.com/milvus-io/milvus/pull/40143

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-25 22:07:56 +08:00
zhagnlu d60511abc3
Revert "fix:fix create duplicated index when concurrency request (#40… (#40176)
…162)"

This reverts commit 34f907fd5d.
pr: #40164

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-02-25 17:55:11 +08:00
zhagnlu c45771af6a
enhance: add monitor metric for retrieve raw data (#40155)
pr: #40141

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-02-25 14:41:56 +08:00
zhagnlu 34f907fd5d
fix:fix create duplicated index when concurrency request (#40162)
pr: #40164

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-02-25 13:49:07 +08:00
cai.zhang 4a75fdac03
enhance: Remove task meta when task is no need to do (#40146)
issue: #39911 

master pr: #39084

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-25 10:35:57 +08:00
nico 0c6518f344
test: add iterator check and update sdk version and cases[2.5] (#40132)
pr: #39798 #39960

Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-02-24 19:13:56 +08:00
Bingyi Sun 29579a8ec9
fix: Fix search failure of null expression (#40128)
issue: https://github.com/milvus-io/milvus/issues/40095
pr: #40129

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-02-24 18:35:55 +08:00
cai.zhang 69f6849dc4
fix: [2.5] Fix bug where prefix matching fails when wildcards are in prefix (#40021)
issue: #40019 

master pr: #40020

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-24 18:03:55 +08:00
yihao.dai b6b03ff74c
enhance: [2.5] Accelerate listing objects during binlog import (#40048)
issue: https://github.com/milvus-io/milvus/issues/40030

pr: https://github.com/milvus-io/milvus/pull/40047

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-24 15:59:56 +08:00
cai.zhang fdad35e668
fix: [2.5] Set task version for stats task (#40130)
issue: #40034 

master pr: #40035

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-24 15:43:55 +08:00
Xianhui Lin a4eb2ce224
fix: [2.5]Revert qc statschecker for json key stats (#40125)
Revert qc statschecker for json key stats
issue:https://github.com/milvus-io/milvus/issues/36995
pr:https://github.com/milvus-io/milvus/pull/39876

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-02-24 13:31:55 +08:00
Chun Han cb82b040a7
enhance: support create collection with description(#40022) (#40028)
related: #40022
pr: https://github.com/milvus-io/milvus/pull/40023

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-24 09:55:57 +08:00