Commit Graph

21956 Commits (v2.5.10)

Author SHA1 Message Date
Bingyi Sun 5a8c98a2ed
fix: Fix json index does not work for string filter (#41383)
pr: #41382 
issue: #35528

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-04-17 16:41:13 +08:00
Xianhui Lin d54ad6cfc1
feat: [2.5]Ignore reporting index metrics for non-existent indexes (#41296)
feat: Ignore reporting index metrics for non-existent indexes

Remove the reporting of index metrics for non-existent indexes in the
getCollectionMetrics function. This change improves the code by skipping
unnecessary operations and reduces log noise.
issue: https://github.com/milvus-io/milvus/issues/41280
pr:https://github.com/milvus-io/milvus/pull/41294

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-04-17 16:28:34 +08:00
Chun Han a89b611b2a
fix: solve incompitable problem for none-encoding index (#41346)
related: https://github.com/milvus-io/milvus/issues/40838
pr: https://github.com/milvus-io/milvus/pull/40839

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-04-16 21:04:52 +08:00
Xianhui Lin b3d3a268b3
fix:[2.5]Add debug memory freeing in sortStats (#41285)
Add debug memory freeing in createJSONKeyIndex function
issue: https://github.com/milvus-io/milvus/issues/41218
pr:https://github.com/milvus-io/milvus/pull/41284

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-04-16 15:00:34 +08:00
박상호 741838a1dc
fix: [2.5] skip dim check for non-vector fields in PreCheck (#41287) (#41329)
issue: https://github.com/milvus-io/milvus/issues/41287
pr: https://github.com/milvus-io/milvus/pull/41289

Signed-off-by: Sangho Park <hoyaspark@gmail.com>
2025-04-16 11:32:33 +08:00
zhagnlu ebe1b1c9a9
fix:fix skip autoindex like expr (#41330)
pr: #41325

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-04-16 10:20:34 +08:00
congqixia f4c541e94a
fix: [2.5] Add save field schema log for kv_catalog.AlterCollection (#41242) (#41308)
Cherry-pick from master
pr: #41242
Related to #41241

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-15 23:42:36 +08:00
congqixia 55b37c3bb6
enhance: Bump milvus & proto version to v2.5.10 (#41328)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-15 19:50:32 +08:00
foxspy bbc715f43e
fix: [2.5] update knowhere version to fix mac build (#41315)
issue: #41314

Signed-off-by: xianliang <xianliang.li@zilliz.com>
2025-04-15 19:36:32 +08:00
zhagnlu 2aae9caca9
enhance: use scan mode for like although inverted index exists (#41309)
#41065

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-04-15 18:36:32 +08:00
cai.zhang 3e06b2c9e7
fix: [2.5] Fix panic with nil pointer dereference when get indexed segment (#41299)
issue: #41288 
master pr: #41297

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-04-15 18:08:32 +08:00
Spade A 699f8a6ada
fix: [2.5] change log info to debug for collection ref (#41269)
master: https://github.com/milvus-io/milvus/pull/41267
issue: https://github.com/milvus-io/milvus/issues/41268

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-04-15 17:28:31 +08:00
cai.zhang 04eae0b0f2
fix: [2.5] Close client before remove worker client (#41254)
issue: #41252 

master pr: #41253

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-04-15 10:28:53 +08:00
Chun Han afc0ca77e4
enhance: Optimize index format for improved load performance (#41041)
related: #40838
pr: https://github.com/milvus-io/milvus/pull/40839

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-04-15 07:07:38 +08:00
zhagnlu 2498eb0691
enhance: add optimize for like expr (#41222)
pr: #41066  cherry-pick from master

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-04-14 21:06:32 +08:00
sre-ci-robot f2e15a43f0
[automated] Bump milvus version to v2.5.9 (#41258)
Bump milvus version to v2.5.9
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-04-11 20:48:37 +08:00
congqixia b073112e16
enhance: [2.5][Restful] Make default timeout configurable (#41211) (#41225)
Cherry-pick from master
pr: #41211

The restful API default timeout was hard-coded. This PR make this
timeout value configurable via paramtable.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-11 13:12:27 +08:00
congqixia 89a1159ed5
enhance: [2.5][GoSDK] Cherry-pick commits and bump version to 2.5.2 (#41235)
Cherry-pick from master
pr: #41161 #41197 #41234

Related to #41108 #40928

Also this PR bump milvusclient go SDK version to v2.5.2

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-11 13:02:26 +08:00
congqixia de6687e27d
fix: [2.5] Remove noexcept from `CacheIndexToDiskInternal` (#41221)
Related to #41219

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-10 17:18:26 +08:00
wei liu 2e8445c2ef
fix: balance checker may enter infinite normal balance loop after balance suspension (#41196)
issue: #41194 
pr: #41195
- Refactor hasUnbalancedCollection flag handling to function scope
- Ensure tracking sets clearance when no balance needed
- Add deferred cleanup for both normal/stopping balance paths
- Add unit tests for collection tracking scenarios

The changes ensure tracking sets (normalBalanceCollectionsCurrentRound
and stoppingBalanceCollectionsCurrentRound) are properly cleared when:
- All collections in current round are balanced
- Balance checks return early due to unready targets
- Balance feature flags are disabled

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-04-10 15:18:28 +08:00
Bingyi Sun daa910af6f
fix: Use int32 when creating array index for element type int8/int16 (#41186)
issue: #41172 
pr: #41185 
Elements with type int8 or int16 in Array is encoded using int32, so we
should parse it as int32 when creating index.

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-04-10 11:08:26 +08:00
sthuang b7858d24a0
fix: [2.5] show collections support custom privilege groups granted objects (#41204)
cherry-pick from master: https://github.com/milvus-io/milvus/pull/41203
related: https://github.com/milvus-io/milvus/issues/41200

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-04-10 10:54:26 +08:00
yanliang567 409721d9e7
test: [cherry-pick] gen collection name by testcase name (#41193)
related issue: #40698 
pr: #41170

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-04-09 22:52:27 +08:00
SimFG 4d813c48d2
fix: [2.5] get replicate channel position (#41189)
- issue: #41187
- pr: #41188

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-04-09 20:52:26 +08:00
cai.zhang 23c86af730
fix: [2.5] Revert add a sign (positive or negative) to constants (#41192)
issue: #41174
master pr: #41191

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-04-09 20:06:27 +08:00
congqixia 7001474914
fix: [2.5][RESTFUL] Return error when writer body closed (#41184)
Cherry-pick from master
pr: #41183
Related to #41181

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-09 19:37:09 +08:00
zhagnlu 77e6404617
fix:add clear bitmap for batch skip mode (#41165)
pr: #41166

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-04-09 12:02:26 +08:00
congqixia d75596456a
enhance: [2.5] Rectify client_request_id logic (#41089) (#41149)
Cherry-pick from master
pr: #41089 
The traceID is not initialized by client_request_id in context. If the
client sent valid traceID, milvus log will print two different traceID
which is wierd.

This PR add the logic to tray parsing incoming `client_request_id` into
traceID. If it works just use it the request traceID, otherwise set it
to a different field named `client_request_id`.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-09 10:26:27 +08:00
zhagnlu fe88a243d1
fix: fix remove index type failed when remote storage is local mode (#41163)
pr: #41164

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-04-09 10:14:27 +08:00
congqixia 8c52fbfe0d
fix: [2.5] Use element_type for Array is null operator (#41158)
Cherry-pick from master
pr: #41157

Related to #41156

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-09 02:08:26 +08:00
liliu-z cb0f984155
enhance: Revert "separate for index completed (#40873)" (#41152)
This reverts commit 23e579e324. #40873

issue: #39519

Signed-off-by: Li Liu <li.liu@zilliz.com>
2025-04-08 17:36:30 +08:00
wei liu ea2b40a79d
fix: remove metrics reset calls to ensure accurate reporting (#41081)
issue: #41048
pr: #41049
Fixes issue introduced in PR #33522 where metric resets caused
incomplete data collection by monitoring systems.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-04-08 11:38:36 +08:00
binbin cc1b0a8cdb
test: Fix test cases for part of json path index (#41132)
related pr: #41016

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2025-04-08 11:04:25 +08:00
Bingyi Sun 9eb74d7418
fix: Fix the bug that null data can not filtered by null expr (#41135)
issue: #41063 
pr: #41124

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-04-08 00:26:26 +08:00
congqixia 281a4b0300
fix: [2.5] Ignore growing segment without start pos for seal policy (#41131)
Cherry-pick from master
pr: #41130
Related to #41129

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-07 23:42:27 +08:00
cai.zhang 64255e229a
fix: [2.5] Correctly parse the minimum value of int64 (#41010)
issue: #40729 
master pr: #41009 

Current approach to parse negative numbers is first parse the numeric
part and then multiply the result by -1(mainly to distinguish the
precedence of the negative sign and the subtraction operator). However,
for the minimum value of int64(`-9223372036854775808`), the value
`9223372036854775808` already exceeds the representable range of int64.
As a result, parsing error occurs.
Therefore, use a specific rule to match `-9223372036854775808`.

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-04-07 23:06:27 +08:00
congqixia c5f87c1b6d
fix: [2.5] Avoid update original search/query request (#41127)
Cherry-pick from master
pr: #41126
Related to #41034

Recent pr #40842 introduced logic to avoid requery pk column, which
updates the original request which makes the request not equavilant to
the original one.

When retry happens due to incomplete request error, this change makes
the final result set lacks the pk column even when user specifies it
explicitly.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-07 22:13:29 +08:00
congqixia d679195a5a
enhance: Bump milvus & proto version to v2.5.9 (#41144)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-07 20:37:35 +08:00
cai.zhang 0db5e0c4f6
enhance: [2.5]Deprecate disk params about indexing (#41078)
issue: #40863 

master pr: #41045

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-04-07 11:36:34 +08:00
Chun Han 23e579e324
separate for index completed (#40873)
related: https://github.com/milvus-io/milvus/issues/40781

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-04-05 10:20:24 +08:00
congqixia 618054d836
enhance: [2.5] Use `%v` for missing id log (#41036) (#41090)
Cherry-pick from master
pr: #41036
`incomplete query result, missing id %!s(int64=348), len(searchIDs) =
10, len(queryIDs) = 9` error message format with error
when missing id is int64

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-03 18:52:23 +08:00
nico e4782b95a0
test: update test cases (#41080)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-04-03 15:54:29 +08:00
wt a47bb93c58
test: [cp] add more varchar expressions for query (#41083)
pr: https://github.com/milvus-io/milvus/pull/39122

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2025-04-03 14:36:22 +08:00
binbin 0f247c469e
test: [cherry-pick-2.5] Add test cases for json path index (#41074)
related pr: #41016

---------

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2025-04-03 13:02:27 +08:00
Zhen Ye 8065c801f2
fix: segv if the LoadArrowReaderFromRemote run at the exception path (#41071)
issue: #41067
pr: #41069

Signed-off-by: chyezh <chyezh@outlook.com>
2025-04-03 02:14:21 +08:00
wei liu 37a533fe6d
fix: [2.5] Address manual balance and balance check issues (#41038)
issue: #37651
pr: #41037
- Fix context propagation for manual balance segment task creation from
PR #38080.
- Optimize stopping balance by preventing redundant checks per round,
addressing performance regression from PR #40297.
- Decrease default `checkBalanceInterval` from 3000ms to 300ms.
- Correct minor log messages in `BalanceChecker`.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-04-03 01:26:23 +08:00
Xianhui Lin 249d5b9b41
fix: jsonstats check if cache schema is nil lazy describecollection (#41068)
fix: jsonstats check if cache schema is nil lazy describecollection
pr:https://github.com/milvus-io/milvus/pull/38039
issue:https://github.com/milvus-io/milvus/issues/36995

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-04-03 00:32:21 +08:00
zhagnlu 5be9cebd67
fix: fix compare two column move cursor bug (#41054)
#41033

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-04-02 20:08:21 +08:00
Bingyi Sun 240f766511
fix: Align brute force search with json index for exists expr (#41056)
issue: #35528 
pr: #41004

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-04-02 18:28:23 +08:00
cqy123456 5017e9ab8c
fix:[2.5]Inserting null and non-null array at the same time will cause milvus crash when growing mmap open (#41052)
issue: https://github.com/milvus-io/milvus/issues/40981
master pr: https://github.com/milvus-io/milvus/pull/41051

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2025-04-02 17:58:21 +08:00