Commit Graph

1745 Commits (2.5)

Author SHA1 Message Date
congqixia 1a2871b628
enhance: [2.5] Remove collection name validation from DescribeCollection (#43300)
Cherry-pick from master
pr: #43299
Related to #43031

Previous pr: #43064

Since old version may create collection with invalidate collection name,
milvus shall allow some API to let user notice such collection still
exists.

This patch removes collection name validation from `DescribeCollection`
call, letting user know that such collection still exists.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-08-04 10:51:04 +08:00
SimFG 33e4bcc689
fix: [2.5] Clean privilege cache after loading policy in InitPolicyInfo (#43643)
- issue: #43641
- pr: #43642

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-07-30 18:07:37 +08:00
XuanYang-cn 78a5fce7f4
fix: [cp25]Set status when err is not empty (#43404)
See also: #43341
pr: #43403

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-07-30 17:47:37 +08:00
wei liu 33e9b873de
enhance: add logs for count(*) (#43001) (#43249)
pr: #43001

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-07-11 19:14:48 +08:00
congqixia e13b55fc0a
fix: [2.5] Remove trimming space logic when validating collection name (#43064) (#43138)
Cherry-pick from master
pr: #43064
Related to #43031

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-07-07 09:54:46 +08:00
wei liu 73210303a9
fix: Fix exclude nodes clearing logic position in load balancer retry (#43002)
issue: #42994
pr: #42577 #40438

cp partial logic from pr #42577 and #40438

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-06-30 16:10:44 +08:00
foxspy 47f265864b
enhance: [2.5] update knowhere version for milvus 2.5.14 (#42939)
issue: #42937 
pr: #42938

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-06-25 21:06:43 +08:00
congqixia b1bbc56b54
fix: [2.5] Use task timestamp to calculate TTL timestamp (#42944)
Cherry-pick from master
pr: #42920
Related to #42918

Previously the `CollectionTtlTimestamp` could be overflowed when the
guarantee_ts==1, which means using `Eventually` consistency level.

This patch use task timestamp, allocated by scheduler, to generate ttl
timestamp ignore the potential very small timestamp being used.

Also add overflow check for ttl timestamp calculated.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-06-25 20:56:42 +08:00
congqixia 1e55112de7
enhance: [2.5] Fill dbName for `OperatePrivilegeV2Request` in interceptor (#42898) (#42904)
Cherry-pick from master
pr: #42898

Related to #40340

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-06-24 10:08:41 +08:00
aoiasd f755fbd553
enhance: [2.5] support print nq and params for search and query (#42545)
relate: https://github.com/milvus-io/milvus/issues/41801
pr: https://github.com/milvus-io/milvus/pull/41802
https://github.com/milvus-io/milvus/pull/42546

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-06-11 14:38:47 +08:00
Bingyi Sun a32b55ed71
enhance: support auto index type for json index (#42161)
issue: #42070 
pr: #42071

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-06-09 21:20:34 +08:00
Bingyi Sun 532f10f343
enhance: Support cast function for json index (#42504)
issue: #41948
pr: #41949

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-06-05 20:26:33 +08:00
aoiasd d9706150d2
enhance: [2.5] run analyzer should get database name from grpc context (#42399)
pr:https://github.com/milvus-io/milvus/pull/42398

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-30 15:48:30 +08:00
aoiasd 198ff1f150
enhance: [2.5] support run analyzer by loaded collection field (#42119)
relate: https://github.com/milvus-io/milvus/issues/42094
pr: https://github.com/milvus-io/milvus/pull/42113

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-29 10:26:30 +08:00
congqixia 6c17cdffd8
enhance: [2.5] Take nq into slow query consideration (#42109) (#42125)
Cherry-pick from master
pr: #42109
Related to #40756

Large nq will naturally increase query time, which causing lots of slow
log when user NQ numbers are very large.

This PR make slow search counts span per nq (using avg val) to decide
whether one request is slow or not.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-28 19:02:30 +08:00
congqixia 49684a2439
enhance: [2.5][Nullable] Fill absent nullable field server-side (#42095) (#42120)
Cherry-pick from master
pr: #42095

The absent nullable field shall be filled at server-side in nullable
design. While the implementation here was buggy causing the feature was
not able to serve.

This PR make proxy fill the field data in correct format so that field
data with absent column(s) will be accepted.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-28 10:02:28 +08:00
Xianhui Lin 0490344442
fix: support TTL expiration with queries returning no results (#42103)
support TTL expiration with queries returning no results
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/42086

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-05-27 15:18:28 +08:00
groot a48001f999
feat: support to drop properties of field (#41954)
issue: https://github.com/milvus-io/milvus/issues/41990
pr: https://github.com/milvus-io/milvus/pull/41996

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2025-05-27 14:32:34 +08:00
Xianhui Lin 0574fc7b7b
enhance: support TTL expiration with queries returning no results (#41960)
support TTL expiration with queries returning no results
issue:https://github.com/milvus-io/milvus/issues/41959
pr:https://github.com/milvus-io/milvus/pull/41720

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-05-26 15:52:28 +08:00
yihao.dai 9b085520cf
fix: [2.5] Fix proxy panic at shard client manager (#42026)
issue: https://github.com/milvus-io/milvus/issues/42024

pr: https://github.com/milvus-io/milvus/pull/42025

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-05-23 19:44:26 +08:00
SimFG 00336a8c4c
enhance: [2.5] add privilege group message types and corresponding tests (#41940)
- issue: #41938
- pr: #41939

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-05-21 11:12:29 +08:00
aoiasd 0e75e664f2
enhance: accesslog support fetch hybrid search expr and field (#40167) (#41921)
relate: https://github.com/milvus-io/milvus/issues/40166
pr: https://github.com/milvus-io/milvus/pull/40167

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-20 15:14:24 +08:00
yihao.dai 7c8370ccd2
fix: [2.5] Fix ants.Pool goroutine leak (#41893)
1. Release the pool after it is no longer in use.
2. Upgrade ants.Pool to fix the goroutine leak issue (see
https://github.com/panjf2000/ants/pull/287).

issue: https://github.com/milvus-io/milvus/issues/41838

pr: https://github.com/milvus-io/milvus/pull/41892

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-05-16 19:12:22 +08:00
aoiasd daf745ffa3
fix: [2.5] hybird search sub requset not set analyzer name (#41897)
relate: https://github.com/milvus-io/milvus/issues/41213
pr: https://github.com/milvus-io/milvus/pull/41896

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-16 17:58:22 +08:00
SimFG 94e2871348
enhance: [2.5] implement authorization checks for DescribeCollection and DescribeDatabase tasks (#41799)
- issue: #41694
- pr: #41798

---------

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-05-15 17:48:23 +08:00
foxspy e36df6991b
enhance: [2.5] Output index version information in the DescribeIndex interface (#41841)
issue: #41431 
pr: #41847

Signed-off-by: foxspy <xianliang.li@zilliz.com>
2025-05-15 14:34:23 +08:00
SimFG 4c656e8a7a
enhance: support more ddl apis to replicate according to cdc (#41679)
- issue: #41677
- pr: #41678

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-05-08 20:02:58 +08:00
SimFG b69bf42a04
enhance: [2.5] Implement OperatePrivilegeV2 message handling and unmarshal support (#41594)
- issue: #41353
- pr: #41355

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-04-30 11:52:53 +08:00
Xianhui Lin 17465ffe9e
feat: [2.5]add str update ts in describecollection (#41600)
issue:https://github.com/milvus-io/milvus/issues/39093
pr:https://github.com/milvus-io/milvus/pull/39096

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-04-29 17:50:53 +08:00
SimFG 6e18ededab
fix: [2.5] mockery too unavailable after upgrade golang version (#41522)
- issue: ##41291
- pr: #41481

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-04-25 14:40:40 +08:00
SimFG 18eb627533
fix: [2.5] Update logging context and upgrade dependencies (#41319)
- issue: #41291
- pr: #41318

---------

Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-04-24 23:50:40 +08:00
aoiasd 8b3353cdab
feat: [2.5] Support run analyzer and more tokenizer. (#41444)
relate: https://github.com/milvus-io/milvus/issues/39659
https://github.com/milvus-io/milvus/issues/39705
pr: https://github.com/milvus-io/milvus/pull/40416
https://github.com/milvus-io/milvus/pull/40458
https://github.com/milvus-io/milvus/pull/39723
https://github.com/milvus-io/milvus/pull/40813
https://github.com/milvus-io/milvus/pull/39854
https://github.com/milvus-io/milvus/pull/39660

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-04-24 10:48:39 +08:00
aoiasd 544493e3e2
feat:[2.5] support multi analyzer for bm25 function (#41456)
relate: https://github.com/milvus-io/milvus/issues/41213
pr: https://github.com/milvus-io/milvus/pull/41351

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-04-23 20:52:39 +08:00
Xianhui Lin 28c9dedb04
feat: [2.5]Add support for modifying max capacity of array fields (#41406)
feat: Add support for modifying max capacity of array fields

This commit adds support for modifying the max capacity of array fields
in the alterCollectionFieldTask function. It checks if the field is an
array type and then validates and updates the max capacity value. This
change improves the flexibility of array fields in the collection.

Issue: https://github.com/milvus-io/milvus/issues/41363
pr:https://github.com/milvus-io/milvus/pull/41404

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-04-21 18:00:37 +08:00
SimFG 4d813c48d2
fix: [2.5] get replicate channel position (#41189)
- issue: #41187
- pr: #41188

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-04-09 20:52:26 +08:00
congqixia c5f87c1b6d
fix: [2.5] Avoid update original search/query request (#41127)
Cherry-pick from master
pr: #41126
Related to #41034

Recent pr #40842 introduced logic to avoid requery pk column, which
updates the original request which makes the request not equavilant to
the original one.

When retry happens due to incomplete request error, this change makes
the final result set lacks the pk column even when user specifies it
explicitly.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-07 22:13:29 +08:00
congqixia 618054d836
enhance: [2.5] Use `%v` for missing id log (#41036) (#41090)
Cherry-pick from master
pr: #41036
`incomplete query result, missing id %!s(int64=348), len(searchIDs) =
10, len(queryIDs) = 9` error message format with error
when missing id is int64

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-03 18:52:23 +08:00
Buqian Zheng c9a354d436
enhance: [2.5] weighted reranker to allow skip score normalization (#40905)
issue: https://github.com/milvus-io/milvus/issues/40836
pr: https://github.com/milvus-io/milvus/pull/40903

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-04-02 17:30:22 +08:00
aoiasd 0ba389e434
enhance: [2.5] add utf8 check for all varchar field #40670 (#40993)
https://github.com/milvus-io/milvus/issues/40684
pr: https://github.com/milvus-io/milvus/pull/40670

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-03-31 14:08:20 +08:00
Buqian Zheng 8504a7b98d
enhance: [2.5] avoid re-query if hybrid search requested only pk as output field (#40906)
pr: https://github.com/milvus-io/milvus/pull/40842
issue: https://github.com/milvus-io/milvus/issues/40833

---------

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-03-28 14:50:26 +08:00
aoiasd 182b3c17d0
enhance: remain raw token for audit log (#40637) (#40867)
pr: https://github.com/milvus-io/milvus/pull/40637

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-03-26 14:54:18 +08:00
SimFG 1263505808
feat: [2.5] support to deny dll according to database property (#40784)
- issue: #40762
- pr: #40764

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-23 11:18:28 +08:00
XuanYang-cn 70ad96ffb3
enhance: Upgrade PyMilvus version to 2.5.6rc5 (#40748)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-03-21 17:48:28 +08:00
Buqian Zheng cff0e82f57
enhance: [2.5] improve sparse query nnz metric (#40714)
add query type and field id label; add metric for hybrid search

issue: https://github.com/milvus-io/milvus/issues/35853
pr: https://github.com/milvus-io/milvus/pull/40713

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-03-20 14:14:21 +08:00
congqixia cd8d7efc96
enhance: [2.5] Add an extra parameter for slow log (#40759)
Cherry-pick from master
pr: #40758
Related to #40756

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-19 18:10:13 +08:00
Bingyi Sun ae8a9cebb8
fix: fix json index not-equal filter (#40648)
issue: #35528 
pr: https://github.com/milvus-io/milvus/pull/40647

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-14 21:36:10 +08:00
SimFG a3c60a03b5
feat: [2.5] add DDLDB rate type and related quota configurations (#40653)
- issue: #40650
- pr: #40651

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-14 15:36:17 +08:00
cai.zhang bdc0e68aaf
feat: [2.5] Support get segment binlogs info with new interface GetSegmentsInfo (#40466)
issue: #40341 

master pr: #40464

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-14 00:14:08 +08:00
Bingyi Sun bd4170106d
fix: cherry pick json index related prs (#40568)
issue: #35528 
pr: #40407 
this pr includes some json index related pr:
1. #40407
2. #40538 
3. #40419

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-11 21:00:09 +08:00
Bingyi Sun 683b26ffb7
feat: cherry pick json path index (#40313)
issue: #35528 
pr: #36750 
this pr includes json path index pr and some related prs:
1. update tantivy version #39253 
2. json path index #36750 
3. fall back to brute force #40076 
4. term filter #40140 
5. bug fix #40336

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-10 22:14:05 +08:00