Commit Graph

1107 Commits (2.5)

Author SHA1 Message Date
Xiaofan 51b3d246f9
fix: hybridsearch should support offset param in restful api related (#43721)
related to #43556 , pr: #43586

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
2025-08-04 20:59:39 +08:00
Chun Han 72bf4ebbbd
fix: return id by default(#43595) (#43596)
related: #43595
pr: https://github.com/milvus-io/milvus/pull/43601

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-07-29 15:53:36 +08:00
wei liu 4952b8c416
enhance: apply load config changes after QueryCoord restart (#43108) (#43236)
issue: #43107
pr: #43108
- Add checkLoadConfigChanges() to apply load config during startup
- Call config check in startQueryCoord() after restart
- Skip auto-updates for collections with user-specified replica numbers
- Add is_user_specified_replica_mode field to preserve user settings
- Add comprehensive unit tests with mockey

Ensures existing collections use latest cluster-level config after
restart.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-07-14 10:22:50 +08:00
Xianhui Lin a1927e22a5
fix: add ShowLoadCollections and ShowLoadPartitions for compatibale mixcoord (#42514)
fix: add ShowLoadCollections and ShowLoadPartitions for compatibale
mixcoord
issue:https://github.com/milvus-io/milvus/issues/42492

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-06-05 15:46:33 +08:00
Bingyi Sun 37a640f5ed
enhance: return index params for restful api (#42016) (#42080)
issue: #42015
pr: #42016

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-05-29 11:50:30 +08:00
aoiasd 198ff1f150
enhance: [2.5] support run analyzer by loaded collection field (#42119)
relate: https://github.com/milvus-io/milvus/issues/42094
pr: https://github.com/milvus-io/milvus/pull/42113

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-29 10:26:30 +08:00
foxspy 6ac85e5cfe
fix: [2.5] add describeIndex timestamp for restful interface (#42105)
issue: https://github.com/milvus-io/milvus/issues/41431
pr: #42104

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-05-28 12:00:29 +08:00
yihao.dai 7c8370ccd2
fix: [2.5] Fix ants.Pool goroutine leak (#41893)
1. Release the pool after it is no longer in use.
2. Upgrade ants.Pool to fix the goroutine leak issue (see
https://github.com/panjf2000/ants/pull/287).

issue: https://github.com/milvus-io/milvus/issues/41838

pr: https://github.com/milvus-io/milvus/pull/41892

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-05-16 19:12:22 +08:00
foxspy e36df6991b
enhance: [2.5] Output index version information in the DescribeIndex interface (#41841)
issue: #41431 
pr: #41847

Signed-off-by: foxspy <xianliang.li@zilliz.com>
2025-05-15 14:34:23 +08:00
congqixia e6bfa12064
enhance: [2.5][Restful] Add consistency level for query/get API (#41825) (#41830)
Cherry-pick from master
pr: #41825 
Related to #41805

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-05-14 14:16:22 +08:00
Xianhui Lin 548754a5e3
fix: fallback to mixcoord session when upgrade to mixCoord (#41773)
fix: fallback to mixcoord  session when upgrade to mixCoord
issue:https://github.com/milvus-io/milvus/issues/41737

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-05-13 23:12:58 +08:00
Xianhui Lin 21ca05e445
feat: refine drop parition through the new interface notifydroppartition in datacoord (#41543)
refine drop parition through the new interface notifydroppartition in
datacoord
 issue: https://github.com/milvus-io/milvus/issues/41542

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-04-27 17:42:40 +08:00
SimFG 18eb627533
fix: [2.5] Update logging context and upgrade dependencies (#41319)
- issue: #41291
- pr: #41318

---------

Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-04-24 23:50:40 +08:00
aoiasd 8b3353cdab
feat: [2.5] Support run analyzer and more tokenizer. (#41444)
relate: https://github.com/milvus-io/milvus/issues/39659
https://github.com/milvus-io/milvus/issues/39705
pr: https://github.com/milvus-io/milvus/pull/40416
https://github.com/milvus-io/milvus/pull/40458
https://github.com/milvus-io/milvus/pull/39723
https://github.com/milvus-io/milvus/pull/40813
https://github.com/milvus-io/milvus/pull/39854
https://github.com/milvus-io/milvus/pull/39660

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-04-24 10:48:39 +08:00
congqixia b073112e16
enhance: [2.5][Restful] Make default timeout configurable (#41211) (#41225)
Cherry-pick from master
pr: #41211

The restful API default timeout was hard-coded. This PR make this
timeout value configurable via paramtable.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-11 13:12:27 +08:00
congqixia 7001474914
fix: [2.5][RESTFUL] Return error when writer body closed (#41184)
Cherry-pick from master
pr: #41183
Related to #41181

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-09 19:37:09 +08:00
aoiasd 182b3c17d0
enhance: remain raw token for audit log (#40637) (#40867)
pr: https://github.com/milvus-io/milvus/pull/40637

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-03-26 14:54:18 +08:00
Chun Han aebbfc7c7b
fix: mmap properties failed to apply when creating collection(#40511) (#40515)
related: #40511
pr: https://github.com/milvus-io/milvus/pull/40512

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-03-18 22:05:19 +08:00
Zhen Ye 167d058682
enhance: remove redundant resource key watch operation, just keep consistency of wal (#40503)
issue: #38399
pr: #40235

related PR: #39522

- Just implement exclusive broadcaster between broadcast message with
same resource key to keep same order in different wal.
- After simplify the broadcast model, original watch-based broadcast is
too complicated and redundant, remove it.
- Add metrics for broadcast.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-18 15:46:25 +08:00
cai.zhang bdc0e68aaf
feat: [2.5] Support get segment binlogs info with new interface GetSegmentsInfo (#40466)
issue: #40341 

master pr: #40464

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-03-14 00:14:08 +08:00
congqixia 14ca0dfc7c
enhance: [2.5] Avoid convert body byte slice to string in httpserver (#40405) (#40414)
Cherry-pick from master
pr: #40405
The convertion of byte slice to string may copy the underline data which
may cause extra memory and cpu time for httpserver

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-10 14:44:05 +08:00
congqixia 1df4631a3f
enhance: [2.5] Remove debug log in rg handler v2 (#40376) (#40393)
Cherry-pick from master
pr: #40376
Remove debug log in resource group handler

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-06 14:14:12 +08:00
Chun Han d754e0bb7e
fix: restful drop db properties failed(#39953) (#40260)
related: #39953
pr: https://github.com/milvus-io/milvus/pull/40257

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-03-03 10:22:02 +08:00
Chun Han cb82b040a7
enhance: support create collection with description(#40022) (#40028)
related: #40022
pr: https://github.com/milvus-io/milvus/pull/40023

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-24 09:55:57 +08:00
congqixia 709594f158
enhance: [2.5] Use v2 package name for pkg module (#40117)
Cherry-pick from master
pr: #39990
Related to #39095

https://go.dev/doc/modules/version-numbers

Update pkg version according to golang dep version convention

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-23 00:46:01 +08:00
congqixia ecdbc12678
enhance: [2.5] Remove hardcoded partition num in restful handler (#40113)
Cherry-pick from master
pr: #40112
The partition num shall be determined by core logic if user did not
specifiy the partition num in request.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-22 16:58:17 +08:00
Chun Han 2677f0b834
fix: cancel sub contexts casade when http request timeout(#40030) (#40060)
related: #40030
pr: https://github.com/milvus-io/milvus/pull/40059

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-22 11:39:53 +08:00
Chun Han 39b1f4aaea
enhance: support return configable properties when describing index(#39951) (#40043)
related: #39951
pr: https://github.com/milvus-io/milvus/pull/40042

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-21 18:51:55 +08:00
wei liu 3c2d8c1419
enhance: [2.5] Add management api to check querycoord balance status (#37784) (#39909)
issue: #37783
pr: #37784

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-19 10:56:49 +08:00
smellthemoon ba0edb8383
enhance: [2.5]return topks when search in restful v2 (#39839)
pr: #39812

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-02-14 11:30:14 +08:00
Zhen Ye f85bf59921
fix: rootcoord graceful stop failed and limit resource of ci (#39793)
issue: #38399
pr: #39781

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-02-13 19:34:13 +08:00
wei liu a50249e0bb
enhance: [2.5] dump pprof info if component stop progress timeout (#39760)
issue: #39735
pr: #39726

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-13 15:30:47 +08:00
smellthemoon dd516a5716
fix: [2.5]not pass the indexname when drop properties (#39679)
pr: #39678 
issue: #38967

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-02-12 15:52:48 +08:00
Zhen Ye 858dc10ef9
enhance: broadcast with event-based notification (#39550)
issue: #38399
pr: #39522

- broadcast message can carry multi resource key now.
- implement event-based notification for broadcast messages
- broadcast message use broadcast id as a unique identifier in message
- broadcasted message on vchannels keep the broadcasted vchannel now.
- broadcasted message and broadcast message have a common broadcast
header now.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-02-07 11:50:50 +08:00
smellthemoon c8327934a6
fix: [2.5]not enable rate limiter for restful v1 (#39555)
issue: #39556 
pr: #39553

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-01-24 14:05:13 +08:00
yihao.dai 83666f1bff
enhance: [2.5] Enable hook for importv2 (#39430)
/kind improvement

pr: https://github.com/milvus-io/milvus/pull/39429

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-21 10:29:04 +08:00
smellthemoon e4c6ef9d57
enhance: [2.5] serializes the resp body and attach some details (#39401)
issue: #37611 
pr: #39140

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-01-20 18:17:10 +08:00
smellthemoon ff53d4f742
enhance: [2.5]add some apis in Restful (#39425)
pr: #39105 
issue: #38709

---------

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-01-20 18:15:22 +08:00
Gao 6d5f174142
enhance: [2.5] add recalls response for restful api (#39409)
issue: #37899 
pr: #39408

Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-01-20 10:59:10 +08:00
Zhen Ye 5330fc981c
fix: panic when streaming release if using msgstream (#39375)
issue: #39367
pr: #39374

Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-17 11:55:03 +08:00
yihao.dai 6773fb10a8
enhance: [2.5] Read metadata concurrently to accelerate recovery (#38900)
Read metadata such as segments, binlogs, and partitions concurrently at
the collection level.

issue: https://github.com/milvus-io/milvus/issues/37630

pr: https://github.com/milvus-io/milvus/pull/38403

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-16 17:53:01 +08:00
SimFG 4cb47b3f67
feat: [2.5] root privileges can be customized (#39324)
- issue: #39184
- pr: #39191

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-01-16 14:27:11 +08:00
smellthemoon 2439278f93
enhance: add some apis in Restful(#38733) (#38875)
issue: #38709 
pr: #38733  #38979

---------

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-01-15 15:19:00 +08:00
aoiasd e6ac2fe063
enhance: [Cherry-pick] report auth log to hook when grpc authenticate failed (#39192)
relate: https://github.com/milvus-io/milvus/pull/38943

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-01-14 17:47:04 +08:00
Zhen Ye 54036bcafd
enhance: add broadcast operation for msgstream (#39119)
issue: #38399
pr: #39040

- make broadcast service available for msgstream by reusing the
architecture streaming service

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-14 15:11:00 +08:00
Zhen Ye 95809ca767
enhance: make new go package to manage proto (#39128)
issue: #39095
pr: #39114

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-10 10:53:01 +08:00
Zhen Ye f2e581e2d7
enhance: add broadcast for streaming service (#39047)
issue: #38399
pr: #39020

- Add new rpc for transfer broadcast to streaming coord
- Add broadcast service at streaming coord to make broadcast message
sent automicly

also cherry pick the pr #38400

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-09 16:46:56 +08:00
wei liu 8a9b811781
enhance: Add resource group api on Restful (#38885) (#39092)
issue: #38739
pr: #38885
enable to manage resource group by Restful
- CreateResourceGroup
- DescribeResourceGroup
- UpdateResourceGroup
- ListResourceGroup
- DropResourceGroup
- TransferReplica

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-01-09 16:00:56 +08:00
Zhen Ye 6f1febe881
enhance: move streaming coord from datacoord to rootcoord (#39009)
issue: #38399
pr: #39007

We want to support broadcast operation for both streaming and msgstream.
But msgstream can be only sent message from rootcoord and proxy.
So this pr move the streamingcoord to rootcoord to make easier
implementation.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-07 17:56:56 +08:00
jaime 78438ef41e
fix: revert optimize CPU usage for CheckHealth requests (#35589) (#38555)
issue: #35563

Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-12-19 00:38:45 +08:00