f83567c0d0
fix: correct memory size estimation on arrays ( #40377 )
...
See: #40342
pr: #40312
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-03-06 17:42:04 +08:00
89bc94595d
fix: [2.5] Pass Knapsnak ptr to avoid compact multiple times ( #40401 )
...
Cherry-pick from master
pr: #40400
Related to #40388
The small segments may be put into bucket twice due to value parameter
of Knapsnap.packWith
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-06 14:16:03 +08:00
1df4631a3f
enhance: [2.5] Remove debug log in rg handler v2 ( #40376 ) ( #40393 )
...
Cherry-pick from master
pr: #40376
Remove debug log in resource group handler
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-06 14:14:12 +08:00
a1b9e3ccb6
fix: Fix a crash issue of bulkinsert ( #40304 )
...
issue: https://github.com/milvus-io/milvus/issues/40291
pr: https://github.com/milvus-io/milvus/pull/40331
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2025-03-05 21:36:08 +08:00
345ca01634
fix: [2.5]fix concurrent issues in null offset #40363 ( #40365 )
...
issue: https://github.com/milvus-io/milvus/issues/40308
cherry-pick: https://github.com/milvus-io/milvus/pull/40363
---------
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-03-05 16:54:09 +08:00
a0f18e8c88
enhance: better logging for grpc resolver ( #40338 )
...
issue: #40311
pr: #40337
- better logging for grpc resolver
- remove the redundant streaming node manage client when streaming
service is disable
Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-05 15:14:01 +08:00
7cbd40c7a1
fix: [2.5] Fix parsing import endTs ( #40333 )
...
Parsing import beginTs, endTs as a hybrid timestamp.
issue: https://github.com/milvus-io/milvus/issues/40326
pr: https://github.com/milvus-io/milvus/pull/40332
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-05 11:40:13 +08:00
6ab8e84f1e
fix: [2.5] improve error handling and unit tests for InitMetaCache function ( #40324 )
...
- issue: #40320
- pr: #40322
Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-05 11:08:13 +08:00
cc7d4ce399
fix: [2.5] Add duplication param check for create index ( #40254 ) ( #40330 )
...
Cherry-pick from master
pr: #40254
Related to #40156
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-05 10:10:01 +08:00
34f2bc0a68
enhance: add more metrics for async cgo component ( #40232 )
...
issue: #40014
pr: #40136
Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-05 09:16:00 +08:00
f02e549840
fix: compaction task cannot be genereted if size greater than max size ( #40350 )
...
See: #40343
pr: #40348
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-05 00:40:01 +08:00
825316670d
enhance: upgrade rust version to 1.83 ( #39295 ) ( #40317 )
...
issue: #39254
pr: https://github.com/milvus-io/milvus/pull/39295
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-04 17:42:04 +08:00
b55327046f
fix: duplicate consuming from stream for invisible segment ( #40318 )
...
issue: #40207
pr: #40316
Signed-off-by: chyezh <chyezh@outlook.com>
2025-03-04 16:10:05 +08:00
d754e0bb7e
fix: restful drop db properties failed( #39953 ) ( #40260 )
...
related: #39953
pr: https://github.com/milvus-io/milvus/pull/40257
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-03-03 10:22:02 +08:00
a945345110
fix: [2.5] use the different msg type for the OperatePrivilegeV2 api ( #40193 )
...
- issue: #40178
- pr: #40192
Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-03 10:20:01 +08:00
893caee467
fix: [2.5] Fix task delta cache data race ( #40262 )
...
issue: https://github.com/milvus-io/milvus/issues/40258
pr: https://github.com/milvus-io/milvus/pull/40259
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-03-02 16:52:10 +08:00
82c000a4b2
fix: task delta cache leak due to duplicate task id ( #40184 )
...
issue: #40052
pr: #40183
task delta cache rely on the taskID is unique, so it incDeltaCache at
AddTask, and decDeltaCache at RemoveTask, but the taskID allocator is
not atomic, which cause two task with same taskID, in such case, it will
call incDeltaCache twice, but call decDeltaCacheOnce, which cause delta
cache leak.
---------
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-28 10:22:08 +08:00
14f05650e3
enhance: clean shard location cache after collection released ( #40228 )
...
issue: #40077
pr: #40088
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-27 19:42:05 +08:00
27fb8d9512
fix: create multiple identical indexes by accident ( #40180 )
...
issue: https://github.com/milvus-io/milvus/issues/40163
pr: https://github.com/milvus-io/milvus/pull/40179
---------
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2025-02-25 22:19:56 +08:00
eee98fd044
fix: [2.5] Fix collections with duplicate names can be created ( #40147 )
...
This PR introduces two restrictions:
1. Before dropping a collection, all aliases associated with that
collection must be dropped.
2. When creating a collection, if the collection name duplicates any
alias, the collection creation will fail.
issue: https://github.com/milvus-io/milvus/issues/40142
pr: https://github.com/milvus-io/milvus/pull/40143
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-25 22:07:56 +08:00
d60511abc3
Revert "fix:fix create duplicated index when concurrency request (#40… ( #40176 )
...
…162)"
This reverts commit 34f907fd5d#40164
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-02-25 17:55:11 +08:00
c45771af6a
enhance: add monitor metric for retrieve raw data ( #40155 )
...
pr: #40141
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-02-25 14:41:56 +08:00
34f907fd5d
fix:fix create duplicated index when concurrency request ( #40162 )
...
pr: #40164
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-02-25 13:49:07 +08:00
4a75fdac03
enhance: Remove task meta when task is no need to do ( #40146 )
...
issue: #39911
master pr: #39084
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-25 10:35:57 +08:00
29579a8ec9
fix: Fix search failure of null expression ( #40128 )
...
issue: https://github.com/milvus-io/milvus/issues/40095
pr: #40129
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-02-24 18:35:55 +08:00
69f6849dc4
fix: [2.5] Fix bug where prefix matching fails when wildcards are in prefix ( #40021 )
...
issue: #40019
master pr: #40020
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-24 18:03:55 +08:00
b6b03ff74c
enhance: [2.5] Accelerate listing objects during binlog import ( #40048 )
...
issue: https://github.com/milvus-io/milvus/issues/40030
pr: https://github.com/milvus-io/milvus/pull/40047
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-24 15:59:56 +08:00
fdad35e668
fix: [2.5] Set task version for stats task ( #40130 )
...
issue: #40034
master pr: #40035
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-24 15:43:55 +08:00
a4eb2ce224
fix: [2.5]Revert qc statschecker for json key stats ( #40125 )
...
Revert qc statschecker for json key stats
issue:https://github.com/milvus-io/milvus/issues/36995
pr:https://github.com/milvus-io/milvus/pull/39876
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-02-24 13:31:55 +08:00
cb82b040a7
enhance: support create collection with description( #40022 ) ( #40028 )
...
related: #40022
pr: https://github.com/milvus-io/milvus/pull/40023
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-24 09:55:57 +08:00
6c81463263
fix: [2.5] Fix task scheduler dead lock ( #40121 )
...
issue: #39101
master pr: #39084
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2025-02-23 18:29:55 +08:00
9cbab98382
enhance: [2.5] Export request timeout interval in config ( #40118 )
2025-02-23 13:47:12 +08:00
709594f158
enhance: [2.5] Use v2 package name for pkg module ( #40117 )
...
Cherry-pick from master
pr: #39990
Related to #39095
https://go.dev/doc/modules/version-numbers
Update pkg version according to golang dep version convention
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-23 00:46:01 +08:00
ecdbc12678
enhance: [2.5] Remove hardcoded partition num in restful handler ( #40113 )
...
Cherry-pick from master
pr: #40112
The partition num shall be determined by core logic if user did not
specifiy the partition num in request.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-22 16:58:17 +08:00
c1de61ff7c
fix: [2.5]Replace the position of EnabledJSONKeyStats ( #40108 )
...
Replace the position of EnabledJSONKeyStats
issue: https://github.com/milvus-io/milvus/issues/36995
pr: https://github.com/milvus-io/milvus/pull/38039
---------
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-02-22 14:35:54 +08:00
2677f0b834
fix: cancel sub contexts casade when http request timeout( #40030 ) ( #40060 )
...
related: #40030
pr: https://github.com/milvus-io/milvus/pull/40059
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-22 11:39:53 +08:00
d66d3f0d47
enhance:decrease dump snapshot limit from 10w to 1w ( #40102 )
...
pr: #40101
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-02-22 11:29:53 +08:00
be30f5301d
enhance: Refine index task scheduler policy ( #40104 )
...
master pr: #39084
issue: #39101
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-22 11:25:54 +08:00
898606ae4c
enhance: [2.5] Avoid stringtoslicebytes copy for BatchPKExists ( #40097 )
...
Cherry-pick from master
pr: #40096
Using unsafe.Slice to convert string to []byte by directly using
underlying data could avoid lots of copy and cpu time
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-21 21:41:21 +08:00
0caad5fe37
enhance: [2.5] Add metrics for proxy queue ( #40071 )
...
master pr: #40070
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-02-21 21:39:54 +08:00
b8a758b6c4
enhance: [2.5] Add get vector latency metric and refine request limit error message ( #40085 )
...
issue: https://github.com/milvus-io/milvus/issues/40078
pr: https://github.com/milvus-io/milvus/pull/40083
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-02-21 20:19:55 +08:00
113d17646b
fix: [2.5] Add sub task pool for multi-stage tasks ( #40081 )
...
Cherry-pick from master
pr: #40079
Related to #40078
Add a subTaskPool to execute sub task in case of logic deadlock
described in issue.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-21 19:17:55 +08:00
39b1f4aaea
enhance: support return configable properties when describing index( #39951 ) ( #40043 )
...
related: #39951
pr: https://github.com/milvus-io/milvus/pull/40042
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-02-21 18:51:55 +08:00
82fb0bf9c1
fix: [2.5] task delta cache leak on reduce task ( #40056 )
...
issue: #40052
pr: #40055
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-21 16:49:54 +08:00
e42c944e04
fix: [2.5] querycoord panic in cornor case ( #40058 )
...
issue: #40050
pr: #40057
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-02-21 11:19:58 +08:00
b7c631f0b7
enhance: [2.5] Remove frequent json stats distribution log ( #40027 )
...
Info log is too frequent only printing the json stats & index info
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-20 13:33:57 +08:00
f142b5bff8
fix: Fix wrong trigger of json key index ( #40026 )
...
pr: https://github.com/milvus-io/milvus/pull/38039
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2025-02-20 03:59:11 +08:00
37874ed6d7
fix: [2.5] enhance isBalanced function to correctly count quote pairs ( #40002 )
...
- issue: #39999
- pr: #40001
Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-02-19 20:19:00 +08:00
ce6d8ba836
enhance: optimize expr performace for some points ( #39695 ) ( #39938 )
...
1. skip get expr arguments which deserialize proto for every batch
execute.
2. replace unordered_set with sort array that has better performace for
small set.
pr: #39695
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-02-19 19:52:53 +08:00
bd5c56a77b
fix: [cp25]Negative -1 executing compaction tasks ( #39955 )
...
See also: #39675
pr: #39954
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-02-19 18:42:53 +08:00
Ted Xu
congqixia
groot
Spade A
Zhen Ye
yihao.dai
SimFG
Bingyi Sun
Chun Han
wei liu
zhenshan.cao
zhagnlu
cai.zhang
Xianhui Lin
XuanYang-cn