aa861f55e6
enhance: [StorageV2] Reverts #44232 bucket name change ( #44390 )
...
Related to #39173
- Put bucket name concatenation logic back for azure support
This reverts commit 8f97eb355f
2025-09-16 10:10:00 +08:00
ad86292bed
fix: Deny RenameCollection when db enabled encryption ( #44225 )
...
Also fix the validation of enabling encyption when create db
See also: #44217 , #44218
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-09-16 10:08:07 +08:00
eb793531b9
feat: impl StructArray -- support import for CSV/JSON/PARQUET/BINLOG ( #44201 )
...
Ref https://github.com/milvus-io/milvus/issues/42148
---------
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-09-15 20:41:59 +08:00
634026a177
fix: [AddField] Forbid delete `dynamicfield.enable` property ( #44335 )
...
Related to #44311
This PR forbids delete `dynamicfield.enable` property and returns user
understandable error message to user.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-15 14:20:00 +08:00
76f6768ea1
enhance: Remove timeout for compaction task ( #44277 )
...
issue: #44272
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-09-15 11:03:58 +08:00
c15290c125
fix: Fix invalid pre-allocated segment IDs ( #44350 )
...
Mark the task as failed when PreAllocatedSegmentIDs is nil.
issue: https://github.com/milvus-io/milvus/issues/44349
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-09-15 10:27:58 +08:00
baa84e0b2b
fix: avoid mvcc when doing pk compare expr ( #44353 )
...
#44352
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-09-15 10:17:59 +08:00
e9bbb6aa9b
fix: fix json_contains bug for stats ( #44325 )
...
#42533
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-09-15 10:16:07 +08:00
b38013352d
enhance: [StorageV2] enable build with azure ( #44177 )
...
related: #43869
---------
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-09-14 08:05:58 +08:00
9140201b8f
fix: add init fs check for querynode and streaming node ( #44360 )
...
related: #44354
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-09-13 10:31:58 +08:00
abe22b95c7
enhance: Utilize group info estimating logic usage as well ( #44356 )
...
Related to #44257 #44334
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-12 22:47:57 +08:00
f135dff94d
fix: Fix GetCompactionTo return empty results when segment was GCed ( #44270 )
...
issue: #44269
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-09-12 18:11:58 +08:00
bfc9e80e14
enhance: Add param item forcing all indices ready for segment ( #44313 )
...
Related to #44312
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-12 17:51:58 +08:00
9d2ff48d63
enhance: Utilize group split info to estimate usage ( #44338 )
...
Related to #44257 #44334
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-12 14:49:57 +08:00
1931dcd9b5
fix: Fix initialize timestamp index concurrently ( #44317 )
...
#issue: https://github.com/milvus-io/milvus/issues/44341
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-09-12 14:25:57 +08:00
62d416bf4f
fix: Check if ArrayData is nil to prevent panic ( #44332 )
...
issue: #44331
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-09-12 14:17:57 +08:00
060fc61e80
fix: milvus-common commits update ( #44339 )
...
issue: #41435
related: #44268
Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
2025-09-12 12:43:57 +08:00
fb58701cbb
enhance: update rust version ( #44322 )
...
relate: https://github.com/milvus-io/milvus/issues/44321
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-09-12 10:53:57 +08:00
9cfa013ec6
enhance: [StorageV2] Store column group info in compaction result ( #44327 )
...
Related to #44257
This PR store split result in compaction segment binlog struct to make
querynode could utilize it later.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-11 19:49:57 +08:00
16e6b6aa8a
fix:fix build json stats bug for nested object ( #44303 )
...
issue: #44132
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-09-11 14:13:56 +08:00
f5c6138793
enhance: update knowhere version ( #44294 )
...
issue: https://github.com/milvus-io/milvus/issues/42937
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2025-09-11 11:21:56 +08:00
fc968ff1c2
enhance: [StorageV2] Pass args for avg size split policy ( #44301 )
...
Related to #44257
This PR
- Pass column stats for avg size split policy
- Add param items for policy configuration
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-11 10:43:57 +08:00
e821468d2a
fix: milvus-common commit update ( #44304 )
...
issue: #41435
related: #44268
Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
2025-09-11 10:19:56 +08:00
77f7d19400
fix:avoid mmap rewrite by multi json fields ( #44299 )
...
issue: #44127
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
2025-09-11 10:13:57 +08:00
64140d696f
enhance: Resolve PR conflict #44282 #44253 ( #44302 )
...
Resolve conflict between pr #44282 and #44253
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-10 19:13:56 +08:00
fd83cae0fd
fix: Adapt all valid nullable data without valid data flags ( #44296 )
...
Related to milvus-io/pymilvus#2971
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-10 18:41:56 +08:00
18371773dd
enhance: Optimize partial update merge logic by unifying nullable format ( #44197 )
...
issue: #43980
This commit optimizes the partial update merge logic by standardizing
nullable field representation before merge operations to avoid corner
cases during the merge process.
Key changes:
- Unify nullable field data format to FULL FORMAT before merge execution
- Add extensive unit tests for bounds checking and edge cases
The optimization ensures:
- Consistent nullable field representation across SDK and internal
- Proper handling of null values during merge operations
- Prevention of index out-of-bounds errors in vector field updates
- Better error handling and validation for partial update scenarios
This resolves issues where different nullable field formats could cause
merge failures or data corruption during partial update operations.
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-09-10 17:27:56 +08:00
68fb357515
fix: Hide credential of embedding/reranking providers in WebUI ( #44275 )
...
issue: https://github.com/milvus-io/milvus/issues/44065
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2025-09-10 16:39:57 +08:00
c5a8aace18
fix: Pooling datanode decompress statslog without rootpath ( #44288 )
...
This bug makes pooling datanode unable to execute L0 compactions
See also: #44289
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-09-10 16:11:56 +08:00
f5618d5153
enhance: [StorageV2] Utilized advance split policy and persist in meta ( #44282 )
...
Related to #44257
This PR:
- Utilize configurable split policy for storage v2, enabling system
field policy
- Store split result in field binlog struct
- Adapt legacy binlog without child fields
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-10 14:47:57 +08:00
08a2678f07
feat: add a namespace compactor ( #44253 )
...
#44011
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-09-10 14:45:56 +08:00
9add663a08
fix: idf oracle use wrong dir ( #44266 )
...
relate: https://github.com/milvus-io/milvus/issues/44264
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-09-10 14:41:56 +08:00
3b01388587
fix: use recovery snapshot checkpoint if no vchannel is on-recovering ( #44246 )
...
issue: #44194
Signed-off-by: chyezh <chyezh@outlook.com>
2025-09-10 14:15:56 +08:00
cbe4c3d231
enhance: get cchannel before build message ( #44229 )
...
issue: #43897
- support never expire txn message.
Signed-off-by: chyezh <chyezh@outlook.com>
2025-09-10 11:09:57 +08:00
4a01c726f3
enhance: cachinglayer: some metric and params update ( #44276 )
...
issue: #41435
---------
Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
2025-09-10 11:03:57 +08:00
2f8620fa79
fix: fix like failed and add max columns limit ( #44233 )
...
#44137
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-09-10 10:33:57 +08:00
45adf2d426
fix: load resource considers ngram index ( #44237 )
...
fix https://github.com/milvus-io/milvus/issues/44236
---------
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-09-10 10:27:56 +08:00
26a024625d
feat: support search by on json field and dynamic field( #43124 ) ( #43203 )
...
related: #43124
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-09-09 21:51:56 +08:00
0cb262e1fb
test: fix stream node panic caused by ctx canceled ( #44285 )
...
issue: #44284
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-09-09 20:41:56 +08:00
dfc2335144
enhance: [StorageV2] storage file system error messages ( #44255 )
...
related: https://github.com/milvus-io/milvus/issues/44138
bump milvus storage version, include the followings:
* https://github.com/milvus-io/milvus-storage/pull/243
* https://github.com/milvus-io/milvus-storage/pull/240
* https://github.com/milvus-io/milvus-storage/pull/245
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-09-09 19:37:56 +08:00
575d490af6
fix: ngram index is mistakenly used for unsopported operations 2 ( #44142 )
...
issue: https://github.com/milvus-io/milvus/issues/44020
https://github.com/milvus-io/milvus/pull/43955 only fixed unary
expression
This fixes all expressions and add more tests.
---------
Signed-off-by: SpadeA-Tang <tangchenjie1210@gmail.com>
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-09-09 19:05:56 +08:00
dae0fd0e90
enhance: removed unused map_c ( #44183 )
...
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-09-09 16:46:04 +08:00
e2eb8562f1
feat: Auto add namespace field data if namespace is enabled ( #44198 )
...
issue: #44011
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-09-09 16:17:56 +08:00
0c9b1597f2
fix: deduce metric type from non-empty search result ( #44222 )
...
issue: https://github.com/milvus-io/milvus/issues/32262
The old implementation always takes metric type from the first sub
result, which may not always be valid. The fixed implementation returns
initialized metric type from sub results.
Signed-off-by: smdsbz <smdsbz@qq.com>
2025-09-09 14:46:04 +08:00
ecd8fa9b1b
enhance: [StorageV2] Add configurable split policy ( #44258 )
...
Related to #44257
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-09 14:29:56 +08:00
fb43651a74
fix: Fix MultiSegmentWrite only write one segment ( #44256 )
...
issue: #44254
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-09-09 14:28:10 +08:00
c5bb4f7483
fix: Fix merge sort out of range ( #44230 )
...
issue: https://github.com/milvus-io/milvus/issues/44227
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-09-08 18:01:55 +08:00
92fedb8280
enhance: forbid panic when tantivy index path not exist ( #44135 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-09-08 15:21:56 +08:00
f98dd84dec
fix: add utf8 check before bm25 functoin run ( #44220 )
...
relate: https://github.com/milvus-io/milvus/issues/44219
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-09-08 14:43:56 +08:00
9bf2b5c10c
enhance: moved more segcore unit test files ( #44210 )
...
issue: https://github.com/milvus-io/milvus/issues/43931
---------
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2025-09-08 10:21:55 +08:00
congqixia
XuanYang-cn
Spade A
cai.zhang
yihao.dai
zhagnlu
sthuang
Bingyi Sun
sparknack
aoiasd
cqy123456
wei liu
groot
Zhen Ye
zhagnlu
Chun Han
Buqian Zheng
Xiaoguang Zhu