Commit Graph

23140 Commits (2.6)

Author SHA1 Message Date
sthuang cb08db0c96
fix: [2.6] force virtual host for oss and cos (#44490)
cherry-pick from master
pr: #44484
related: https://github.com/milvus-io/milvus/issues/44481

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-09-23 10:50:09 +08:00
sre-ci-robot 1c9738d380
[automated] Bump milvus version to v2.6.2 (#44451)
Bump milvus version to v2.6.2
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-09-18 20:04:42 +08:00
XuanYang-cn d1b40b7742
fix: Rename Collection use wrong method to check if collection exists (#44436)
See also: #44435

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-09-18 14:37:07 +08:00
Zhen Ye ba289891c0
enhance: add all ddl message into messages (#44407)
issue: #43897

- add ddl messages proto and add some message utilities.
- support shard/exclusive resource-key-lock.
- add all ddl callbacks future into broadcast registry.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-09-18 10:08:00 +08:00
congqixia c142974853
enhance: Bump milvus & proto version to v2.6.2 (#44427)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-17 21:12:01 +08:00
zhagnlu 9b6703626d
fix:fix unescaped bug for json stats (#44421)
#42533

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-09-17 20:54:01 +08:00
Bingyi Sun 5cd2d99799
enhance: Revert "feat: encode cluster id in auto id (#44324)" (#44426)
This reverts commit 7af1594103
2025-09-17 17:56:01 +08:00
Bingyi Sun 7af1594103
feat: encode cluster id in auto id (#44324)
https://github.com/milvus-io/milvus/issues/44326
prev:
`[physical_ts][logical_ts]`
after
`[sign_bit][cluster_id][physical_ts][logical_ts]`

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-09-17 16:56:01 +08:00
congqixia 1e3ec42e54
fix: Check child fields len instead of nil (#44405)
Related to #44398

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-17 11:36:00 +08:00
Zhen Ye 41dc494d5b
enhance: segment not flush at coord after schema change (#44412)
issue: #43289

- introduced by #43500

Signed-off-by: chyezh <chyezh@outlook.com>
2025-09-17 10:26:00 +08:00
sthuang 2f70a73258
fix: turn on azure by default (#44377)
related: #44354, #44138, #43869

---------

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-09-17 10:12:01 +08:00
congqixia 6f7318a731
enhance: [StorageV2] Use compressed size as log file size (#44402)
Related to #39173

backlog issue that memory size and log size shared same value. This
patch add `GetFileSize` api to get remote compressed binlog size as meta
log file size to calculate usage more accurate.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-16 21:20:02 +08:00
zhenshan.cao 691a8df953
feat: Add RESTful api for rolling upgrade support (#44381)
issue: https://github.com/milvus-io/milvus/issues/43968

Co-authored-by: chyezh <ye.zhen@zilliz.com>
2025-09-16 20:08:00 +08:00
XuanYang-cn 3e0d77eb8f
fix: pooling datanode upload without rootpath in L0 compaction (#44374)
See also: #44289

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-09-16 18:10:00 +08:00
yihao.dai 51f69f32d0
feat: Add CDC support (#44124)
This PR implements a new CDC service for Milvus 2.6, providing log-based
cross-cluster replication.

issue: https://github.com/milvus-io/milvus/issues/44123

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: chyezh <chyezh@outlook.com>
Co-authored-by: chyezh <chyezh@outlook.com>
2025-09-16 16:32:01 +08:00
congqixia 98d23de36c
enhance: [StorageV2] Make load info contains child info (#44384)
Related to #44257

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-16 16:14:00 +08:00
congqixia 103db5ae3e
enhance: [StorageV2] Include partition & clustering key to sys group (#44372)
Related to #44257

This PR makes partition key & clustering candidates of system field
group and adds param item controlling the policy

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-16 12:08:00 +08:00
sre-ci-robot 2f35db5a09
enhance: update builder env rust (#44366)
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
Co-authored-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-09-16 11:53:59 +08:00
zhikunyao 008caae713
enhance: base images use https to install apt package (#44382)
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-09-16 11:51:59 +08:00
sthuang 0ec47a50ba
enhance: clean up vcpkg build (#44386)
related: #44385

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-09-16 10:21:59 +08:00
congqixia aa861f55e6
enhance: [StorageV2] Reverts #44232 bucket name change (#44390)
Related to #39173

- Put bucket name concatenation logic back for azure support

This reverts commit 8f97eb355f.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-16 10:10:00 +08:00
XuanYang-cn ad86292bed
fix: Deny RenameCollection when db enabled encryption (#44225)
Also fix the validation of enabling encyption when create db

See also: #44217, #44218

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-09-16 10:08:07 +08:00
Spade A eb793531b9
feat: impl StructArray -- support import for CSV/JSON/PARQUET/BINLOG (#44201)
Ref https://github.com/milvus-io/milvus/issues/42148

---------

Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-09-15 20:41:59 +08:00
aoiasd 2b2a11afba
enhance: use fixed vcpkg version for build image (#44378)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-09-15 19:33:59 +08:00
congqixia 634026a177
fix: [AddField] Forbid delete `dynamicfield.enable` property (#44335)
Related to #44311

This PR forbids delete `dynamicfield.enable` property and returns user
understandable error message to user.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-15 14:20:00 +08:00
XuanYang-cn e70c2f7b3d
test: Increase PyMilvus version to 2.7.0rc29 for master branch (#44367)
Automated daily bump from pymilvus master branch. Updates
tests/python_client/requirements.txt.

Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2025-09-15 11:11:59 +08:00
cai.zhang 76f6768ea1
enhance: Remove timeout for compaction task (#44277)
issue: #44272

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-09-15 11:03:58 +08:00
yihao.dai c15290c125
fix: Fix invalid pre-allocated segment IDs (#44350)
Mark the task as failed when PreAllocatedSegmentIDs is nil.

issue: https://github.com/milvus-io/milvus/issues/44349

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-09-15 10:27:58 +08:00
zhagnlu baa84e0b2b
fix: avoid mvcc when doing pk compare expr (#44353)
#44352

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-09-15 10:17:59 +08:00
zhagnlu e9bbb6aa9b
fix: fix json_contains bug for stats (#44325)
#42533

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-09-15 10:16:07 +08:00
sthuang b38013352d
enhance: [StorageV2] enable build with azure (#44177)
related: #43869

---------

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-09-14 08:05:58 +08:00
qixuan 9228ed7b8f
test: add case about enable dynamic schema (#44355)
related issue: #42126

Signed-off-by: qixuan <673771573@qq.com>
2025-09-13 19:55:57 +08:00
sthuang 9140201b8f
fix: add init fs check for querynode and streaming node (#44360)
related: #44354

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-09-13 10:31:58 +08:00
congqixia abe22b95c7
enhance: Utilize group info estimating logic usage as well (#44356)
Related to #44257 #44334

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-12 22:47:57 +08:00
cai.zhang f135dff94d
fix: Fix GetCompactionTo return empty results when segment was GCed (#44270)
issue: #44269

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-09-12 18:11:58 +08:00
congqixia bfc9e80e14
enhance: Add param item forcing all indices ready for segment (#44313)
Related to #44312

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-12 17:51:58 +08:00
zhikunyao 1d658b5e84
test: fix macos runner image to lower version (#44348)
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-09-12 16:55:58 +08:00
congqixia 9d2ff48d63
enhance: Utilize group split info to estimate usage (#44338)
Related to #44257 #44334

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-12 14:49:57 +08:00
Bingyi Sun 1931dcd9b5
fix: Fix initialize timestamp index concurrently (#44317)
#issue: https://github.com/milvus-io/milvus/issues/44341

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-09-12 14:25:57 +08:00
cai.zhang 62d416bf4f
fix: Check if ArrayData is nil to prevent panic (#44332)
issue: #44331

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-09-12 14:17:57 +08:00
sparknack 060fc61e80
fix: milvus-common commits update (#44339)
issue: #41435
related: #44268

Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
2025-09-12 12:43:57 +08:00
aoiasd fb58701cbb
enhance: update rust version (#44322)
relate: https://github.com/milvus-io/milvus/issues/44321

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-09-12 10:53:57 +08:00
9Eurydice9 662397e487
test: migrate test_query V2 cases for milvus client (#44238)
issue: #44090
Migrate test_query cases from TestcaseBase to TestMilvusClientV2Base

---------

Signed-off-by: Orpheus Wang <orpheus.wang@zilliz.com>
2025-09-12 09:31:57 +08:00
Feilong Hou 6884cdbe90
test: add complex json expression test (#44211)
<test>: <add test case for complex json expression

 On branch feature/json-shredding
 Changes to be committed:
       modified:   milvus_client/expressions/README.md
modified:
milvus_client/expressions/test_milvus_client_scalar_filtering.py

---------

Signed-off-by: Eric Hou <eric.hou@zilliz.com>
Co-authored-by: Eric Hou <eric.hou@zilliz.com>
2025-09-11 19:57:58 +08:00
congqixia 9cfa013ec6
enhance: [StorageV2] Store column group info in compaction result (#44327)
Related to #44257

This PR store split result in compaction segment binlog struct to make
querynode could utilize it later.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-11 19:49:57 +08:00
zhagnlu 16e6b6aa8a
fix:fix build json stats bug for nested object (#44303)
issue: #44132

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-09-11 14:13:56 +08:00
cqy123456 f5c6138793
enhance: update knowhere version (#44294)
issue: https://github.com/milvus-io/milvus/issues/42937

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2025-09-11 11:21:56 +08:00
congqixia fc968ff1c2
enhance: [StorageV2] Pass args for avg size split policy (#44301)
Related to #44257

This PR
- Pass column stats for avg size split policy
- Add param items for policy configuration

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-09-11 10:43:57 +08:00
sparknack e821468d2a
fix: milvus-common commit update (#44304)
issue: #41435 
related: #44268

Signed-off-by: Shawn Wang <shawn.wang@zilliz.com>
2025-09-11 10:19:56 +08:00
zhagnlu 77f7d19400
fix:avoid mmap rewrite by multi json fields (#44299)
issue: #44127

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
2025-09-11 10:13:57 +08:00