Commit Graph

21704 Commits (70c53f787ebe8030831ab7dc6eee1e7ec697cd26)

Author SHA1 Message Date
congqixia 70c53f787e
enhance: [GoSDK] Pass `UseDefaultConsistency` flag for query option (#39515)
If the flag is not passed, the behaviors will not be expected when user
not passing consistency level.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-23 14:21:14 +08:00
Cai Yudong 7476eb3625
feat: Support bulk insert for Int8Vector (#39499)
Issue: #38666

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2025-01-23 10:19:06 +08:00
SimFG f070af67f7
fix: deny to set the mmap param for the alter index api when enable auto index (#39518)
- issue: #39517

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-01-23 10:01:04 +08:00
XuanYang-cn bb8cc6eb85
enhance: Add configs for compaction schedule (#39010)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-01-22 16:31:10 +08:00
congqixia 1a1ed07cfa
enhance: Skip update index metrics if index dropped (#39458)
Related to #39457

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-22 11:19:04 +08:00
laurazhao0611 41352e40e4
test: add search iterator cases and alter collection properties (#39406)
/kind improvment

---------

Signed-off-by: laurazhao0611 <laurazhao@zilliz.com>
Co-authored-by: laurazhao0611 <laurazhao@zilliz.com>
2025-01-22 10:41:04 +08:00
zhuwenxing 40e6fcd868
test: add partition key isolation test case (#39403)
/kind improvement

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-01-22 09:57:06 +08:00
zhuwenxing eab102e976
test: add restful api case (#38977)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-01-22 09:55:23 +08:00
yihao.dai e111c9277f
enhance: Enable hook for importv2 (#39429)
/kind improvement

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-21 15:15:04 +08:00
yihao.dai 89eaf92984
enhance: Limit number of segments restored and promptly terminate the job (#39344)
1. Limit the maximum number of restored segments to 1024.
2. Fail the import job if saving binlog fails.
3. Fail the import job if saving the import task fails to prevent
repeatedly generating dirty importing segments.

issue: https://github.com/milvus-io/milvus/issues/39331

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-21 15:13:13 +08:00
XuanYang-cn 7261128df0
enhance: Remove not inuse binlog iterators (#39243)
1. Remove datanode/iterators/binlog_iterator
2. Remove storage/binlog_iterator/MergeIterator

See also: #39242

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-01-21 11:15:04 +08:00
aoiasd 9cb4c4e8ac
fix: bm25 import segment without bm25 stats meta (#38855)
relate: https://github.com/milvus-io/milvus/issues/38854

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-01-21 11:09:04 +08:00
Cai Yudong 341d6c1eb7
feat: Update segcore for VECTOR_INT8 (#39415)
Issue: #38666

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2025-01-21 11:03:03 +08:00
Gao 905c3b81dd
enhance: set materializedView.enabled default to true (#39449)
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-01-20 20:39:04 +08:00
aoiasd a41de38f21
enhance: remain token after authorize (#39453)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-01-20 20:27:23 +08:00
Bingyi Sun 140c5a0a75
enhance: add unit test for string pk (#39329)
https://github.com/milvus-io/milvus/issues/39107

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-01-20 19:03:04 +08:00
congqixia fb5761af8d
enhance: Skip loading pk index for sorted segment in loader (#39437)
Related to #39339
Previous PR #39389 only skips append index into segment

Also related to #39428

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-20 18:17:10 +08:00
smellthemoon 513b489c85
enhance: add some apis in Restful (#39105)
- drop/alter database properties
- simplify the structure of search_params
- flush
- compact
- get_compact_status
issue: #38709

---------

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-01-20 18:15:22 +08:00
congqixia 45d49df89b
fix: Skip load extra indexes for sorted segment pk field (#39389)
Related to #39339

Extra indexes can be ignored for most cases since sorted pk column
already provided indexing features

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-20 18:13:15 +08:00
sre-ci-robot 682b8450e5
[automated] Update cpu Builder image changes (#39435)
Update cpu Builder image changes
See changes:
cb959cd1f9
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-01-20 17:23:05 +08:00
zhenshan.cao 38b96090a8
fix: deleted the sealed segment data accidentally (#39421)
issue: https://github.com/milvus-io/milvus/issues/39333

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2025-01-20 15:29:02 +08:00
Bingyi Sun cb959cd1f9
enhance: upgrade rust version to 1.83 (#39295)
#39254

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-01-20 11:15:03 +08:00
yihao.dai e55d6506e3
enhance: Remove frequent observe log (#39413)
/kind improvement

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-20 11:01:10 +08:00
Gao 1a680c29e2
fix: correct remote centroids path in clustering compaction (#39398)
issue: https://github.com/milvus-io/milvus/issues/39353
The path was modified unintentionally, change it back.

Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-01-20 10:59:10 +08:00
Gao 9c4a81c80c
enhance: add recalls response for restful api (#39408)
issue: #37899

Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-01-20 10:55:04 +08:00
qixuan 228bff5e7b
test: modify search iterator V2 case about alias/db/rbac for milvus client (#39400)
issue: #37548

Signed-off-by: qixuan <673771573@qq.com>
2025-01-20 10:25:03 +08:00
sre-ci-robot fdb968d0ea
[automated] Update Knowhere Commit (#39420)
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-01-20 01:17:02 +08:00
sre-ci-robot a99c92e795 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2025-01-19 00:01:39 +00:00
Gifi Siby f54e8e9554
fix: Folders are also considered for WalkWithObjects to adhere bulk insert failure on using GCS buckets (#39352)
Related task: [#39134
](https://github.com/milvus-io/milvus/issues/39134)

Previous PR: [#39150 ](https://github.com/milvus-io/milvus/pull/39150)
2025-01-19 02:49:03 +08:00
Cai Yudong 5b35fc700d
enhance: [skip-e2e] Use template to remove duplicate unittest (#39396)
Issue: #38666

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2025-01-18 10:33:01 +08:00
congqixia 7cac87caca
fix: Skip erase field if index build on PK field (#39370)
Related to #39339

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-17 20:31:02 +08:00
SimFG c22e457c59
feat: root privileges can be customized (#39191)
- issue: #39184

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-01-17 16:25:04 +08:00
Cai Yudong 64feeb0e2b
enhance: Rename API GenDataset to GenFieldData in unittest (#39386)
Issue: #38666

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2025-01-17 15:55:03 +08:00
zhikunyao d14bb67c62
enhance: update workflow action upload-artifact to v4 (#39391)
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-01-17 15:47:01 +08:00
zhuwenxing bef042afd5
test: add scalar index for compatibility testing (#39291)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-01-17 14:33:10 +08:00
Zhen Ye 3ca6c0127d
fix: update rg failed when alter database (#39355)
issue: #36933

Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-17 14:27:03 +08:00
Zhen Ye 92bde5b4f6
fix: panic when streaming release if using msgstream (#39374)
issue: #39367

Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-17 11:47:02 +08:00
smellthemoon c38bca8d80
enhance: serializes the resp body and attach some details (#39140)
#37611

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-01-17 11:21:02 +08:00
Ted Xu 9209a70bb6
fix: clang format broken under osx (#38427)
See: #38434

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-01-17 10:43:03 +08:00
sthuang 3c9f26942d
enhance: clean up logs of empty op key (#39335)
related: https://github.com/milvus-io/milvus/issues/39334

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-01-17 10:29:03 +08:00
Xianhui Lin 4c76f0403f
fix: bulkimport binlogs skip diskquota check (#39315)
bulkimport binlogs skip diskquota check
issue:https://github.com/milvus-io/milvus/issues/38845

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-01-17 10:03:03 +08:00
Spade A 0461ddf776
fix: phrase match does not support offset input (#39338)
fix: #39337

Signed-off-by: SpadeA-Tang <tangchenjie1210@gmail.com>
2025-01-16 22:05:01 +08:00
XuanYang-cn 74b4369c5b
fix: Record active collections for l0Policy (#39217)
By recording the active collection lists, The l0 compaction trigger
of view change and idle won't influence each other.

Also this pr replaces the L0View cache with real L0 segments' change.
Save some memory and make L0 compaction triggers more accurate.

See also: #39187

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-01-16 20:19:02 +08:00
sre-ci-robot 78568906b9 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2025-01-16 12:04:29 +00:00
Duc Le Tu 2a962ad1ec
fix: apply custom producer config for kafkaHealthCheck (#39283)
issue: https://github.com/milvus-io/milvus/issues/39287
KafkaHealthCheck init without ProducerExtraConfig. This PR fix that.

---------

Signed-off-by: DLT1412 <tuduc93@gmail.com>
Co-authored-by: DucLT <duc.le1@be.com.vn>
2025-01-16 19:31:02 +08:00
foxspy 172051b050
fix: remove num_build_thread param (#39340)
issue: #39090 
The num_build_thread parameter will limit the number of build omps. This
parameter will override the effect of buildIndexThreadPoolRatio.
Removing this parameter will have no actual effect. This parameter is
actually only used in the growing index, where it will be explicitly
set.

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-01-16 19:21:01 +08:00
Gao 75d7978a18
enhance: pass partition key scalar info if enable for vector mem index (#39123)
issue: #34332

---------

Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-01-16 14:33:03 +08:00
congqixia 1f6fd54146
fix: [skip e2e] Make test case assigner result deterministic (#39317)
Related to #39296

The case initialized with {100:8 ,101: 16}. After first assignment, the
slots become {100:8, 101:8} and the following result is not stable.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-16 14:25:02 +08:00
nico 93ce4b1c97
test: modify milvus client rbac test cases (#39079)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-01-16 11:39:01 +08:00
Spade A 8c4ba70a4c
fix: enable to build index with single segment (#39233)
fix https://github.com/milvus-io/milvus/issues/39232

---------

Signed-off-by: SpadeA-Tang <tangchenjie1210@gmail.com>
2025-01-16 11:01:06 +08:00