b3791a6f90
fix: Use param item formatter to avoid SetConfig to overlay ( #39597 )
...
Related to #39596
When updating the build param configuration, the `Formatter` could be
used to do so and completed avoid touching the `overlay` config items
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-27 10:51:07 +08:00
f7b7bf69d1
enhance: Add dsl log field for HybridSearch ( #39584 )
...
The dsl fields are separated in sub request structs and cannot be
easiliy printed before. This PR adds a log helper to print the dsl
expressions of HybridSearchRequest.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-26 15:57:06 +08:00
5f4bad6b23
fix: metastore privilege name check with privilege name all ( #39476 )
...
related: https://github.com/milvus-io/milvus/issues/39365
---------
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-01-26 12:17:20 +08:00
e61a841806
enhance: [GoSDK] Support return recall in search result ( #39580 )
...
Related to #37899
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-24 19:05:06 +08:00
c4ae9f4ece
feat: introduce third-party milvus-storage ( #39418 )
...
related: https://github.com/milvus-io/milvus/issues/39173
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-01-24 17:21:13 +08:00
f32830e016
feat: Support restful & go sdk for Int8Vector ( #39278 )
...
Issue: #38666
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2025-01-24 17:07:07 +08:00
5730b69e56
feat: Enable more VECTOR_INT8 unittest ( #39569 )
...
Issue: #38666
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2025-01-24 17:03:07 +08:00
c84a0748c4
enhance: add rw/ro streaming query node replica management ( #38677 )
...
issue: #38399
- Embed the query node into streaming node to make delegator available
at streaming node.
- The embedded query node has a special server label
`QUERYNODE_STREAMING-EMBEDDED`.
- Change the balance strategy to make the channel assigned to streaming
node as much as possible.
Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-24 16:55:07 +08:00
8117d59f85
fix:fix GetValueFromConfig for bool type ( #39526 )
...
#39525
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-01-24 16:17:05 +08:00
6d8441ad7e
enhance: Use mockery pkg config for datacoord&datanode ( #39567 )
...
Related to #38339
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-24 14:25:06 +08:00
16cbdfb3b1
feat: Add Text Embedding Function ( #36366 )
...
https://github.com/milvus-io/milvus/issues/35856
Signed-off-by: junjie.jiang <junjie.jiang@zilliz.com>
2025-01-24 14:23:06 +08:00
47d280d974
fix: not enable rate limiter for restful v1 ( #39553 )
...
issue: #39556
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-01-24 14:05:13 +08:00
5fb597b37b
fix: Remove frequently updating metric to avoid mutex contention ( #38775 )
...
issue: https://github.com/milvus-io/milvus/issues/37630
Reduce the frequency updating metrics to avoid holding the mutex for
long periods.
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-24 10:31:07 +08:00
cd068f2c3a
[automated] Bump milvus version to v2.5.4 ( #39548 )
...
Bump milvus version to v2.5.4
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-01-24 10:29:15 +08:00
05b6ea1351
enhance: Refine error msg for schema & index checking ( #39533 )
...
The error message was malformated or missing some meta info, say field
name. This PR recitfies some message format and add field name in error
message when type param check fails.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-24 09:57:06 +08:00
4cf268bcf1
test: bump deps in requirements ( #39530 )
...
/kind improvement
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-01-24 09:53:05 +08:00
a5217e9f36
test: add database milvus client testcases ( #39505 )
...
/kind improvement
---------
Signed-off-by: laurazhao0611 <laurazhao@zilliz.com>
Co-authored-by: laurazhao0611 <laurazhao@zilliz.com>
2025-01-23 18:45:07 +08:00
844df76cc0
enhance: Rectify run_clang_format grep command ( #39534 )
...
Previously the grep with regex does not work and failed to match lots of
.cpp files
This PR:
- use "-E" flag to use regex match
- commit the fixed result of current cpp code
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-23 17:07:05 +08:00
56659bacbb
enhance: make serialization be part of sync task to support file format change ( #38946 )
...
See #38945
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-01-23 15:49:05 +08:00
176ef631bc
test: enable partition key isolatio testcases in ci ( #39531 )
...
related: https://github.com/milvus-io/milvus/issues/39407
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-01-23 14:33:06 +08:00
e0b26260f2
enhance: enable task delta cache ( #39307 )
...
When there are many segment tasks in the querycoord scheduler, the
traversal in `GetSegmentTaskDelta` checks becomes time-consuming. This
PR adds caching for segment deltas.
issue: https://github.com/milvus-io/milvus/issues/37630
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
2025-01-23 14:31:16 +08:00
e02fb41db8
test: add go-sdk cases for database properties ( #39484 )
...
issue: #33419
- Add test cases for database properties
- Fixed typo AlterDatabaseProperies to AlterDatabaseProperties
- Rename UsingDatabase to UseDatabase
- Rename ListDatabases to ListDatabase
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2025-01-23 14:29:16 +08:00
38f813bed3
enhance: Read metadata concurrently to accelerate recovery ( #38403 )
...
Read metadata such as segments, binlogs, and partitions concurrently at
the collection level.
issue: https://github.com/milvus-io/milvus/issues/37630
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-23 14:27:27 +08:00
154edd237d
enhance: Skip creating partition rate limiters when not enable ( #38816 )
...
issue: https://github.com/milvus-io/milvus/issues/37630
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-23 14:25:17 +08:00
547c686027
fix: fix assignment operator in AssertInfo to comparison operator ( #39347 )
...
fix : #39346
Remove the problem line as it's redundant.
---------
Signed-off-by: SpadeA-Tang <tangchenjie1210@gmail.com>
2025-01-23 14:23:18 +08:00
70c53f787e
enhance: [GoSDK] Pass `UseDefaultConsistency` flag for query option ( #39515 )
...
If the flag is not passed, the behaviors will not be expected when user
not passing consistency level.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-23 14:21:14 +08:00
7476eb3625
feat: Support bulk insert for Int8Vector ( #39499 )
...
Issue: #38666
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2025-01-23 10:19:06 +08:00
f070af67f7
fix: deny to set the mmap param for the alter index api when enable auto index ( #39518 )
...
- issue: #39517
Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-01-23 10:01:04 +08:00
bb8cc6eb85
enhance: Add configs for compaction schedule ( #39010 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-01-22 16:31:10 +08:00
1a1ed07cfa
enhance: Skip update index metrics if index dropped ( #39458 )
...
Related to #39457
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-22 11:19:04 +08:00
41352e40e4
test: add search iterator cases and alter collection properties ( #39406 )
...
/kind improvment
---------
Signed-off-by: laurazhao0611 <laurazhao@zilliz.com>
Co-authored-by: laurazhao0611 <laurazhao@zilliz.com>
2025-01-22 10:41:04 +08:00
40e6fcd868
test: add partition key isolation test case ( #39403 )
...
/kind improvement
---------
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-01-22 09:57:06 +08:00
eab102e976
test: add restful api case ( #38977 )
...
/kind improvement
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-01-22 09:55:23 +08:00
e111c9277f
enhance: Enable hook for importv2 ( #39429 )
...
/kind improvement
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-21 15:15:04 +08:00
89eaf92984
enhance: Limit number of segments restored and promptly terminate the job ( #39344 )
...
1. Limit the maximum number of restored segments to 1024.
2. Fail the import job if saving binlog fails.
3. Fail the import job if saving the import task fails to prevent
repeatedly generating dirty importing segments.
issue: https://github.com/milvus-io/milvus/issues/39331
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-21 15:13:13 +08:00
7261128df0
enhance: Remove not inuse binlog iterators ( #39243 )
...
1. Remove datanode/iterators/binlog_iterator
2. Remove storage/binlog_iterator/MergeIterator
See also: #39242
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2025-01-21 11:15:04 +08:00
9cb4c4e8ac
fix: bm25 import segment without bm25 stats meta ( #38855 )
...
relate: https://github.com/milvus-io/milvus/issues/38854
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-01-21 11:09:04 +08:00
341d6c1eb7
feat: Update segcore for VECTOR_INT8 ( #39415 )
...
Issue: #38666
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2025-01-21 11:03:03 +08:00
905c3b81dd
enhance: set materializedView.enabled default to true ( #39449 )
...
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-01-20 20:39:04 +08:00
a41de38f21
enhance: remain token after authorize ( #39453 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-01-20 20:27:23 +08:00
140c5a0a75
enhance: add unit test for string pk ( #39329 )
...
https://github.com/milvus-io/milvus/issues/39107
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-01-20 19:03:04 +08:00
fb5761af8d
enhance: Skip loading pk index for sorted segment in loader ( #39437 )
...
Related to #39339
Previous PR #39389 only skips append index into segment
Also related to #39428
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-20 18:17:10 +08:00
513b489c85
enhance: add some apis in Restful ( #39105 )
...
- drop/alter database properties
- simplify the structure of search_params
- flush
- compact
- get_compact_status
issue: #38709
---------
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-01-20 18:15:22 +08:00
45d49df89b
fix: Skip load extra indexes for sorted segment pk field ( #39389 )
...
Related to #39339
Extra indexes can be ignored for most cases since sorted pk column
already provided indexing features
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-20 18:13:15 +08:00
682b8450e5
[automated] Update cpu Builder image changes ( #39435 )
...
Update cpu Builder image changes
See changes:
cb959cd1f9sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-01-20 17:23:05 +08:00
38b96090a8
fix: deleted the sealed segment data accidentally ( #39421 )
...
issue: https://github.com/milvus-io/milvus/issues/39333
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2025-01-20 15:29:02 +08:00
cb959cd1f9
enhance: upgrade rust version to 1.83 ( #39295 )
...
#39254
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-01-20 11:15:03 +08:00
e55d6506e3
enhance: Remove frequent observe log ( #39413 )
...
/kind improvement
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-20 11:01:10 +08:00
1a680c29e2
fix: correct remote centroids path in clustering compaction ( #39398 )
...
issue: https://github.com/milvus-io/milvus/issues/39353
The path was modified unintentionally, change it back.
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-01-20 10:59:10 +08:00
9c4a81c80c
enhance: add recalls response for restful api ( #39408 )
...
issue: #37899
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-01-20 10:55:04 +08:00
congqixia
sthuang
Cai Yudong
Zhen Ye
zhagnlu
junjiejiangjjj
smellthemoon
yihao.dai
sre-ci-robot
zhuwenxing
laurazhao0611
Ted Xu
ThreadDao
Spade A
SimFG
XuanYang-cn
aoiasd
Gao
Bingyi Sun
zhenshan.cao