Commit Graph

21691 Commits (master)

Author SHA1 Message Date
Gao f0dae81494
fix: set iterative filter hint to false when no expr specified (#39033)
issue: https://github.com/milvus-io/milvus/issues/39013

Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-01-08 12:56:56 +08:00
congqixia f076898761
fix: Return io error other than `NotExist` refreshing config (#38924)
Related to #38923

This PR:

- Check whether `os.Stat` config file error is io.ErrNotExist
- Panic when get config return error during Milvus initialization

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-08 12:00:56 +08:00
Zhen Ye 134952b6c5
enhance: refactor the streaming node log (#39052)
issue: #38399

Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-08 11:30:56 +08:00
yanliang567 329795ba91
test: Add search with hints on different expressions (#39048)
issue: https://github.com/milvus-io/milvus/issues/38877

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-01-08 10:58:55 +08:00
wei liu 47e7ea241e
enhance: Add log for case which target not update as expected (#38944)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-01-07 17:45:03 +08:00
Zhen Ye c5a7000a92
enhance: move streaming coord from datacoord to rootcoord (#39007)
issue: #38399

We want to support broadcast operation for both streaming and msgstream.
But msgstream can be only sent message from rootcoord and proxy.
So this pr move the streamingcoord to rootcoord to make easier
implementation.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-07 17:42:57 +08:00
Ted Xu 3dc95153b7
fix: build break under debug mode (#38790)
See #38435

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2025-01-07 17:36:56 +08:00
congqixia 182cac03e5
enhance: Use bitset or instead of bitwise set (#39037)
Related to #39003

Copying bitset value bit by bit is slow and CPU heavy, this PR utilizes
bitset operator "|=" to accelerate this procedure

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-07 15:02:56 +08:00
Cai Yudong 84f8047a86
fix: Fix Milvus build error (#39008)
Issue: #39005

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2025-01-07 14:22:56 +08:00
Chun Han 3739446a33
enhance: refine array view to optimize memory usage(#38736) (#38808)
related: #38736

700m data, array_length=10
non-mmap_offsets_uint64: 2.0G
mmap_offsets_uint64: 1.1G
mmap_offsets_uint32: 880MB

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2025-01-07 13:26:55 +08:00
congqixia 72f5b85c05
enhance: Accelerate `find_first` by utilizing bitset simd methods (#39004)
Related to #39003

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-07 10:34:54 +08:00
cai.zhang ee9a2793da
fix: [skip-e2e] Remove valid expressions from invalid expressions (#39012)
issue: #39014

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-01-06 18:06:54 +08:00
zhagnlu 8165044b6d
fix: fix query incorrect in case of concurrent delete (#38991)
#38961

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-01-06 15:14:54 +08:00
yanliang567 731e882d22
test: Refactor pymilvus client v2 testbase and add a test for search hint (#38939)
issue: https://github.com/milvus-io/milvus/issues/38877
1. refactor pymilvus client v2 testcasebase
2. add a test for search hint
3. update pymilvus to 2.6

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-01-06 11:24:55 +08:00
Bingyi Sun f0cddfd160
fix: Fix panic caused by removing directory (#38622)
https://github.com/milvus-io/milvus/issues/38604

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-01-06 10:54:54 +08:00
sre-ci-robot 0a2c964bb8 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2025-01-06 00:01:39 +00:00
congqixia 7128e36eb0
enhance: Use mvcc timestamp as guarantee ts if set (#38980)
When MvccTimestamp is set, it could be used as guarantee timestamp
directly instead of new ts allocated by scheduler reducing the waiting
time when delegator has tsafe lag

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-05 19:02:54 +08:00
Francisco Arceo 7f05d7a40f
doc: Update typo in "Welcome to Milvus" (#38995)
enhance: Updating a minor typo.

Signed-off-by: Francisco Javier Arceo <farceo@redhat.com>
2025-01-05 19:00:54 +08:00
cai.zhang bd280d6f98
fix: expression with capital AND and OR are not recognized (#38927)
fix https://github.com/milvus-io/milvus/issues/38864
AND, OR and NOT is not recognized in milvus parser

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-01-05 18:55:00 +08:00
cai.zhang 9672eee78a
enhance: Increase the buffer capacity of notifyIndexChan to support concurrency (#38957)
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-01-05 18:53:01 +08:00
sre-ci-robot 11bfc93683
[automated] Update Knowhere Commit (#38993)
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-01-04 01:16:53 +08:00
sre-ci-robot 90167640c4 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2025-01-03 12:00:48 +00:00
congqixia 4966230d86
enhance: [GoSDK] Support Resource Group Controlling APIs (#38940)
Related to #30647

This PR add APIs:

- DescribeResourceGroup
- UpdateResourceGroup
- TransferReplica

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-03 18:12:54 +08:00
Bingyi Sun c6a7f48123
enhance: Fix using wrong pool for warmup (#38941)
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-01-03 17:50:54 +08:00
foxspy af08b5b311
enhance: Update Knowhere version (#38942)
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-01-03 14:28:53 +08:00
nico 1825ab54df
enhance: delete one pod pipeline in nightly and open mmap in standalone (#38887)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-01-03 14:26:54 +08:00
Spade A 4245c5bed1
fix: text match panics when enable_match is set be false (#38950)
fix: https://github.com/milvus-io/milvus/issues/38949

---------

Signed-off-by: SpadeA-Tang <tangchenjie1210@gmail.com>
2025-01-03 14:20:55 +08:00
SimFG d7623ab635
enhance: extract the task step execution process (#38323)
- issue: #38322

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-01-03 12:36:54 +08:00
Zhen Ye 80fefadf27
enhance: TestDeleteComplexExpr may failure because of timeout (#38935)
issue: #33419

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-03 12:25:26 +08:00
sre-ci-robot e6bf141e0b
[automated] Bump milvus version to v2.5.2 (#38959)
Bump milvus version to v2.5.2
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-01-03 10:56:55 +08:00
Gao d9ebb70b10
fix: search req transfer correctly (#38955)
issue: #37899

Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-01-03 10:04:54 +08:00
Bingyi Sun aa0a87eda7
fix: Block warmup submit if pool full in sync mode (#38690)
https://github.com/milvus-io/milvus/issues/38692

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-01-02 15:04:58 +08:00
Patrick Weizhi Xu d3a5282eaa
enhance: add param for tuning max VARCHAR length and restore limit to 65535 (#38884)
issue: #38882 

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
(cherry picked from commit 8e740e004151dd2c11918aad2857c1c8d1bd98f5)
2025-01-02 14:42:53 +08:00
smellthemoon 907fc24f85
enhance: support null expr (#38772)
#31728

---------

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2025-01-02 14:16:54 +08:00
congqixia 19a5c31907
enhance: Bump golang/x/net to v0.33 fixing security alarm (#38850)
Related to https://github.com/milvus-io/milvus/security/dependabot/106

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-02 10:50:55 +08:00
MimoN accfacf012
fix: [skip e2e]update webui logic (#38755)
issue: #36621

* update collection detail page logic
* fix data page segments list
* remove useless js file
2024-12-31 18:25:00 +08:00
tinswzy 11f8f4a378
enhance: add intent ctx to rootcoord init (#38439)
issue: #35917 
add intent ctx to rootcoord initialization process

Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2024-12-31 18:22:53 +08:00
zhuwenxing 95c1ccc20d
test: [skip e2e]update chaos test script (#38886)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-12-31 16:12:52 +08:00
ThreadDao ba0c7b8fff
test: update cases for search params support and groupby issue fix (#38852)
issue: #38343 #33419
- update cases for WithSearchParam
- remove skip for groupby search issue
- update output query dynamic case for server changes

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-12-31 14:14:52 +08:00
zhuwenxing 2f6d4efa68
test: [skip e2e]fix pytest_addoption type (#38860)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-12-31 14:12:58 +08:00
smellthemoon 6b105837b4
enhance: add some apis in Restful (#38733)
add some apis in Restful #38709 

- alter/drop collection properties
- alter/drop index properties
- alter collection field properties
- refresh load

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-12-31 11:28:51 +08:00
Bingyi Sun 3822819942
enhance: Remove an undefined behavior in index writer (#38657)
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-12-31 10:42:52 +08:00
sre-ci-robot 276e7a8d13 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2024-12-31 00:01:28 +00:00
cai.zhang af0315f190
fix: Release compaction task lock when return function (#38856)
issue: #38851

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-12-30 22:44:49 +08:00
codingjaguar 43a50d71bd
doc: Update readme to refine wording and reflect changes in 2.5 version (#38761)
Update readme to refine wording and reflect changes in 2.5 version

---------

Signed-off-by: codingjaguar <jiang.chen@zilliz.com>
2024-12-30 20:43:59 +08:00
Xiaofan cb6eca8e91
fix: drop partition can not be successful if load failed (#38793)
fix #38649
when partition load failed, the partition drop will also fail due to the
wrong error message

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
2024-12-30 19:42:52 +08:00
cai.zhang ba3c2e6fb1
fix: Only generate the index_null_offset file when the field support null value (#38833)
issue: #38832

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2024-12-30 18:02:52 +08:00
Zhen Ye 07c1f43d95
fix: the retrieve plan on heap is used after free when reduce (#38840)
issue: #38731

Signed-off-by: chyezh <chyezh@outlook.com>
2024-12-30 17:50:51 +08:00
Zhen Ye 56c5b66619
fix: the close operation of rmq consumer is not sync (#38734)
issue: #38399

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2024-12-30 16:04:51 +08:00
SimFG ecc820e030
enhance: update expr version to support method parameter type conversion (#38780)
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-12-30 15:59:06 +08:00