Commit Graph

3172 Commits (70c53f787ebe8030831ab7dc6eee1e7ec697cd26)

Author SHA1 Message Date
Cai Yudong 7476eb3625
feat: Support bulk insert for Int8Vector (#39499)
Issue: #38666

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2025-01-23 10:19:06 +08:00
SimFG f070af67f7
fix: deny to set the mmap param for the alter index api when enable auto index (#39518)
- issue: #39517

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-01-23 10:01:04 +08:00
laurazhao0611 41352e40e4
test: add search iterator cases and alter collection properties (#39406)
/kind improvment

---------

Signed-off-by: laurazhao0611 <laurazhao@zilliz.com>
Co-authored-by: laurazhao0611 <laurazhao@zilliz.com>
2025-01-22 10:41:04 +08:00
zhuwenxing 40e6fcd868
test: add partition key isolation test case (#39403)
/kind improvement

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-01-22 09:57:06 +08:00
zhuwenxing eab102e976
test: add restful api case (#38977)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-01-22 09:55:23 +08:00
qixuan 228bff5e7b
test: modify search iterator V2 case about alias/db/rbac for milvus client (#39400)
issue: #37548

Signed-off-by: qixuan <673771573@qq.com>
2025-01-20 10:25:03 +08:00
zhuwenxing bef042afd5
test: add scalar index for compatibility testing (#39291)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-01-17 14:33:10 +08:00
nico 93ce4b1c97
test: modify milvus client rbac test cases (#39079)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-01-16 11:39:01 +08:00
qixuan 27a99f6b9d
test:Add search Iterator v2 test case for milvus client (#39120)
issue: #37548

Signed-off-by: qixuan <673771573@qq.com>
2025-01-15 17:10:59 +08:00
Zhen Ye fd84ed817c
enhance: add broadcast operation for msgstream (#39040)
issue: #38399

- make broadcast service available for msgstream by reusing the
architecture streaming service

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-14 15:14:59 +08:00
sthuang 5c5948cb70
fix: rbac custom group privilege level check (#39164)
related: https://github.com/milvus-io/milvus/issues/39086

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-01-13 11:24:59 +08:00
sthuang 3cd74037db
fix: restore rbac with empty meta panic (#39141)
related: https://github.com/milvus-io/milvus/issues/38985

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2025-01-13 10:02:57 +08:00
zhuwenxing a8a65641b5
test: update reatful api timeout (#39139)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-01-11 14:21:03 +08:00
Xianhui Lin e5eb1159e2
fix: Refine the err msg of alter index invalid (#39137)
fix: Refine the err msg of alter index invalid
issue: https://github.com/milvus-io/milvus/issues/38517

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-01-10 12:08:57 +08:00
wt 7d32603d4d
test: add more varchar expressions for query (#39122)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2025-01-10 10:54:57 +08:00
Zhen Ye bb8d1ab3bf
enhance: make new go package to manage proto (#39114)
issue: #39095

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-10 10:49:01 +08:00
ThreadDao 461c376b46
test: add test cases for template param (#38867)
issue: #33419
- add case for Get
- add case for TemplateParam

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2025-01-10 09:38:58 +08:00
yanliang567 329795ba91
test: Add search with hints on different expressions (#39048)
issue: https://github.com/milvus-io/milvus/issues/38877

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-01-08 10:58:55 +08:00
cai.zhang ee9a2793da
fix: [skip-e2e] Remove valid expressions from invalid expressions (#39012)
issue: #39014

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-01-06 18:06:54 +08:00
yanliang567 731e882d22
test: Refactor pymilvus client v2 testbase and add a test for search hint (#38939)
issue: https://github.com/milvus-io/milvus/issues/38877
1. refactor pymilvus client v2 testcasebase
2. add a test for search hint
3. update pymilvus to 2.6

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-01-06 11:24:55 +08:00
foxspy af08b5b311
enhance: Update Knowhere version (#38942)
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-01-03 14:28:53 +08:00
nico 1825ab54df
enhance: delete one pod pipeline in nightly and open mmap in standalone (#38887)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-01-03 14:26:54 +08:00
Zhen Ye 80fefadf27
enhance: TestDeleteComplexExpr may failure because of timeout (#38935)
issue: #33419

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-03 12:25:26 +08:00
Patrick Weizhi Xu d3a5282eaa
enhance: add param for tuning max VARCHAR length and restore limit to 65535 (#38884)
issue: #38882 

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
(cherry picked from commit 8e740e004151dd2c11918aad2857c1c8d1bd98f5)
2025-01-02 14:42:53 +08:00
congqixia 19a5c31907
enhance: Bump golang/x/net to v0.33 fixing security alarm (#38850)
Related to https://github.com/milvus-io/milvus/security/dependabot/106

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-02 10:50:55 +08:00
zhuwenxing 95c1ccc20d
test: [skip e2e]update chaos test script (#38886)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-12-31 16:12:52 +08:00
ThreadDao ba0c7b8fff
test: update cases for search params support and groupby issue fix (#38852)
issue: #38343 #33419
- update cases for WithSearchParam
- remove skip for groupby search issue
- update output query dynamic case for server changes

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-12-31 14:14:52 +08:00
zhuwenxing 2f6d4efa68
test: [skip e2e]fix pytest_addoption type (#38860)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-12-31 14:12:58 +08:00
zhuwenxing e19b8f2114
test: update default value of pytest addoption (#38836)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-12-30 14:34:51 +08:00
zhuwenxing d433b754ce
test: [skip e2e]remove secure=True in connections (#38779)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-12-27 16:58:50 +08:00
congqixia a882f341f4
enhance: [GoSDK] Add APIs for backup tool (#38791)
Related to #31291

This PR:

- Add Backup&Restore RBAC APIs
- Add GetPersistentSegmentInfo API
- Add GetServerVersion API
- Add flush task stats

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-27 14:20:51 +08:00
Zhen Ye 5001878b8a
enhance: only use streaming service on e2e and nightly e2e (#38743)
issue: #38399

Signed-off-by: chyezh <chyezh@outlook.com>
2024-12-26 11:32:50 +08:00
aoiasd c7ea09a8be
enhance: return exception type name when segcore return unkonwn exception (#38326)
relate: https://github.com/milvus-io/milvus/issues/38265

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-12-25 18:58:50 +08:00
wei liu 25f0c82ceb
fix: Fix update loading collection's load config doesn't work (#38595)
issue: #38594

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-12-25 18:02:51 +08:00
sthuang 6bc799061e
fix: fix privilege group list and list collections (#38684)
related: #37031
* built-in privilege group privileges in listPrivilegeGroups() should be
the same as in milvus.yaml
* collections granted by collection level built-in privilege group
should be list in showCollections()

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-25 18:00:51 +08:00
ThreadDao ea339c13c6
test: add cases for async milvus client (#38699)
issue: #38697

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-12-25 16:54:50 +08:00
binbin 5304707393
test: Add test cases for rbac v2 (#38556)
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-12-24 18:06:48 +08:00
yanliang567 6884319d03
test: [CP] add alter tests (#38659)
related issue: https://github.com/milvus-io/milvus/issues/38471

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-12-23 19:42:49 +08:00
laurazhao0611 82d85e8c57
test: modify part of milvus client test cases with load func (#38654)
/kind improvment
/cc @yanliang567 @binbinlv

Signed-off-by: laurazhao0611 <laura.zhao@zilliz.com>
2024-12-23 17:16:48 +08:00
Xianhui Lin 90de37e60a
enhance: field stringtype maxlength raise to 1M (#38592)
enhance: field stringtype maxlength raise to 1M
issue: https://github.com/milvus-io/milvus/issues/37436

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2024-12-20 14:32:45 +08:00
congqixia c39db11509
enhance: [GoSDK] Sync API names and add missing APIs (#38603)
Related to #31293

- Rename `UsingDatabase` to `UseDatabase`
- Uncomment default value methods
- Add missing RBAC APIs
- Add some resource group APIs

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-20 11:52:46 +08:00
XuanYang-cn ca7ec23198
enhance: Use partitionID when delete by partitionKey (#38231)
When delete by partition_key, Milvus will generates L0 segments
globally. During L0 Compaction, those L0 segments will touch all
partitions collection wise. Due to the false-positive rate of segment
bloomfilters, L0 compactions will append false deltalogs to completed
irrelevant partitions, which causes *partition deletion amplification.

This PR uses partition_key to set targeted partitionID when producing
deleteMsgs into MsgStreams. This'll narrow down L0 segments scope to
partition level, and remove the false-positive influence
collection-wise.

However, due to DeleteMsg structure, we can only label one partition to
one deleteMsg, so this enhancement fails if user wants to delete over 2
partition_keys in one deletion.

See also: #34665

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-12-20 11:18:46 +08:00
Bingyi Sun 894c203f27
enhance: allow hyphen in partition name (#38494)
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-12-18 15:04:45 +08:00
nico fb0e689617
test: update sdk version and add cases (#38478)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-12-18 10:10:57 +08:00
zhuwenxing b694e06488
test: add lib for supporting higher python version (#38475)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-12-17 14:48:50 +08:00
Bingyi Sun 3e2a2f278b
enhance: Handle rust error in c++ (#38113)
https://github.com/milvus-io/milvus/issues/37930

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-12-16 19:40:45 +08:00
ThreadDao 8794ec966e
test: add go case for groupby search (#38411)
issue: #33419

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-12-16 10:44:43 +08:00
tinswzy 27229f7907
enhance: refine exists log print with ctx (#38080)
issue: #35917 
Refines exists log print with ctx

Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2024-12-14 22:36:44 +08:00
congqixia fe79babdb3
enhance: Bump golang/x/crypto for all packages (#38445)
Related to #38446
See also https://github.com/milvus-io/milvus/security/dependabot/103

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-13 19:12:42 +08:00
Xianhui Lin f2d79b3d3a
enhance: altercollection validation logic (#38419)
altercollection validation logic
issue: https://github.com/milvus-io/milvus/issues/37436

---------

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2024-12-12 21:42:42 +08:00