Commit Graph

1876 Commits (8288c06e3d43a0aa82e50da3d1b749a76ac42e5c)

Author SHA1 Message Date
nico 2630717836
test: update sdk version and cases (#37507)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-11-12 17:48:28 +08:00
Bingyi Sun 2742e9573f
enhance: Print results if a test fails (#37606)
test_hybrid_search_different_limit_round_decimal fails occasionally. 
Print more details for debug.

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-11-12 17:12:28 +08:00
Chun Han 2d29dcd30c
enhance:refine group_strict_size parameter(#37482) (#37483)
related: #37482

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2024-11-12 09:56:28 +08:00
binbin 21b68029a0
test: Add nullable test cases for bulk writer (#37572)
issue: #36129

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-11-12 09:46:28 +08:00
aoiasd 12951f0abb
enhance: rename tokenizer to analyzer and check analyzer params (#37478)
relate: https://github.com/milvus-io/milvus/issues/35853

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-11-10 16:12:26 +08:00
zhuwenxing ffdde391e3
test: fix unstable testcase caused by server refactor (#37545)
issue: https://github.com/milvus-io/milvus/issues/37533

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-09 09:58:26 +08:00
Buqian Zheng 40b770cb7b
fix: add rescorer activation function for BM25 (#37481)
issue: #35853

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-11-07 12:08:25 +08:00
cai.zhang aed3b94b5d
enhance: Refine error message for contains array (#37383)
issue: #36221

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-11-07 10:44:25 +08:00
nico cf66fbee8a
test: update test cases (#37215)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-11-06 17:50:25 +08:00
aoiasd d67853fa89
feat: Tokenizer support build with params and clone for concurrency (#37048)
relate: https://github.com/milvus-io/milvus/issues/35853
https://github.com/milvus-io/milvus/issues/36751

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-11-06 17:48:24 +08:00
zhuwenxing 0fc6c634b0
test: fix tokenizer and monkey patch faker function (#37119)
/kind improvement

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Signed-off-by: zhuwenxing <wxzhuyeah@gmail.com>
2024-11-05 08:42:23 +08:00
cai.zhang 50de122dc7
enhance: Rename textmatch to text_match (#37290)
issue: #36672

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-11-03 18:40:27 +08:00
zhuwenxing d24970c090
test: fix potential unstable cases of full-text search (#37328)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-10-31 21:12:21 +08:00
zhuwenxing 6e37372619
test: update checker (#37275)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-10-31 09:50:20 +08:00
yanliang567 3a3404658e
test: Add a test for iterator enhancement (#37296)
related issue: https://github.com/milvus-io/milvus/issues/37084

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-10-30 16:54:20 +08:00
Zhen Ye 889434691c
enhance: enable asan for e2e (#37149)
issue: #35854

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2024-10-29 14:14:24 +08:00
zhuwenxing 4c108b1564
test: update jieba tokenizer in test (#37199)
/kind improvement

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-10-28 19:22:22 +08:00
zhuwenxing cdee149191
test: fix testcases for verification after chaos (#37153)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-10-28 10:33:29 +08:00
zhuwenxing c8dd665bf6
test: supplementing case for text match (#36693)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-10-28 10:31:40 +08:00
foxspy d7b2ffe5aa
enhance: add an unify vector index config checker (#36844)
issue: #34298

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2024-10-28 10:11:37 +08:00
Yinzuo Jiang 3628593d20
feat: Implement custom function module in milvus expr (#36560)
OSPP 2024 project:
https://summer-ospp.ac.cn/org/prodetail/247410235?list=org&navpage=org

Solutions:

- parser (planparserv2)
    - add CallExpr in planparserv2/Plan.g4
    - update parser_visitor and show_visitor
- grpc protobuf
    - add CallExpr in plan.proto
- execution (`core/src/exec`)
- add `CallExpr` `ValueExpr` and `ColumnExpr` (both logical and
physical) for function call and function parameters
- function factory (`core/src/exec/expression/function`)
    - create a global hashmap when starting milvus (see server.go)
- the global hashmap stores function signatures and their function
pointers, the CallExpr in execution engine can get the function pointer
by function signature.
- custom functions
    - empty(string)
    - starts_with(string, string)
- add cpp/go unittests and E2E tests

closes: #36559

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
2024-10-25 15:25:30 +08:00
Buqian Zheng 088d5d7d76
fix: optimize BM25 err message (#37074)
issue: https://github.com/milvus-io/milvus/issues/37022

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-10-25 14:35:45 +08:00
zhuwenxing ac2858d418
test: add full text search checker in test (#37122)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-10-25 14:09:29 +08:00
qixuan 80aa9ab4d6
test: Add insert and upsert related cases for null and default value support (#37088)
issue: #36129

---------

Signed-off-by: qixuan <673771573@qq.com>
2024-10-25 11:03:29 +08:00
binbin c285853de8
test: Add test cases about expr for null and default support (#37121)
issue: #36129

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-10-25 11:01:30 +08:00
smellthemoon 2b3f5bec07
fix: panic when create index on all none data (#37046)
#37045

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-10-24 17:09:28 +08:00
yanliang567 0d376f1a8f
test: Add query iterator test and seperate a new test file (#37085)
related issue: #37084

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-10-24 11:47:29 +08:00
zhuwenxing 3b024f9b36
test: Add full-text search test cases (#36998)
/kind improvement

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-10-23 09:51:27 +08:00
zhuwenxing 80d48f1e53
test: add text match checker in test (#37052)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-10-23 09:49:27 +08:00
qixuan 36147b10f5
test: Add insert and upsert related cases for null and default value support (#36932)
issue: #36129

Signed-off-by: qixuan <673771573@qq.com>
2024-10-22 10:13:27 +08:00
yanliang567 d17135d3bc
test: Add alias test with rename collection (#36978)
related issue: #36963 
1. add alias tests with rename collection for issue #36963
2. update some test levels
3. fix some xfail tests

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-10-18 16:27:24 +08:00
smellthemoon eb3e4583ec
enhance: all op(Null) is false in expr (#35527)
#31728

---------

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-10-17 21:14:30 +08:00
wt 97ff012c67
test: check query response data (#36952)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-10-17 19:13:25 +08:00
nico 2291d0c9f5
test: update test cases (#36878)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-10-15 19:13:24 +08:00
yanliang567 0ec92513a5
test: Update Diskann supporting group by (#36853)
related issue: #36813 

milvus diskann does not support group_search before, it supports now.

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-10-15 10:35:23 +08:00
ThreadDao d566b0ceff
test: add stats task feature cases and DefaultVectorSearchParams (#36768)
issue: #36767

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-10-14 19:15:23 +08:00
nico 937ebec2ce
test: update test cases (#36841)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-10-14 19:13:23 +08:00
yanliang567 c96bbe19ba
test: Add upsert in rows tests (#36820)
related issue: #36710

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-10-14 16:41:22 +08:00
yanliang567 621dbc9107
test: Add json key in [] test to verify issue 36718 (#36738)
related issue: #36718

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-10-11 14:29:21 +08:00
Buqian Zheng f7b811450d
feat: add enable_tokenizer params to VarChar field (#36480)
issue: #35922

add an enable_tokenizer param to varchar field: must be set to true so
that a varchar field can enable_match or used as input of BM25 function

---------

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-10-10 20:33:21 +08:00
nico 9fdf0505a8
test: update test case for support dynamic load replica (#36589)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-10-08 17:31:20 +08:00
binbin 0d57ff01a6
test: add null and default test cases (#36612)
issue: #36129

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-10-08 17:25:24 +08:00
wt 798ef223f1
test: add test cases for param checking (#36595)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-30 10:33:16 +08:00
Chun Han a54bffd6cd
fix: refine test case for search_group_by(#36401) (#36511)
related: #36401

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2024-09-30 10:13:17 +08:00
binbin d1d5a50014
test: add null and default test cases (#36539)
issue: #36129

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-09-29 09:39:22 +08:00
wt 1f271e39c6
test: add partition key & bitmap test case (#36564)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-27 14:17:14 +08:00
yanliang567 e6c7fd6605
test: Add group search test on sparse vectors (#36562)
related issue: #36295
add one test for alter alias

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-09-27 14:15:14 +08:00
zhuwenxing 7c2cb8c5d4
test: add bulk insert case for text match feature (#36398)
/kind improvement

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-09-27 10:01:14 +08:00
wt ff4c62e44f
test: add more scalar filter expressions (#36545)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-27 09:59:14 +08:00
zhuwenxing 9444329da1
test: relax the checks on range search (#36542)
/kind improvement

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-09-27 09:57:13 +08:00
zhagnlu 0799d927c6
fix:fix term expr overflow bug (#36525)
#36520

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-09-26 15:01:14 +08:00
zhuwenxing 954d8a5f68
test: add search test cases with text match (#36399)
/kind improvement

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-09-26 10:15:14 +08:00
nico cfd636ed5b
test: add different language tests and modify some cases (#36465)
fix: #36396

Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-09-26 09:21:13 +08:00
wt 14be89df29
test: add case to enable offset cache and mmap at the same time (#36505)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-25 19:59:13 +08:00
zhuwenxing 58baeee8f1
test: add query with text match filter (#36381)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Co-authored-by: yanliang567 <82361606+yanliang567@users.noreply.github.com>
2024-09-25 15:17:13 +08:00
Chun Han d55d9d6e1d
fix: change pymilvus version for hybridsearch-groupby(#36407) (#36451)
related: #36407

---------

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2024-09-24 14:29:13 +08:00
qixuan 51cdee1f84
test: Add query related test cases for default and null support (#36277)
issue: #36129

Signed-off-by: qixuan <673771573@qq.com>
2024-09-23 19:07:13 +08:00
wt 701f3bf26e
test: add search group by test case for bitmap (#36410)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-23 17:29:12 +08:00
yanliang567 1fb8b46db0
test: Share one collection for group search tests (#36427)
related issue: #36407
1. add partial load tests
2. use new test class to share one collection for all grouping search
tests

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-09-23 14:09:11 +08:00
yanliang567 e013ef1908
test: Add tests for hybrid search group by (#36326)
related issue: #36295

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-09-19 09:41:12 +08:00
binbin 5ca4d5977a
test: Add bulk insert related test cases for default and null support (#36219)
issue: #36129

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-09-18 19:33:17 +08:00
wt 526a672bae
test: add more bitmap test cases (#36290)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-16 11:03:09 +08:00
nico e3e88ffbe6
test: update pymilvus version and skip some cases (#36281)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-09-14 17:57:14 +08:00
yanliang567 2e434b2358
test: Add group size tests (#36240)
related issue: #36146

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-09-13 16:13:08 +08:00
binbin b5ff348906
test: Add part of test cases for default and null support (#36186)
issue : #36129

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-09-12 17:29:13 +08:00
binbin d9c8d1ea90
test: Add part of test cases for default and null support (#36130)
issue: #36129

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-09-11 10:59:07 +08:00
wt dbe03a6151
test: add check after altering cardinality limit (#36158)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-11 10:49:06 +08:00
nico 42eef4900d
test: update test cases and sdk version (#36148)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-09-11 10:45:07 +08:00
wt 53a87825f3
test: add more bitmap test cases (#36131)
1. verified issues #36054 and #35971 
2. add mix scenes test cases for BITMAP index

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-10 10:55:07 +08:00
wt c916407f37
test: add query expr test cases (#36073)
1. query with expr under different scalar index types
2. test framework supports preparing one piece of data and multiple
parameter queries

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-09 19:55:06 +08:00
zhagnlu 208c8a2328
fix:support config index offsetcache and fix create same index again (#35985)
#35971

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-09-08 18:23:05 +08:00
Jiquan Long 11325d9ed5
fix: binary arith expression on inverted index (#35945)
issue: https://github.com/milvus-io/milvus/issues/35946

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2024-09-05 20:01:05 +08:00
nico 40d34f711e
test: update test cases (#35867)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-09-04 10:37:03 +08:00
wt cb49b32358
test: add bitmap index cases (#35909)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-03 16:49:03 +08:00
zhuwenxing 57422cb2ed
test: add array inverted index function test (#35874)
/kind improvement

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-09-02 17:49:02 +08:00
yellow-shine bb9bed64a3
enhance: new nightly ci to support testing distributed-streaming (#35672)
issue: https://github.com/milvus-io/milvus/issues/35704

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-27 14:24:59 +08:00
nico f756f01445
test: update test cases (#35640)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-08-26 12:00:58 +08:00
yanliang567 7ac339ac64
test: Update init collection method (#35596)
Related issue: #32653

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-08-21 09:22:56 +08:00
yanliang567 249dc4d9eb
test: Add tests for upsert with auto id (#35556)
Related issue: #34668

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-08-20 14:20:56 +08:00
wei liu 22ced010cd
enhance: make configure load param feature be compatible with old sdk (#35520)
issue: #31570 #35521

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-08-20 10:30:55 +08:00
zhagnlu c19fe95154
fix: support string match for hybrid and bitmap index (#35294)
#34841

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-08-07 09:54:22 +08:00
zhagnlu 4b553b0333
enhance: revert remove duplicated pk function (#35103)
issue: #34778
 Revert "fix: fix query count(*) concurrently"
 Revert "enhance: mark duplicated pk as deleted "

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-08-05 10:48:17 +08:00
yellow-shine 241c71fdde
enhance: use docker compose instead of docker-compose (#35208)
https://github.com/milvus-io/milvus/issues/35209

---------

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-02 19:32:32 +08:00
zhagnlu a8a4779749
fix: fix parse plan proto failed for search type (#34944)
#25848

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-07-29 21:19:49 +08:00
zhagnlu 86322e0468
fix: fix query count(*) concurrently (#35007)
#34778
#34849
fix two problems:
1. count(*) incorrect, if growing insert duplicated (pk, timestamp)
pairs that pk and timestamp all same, need to keep just one pair.
2. count(*) may core dump, if get_real_count interface get snapshot and
do mvcc at not consistency status, mainly happens under concurrency.

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-07-29 19:53:50 +08:00
elstic 2c462d387b
test: Fix index creation mismatch for sparse vector columns in multivector case (#34618)
If `is_all_data_type` is true, the case will add float32, f16, bf16, and
sparse vectors, but the created indexes are all `flat` indexes by
default. The sparse type cannot create a flat index. Fix the test code
to create a `SPARSE_INVERTED_INDEX` index for the sparse vector when
is_all_data_type is true

Signed-off-by: elstic <hao.wang@zilliz.com>
2024-07-13 10:45:37 +08:00
smellthemoon 07b94b4615
enhance: support upsert autoid==true (#30342)
related with: #29258

---------

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-07-11 16:53:35 +08:00
Gao ae6d6f91e6
enhance: change autoindex default metric type (#34261)
issue: #34304 
cosine is more widely used in float vectors, and cosine and hamming
distance are 'metrics' which have good geometric properties

Signed-off-by: chasingegg <chao.gao@zilliz.com>
2024-07-08 19:52:24 +08:00
elstic f7898a3ad6
test: update test case (#34108)
Signed-off-by: elstic <hao.wang@zilliz.com>
2024-07-08 11:46:10 +08:00
zhuwenxing 00e5a406d4
test: remove dup code (#34242)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-06-28 10:46:04 +08:00
nico f2107ad263
test: update test cases about autoindex (#34224)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-06-27 17:06:05 +08:00
zhuwenxing a08000cfbf
enhance:[skip e2e]update one pod mode resource (#34196)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-06-26 16:54:05 +08:00
nico c85644e1b3
test: modify test case about upsert partition (#33919)
issue: #33902

Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-06-21 18:50:00 +08:00
yanliang567 f3f390ea43
test: Update tests for range search and add test for query with dup ids (#34057)
related issue: #33883

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-06-21 18:48:02 +08:00
elstic 4e414fb7fc
test: optimizing variable names (#34035)
Signed-off-by: elstic <hao.wang@zilliz.com>
2024-06-21 10:14:00 +08:00
elstic ce3d7070ac
test: change the number of insertion vectors (#34014)
pr: https://github.com/milvus-io/milvus/pull/33916 

1. Fix case: test_collection_multi_sparse_vectors 
2. Reduce the amount of data generated

Signed-off-by: elstic <hao.wang@zilliz.com>
2024-06-20 13:58:05 +08:00
zhuwenxing f3d902cf16
test: add test case for bulkwriter (#33879)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-06-20 09:24:04 +08:00
nico 0264588df9
enhance: update pymilvus version (#33905)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-06-20 09:22:18 +08:00
congqixia cc77363b66
enhance: Set maxPartitionNum default value to 1024 (#33949)
See also #30059

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-20 09:11:59 +08:00
elstic 1216a4bcd8
test: Add more sparse test cases (#33916)
issue: https://github.com/milvus-io/milvus/issues/31483

Signed-off-by: elstic <hao.wang@zilliz.com>
2024-06-19 15:24:09 +08:00