0c0630cc38
feat: support dropping index without releasing collection ( #42941 )
...
issue: #42942
This pr includes the following changes:
1. Added checks for index checker in querycoord to generate drop index
tasks
2. Added drop index interface to querynode
3. To avoid search failure after dropping the index, the querynode
allows the use of lazy mode (warmup=disable) to load raw data even when
indexes contain raw data.
4. In segcore, loading the index no longer deletes raw data; instead, it
evicts it.
5. In expr, the index is pinned to prevent concurrent errors.
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-09-02 16:17:52 +08:00
ffb2877992
enhance: support auto index type for json index ( #42071 )
...
issue: https://github.com/milvus-io/milvus/issues/42070
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-06-09 21:22:34 +08:00
d475d93a3d
test: Add ivf_rabitq index tests ( #41914 )
...
related issue: #41760
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-05-20 19:28:24 +08:00
70b311735b
test: [E2e Refactor] use vector datatype instead of hard code dataype names ( #41497 )
...
related issue: #40698
1. use vector datat types instead of hard code datatpe names
2. update search pagination tests
3. remove checking distances in search results checking, for knowhere
customize the distances for different metrics and indexes. Now only
assert the distances are sorted correct.
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-04-25 10:46:38 +08:00
9676365af9
fix: Fix json index not equal filter ( #40647 )
...
issue: #35528
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-27 23:06:23 +08:00
345538d10a
test: Add test cases for part of json path index ( #40445 )
...
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2025-03-10 14:30:07 +08:00
7d35d023a3
test: Remove the old get index params method ( #40319 )
...
related issue: https://github.com/milvus-io/milvus/issues/40156
remove the old get index params method and update the new one
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-03-04 17:12:06 +08:00
9a8d94998a
test: update cases for error message ( #39960 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-02-28 17:36:02 +08:00
b59555057d
feat: support json index ( #36750 )
...
https://github.com/milvus-io/milvus/issues/35528
This PR adds json index support for json and dynamic fields. Now you can
only do unary query like 'a["b"] > 1' using this index. We will support
more filter type later.
basic usage:
```
collection.create_index("json_field", {"index_type": "INVERTED",
"params": {"json_cast_type": DataType.STRING, "json_path":
'json_field["a"]["b"]'}})
```
There are some limits to use this index:
1. If a record does not have the json path you specify, it will be
ignored and there will not be an error.
2. If a value of the json path fails to be cast to the type you specify,
it will be ignored and there will not be an error.
3. A specific json path can have only one json index.
4. If you try to create more than one json indexes for one json field,
sdk(pymilvus<=2.4.7) may return immediately because of internal
implementation. This will be fixed in a later version.
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-02-15 14:06:15 +08:00
5fdc7578bb
test: Add sparse invert index algo check tests ( #39691 )
...
related issue: #39332
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-02-12 12:14:46 +08:00
5cdd906d4b
test: update test cases and sdk version ( #39443 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-02-11 18:42:45 +08:00
e5eb1159e2
fix: Refine the err msg of alter index invalid ( #39137 )
...
fix: Refine the err msg of alter index invalid
issue: https://github.com/milvus-io/milvus/issues/38517
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-01-10 12:08:57 +08:00
fb0e689617
test: update sdk version and add cases ( #38478 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-12-18 10:10:57 +08:00
af433ffd68
test: Add expression template tests and use error msg only as assertion ( #37618 )
...
related issue: https://github.com/milvus-io/milvus/issues/37451
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-11-13 17:14:30 +08:00
2630717836
test: update sdk version and cases ( #37507 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-11-12 17:48:28 +08:00
cf66fbee8a
test: update test cases ( #37215 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-11-06 17:50:25 +08:00
937ebec2ce
test: update test cases ( #36841 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-10-14 19:13:23 +08:00
798ef223f1
test: add test cases for param checking ( #36595 )
...
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-30 10:33:16 +08:00
ff4c62e44f
test: add more scalar filter expressions ( #36545 )
...
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-27 09:59:14 +08:00
701f3bf26e
test: add search group by test case for bitmap ( #36410 )
...
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-23 17:29:12 +08:00
526a672bae
test: add more bitmap test cases ( #36290 )
...
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-16 11:03:09 +08:00
dbe03a6151
test: add check after altering cardinality limit ( #36158 )
...
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-11 10:49:06 +08:00
53a87825f3
test: add more bitmap test cases ( #36131 )
...
1. verified issues #36054 and #35971
2. add mix scenes test cases for BITMAP index
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-10 10:55:07 +08:00
11325d9ed5
fix: binary arith expression on inverted index ( #35945 )
...
issue: https://github.com/milvus-io/milvus/issues/35946
---------
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2024-09-05 20:01:05 +08:00
cb49b32358
test: add bitmap index cases ( #35909 )
...
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-03 16:49:03 +08:00
f756f01445
test: update test cases ( #35640 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-08-26 12:00:58 +08:00
7ac339ac64
test: Update init collection method ( #35596 )
...
Related issue: #32653
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-08-21 09:22:56 +08:00
ae6d6f91e6
enhance: change autoindex default metric type ( #34261 )
...
issue: #34304
cosine is more widely used in float vectors, and cosine and hamming
distance are 'metrics' which have good geometric properties
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2024-07-08 19:52:24 +08:00
f2107ad263
test: update test cases about autoindex ( #34224 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-06-27 17:06:05 +08:00
1216a4bcd8
test: Add more sparse test cases ( #33916 )
...
issue: https://github.com/milvus-io/milvus/issues/31483
Signed-off-by: elstic <hao.wang@zilliz.com>
2024-06-19 15:24:09 +08:00
0c5d8660aa
feat: support inverted index for array ( #33452 )
...
issue: https://github.com/milvus-io/milvus/issues/27704
---------
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2024-05-31 09:47:47 +08:00
00cd88e164
test: Add index names tests for mulitple vectors support ( #33250 )
...
Related issue: https://github.com/milvus-io/milvus/issues/32653
1. Update index name tests
2. remove some time.sleep
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-05-23 14:29:40 +08:00
ba3b2a91a0
test: Remove useless common types and refine error assert in negative cases ( #33023 )
...
Related issue: #32653
1. Remove some meaningless common types
2. Refine error assertion in negative cases
3. Remove some dup tests
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-05-14 15:03:33 +08:00
5bb672d70d
test: Add a new range search test for all indexes and align some index params ( #32724 )
...
related issue: https://github.com/milvus-io/milvus/issues/32653
1. align some default index params
2. add a new range search tests for all indexes and float vectors
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-04-30 17:37:27 +08:00
f0caf3a2da
test: update some cases ( #32323 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-04-16 20:27:32 +08:00
14a9785380
test: update pymilvus version and test cases ( #31827 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-04-07 18:49:16 +08:00
3b5209c460
test: support enable or disable multiple vector fields in all data type tests ( #31201 )
...
issue: #29799
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-04-03 11:11:23 +08:00
1f43be4a3c
enhance: Support auto index for scalar index ( #31255 )
...
issue: #29309
reopen pr : #29310
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-03-21 10:37:08 +08:00
93bb04f884
test: add some mmap cases ( #31211 )
...
issue : https://github.com/milvus-io/milvus/issues/30940
Signed-off-by: elstic <hao.wang@zilliz.com>
2024-03-15 15:25:05 +08:00
5220005a24
test: update the dim of the largest or smallest vector in case ( #31223 )
...
issue: https://github.com/milvus-io/milvus/issues/31160
Signed-off-by: elstic <hao.wang@zilliz.com>
2024-03-13 16:53:04 +08:00
bd063a352d
test: add test cases for mmap ( #30942 )
...
issue: https://github.com/milvus-io/milvus/issues/30940
Signed-off-by: elstic <hao.wang@zilliz.com>
2024-03-04 19:33:01 +08:00
a556671119
test: add hybrid search cases ( #29830 )
...
issue: #29799
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-02-20 11:58:51 +08:00
5bbace1094
enhance: update test cases and increase timeout of rbac pipeline ( #30549 )
...
issue: #29880
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-02-07 10:54:47 +08:00
51fe4743f1
enhance: hint the invalid metric type in error message ( #30263 )
...
this hints the user passed invalid metric type in error message, so
users could know what's wrong
Signed-off-by: yah01 <yang.cen@zilliz.com>
2024-01-25 14:15:00 +08:00
8c89ad694e
fix: Fix error message for indexing ( #29898 )
...
issue: #29897
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-01-12 19:44:51 +08:00
0a70e8b601
enhance: Remove multiple vector field limit ( #27827 )
...
issue: https://github.com/milvus-io/milvus/issues/25639
/kind improvement
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-12-28 16:40:46 +08:00
a693af014f
Add test cases of array ( #27603 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-24 09:26:31 +08:00
02d5aeaf2b
Add test cases of scann index ( #27784 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-20 09:58:07 +08:00
5dbcdf777d
update pymilvus verison ( #27724 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-17 10:38:10 +08:00
76bb0a7bd8
update pymilvus version and modify Error code & msg improvement ( #27609 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-16 09:16:07 +08:00
Bingyi Sun
yanliang567
binbin
nico
Xianhui Lin
wt
Jiquan Long
Gao
elstic
cai.zhang
yah01
xige-16