04fff74a56
feat: introduce Text data type ( #39874 )
...
issue: https://github.com/milvus-io/milvus/issues/39818
This PR mimics Varchar data type, allows insert, search, query, delete,
full-text search and others.
Functionalities related to filter expressions are disabled temporarily.
Storage changes for Text data type will be in the following PRs.
Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
2025-02-19 11:04:51 +08:00
5fdc7578bb
test: Add sparse invert index algo check tests ( #39691 )
...
related issue: #39332
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-02-12 12:14:46 +08:00
27c22d1166
test: remove sparse embedding in output fields for fts cases ( #37980 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-25 19:14:33 +08:00
0b9edb62a9
test: add testcases contain growing segments ( #37262 )
...
/kind improvement
---------
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-25 10:40:34 +08:00
511edd29fd
enhance: disallow get raw vector data of a BM25 Function output field ( #37800 )
...
issue: https://github.com/milvus-io/milvus/issues/35853
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-11-20 14:22:30 +08:00
3f7352f3cf
test: remove xfail of fts test cases after fix ( #37724 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-16 11:14:30 +08:00
12951f0abb
enhance: rename tokenizer to analyzer and check analyzer params ( #37478 )
...
relate: https://github.com/milvus-io/milvus/issues/35853
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-11-10 16:12:26 +08:00
d67853fa89
feat: Tokenizer support build with params and clone for concurrency ( #37048 )
...
relate: https://github.com/milvus-io/milvus/issues/35853
https://github.com/milvus-io/milvus/issues/36751
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-11-06 17:48:24 +08:00
0fc6c634b0
test: fix tokenizer and monkey patch faker function ( #37119 )
...
/kind improvement
---------
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Signed-off-by: zhuwenxing <wxzhuyeah@gmail.com>
2024-11-05 08:42:23 +08:00
50de122dc7
enhance: Rename textmatch to text_match ( #37290 )
...
issue: #36672
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-11-03 18:40:27 +08:00
d24970c090
test: fix potential unstable cases of full-text search ( #37328 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-10-31 21:12:21 +08:00
6e37372619
test: update checker ( #37275 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-10-31 09:50:20 +08:00
4c108b1564
test: update jieba tokenizer in test ( #37199 )
...
/kind improvement
---------
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-10-28 19:22:22 +08:00
088d5d7d76
fix: optimize BM25 err message ( #37074 )
...
issue: https://github.com/milvus-io/milvus/issues/37022
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-10-25 14:35:45 +08:00
3b024f9b36
test: Add full-text search test cases ( #36998 )
...
/kind improvement
---------
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-10-23 09:51:27 +08:00
Patrick Weizhi Xu
yanliang567
zhuwenxing
Buqian Zheng
aoiasd
cai.zhang