305524f99a
fix: jieba tokenizer cause panic when dict word was empty string ( #43337 ) ( #43718 )
...
pr: https://github.com/milvus-io/milvus/pull/43337
relate: https://github.com/milvus-io/milvus/issues/42779
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-08-04 20:57:48 +08:00
bb528ba065
enhance: [2.5]update knowhere version ( #43623 )
...
issue: #42937
related: #43528 https://github.com/zilliztech/knowhere/pull/1278
pr: #43528
Signed-off-by: xianliang <xianliang.li@zilliz.com>
2025-07-29 17:27:38 +08:00
fe39128021
enhance: update lindera version ( #43457 )
...
relate: https://github.com/milvus-io/milvus/issues/43120
pr: https://github.com/milvus-io/milvus/pull/43121
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-07-22 19:56:53 +08:00
ecf011aeb1
fix: update tantivy for fixing dir removing race condition #43399 ( #43401 )
...
pr: https://github.com/milvus-io/milvus/pull/43399
issue: https://github.com/milvus-io/milvus/issues/43258
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-07-18 16:56:52 +08:00
a6b2284de6
enhance: [2.5]update knowhere version ( #43398 )
...
issue: #42937
/kind branch-feature
Signed-off-by: xianliang <xianliang.li@zilliz.com>
2025-07-18 16:20:52 +08:00
47f265864b
enhance: [2.5] update knowhere version for milvus 2.5.14 ( #42939 )
...
issue: #42937
pr: #42938
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-06-25 21:06:43 +08:00
017eb9ffe2
fix: fix some bugs discovered by chaos tests --- cherry pick ( #42909 )
...
master: https://github.com/milvus-io/milvus/pull/42906
issue: https://github.com/milvus-io/milvus/issues/42870
---------
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-06-24 17:10:42 +08:00
79ffc17bfe
enhance: optimize tantivy cargo config cherry-pick ( #42881 )
...
master: https://github.com/milvus-io/milvus/pull/42880
issue: https://github.com/milvus-io/milvus/issues/42879
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-06-20 16:18:11 +08:00
b837fb2d1e
fix: update tantivy for fixing threads explosion in file watcher ( #42828 )
...
master pr: #41450
---------
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-06-18 15:40:40 +08:00
77bcd1dac0
fix: update tantivy for solving threads exposion for tantivy ( #42713 )
...
update tantivy: https://github.com/zilliztech/tantivy/pull/16
Signed-off-by: SpadeA-Tang <tangchenjie1210@gmail.com>
2025-06-17 16:01:01 +08:00
94005f8e01
enhance: tantivy collector set bitset directly cp-39748 ( #42694 )
...
issue: https://github.com/milvus-io/milvus/issues/39755
pr: #39748
It also cherry-pick #40608
---------
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-06-16 16:58:40 +08:00
35252ffbae
enhance: [2.5] use english name as language name for all type language identifier ( #42601 )
...
Set whatlang detect return language name as english name.
Make sure same with lingua.
pr: https://github.com/milvus-io/milvus/pull/42600
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-06-11 14:40:37 +08:00
6b0e602574
fix: [2.5] update tantivy version to fix stemmper panic ( #42172 )
...
relate: https://github.com/milvus-io/milvus/issues/42168
pr: https://github.com/milvus-io/milvus/pull/42171
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-05-30 14:06:29 +08:00
e567b38a74
enhance: [2.5] update knowhere version ( #42159 )
...
issue: #42060
/kind branch-feature
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-05-29 12:22:30 +08:00
96f7ab592b
enhance: [2.5] update knowhere version ( #41828 )
...
issue: #37644
/kind branch-feature
Signed-off-by: foxspy <xianliang.li@zilliz.com>
2025-05-14 10:50:23 +08:00
8b3353cdab
feat: [2.5] Support run analyzer and more tokenizer. ( #41444 )
...
relate: https://github.com/milvus-io/milvus/issues/39659
https://github.com/milvus-io/milvus/issues/39705
pr: https://github.com/milvus-io/milvus/pull/40416
https://github.com/milvus-io/milvus/pull/40458
https://github.com/milvus-io/milvus/pull/39723
https://github.com/milvus-io/milvus/pull/40813
https://github.com/milvus-io/milvus/pull/39854
https://github.com/milvus-io/milvus/pull/39660
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2025-04-24 10:48:39 +08:00
d5977ec521
enhance: [2.5] add force rebuild index configuration ( #41432 )
...
issue: #41431
pr: #41473
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-04-23 21:44:38 +08:00
bbc715f43e
fix: [2.5] update knowhere version to fix mac build ( #41315 )
...
issue: #41314
Signed-off-by: xianliang <xianliang.li@zilliz.com>
2025-04-15 19:36:32 +08:00
05c01070c6
fix: fix arm64 compile issue ( #41058 )
...
issue: #41059
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-04-02 17:44:22 +08:00
a906466d8f
fix: [2.5]Add bypass thread pool mode to avoid growing indexes blocking insert/load ( #41013 )
...
issue: #40825
related: #41012
pr: #41012
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-04-02 16:58:25 +08:00
28c1ab8a16
enhance: add documents in batch for json key stats ( #40898 )
...
issue: #40897
After this, the document add operations scheduling duration is
**decreased** roughly from **6s to 0.9s** for the case in the issue.
---------
Signed-off-by: SpadeA <tangchenjie1210@gmail.com>
2025-04-02 08:22:24 +08:00
9108cee958
feat: add json null/exists expression ( #41002 )
...
issue: #35528
pr: https://github.com/milvus-io/milvus/pull/41004
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-31 21:52:23 +08:00
0a1272fc6f
fix: Revert "enhance: update tantivy version ( #39253 )" ( #40769 )
...
issue: #35528
pr: #40313
This reverts commit d3cec7f277
2025-03-21 11:24:17 +08:00
b8abd91962
enhance[2.5]: add more config for interimIndex to support more refine mode ( #40429 )
...
issue: https://github.com/milvus-io/milvus/issues/27678
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2025-03-17 22:04:12 +08:00
bd4170106d
fix: cherry pick json index related prs ( #40568 )
...
issue: #35528
pr: #40407
this pr includes some json index related pr:
1. #40407
2. #40538
3. #40419
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-11 21:00:09 +08:00
683b26ffb7
feat: cherry pick json path index ( #40313 )
...
issue: #35528
pr: #36750
this pr includes json path index pr and some related prs:
1. update tantivy version #39253
2. json path index #36750
3. fall back to brute force #40076
4. term filter #40140
5. bug fix #40336
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-10 22:14:05 +08:00
825316670d
enhance: upgrade rust version to 1.83 ( #39295 ) ( #40317 )
...
issue: #39254
pr: https://github.com/milvus-io/milvus/pull/39295
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-03-04 17:42:04 +08:00
f0964f769d
enhance: [2.5]Add json key inverted index in stats for optimization ( #39876 )
...
Add json key inverted index in stats for optimization
issue: https://github.com/milvus-io/milvus/issues/36995
pr: https://github.com/milvus-io/milvus/pull/38039
---------
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2025-02-16 20:12:15 +08:00
e372b1733c
enhance: [2.5]update raft to cuvs ( #39221 )
...
pr: #39873
issue: #39883
Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
2025-02-14 16:52:14 +08:00
b02d6423a3
enhance: [2.5]update knowhere version ( #39673 )
...
/kind branch-feature
release note :
https://github.com/zilliztech/knowhere/releases/tag/v2.5.3
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-02-07 12:46:45 +08:00
aee9368c6e
enhance: [2.5] update knowhere version and IsAdditionalScalarSupported interface ( #39574 )
...
pr: #39573
---------
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2025-02-05 19:53:11 +08:00
6f9f840080
fix: Fix panic caused by removing directory ( #38622 ) ( #39434 )
...
related pr: https://github.com/milvus-io/milvus/pull/38622
issue: https://github.com/milvus-io/milvus/issues/39428
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2025-01-20 16:13:03 +08:00
1d9788e4bc
fix: [2.5] enable to build index with single segment ( #39272 )
...
issue: #39232
cherry-pick https://github.com/milvus-io/milvus/pull/39233
---------
Signed-off-by: SpadeA-Tang <tangchenjie1210@gmail.com>
2025-01-16 09:59:02 +08:00
5b113064fe
enhance: update knowhere version ( #39218 )
...
/kind branch-feature
release-note :
https://github.com/zilliztech/knowhere/releases/tag/v2.5.2
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-01-14 10:21:06 +08:00
3d723676ac
enhance: [2.5]update knowhere version ( #38785 )
...
/kind branch-feature
release note: https://github.com/zilliztech/knowhere/releases/tag/v2.5.1
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2024-12-27 10:24:50 +08:00
06d410b70f
enhance: update knowhere version ( #38544 )
...
related: #37730
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2024-12-18 16:52:45 +08:00
ffd3c5d2f5
[automated] Update Knowhere Commit ( #38542 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-12-18 01:24:47 +08:00
3e2a2f278b
enhance: Handle rust error in c++ ( #38113 )
...
https://github.com/milvus-io/milvus/issues/37930
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-12-16 19:40:45 +08:00
1e274384cd
[automated] Update Knowhere Commit ( #38458 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-12-14 00:54:43 +08:00
e404123e3e
[automated] Update Knowhere Commit ( #38422 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-12-13 02:40:44 +08:00
87aa9a0f2d
fix: empty analyzer params not use standard tokenizer ( #38148 )
...
relate: https://github.com/milvus-io/milvus/issues/35853
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-12-04 14:58:39 +08:00
3445b8bd44
[automated] Update Knowhere Commit ( #38192 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-12-04 02:30:39 +08:00
0894ed0016
[automated] Update Knowhere Commit ( #38082 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-11-29 01:08:36 +08:00
e6af806a0d
enhance: optimize self defined rust error ( #37975 )
...
Prepare for issue: https://github.com/milvus-io/milvus/issues/37930
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-11-28 20:30:36 +08:00
fbb68ca370
enhance: make all index operation async scheduled by tokio ( #37946 )
...
issue: #37851
related pr: https://github.com/milvus-io/tantivy/pull/3
Signed-off-by: chyezh <chyezh@outlook.com>
2024-11-25 10:12:34 +08:00
ed73dfca3f
[automated] Update Knowhere Commit ( #37965 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-11-25 01:28:32 +08:00
700a448a54
fix: Escape prefix before search in inverted index ( #37925 )
...
issue: https://github.com/milvus-io/milvus/issues/37912
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-11-22 14:10:33 +08:00
06d73cf2e2
enhance: Remove raw tokenizer register. ( #37886 )
...
tantivy already register raw tokenizer by default
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-11-22 12:02:32 +08:00
1dc1a97e65
fix: use different thread pool for scheduler and merger ( #37911 )
...
issue: #37895
related pr: https://github.com/milvus-io/tantivy/pull/2
Signed-off-by: chyezh <chyezh@outlook.com>
2024-11-21 21:34:33 +08:00
f3a36f8a29
fix: use global pool but not dedicated pool for every index ( #37852 )
...
issue: #37851
- make a global thread pool at tantivy temporally.
- set 1 but not 4 threads for inverted text index.
Signed-off-by: chyezh <chyezh@outlook.com>
2024-11-20 20:44:32 +08:00
aoiasd
foxspy
Spade A
Bingyi Sun
cqy123456
Xianhui Lin
presburger
Gao
sre-ci-robot
Zhen Ye