73aa95f596
fix: Add version to the proxy cache to resolve concurrency issues ( #38067 )
...
issue: #36989
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-12-04 18:06:39 +08:00
1f66b9ebfb
feat: add config field to set internal tls sni ( #38124 )
...
/cc @xiaofan-luan @jaime0815 @nish112022
part of https://github.com/milvus-io/milvus/issues/36864
Signed-off-by: haorenfsa <haorenfsa@gmail.com>
2024-12-04 14:56:47 +08:00
a5e0a56a8e
fix: move grant/revoke v2 params check from rootcoord to proxy ( #38130 )
...
related issue: https://github.com/milvus-io/milvus/issues/37031
fixed issues #38042 : The interface "grant_v2" does not support empty
collectionName while the error says it does
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-02 19:48:37 +08:00
4c623cebeb
enhance: [skip e2e] Update test plugin version ( #38106 )
...
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-12-02 12:00:37 +08:00
23dc313c44
fix: fix grant/revoke v2 meta and unclear error messages ( #38110 )
...
related issue: https://github.com/milvus-io/milvus/issues/37031
fixed issues:
#37974 : better error messages for grant v2 interface
#37903 : fix meta built-in privilege group object name
#37843 : better error messages for custom privilege group interface
#38002 : fix built-in privilege group meta to pass proxy interceptor
check
#38008 : fix revoke v2 to support revoking v1 granted privileges
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-02 11:36:39 +08:00
ec119f5f14
test: update check search result ( #38099 )
...
issue: #37271
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-12-01 17:50:37 +08:00
bec54998e4
test: update resource group case about error msg and update_resource_group ( #38094 )
...
Signed-off-by: qixuan <673771573@qq.com>
2024-11-30 13:32:36 +08:00
1ce609834a
feat: [GoSDK] fp32 <-> fp16/bf16 vector conversion ( #37978 )
...
Add the following methods for convenient fp32 vector <-> fp16/bf16
vector conversion
fp32 <-> fp16/bf16 vector conversion:
- `func (fv FloatVector) ToFloat16Vector() Float16Vector`
- `func (fv FloatVector) ToBFloat16Vector() BFloat16Vector`
- `func (fv Float16Vector) ToFloat32Vector() FloatVector`
- `func (fv BFloat16Vector) ToFloat32Vector() FloatVector`
`columnBasedDataOption`:
- `func (opt *columnBasedDataOption) WithFloat16VectorColumn(colName
string, dim int, data [][]float32) *columnBasedDataOption`
- `func (opt *columnBasedDataOption) WithBFloat16VectorColumn(colName
string, dim int, data [][]float32) *columnBasedDataOption`
`ColumnFloat16Vector`/`ColumnBFloat16Vector`:
- `func NewColumnFloat16VectorFromFp32Vector(fieldName string, dim int,
data [][]float32) *ColumnFloat16Vector`
- `func NewColumnBFloat16VectorFromFp32Vector(fieldName string, dim int,
data [][]float32) *ColumnBFloat16Vector`
- support []float32 or `entity.FloatVector` in
- `func (c *ColumnFloat16Vector) AppendValue(i interface{}) error`
- `func (c *ColumnFloat16Vector) AppendValue(i interface{}) error`
issue: #37448
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
2024-11-29 08:00:37 +08:00
5e807c3649
test:[skip e2e] update pulsar labelSelectors to v3 in chaos test ( #38049 )
...
After upgrading pulsar from v2 to v3, the labels of the helm deployed
pulsar were changed from app=pulsarv to app=pulsarv3.
Therefore, it is necessary to modify this part of the labelSelector so
that chaos mesh can correctly inject faults
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-28 14:18:35 +08:00
864ed1a3be
test: update python requirements in test dir ( #38047 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-27 19:34:35 +08:00
e5775a71af
test: add bulk import testcases for full text search ( #37197 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-27 19:32:42 +08:00
8188e1472d
test: add custom analyzer testcases ( #37781 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-27 16:08:36 +08:00
c5327ff150
test: add cases for gosdk v2 partial load ( #37924 )
...
issue: #33419
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-11-26 15:08:34 +08:00
6b23e668b0
test: Update go_client version & update latest changes ( #37793 )
...
Related to #37768
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-26 10:26:40 +08:00
27c22d1166
test: remove sparse embedding in output fields for fts cases ( #37980 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-25 19:14:33 +08:00
4cd79323bf
test: Add cases for restful about default and none ( #37943 )
...
issue: #36129
Signed-off-by: qixuan <673771573@qq.com>
2024-11-25 14:06:33 +08:00
0b9edb62a9
test: add testcases contain growing segments ( #37262 )
...
/kind improvement
---------
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-25 10:40:34 +08:00
5a06faca39
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API ( #37556 )
...
RESTful API. The influenced API are as follows:
- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search
We do not modify search API in Handler/HandlerV1 because they do not
support fp16/bf16 vectors.
module github.com/milvus-io/milvus/pkg:
Add `Float32ArrayToBFloat16Bytes()`, `Float32ArrayToFloat16Bytes()` and
`Float32ArrayToBytes()`. These method will be used in GoSDK in the
future.
issue: #37448
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
2024-11-24 17:46:33 +08:00
bc131a911c
test: add cases for gosdk v2 load release ( #37831 )
...
issue: #33419
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-11-22 10:54:32 +08:00
19572f5b06
enhance: RBAC new grant/revoke privilege ( #37785 )
...
issue: https://github.com/milvus-io/milvus/issues/37031
also fix issues: https://github.com/milvus-io/milvus/issues/37843 ,
https://github.com/milvus-io/milvus/issues/37842 ,
https://github.com/milvus-io/milvus/issues/37887
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-11-21 22:20:34 +08:00
511edd29fd
enhance: disallow get raw vector data of a BM25 Function output field ( #37800 )
...
issue: https://github.com/milvus-io/milvus/issues/35853
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-11-20 14:22:30 +08:00
484c6b5c44
feat: Added code for Internal-tls ( #36865 )
...
issue : https://github.com/milvus-io/milvus/issues/36864
I have a few questions regarding my approach.I will consolidate them
here for feedback and review.Thanks
---------
Signed-off-by: Nischay Yadav <nischay.yadav@ibm.com>
Signed-off-by: Nischay <Nischay.Yadav@ibm.com>
2024-11-20 06:00:32 +08:00
866d512f6f
test: update test cases and sdk version ( #37774 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-11-19 14:14:32 +08:00
dae4160466
enhance: Whether to enable mergeSort mode when performing mixCompaction ( #37664 )
...
issue: #37579
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-11-19 11:28:31 +08:00
2d72ad33f2
enhance: RBAC built in privilege groups ( #37720 )
...
issue: #37031
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-11-18 20:38:39 +08:00
3cdb485022
test: update timeout of load in ci cases ( #37596 )
...
action for
https://github.com/milvus-io/milvus/issues/37166#issuecomment-2469502955
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-16 16:00:31 +08:00
3f7352f3cf
test: remove xfail of fts test cases after fix ( #37724 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-16 11:14:30 +08:00
a1b6be1253
fix: Delegator stuck at unserviceable status ( #37694 )
...
issue: #37679
pr #36549 introduce the logic error which update current target when
only parts of channel is ready.
This PR fix the logic error and let dist handler keep pull distribution
on querynode until all delegator becomes serviceable.
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-11-15 10:20:31 +08:00
5ae347aba0
enhance: update knowhere version ( #37688 )
...
issue: #37665 #37631 #37620 #37587 #36906
knowhere has add default nlist value, so some invalid param test ut with
no nlist param will be valid.
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2024-11-15 10:10:31 +08:00
405c12f7d1
test: update test cases ( #37660 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-11-14 17:46:39 +08:00
af433ffd68
test: Add expression template tests and use error msg only as assertion ( #37618 )
...
related issue: https://github.com/milvus-io/milvus/issues/37451
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-11-13 17:14:30 +08:00
a654487995
fix: some error in restful ( #37487 )
...
#37370
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-11-13 17:12:39 +08:00
2630717836
test: update sdk version and cases ( #37507 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-11-12 17:48:28 +08:00
1e8ea4a7e7
feat: add segment/channel/task/slow query render ( #37561 )
...
issue: #36621
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-11-12 17:44:29 +08:00
2742e9573f
enhance: Print results if a test fails ( #37606 )
...
test_hybrid_search_different_limit_round_decimal fails occasionally.
Print more details for debug.
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-11-12 17:12:28 +08:00
266f8ef1f5
fix: Search may return less result after qn recover ( #36549 )
...
issue: #36293 #36242
after qn recover, delegator may be loaded in new node, after all segment
has been loaded, delegator becomes serviceable. but delegator's target
version hasn't been synced, and if search/query comes, delegator will
use wrong target version to filter out a empty segment list, which
caused empty search result.
This pr will block delegator's serviceable status until target version
is synced
---------
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-11-12 16:34:28 +08:00
b5b003551e
enhance: use localhost for it and ut ( #37529 )
...
issue: #37528
Signed-off-by: chyezh <chyezh@outlook.com>
2024-11-12 11:36:27 +08:00
a45a288a25
fix: Separate L0 and Mix trigger interval ( #37190 )
...
See also: #37108
- Add MixCompactionTriggerInterval, default 60s
- Add L0CompactionTriggerInterval, default 10s
- Export Single related compaction configs
- Raise SingleCompactionDeltaLogMaxSize from 2MB to 16MB
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-11-12 10:56:37 +08:00
2d29dcd30c
enhance:refine group_strict_size parameter( #37482 ) ( #37483 )
...
related: #37482
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2024-11-12 09:56:28 +08:00
21b68029a0
test: Add nullable test cases for bulk writer ( #37572 )
...
issue: #36129
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-11-12 09:46:28 +08:00
83d2729f94
enhance: Generate milvusclient mockery with latest proto ( #37567 )
...
Related to #37558
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-11 14:28:30 +08:00
f42869c0ce
test: remove case skip label ( #37539 )
...
[test] remove case skip label
issue: #33952
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-11-10 16:14:27 +08:00
12951f0abb
enhance: rename tokenizer to analyzer and check analyzer params ( #37478 )
...
relate: https://github.com/milvus-io/milvus/issues/35853
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-11-10 16:12:26 +08:00
ff00a12805
enhance: RBAC custom privilege group ut coverage ( #37558 )
...
issue: https://github.com/milvus-io/milvus/issues/37031
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-11-09 20:40:25 +08:00
ffdde391e3
test: fix unstable testcase caused by server refactor ( #37545 )
...
issue: https://github.com/milvus-io/milvus/issues/37533
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-09 09:58:26 +08:00
70605cf5b3
enhance: Support custom privilege group for RBAC ( #37087 )
...
issue: #37031
---------
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-11-09 08:44:28 +08:00
ae227e3934
enhance: Add integration test for stats task ( #37506 )
...
issue: #33744
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-11-08 15:48:26 +08:00
11f4fe0177
enhance: [GoSDK] move client pkg go files to sub one ( #37492 )
...
Related to #31293
Client source files under client pkg cannot be evaluate correctly by
codecov. This PR moves them to `milvusclient` sub-package to fix this
issue and follow go major version best practice.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-08 07:32:26 +08:00
86fd3200be
enhance: refactor createIndex in RESTful API ( #37235 )
...
Make the parameter input method consistent with miluvs-client.
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-11-07 14:18:30 +08:00
40b770cb7b
fix: add rescorer activation function for BM25 ( #37481 )
...
issue: #35853
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-11-07 12:08:25 +08:00
cai.zhang
shaoyue
sthuang
binbin
wt
qixuan
Yinzuo Jiang
zhuwenxing
ThreadDao
congqixia
Buqian Zheng
nish112022
nico
wei liu
foxspy
yanliang567
smellthemoon
jaime
Bingyi Sun
Zhen Ye
XuanYang-cn
Chun Han
aoiasd