milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
21,390 Commits
127 Branches
113 Tags
553 MiB
Commit Graph

21390 Commits (203557594164abeed39c4ea0ee01688d283a86ea)

Author SHA1 Message Date
yihao.dai 7fb0c281f2
fix: Fix checkGeneralCapacity slowly (#37976) 
Cache the general count to speed up `checkGeneralCapacity`.

issue: https://github.com/milvus-io/milvus/issues/37630

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-12-01 18:28:38 +08:00
cai.zhang 2319018fcb
fix: Check if the dynamic fields contain any static fields (#38025) 
issue: #38024

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-12-01 18:06:37 +08:00
wt ec119f5f14
test: update check search result (#38099) 
issue: #37271

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2024-12-01 17:50:37 +08:00
qixuan bec54998e4
test: update resource group case about error msg and update_resource_group (#38094) 
Signed-off-by: qixuan <673771573@qq.com>
 2024-11-30 13:32:36 +08:00
wei liu 108434969f
enhance: Add collection id to search request count metrics (#38069) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-11-29 17:28:38 +08:00
congqixia fdea7a7898
enhance: [GoSDK] Refine float point conversion precision loss ut (#38097) 
Previous PR: #37978

This unit test is unable due to dim is a random number. When dim is
large enough precision loss will be greater than 0.04

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-29 16:54:36 +08:00
congqixia 61f73d552f
fix: Return thread watcher goroutine after closed (#38091) 
Resolves #38090

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-29 15:10:36 +08:00
Linkwei 80c62f8c11
enhance: add windows startup script for milvus docker deployment (#38089) 
[enhance：add window bat milvus standalone ](enhance: add windows startup
script for milvus docker deployment)
issue：https://github.com/milvus-io/milvus/issues/38098

Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro-6.local>
Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro-6.local>
 2024-11-29 15:06:37 +08:00
jaime a9080d8d96
enhance: the actual number of databases should equal the config value (#38006) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-11-29 14:44:36 +08:00
smellthemoon 48ed586167
enhance: pre allocate space to prevent slice grow (#38065) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-11-29 14:26:43 +08:00
congqixia 9d3035c8ab
enhance: Fix conflict complication error (#38087) 
Related to #37957 #37989

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-29 12:00:36 +08:00
cai.zhang 5e152767a3
fix: Handle the error of the compaction queue being full (#37989) 
issue: #37988

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-11-29 11:10:36 +08:00
congqixia fd94f12fb9
enhance: [GoSDK] Support nullable generic column (#38076) 
Related to #31728 #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-29 10:40:37 +08:00
Zhen Ye c6dcef7b84
enhance: move segcore codes of segment into one package (#37722) 
issue: #33285

- move most cgo opeartions related to search/query into segcore package
for reusing for streamingnode.
- add go unittest for segcore operations.

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-11-29 10:22:36 +08:00
sre-ci-robot 843c1f506f Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-11-29 00:01:35 +00:00
Yinzuo Jiang 1ce609834a
feat: [GoSDK] fp32 <-> fp16/bf16 vector conversion (#37978) 
Add the following methods for convenient fp32 vector <-> fp16/bf16
vector conversion

fp32 <-> fp16/bf16 vector conversion:

- `func (fv FloatVector) ToFloat16Vector() Float16Vector`
- `func (fv FloatVector) ToBFloat16Vector() BFloat16Vector`
- `func (fv Float16Vector) ToFloat32Vector() FloatVector`
- `func (fv BFloat16Vector) ToFloat32Vector() FloatVector`

`columnBasedDataOption`:

- `func (opt *columnBasedDataOption) WithFloat16VectorColumn(colName
string, dim int, data [][]float32) *columnBasedDataOption`
- `func (opt *columnBasedDataOption) WithBFloat16VectorColumn(colName
string, dim int, data [][]float32) *columnBasedDataOption`

`ColumnFloat16Vector`/`ColumnBFloat16Vector`:

- `func NewColumnFloat16VectorFromFp32Vector(fieldName string, dim int,
data [][]float32) *ColumnFloat16Vector`
- `func NewColumnBFloat16VectorFromFp32Vector(fieldName string, dim int,
data [][]float32) *ColumnBFloat16Vector`
- support []float32 or `entity.FloatVector` in
    - `func (c *ColumnFloat16Vector) AppendValue(i interface{}) error`
    - `func (c *ColumnFloat16Vector) AppendValue(i interface{}) error`

issue: #37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
 2024-11-29 08:00:37 +08:00
sre-ci-robot 0894ed0016
[automated] Update Knowhere Commit (#38082) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-11-29 01:08:36 +08:00
Bingyi Sun e6af806a0d
enhance: optimize self defined rust error (#37975) 
Prepare for issue: https://github.com/milvus-io/milvus/issues/37930

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-11-28 20:30:36 +08:00
sre-ci-robot 84698c072a Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-11-28 12:00:40 +00:00
zhuwenxing 5e807c3649
test:[skip e2e] update pulsar labelSelectors to v3 in chaos test (#38049) 
After upgrading pulsar from v2 to v3, the labels of the helm deployed
pulsar were changed from app=pulsarv to app=pulsarv3.
Therefore, it is necessary to modify this part of the labelSelector so
that chaos mesh can correctly inject faults

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-11-28 14:18:35 +08:00
HuaSheng2000 6aaa926483
fix: Modify the documentation of the Demos and Tutorials chapter (#38054) (#38057) 
issue: #38054 
- Delete the table about tutorials in the English document, use link to
replace the existing table, and add corresponding descriptions (the
table content is outdated, and using link can reduce maintenance costs).
- Add link and corresponding descriptions of tutorials in Chinese
documentation.

---------

Signed-off-by: HuaSheng2000 <34791273+HuaSheng2000@users.noreply.github.com>
 2024-11-28 10:00:36 +08:00
zhuwenxing 864ed1a3be
test: update python requirements in test dir (#38047) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-11-27 19:34:35 +08:00
zhuwenxing e5775a71af
test: add bulk import testcases for full text search (#37197) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-11-27 19:32:42 +08:00
zhuwenxing 8188e1472d
test: add custom analyzer testcases (#37781) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-11-27 16:08:36 +08:00
SimFG 302650ae0e
fix: use the default partition for the limit quota when the request partition name is empty (#38005) 
- issue: #37685

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-11-27 11:00:36 +08:00
SimFG 49ee46ec1d
enhance: support to config the default db properties (#38035) 
- issue: #38034

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-11-27 10:04:34 +08:00
SimFG 971b4f17ae
fix: add the db information in the dml message (#37969) 
- issue: #37966

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-11-27 10:02:35 +08:00
sre-ci-robot 24a0b05745 Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-11-27 00:01:35 +00:00
tinswzy 1dbb6cd7cb
enhance: refine the datacoord meta related interfaces (#37957) 
issue: #35917 
This PR refines the meta-related APIs in datacoord to allow the ctx to
be passed down to the catalog operation interfaces

Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
 2024-11-26 19:46:34 +08:00
SimFG 2208b7c2ef
fix: the too long default root password does not take effect (#37983) 
- issue: #36987

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-11-26 17:24:35 +08:00
yellow-shine 858eaa668d
enhance: select node (#37998) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-11-26 17:02:41 +08:00
Zhen Ye 2b4f211d84
enhance: add switch for local rpc enabled (#37985) 
issue: #33285

- Add switch for local rpc

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-11-26 17:00:54 +08:00
aoiasd db3c002788
fix:wrong warning log when idf oracle find L0 segment lacks (#37873) 
relate: https://github.com/milvus-io/milvus/issues/35853

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-11-26 16:26:41 +08:00
ThreadDao c5327ff150
test: add cases for gosdk v2 partial load (#37924) 
issue: #33419

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-11-26 15:08:34 +08:00
congqixia cb6542339e
enhance: Mark cgo thread with tag name (#38000) 
Related to #37999

This PR add `SetThreadName` API for marking cgo thread and utilize it
when initializing cgo worker.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-26 11:22:35 +08:00
congqixia 6b23e668b0
test: Update go_client version & update latest changes (#37793) 
Related to #37768

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-26 10:26:40 +08:00
zhuwenxing 27c22d1166
test: remove sparse embedding in output fields for fts cases (#37980) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-11-25 19:14:33 +08:00
qixuan 4cd79323bf
test: Add cases for restful about default and none (#37943) 
issue: #36129

Signed-off-by: qixuan <673771573@qq.com>
 2024-11-25 14:06:33 +08:00
tinswzy e76802f910
enhance: refine querycoord meta/catalog related interfaces to ensure that each method includes a ctx parameter (#37916) 
issue: #35917 
This PR refine the querycoord meta related interfaces to ensure that
each method includes a ctx parameter.

Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
 2024-11-25 11:14:34 +08:00
zhuwenxing 0b9edb62a9
test: add testcases contain growing segments (#37262) 
/kind improvement

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-11-25 10:40:34 +08:00
Zhen Ye fbb68ca370
enhance: make all index operation async scheduled by tokio (#37946) 
issue: #37851
related pr: https://github.com/milvus-io/tantivy/pull/3

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-11-25 10:12:34 +08:00
sre-ci-robot ed73dfca3f
[automated] Update Knowhere Commit (#37965) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-11-25 01:28:32 +08:00
Yinzuo Jiang 5a06faca39
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API (#37556) 
RESTful API. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

We do not modify search API in Handler/HandlerV1 because they do not
support fp16/bf16 vectors.

module github.com/milvus-io/milvus/pkg:

Add `Float32ArrayToBFloat16Bytes()`, `Float32ArrayToFloat16Bytes()` and
`Float32ArrayToBytes()`. These method will be used in GoSDK in the
future.

issue: #37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
 2024-11-24 17:46:33 +08:00
zhagnlu 62af24c1a1
fix: change search latency metric from us unit to ms unit (#37806) 
#37805

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-11-24 17:26:33 +08:00
congqixia 1e76d2b9f1
fix: Use correct policy merging growing&l0 and add unit tests (#37950) 
Related to #37574

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-24 17:10:33 +08:00
congqixia 8c9dab5cf7
enhance: [GoSDK] Add Slice method for Vector Columns (#37951) 
Related to #37768

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-24 14:48:33 +08:00
sre-ci-robot 930112e55e
[automated] Bump milvus version to v2.5.0-beta (#37961) 
Bump milvus version to v2.5.0-beta
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-11-23 21:48:32 +08:00
Zhen Ye b9a10a2f68
enhance: remove the rpc layer of coordinator when enabling standalone or mixcoord (#37815) 
issue: #37764

- add a local client to call local server directly for
querycoord/rootcoord/datacoord.
- enable local client if milvus is running mixcoord or standalone mode.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-11-23 21:36:33 +08:00
sre-ci-robot 74752f2ec7
[automated] Bump milvus version to v2.5.0-beta (#37954) 
Bump milvus version to v2.5.0-beta
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-11-22 23:16:41 +08:00
sthuang bd0811434b
fix: fix grant v2 service (#37945) 
issue: https://github.com/milvus-io/milvus/issues/37031

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2024-11-22 19:42:32 +08:00