milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
19,585 Commits
149 Branches
122 Tags
579 MiB
Commit Graph

19585 Commits (184d8000a9216cab1da48874a96d453e4646d00f)

Author SHA1 Message Date
sammy.huang 184d8000a9
enhance: hotfix for pipeline () 
pr: 

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-04-16 22:58:42 +08:00
zhuwenxing ae5e3a4fe3
test:[skip e2e]update script to get image tag () 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-04-16 20:29:19 +08:00
nico f0caf3a2da
test: update some cases () 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-04-16 20:27:32 +08:00
sammy.huang 15b9319523
enhance: hot fix publish pipeline () 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-04-16 19:48:15 +08:00
congqixia 72c172a7d7
enhance: Remove duplicated collectionID label for task latency () 
`CollectionID` already exists in channel name, so remove it to save
metrics traffic.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-04-16 18:55:19 +08:00
SimFG 84f05ba66e
enhance: make the auth error message more suitable () 
/issue: 
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-04-16 16:47:19 +08:00
Ted Xu 78d32bd8b2
enhance: update milvus.yaml () 
See 

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-04-16 16:17:19 +08:00
congqixia 83da08c388
enhance: Use map instead of slice to maintain channel info () 
See also 

`ChannelManager.Match` is a frequent operation for datacoord. When the
collection number is large, iteration over all channels will cost lots
of CPU time and time consuming.

This PR change the data structure storing datanode-channel info to map
avoiding this iteration when checking channel existence.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-04-16 15:57:19 +08:00
zhuwenxing 520a302f3a
test:[skip e2e]fix get image tag () 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-04-16 15:53:19 +08:00
zhagnlu 9248a6a149
fix: remove sve flags () 


Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-04-16 15:21:19 +08:00
yihao.dai 558feed5ed
fix: Use pk from binlog during import () 
During binlog import, even if the primary key's autoID is set to true,
the primary key from the binlog should be used instead of being
reassigned.

issue: https://github.com/milvus-io/milvus/discussions/31943,
https://github.com/milvus-io/milvus/issues/28521

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-04-16 14:51:20 +08:00
chyezh e19d17076f
fix: delete may lost when enable lru cache, some field should be reset when ReleaseData () 
issue: 

- Delete may be lost when segment is not data-loaded status in lru
cache. skip filtering to fix it.

- `stats_` and `variable_fields_avg_size_` should be reset when
`ReleaseData`

- Remove repeat load delta log operation in lru.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-04-16 11:17:20 +08:00
Gao 55d894bd5e
enhance: support disable search optimization () 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-04-16 10:51:20 +08:00
SimFG 1af084ea6b
enhance: Make datanode exit and case `TestProxy` faster () 
/kind improvement
issue: 

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-04-16 10:49:20 +08:00
nico 7f0c56ad0a
test: update some cases () 
fix: 

Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-04-16 10:17:20 +08:00
sammy.huang df2ca7f312
enhance: use openblas-devel instead () 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-04-15 22:14:43 +08:00
sammy.huang 053347637b
enhance: add openblas-devel () 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-04-15 19:47:20 +08:00
binbin 6db4565656
test: enable bf16/f16 test cases for DISKANN index () 
issue: 

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2024-04-15 19:41:19 +08:00
zhuwenxing fd971a434f
test: add case for sparse vector and verify group by () 
add case for sparse vector and verify group by

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-04-15 19:39:31 +08:00
chyezh 70e3d5b495
fix: wrong node id in TestCheckNodesInReplica () 
issue: 

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-04-15 17:38:17 +08:00
smellthemoon ae8f46f431
fix: panic when get empty ids () 


Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-04-15 16:53:23 +08:00
Buqian Zheng c93ae72d92
fix: more comprehensive check on sparse index and value () 
issue: 

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-04-15 16:51:24 +08:00
wei liu 0d849a6c0a
fix: fix collectionInfo leak in datacoord () 
issue: 

lack of logic to clean collection info in datacoord's meta, This PR
clean collection info after drop channel, to avoid collection info leak
in datacoord

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-04-15 16:33:19 +08:00
congqixia b87f41128b
fix: [skip e2e] Make channel balance test accept flushing segments () 
See also 

Make the case stable since the segment state may be flushing when suite
tries to check segment state.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-04-15 11:27:18 +08:00
wei liu 4822b109bd
fix: Skip to load l0 segment on old version query node () 
issue: 

during rolling upgrade progress, skip to load l0 segment on old version
query node

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-04-15 11:23:23 +08:00
congqixia dc11cbd123
enhance: Maintain collection-patitions mapping in qc meta () 
Related to 

Add collection to partitionIDs mapping to avoid interation on all
partitions loaded when trying to get all partitions with collection id

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-04-15 10:05:19 +08:00
binbin 14977b84d1
test: enable bf16 and f16 test cases () 
issue: 

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2024-04-15 09:55:18 +08:00
chyezh 48fe977a9d
enhance: declarative resource group api () 
issue: 

- Add declarative resource group api

- Add config for resource group management

- Resource group recovery enhancement

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-04-15 08:13:19 +08:00
Xiaofan e26cc9bfb5
Update README.md 2024-04-14 16:29:51 -07:00
Chun Han 337cc0756d
fix: lack good results for insufficient ef() () 
related: 

Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2024-04-13 22:13:23 +08:00
yihao.dai aa96843d31
fix: Fix import hanging and improve logging output () 
Fix import hanging when the previous import task failed, and improve
parquet import logging outout.

issue: https://github.com/milvus-io/milvus/issues/31834

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-04-13 22:03:23 +08:00
Jiquan Long 4fb85be525
fix: put inverted index into local storage () 
issue: https://github.com/milvus-io/milvus/issues/32154

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-04-13 21:57:19 +08:00
PowderLi 610a65af14
fix: restful v2 () 
issue: 

1. cannot get dbName correctly while describe alias 
2. return a valid json string even if the user doesn't have the whole
privileges to describe collection 
3. rename IndexParam.IndexConfig to IndexParam.Params
4. FieldSchema.ElementTypeParams, IndexParam.Params can not only accept
string

Signed-off-by: PowderLi <min.li@zilliz.com>
 2024-04-13 21:55:29 +08:00
sammy.huang ab6ddf6929
enhance: [skip e2e] use pull_request_target event instead () 
issue: 

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-04-13 21:17:17 +08:00
congqixia 674991d07c
fix: Wait StandBy server ready for testcase () 
See also 

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-04-12 23:49:18 +08:00
edward.zeng b7ff85638d
fix: mvcc database space exceeded for embed etcd () 
Fix 

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2024-04-12 21:39:19 +08:00
SimFG 2944971507
enhance: fix the dev docker yaml and use `go install` to install the gotestsum () 
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-04-12 19:17:18 +08:00
Cai Yudong 06e0c8baac
fix: fix estimate float16 field data size wrong () 
Issue: 

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2024-04-12 16:29:26 +08:00
zhenshan.cao 88c6828d6c
fix: failed to raise metric_type not match error () 
issue: https://github.com/milvus-io/milvus/issues/32176

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2024-04-12 16:19:18 +08:00
SimFG c012e6786f
feat: support rate limiter based on db and partition levels () 
issue: https://github.com/milvus-io/milvus/issues/30577
co-author: @jaime0815

---------

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
 2024-04-12 16:01:19 +08:00
aoiasd fb376fd1e6
enhance: Refine varchar length exceeds max length error message () 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-04-12 15:01:19 +08:00
XuanYang-cn 4617d22482
enhance: Use channel manager interface in server_test () 
Tidy the following test codes

    - Remove channel in newTestServer
    - Remove newTestServerWithMeta
    - Remove newTestServer2
    - Remove testDataCoordBase
    - Use the same func for handleTTmsg and handleRPCTTmsg

See also: 

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-04-12 14:59:20 +08:00
Buqian Zheng 33801c32c4
fix: in milvus check sparse index to be less than uint32 max () 
issue: 

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-04-12 14:25:19 +08:00
congqixia c0fa169d9a
enhance: Make write buffer memory check do until safe () 
See also  

Make memory check evict memory buffer until memory water level is safe.
Also make `EvictBuffer` wait until sync task done.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-04-12 10:55:18 +08:00
wei liu 68dec7dcd4
fix: Use correct ts to avoid exclude segment list leak () 
issue: 

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-04-12 10:39:19 +08:00
aoiasd 43a9be2cce
enhance: support access log dynamic config and prepare for support resutful interface access log () 
relate: https://github.com/milvus-io/milvus/issues/29637
https://github.com/milvus-io/milvus/issues/31823

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-04-12 10:37:27 +08:00
sre-ci-robot 454984aa4e
[automated] Update Knowhere Commit () 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-04-12 01:25:19 +08:00
jaime 371e6d2c1a
enhance: refine sync memory watermark configuration () 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-04-11 20:07:24 +08:00
Alexander Guzhva b5455d176e
fix: dynamically resolve whether SVE is available for bitset () 
Issue:  
This PR adds a dynamic SVE detection for ARM CPU families for the bitset
code.
Also, allows the code to be compiled if the compiler does not support
NEON (arm-v7).

Signed-off-by: Alexandr Guzhva <alexanderguzhva@gmail.com>
 2024-04-11 19:27:18 +08:00
Ted Xu 3d5fe7b45c
feat: adding cache stats support () 
See 

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-04-11 19:19:18 +08:00