Commit Graph

5573 Commits (v0.10.6)

Author SHA1 Message Date
BossZou de07c35ca2
Upgrade mishards to v0.10.6 (#4733)
* Check search results to avoid out-of-index

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* [skip-ci] Update milvus docker images in all_in_one

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-02-22 18:41:08 +08:00
shengjun.li 64ddc2a556 Add an optional parameter 'nbtis' for IVF_PQ (#4709)
* Add an optional parameter 'nbtis' for IVF_PQ

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix test

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-19 18:12:24 +08:00
op-hunter e8afb2ba65
The GPU cache holds much more data than the configured value (#4720)
* The GPU cache holds much more data than the configured value

Signed-off-by: cmli <chengming.li@zilliz.com>

* update changelog and remove the useless variable G_BYTE and unit

Signed-off-by: cmli <chengming.li@zilliz.com>
2021-02-19 11:49:17 +08:00
shengjun.li 09f0730f8d
Code Refactoring (#4702)
* remove useless code

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* Code Refactoring

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix ut

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-09 09:25:15 +00:00
ThreadDao 97a5d9055e
Add cases for search with the dimension that isn't a power of 2 (#4703) 2021-02-09 10:52:40 +08:00
WangJian 3cd1b37278
[skip ci] change type of tps and qps from int64_t to double (#4705)
fix bug: QPS will be zero when TPS is less than 1 in sdk/examples/sdk_qps

Signed-off-by: WangJian <wangjian4500@gmail.com>
2021-02-09 10:25:04 +08:00
shengjun.li c8dec9f02f
[skip ci] update change log (#4698)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-06 04:08:01 +00:00
shengjun.li 1211e9bac3
BinaryFlat support AVX2 (#4694)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-04 08:42:42 +00:00
shengjun.li bbbf254b7c
Fix binaryflat (#4681)
* fix binary distance

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* improve the performance of BinaryFlat

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* avoid negative zero in Tanimoto

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-02 17:11:02 +08:00
yukun 3efbab1df5
make metrics label configurable (#4677)
* update to 0.10.6

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* Configurable metric labels

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Roll back clienTest modify

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-02 10:45:36 +08:00
Wang Xiangyu 87c48faf4f
update CODEOWNERS (#4673)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-29 19:03:48 +08:00
Wang Xiangyu b9ae598377
[skip ci] Update mergify (#4657)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-25 15:29:43 +08:00
ireneontheway5 84a44b2f56
[skip ci] Fix the dead link in README.md. (#4651)
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
2021-01-25 15:27:23 +08:00
shengjun.li 893e8bb020
update .github (#4653)
* Update PULL_REQUEST_TEMPLATE.md (#2639)

Signed-off-by: jinhai <hai.jin@zilliz.com>

* optimize config code (#2996)

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update pull request template

Signed-off-by: wxyu <xy.wang@zilliz.com>

* [skip ci] update pull request template (#3008)

Signed-off-by: wxyu <xy.wang@zilliz.com>

* [skip ci] Update PR template

Signed-off-by: jinhai <hai.jin@zilliz.com>

* update PULL_REQUEST_TEMPLATE.md

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* [skip ci] Update ISSUE template

Signed-off-by: jinhai <hai.jin@zilliz.com>

* [skip ci]fix template doc (#3268)

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* [skip ci]update issue template (#3379)

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* [skip ci]remove cherry-pick section in PULL REQUEST TEMPLATE (#3571)

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* [skip ci] add enhancement issue template (#3585)

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
Co-authored-by: Wang XiangYu <xy.wang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2021-01-23 11:06:42 +08:00
shengjun.li f942f0b823
fix errors in .mds (#4644)
* Updated logo and architecture links. (#2529)

Signed-off-by: PahudPlus <haimeng.cai@zilliz.com>

* Fixed broken links. (#2902)

Signed-off-by: PahudPlus <haimeng.cai@zilliz.com>

* Minor editorial updates. (#2946)

Signed-off-by: Amy Hong <yun.hong@zilliz.com>

* fix cuda version requirement (#2909)

Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>

* [skip ci] Updated INSTALL.md.  (#3016)

Signed-off-by: Amy Hong <yun.hong@zilliz.com>

* [skip ci] Fixed broken links. (#3304)

Signed-off-by: Amy Hong <yun.hong@zilliz.com>

* [skip ci] update install from code (#3855)

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* [skip ci] update cmake version (#4084)

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* [skip ci] Update the foundation name. (#4438)

Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>

* [skip ci] Added a space for readability (#4465)

Added a space between the heart emoji and the word for better readability.

Signed-off-by: Mark Berger <maberger0811@gmail.com>

* [skip ci] Update links and fix dead links. (#4496)

Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>

* [skip ci] fix errors in mds

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: PahudPlus <64403786+PahudPlus@users.noreply.github.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: AmyYH <68527082+AmyYH@users.noreply.github.com>
Co-authored-by: Wang XiangYu <xy.wang@zilliz.com>
Co-authored-by: ireneontheway5 <75291211+ireneontheway5@users.noreply.github.com>
Co-authored-by: Mark Berger <maberger0811@gmail.com>
2021-01-22 19:16:40 +08:00
Starlord 19cd3d8f7c
fix: shards/requirements.txt to reduce vulnerabilities (#4647)
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-RSA-570831
- https://snyk.io/vuln/SNYK-PYTHON-SQLALCHEMY-590109
- https://snyk.io/vuln/SNYK-PYTHON-URLLIB3-1014645

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2021-01-22 15:42:03 +08:00
Starlord 57efa7640a
fix: tests/milvus_python_test/requirements_no_pymilvus.txt to reduce vulnerabilities (#4641)
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-PY-1049546

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2021-01-22 15:40:39 +08:00
yukun f709349cc8
[skip ci]Fix restful api doc for loadcollection (#4627)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-01-19 19:05:52 +08:00
BossZou 4175ac1f22
[skip ci] mishards upgrade for milvus 0.10.5 (#4581)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-01-06 08:49:22 +00:00
BossZou 4eda95e63b
[skip ci] fix mishards error when invoking load_collection (#4569)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-01-05 09:43:50 +00:00
BossZou 9088b2c711
Fix shards mismatch pod name (#4565)
* skip pod if name mismatch

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* [skip ci] update changlog

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* [skip ci] fix variable name typo

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-01-05 03:12:36 +00:00
groot 810f5e6f70
fix random crash for scheduler task (#4563)
* fix random crash for scheduler task

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix unittest crash

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-01-04 13:12:05 +00:00
BossZou ec0291a08d
[skip ci] complete k8s provider deleting pod logic (#4553)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-12-31 03:39:49 +00:00
ThreadDao e0d33e5546
[skip ci] add case for load partition and fix connect case and update concurrent search (#4535) 2020-12-29 15:31:19 +08:00
ThreadDao 14e23a9238
add case for search with multi partition contains default (#4526) 2020-12-28 18:05:07 +08:00
del-zhenwu 216d8d54be
add load_collection case with partition (#4507)
* add load_collection with partition

Signed-off-by: zw <zw@milvus.io>

* add filebeat in CI

Signed-off-by: zw <zw@milvus.io>

* remove CI on ubuntu

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-12-25 10:21:03 +08:00
groot 89bbe1ee4d
#4492 while share file system servcie became abnormal, the milvus can not supply query service (#4506)
* modify changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #4492 while share file system servcie became abnormal, the milvus can not supply query service

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-25 02:12:58 +00:00
yukun 9ab4baacd5
[skip ci]Add a metric to display the number of files opened by Milvus (#4509)
* [skip ci]Add a metric to display the number of files opened by Milvus

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* [skip ci]Add dashboard.yml

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-12-25 02:06:07 +00:00
BossZou febcfe4c0b
[skip ci] update-mishards-load-api (#4505)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-12-24 02:47:49 +00:00
groot 437f5d9777
modify changelog (#4503)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-24 10:09:55 +08:00
shengjun.li f9222da52b
fix MapOffsetToUid (#4493)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-23 10:22:09 +08:00
groot 705e5cde8e
modify http request for load_collection change (#4494)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-22 11:10:14 +00:00
groot 22cca00af3
LoadCollection api change for C++ sdk (#4491)
* LoadCollection api change for C++ sdk

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-22 06:14:23 +00:00
op-hunter 646baed233
remove useless mutex in knowhere indexes and refactor BuildAll interf… (#4487)
* remove useless mutex in knowhere indexes

Signed-off-by: cmli <chengming.li@zilliz.com>

* refactor BuildAll interface 4 NSG and SPTAG

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix ut

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-22 09:35:20 +08:00
groot 607ec31fbc
#4484 Milvus only search default partition if search parameter partition_tags contains _default (#4486)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-21 08:30:10 +00:00
shengjun.li a07526c98e
Optimize the process of indexing and querying (#4455)
* fix index

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix engine

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix ut

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-18 17:53:39 +08:00
BossZou e5d218f405
[skip ci] Fix mishards error shen k8s find node fail (#4474)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-12-18 03:30:44 +00:00
groot 805212a0dc
#4307 expand load_collection to load partition (#4443)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-11 17:44:48 +08:00
groot 62098d760e
#4378 Multi-threads to call load_collection and search cause Milvus hang (#4408)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-08 19:14:53 +08:00
shengjun.li 47542a747c
update version info for 0.10.5 (#4409)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-08 18:22:21 +08:00
del-zhenwu 4c7d6c22ef
[skip ci] remove cron job for branch 0.10.4 (#4353)
* [skip ci] update ci/jenkinsfile to 0.10.4

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update version in test case

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update benchmark scripts

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add comments in scripts

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix style in benchmark

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix style in benchmark

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix style in benchmark

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix style in benchmark

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix style in benchmark

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix style in benchmark

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix style in benchmark

Signed-off-by: zw <zw@milvus.io>

* [skip ci] remove cron job for branch 0.10.4

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-12-04 06:53:13 +00:00
BossZou 2d57c5cd52
Upgrade mishards for v0.10.4 (#4356)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-12-02 18:00:19 +08:00
del-zhenwu de0669f9dc
[skip ci] update benchmark scripts on 0.10.4 (#4213)
* [skip ci] update ci/jenkinsfile to 0.10.4

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update version in test case

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update benchmark scripts

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add comments in scripts

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix style in benchmark

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix style in benchmark

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix style in benchmark

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix style in benchmark

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix style in benchmark

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix style in benchmark

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix style in benchmark

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-12-01 11:30:29 +08:00
shengjun.li bf5fdc3131
Fix memory leak in IVF indexes (#4325)
* fix memory lead in IVF indexes

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* [skip ci] modify change log

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-01 09:36:04 +08:00
Xiaohai Xu 99245c0c63
#4174 Search out of memory: CPU2GPU1 with index flat (#4178)
* Fix gpu resource issue

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix_ut

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-05 13:57:50 +08:00
groot 124d914bb5
#4169 Collection does not exist when drop partition and count entities concurrently (#4175)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-11-04 18:55:13 +08:00
groot 001c8513fe
#4082 Expose MAX_PARTITION_LIMIT to config (#4138)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-10-31 16:39:26 +08:00
quicksilver 3ab73968c1 Add wget in deployment Dockerfile
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-31 09:46:46 +08:00
quicksilver 95ecfbc676 Use tini for Docker quicker exit.
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-30 11:28:52 +08:00
groot d41835585a
remove dependency of sqlite_orm (#4129)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-10-30 01:59:11 +00:00