milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,180 Commits
135 Branches
115 Tags
565 MiB
Commit Graph

235 Commits (experimental)

Author SHA1 Message Date
del-zhenwu b6e78f700f
pick test cases from 0.11.1 (#4406) 
* pick test cases from 0.11.1

Signed-off-by: zw <zw@milvus.io>

* update version in case

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-12-08 21:30:14 +08:00
Wang Xiangyu e04194313a
Rewrite the metrics module (#4249) 
* remove metrics

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* add metric rpc_request_total

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* add ScopedTimer and metric operation_lantency_seconds

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* Add metrics endpoint in httpserver

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add return string in metrics endpoint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add SystemInfo

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* add SystemInfoCollector

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* code format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* clang-format

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* Fix client sdk simple

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* add systeminfo metric cpu_utilization_ratio

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* Add SystemInfoCollector

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* add metric cache_gets_total, cache_hits_total

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* update metric rpc_request_total

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* Cpu temperature return nan if not right

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* add prefix for all metrics, add metric valid range

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* Add range annotation

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* remove config metric

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* update metric network receive and transport

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* Fix cpu utilization

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_web

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix cpplint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change helm_branch to 0.12.0

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove metrics test cases

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: fishpenguin <kun.yu@zilliz.com>
 2020-11-24 17:14:39 +08:00
BossZou 3f53ee3fbe The scalar field value of search result is wrong after deleted (#4209) 
* The scalar field information of search result is wrong after some entities deleted

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code format

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Fix bitset count passing error

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code style

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add more db del test

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add test

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] add ()

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-20 11:46:08 +08:00
Snyk bot 0f8d3e8e01
fix: upgrade com.alibaba:fastjson from 1.2.73 to 1.2.74 (#4179) 
Snyk has created this PR to upgrade com.alibaba:fastjson from 1.2.73 to 1.2.74.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.alibaba/fastjson/

See this project in Snyk:
https://app.snyk.io/org/cxie/project/2f701ce6-b421-4bbf-aaad-9d2bdb8569e4?utm_source=github&utm_medium=upgrade-pr
 2020-11-09 10:36:54 +08:00
BossZou 9643af6909
[skip ci] restrict server python sdk version (#4177) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-11-04 15:46:38 +08:00
groot bc66b877b0
#4101 Trim blank space for collection name, partition name and field … (#4127) 
* #4101 Trim blank space for collection name, partition name and field name

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-10-30 15:18:28 +08:00
Xiaohai Xu 97b180271a
Pass "nbits" as an argument to IVF_PQ create_index (#4109) 
* add nbits choices between 1 and 16

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix python case

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Fix case

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-10-29 09:59:09 +08:00
Snyk bot d29508c594
fix: tests/milvus-java-test/pom.xml to reduce vulnerabilities (#4013) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMBEUST-174815
- https://snyk.io/vuln/SNYK-JAVA-ORGTESTNG-174823

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-10-17 17:54:10 +08:00
Snyk bot 49ef3fe18b
fix: tests/milvus-java-test/pom.xml to reduce vulnerabilities (#3980) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-JUNIT-1017047

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-10-17 17:15:39 +08:00
shengjun.li fff5da0de4 cp test from 0.11.0 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-10-16 16:21:08 +08:00
BossZou 0741dabf08 remove surplus class import in dev case (#3985) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-10-16 16:21:08 +08:00
cqy123456 bbc46b7d55
when the topk of gpu search >2048 ,turning into the cpu search (#3640) 
* search task

Signed-off-by: cqy <yaya645@126.com>

code refactoring

Signed-off-by: cqy <yaya645@126.com>

* fix sq8h pass

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* modify the range of param 'ef' in HNSW

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-19 16:42:04 +08:00
groot 82711d6065 rename segment_row_count to segment_row_limit (#3724) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-17 14:15:56 +08:00
del-zhenwu 5f9a7405f6 [skip ci] disable two compact cases (#3731) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-17 14:15:56 +08:00
groot 3b29ae776f fix delete entity performance issue (#3667) 
* fix delete entity performance issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* force flush for delete

Signed-off-by: groot <yihua.mo@zilliz.com>

* improve delete performance

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix delete performce issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix hang

Signed-off-by: groot <yihua.mo@zilliz.com>

* segment row count min limit

Signed-off-by: groot <yihua.mo@zilliz.com>

* merge 0.11.0

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failed

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-17 14:15:56 +08:00
del-zhenwu eb6954d506 remove set config case (#3587) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-12 15:54:55 +08:00
Xiaohai Xu 8b92021a27 fix nprobe error (#3658) 
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-12 15:54:55 +08:00
Wang Xiangyu 1a238b1270 Update ConfigMgr::Set behavior (#3546) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-12 15:54:55 +08:00
Snyk bot b72c9d0070
fix: tests/milvus-java-test/pom.xml to reduce vulnerabilities (#3663) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMBEUST-174815
 2020-09-09 16:01:19 +08:00
cqy123456 761f1e0666 solve conflict 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-04 09:53:29 +08:00
groot a87596fb7e
split insert data accordding to segment row count (#3529) 
* split insert data accordding to segment row count

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: groot <yihua.mo@zilliz.com>

* avoid tiny segment row count

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-01 14:21:21 +08:00
groot dd2535e184
fix hnswsq index bug (#3467) 
* remove unused config

Signed-off-by: groot <yihua.mo@zilliz.com>

* add comments

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix hnswsq index bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-08-27 09:49:22 +08:00
Xiaohai Xu b4caa81a52
fix binary issue (#3468) 
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-08-26 19:16:58 +08:00
del-zhenwu 695987448f
Update version (#3454) 
* [skip ci] add constants.java

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update server version to 0.11.0 in test cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-26 10:40:28 +08:00
ThreadDao 730a09be68
[skip ci] add assert by collection stats (#3437) 
Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-25 09:41:42 +08:00
XuanYang-cn 7326784e30
Fix Server get stuck if create index with invalide metric types after entities inserted (#3428) 
* add create index with invalid metric type case

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix bin index validation

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* change changelog

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
 2020-08-24 23:17:42 +08:00
del-zhenwu edd4c4033d
[skip ci] add TestSearchEntities.java (#3433) 
* [skip ci] add constants.java

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add testIndex.java

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add TestDeleteEntities.java

Signed-off-by: zw <zw@milvus.io>

* update TestSearchEntities.java

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add TestSearchEntities.java

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-24 17:15:53 +08:00
chen qingxiang ed1195edb2
remove the _id fileld when get collection info (#3414) 
* fix the bug of issue #3336

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix wrong test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-08-24 03:45:53 +00:00
ThreadDao e89a707d6c
[skip ci] Test get entity by id (#3417) 
* [skip ci] update for Contasts

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] test get entity by id

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] test get entity by id

Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-24 10:04:10 +08:00
del-zhenwu b0b6aefc21
[skip ci] Java sdk test: add testIndex.java (#3409) 
* [skip ci] add constants.java

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add testIndex.java

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add TestDeleteEntities.java

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-24 10:03:25 +08:00
chen qingxiang 2e5ff884c1
fix the bugs of delete all and compact (#3395) 
* fix the bugs of delete all and compact

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix the wrong usages in unittest

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix the bug of insert makes no effect

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* add character check in ExtraFileInfo and change the const size and type

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix wrong test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-08-22 10:37:27 +00:00
BossZou c66e40ccff
[skip ci] comment unused insert case (#3405) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-08-22 16:54:18 +08:00
ThreadDao 49218f5490
fix dsl term with multi fields (#3403) 
Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-22 16:41:31 +08:00
del-zhenwu 2633319c9d
[skip ci] add constants.java (#3404) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-22 16:10:31 +08:00
ThreadDao 3f84777264
[skip ci] modify test flush and compact (#3390) 
* java main class

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix generate default entities

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] modify test flush

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] modify test compact

Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-21 19:03:38 +08:00
del-zhenwu d34be8bc79
Skip flat search params (#3381) 
* assert top ids

Signed-off-by: zw <zw@milvus.io>

* update milvus-helm to 0.11.0

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-21 16:25:28 +08:00
ThreadDao 03c0415ec6
[skip ci] fix generate default entities (#3382) 
* java main class

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix generate default entities

Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-21 14:19:13 +08:00
ThreadDao befc21ec37
[skip ci] fix java sdk test case (#3375) 
* java main class

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-21 11:50:22 +08:00
Xiaohai Xu b437639b7a
#3309 Error should be raised if search binary collection with metric_type: L2 (#3349) 
* add check

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-08-20 18:22:09 +08:00
ThreadDao 2a2cf0fe9f
fix search without insert data (#3339) 
Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-20 14:44:29 +08:00
Xiaohai Xu 07ece74b70
#3295 Server crashed during creating index (#3307) 
* fix binary case

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix validation

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* exception by reference

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-08-19 15:43:41 +08:00
del-zhenwu d9e9d52f3b
enable some cases (#3325) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-19 15:30:50 +08:00
del-zhenwu dfecfb85db
enable binary search cases (#3312) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-18 22:26:44 +08:00
ThreadDao cb74d0a30b
Fix invalid ranges and delete logging (#3303) 
* invalid ranges

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* delete gen invalid ranges

Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-18 18:48:18 +08:00
del-zhenwu d993bcc989
remove todo case (#3296) 
* remove todo case

Signed-off-by: zw <zw@milvus.io>

* remove todo case

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-18 16:50:51 +08:00
Snyk bot 5d4f27bd6c
fix: upgrade com.alibaba:fastjson from 1.2.72 to 1.2.73 (#3292) 
Snyk has created this PR to upgrade com.alibaba:fastjson from 1.2.72 to 1.2.73.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.alibaba/fastjson/

See this project in Snyk:
https://app.snyk.io/org/cxie/project/2f701ce6-b421-4bbf-aaad-9d2bdb8569e4?utm_source=github&utm_medium=upgrade-pr
 2020-08-18 10:15:35 +08:00
Snyk bot ee4f949728
fix: upgrade org.apache.commons:commons-lang3 from 3.10 to 3.11 (#3118) 
Snyk has created this PR to upgrade org.apache.commons:commons-lang3 from 3.10 to 3.11.

See this package in Maven Repository:
https://mvnrepository.com/artifact/org.apache.commons/commons-lang3/

See this project in Snyk:
https://app.snyk.io/org/cxie/project/2f701ce6-b421-4bbf-aaad-9d2bdb8569e4?utm_source=github&utm_medium=upgrade-pr
 2020-08-15 01:18:46 +08:00
del-zhenwu 0dfe08471b
[skip ci] disable ubuntu && update case (#3244) 
* [skip ci] disable ubuntu && update case

Signed-off-by: zw <zw@milvus.io>

* some cases set level-1 from level-2

Signed-off-by: zw <zw@milvus.io>

* add get collection info case: after index created

Signed-off-by: zw <zw@milvus.io>

* add -1 in invalid ints

Signed-off-by: zw <zw@milvus.io>

* remove douban pip during install python-lib

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-15 01:18:24 +08:00
ThreadDao 892b16633b
update dsl search case (#3225) 
* [skip ci] add dsl search case

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci]fix test bug in whether user defined id (#3192)

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] add dsl search case

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* Fix TestSearchDSL level 2 bugs (#3185)

* Fix TestSearchDSL level 2 bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix QueryTest

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add annotation in milvus.proto

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] update dsl search case

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* fix valid ranges

Signed-off-by: zongyufen <zongyufen@foxmail.com>

Co-authored-by: chen qingxiang <67679556+godchen0212@users.noreply.github.com>
Co-authored-by: yukun <kun.yu@zilliz.com>
Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-08-14 15:02:42 +08:00
chen qingxiang 6f6a1bfd82
fix cmd req bug and fix test case bug (#3241) 
* [skip ci]fix test case bug

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* cancel change config

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix Cmd req bug and change config test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change test case in config and throw inmutable params problem

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-08-13 06:14:50 +00:00