milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,979 Commits
140 Branches
117 Tags
581 MiB
Commit Graph

224 Commits (ca60fa2cc8d89048ad246beb911852a4b0d19ede)

Author SHA1 Message Date
cqy123456 bbc46b7d55
when the topk of gpu search >2048 ,turning into the cpu search (#3640) 
* search task

Signed-off-by: cqy <yaya645@126.com>

code refactoring

Signed-off-by: cqy <yaya645@126.com>

* fix sq8h pass

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* modify the range of param 'ef' in HNSW

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-19 16:42:04 +08:00
groot 82711d6065 rename segment_row_count to segment_row_limit (#3724) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-17 14:15:56 +08:00
del-zhenwu 5f9a7405f6 [skip ci] disable two compact cases (#3731) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-17 14:15:56 +08:00
groot 3b29ae776f fix delete entity performance issue (#3667) 
* fix delete entity performance issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* force flush for delete

Signed-off-by: groot <yihua.mo@zilliz.com>

* improve delete performance

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix delete performce issue

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix hang

Signed-off-by: groot <yihua.mo@zilliz.com>

* segment row count min limit

Signed-off-by: groot <yihua.mo@zilliz.com>

* merge 0.11.0

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failed

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-17 14:15:56 +08:00
del-zhenwu eb6954d506 remove set config case (#3587) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-12 15:54:55 +08:00
Xiaohai Xu 8b92021a27 fix nprobe error (#3658) 
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-12 15:54:55 +08:00
Wang Xiangyu 1a238b1270 Update ConfigMgr::Set behavior (#3546) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-12 15:54:55 +08:00
Snyk bot b72c9d0070
fix: tests/milvus-java-test/pom.xml to reduce vulnerabilities (#3663) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMBEUST-174815
 2020-09-09 16:01:19 +08:00
cqy123456 761f1e0666 solve conflict 
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-09-04 09:53:29 +08:00
groot a87596fb7e
split insert data accordding to segment row count (#3529) 
* split insert data accordding to segment row count

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: groot <yihua.mo@zilliz.com>

* avoid tiny segment row count

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-09-01 14:21:21 +08:00
groot dd2535e184
fix hnswsq index bug (#3467) 
* remove unused config

Signed-off-by: groot <yihua.mo@zilliz.com>

* add comments

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix hnswsq index bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-08-27 09:49:22 +08:00
Xiaohai Xu b4caa81a52
fix binary issue (#3468) 
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-08-26 19:16:58 +08:00
del-zhenwu 695987448f
Update version (#3454) 
* [skip ci] add constants.java

Signed-off-by: zw <zw@milvus.io>

* [skip ci] update server version to 0.11.0 in test cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-26 10:40:28 +08:00
ThreadDao 730a09be68
[skip ci] add assert by collection stats (#3437) 
Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-25 09:41:42 +08:00
XuanYang-cn 7326784e30
Fix Server get stuck if create index with invalide metric types after entities inserted (#3428) 
* add create index with invalid metric type case

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix bin index validation

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* change changelog

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
 2020-08-24 23:17:42 +08:00
del-zhenwu edd4c4033d
[skip ci] add TestSearchEntities.java (#3433) 
* [skip ci] add constants.java

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add testIndex.java

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add TestDeleteEntities.java

Signed-off-by: zw <zw@milvus.io>

* update TestSearchEntities.java

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add TestSearchEntities.java

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-24 17:15:53 +08:00
chen qingxiang ed1195edb2
remove the _id fileld when get collection info (#3414) 
* fix the bug of issue #3336

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix wrong test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-08-24 03:45:53 +00:00
ThreadDao e89a707d6c
[skip ci] Test get entity by id (#3417) 
* [skip ci] update for Contasts

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] test get entity by id

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] test get entity by id

Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-24 10:04:10 +08:00
del-zhenwu b0b6aefc21
[skip ci] Java sdk test: add testIndex.java (#3409) 
* [skip ci] add constants.java

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add testIndex.java

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add TestDeleteEntities.java

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-24 10:03:25 +08:00
chen qingxiang 2e5ff884c1
fix the bugs of delete all and compact (#3395) 
* fix the bugs of delete all and compact

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix the wrong usages in unittest

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix the bug of insert makes no effect

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* add character check in ExtraFileInfo and change the const size and type

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix wrong test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-08-22 10:37:27 +00:00
BossZou c66e40ccff
[skip ci] comment unused insert case (#3405) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-08-22 16:54:18 +08:00
ThreadDao 49218f5490
fix dsl term with multi fields (#3403) 
Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-22 16:41:31 +08:00
del-zhenwu 2633319c9d
[skip ci] add constants.java (#3404) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-22 16:10:31 +08:00
ThreadDao 3f84777264
[skip ci] modify test flush and compact (#3390) 
* java main class

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix generate default entities

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] modify test flush

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] modify test compact

Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-21 19:03:38 +08:00
del-zhenwu d34be8bc79
Skip flat search params (#3381) 
* assert top ids

Signed-off-by: zw <zw@milvus.io>

* update milvus-helm to 0.11.0

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-21 16:25:28 +08:00
ThreadDao 03c0415ec6
[skip ci] fix generate default entities (#3382) 
* java main class

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix generate default entities

Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-21 14:19:13 +08:00
ThreadDao befc21ec37
[skip ci] fix java sdk test case (#3375) 
* java main class

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-21 11:50:22 +08:00
Xiaohai Xu b437639b7a
#3309 Error should be raised if search binary collection with metric_type: L2 (#3349) 
* add check

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-08-20 18:22:09 +08:00
ThreadDao 2a2cf0fe9f
fix search without insert data (#3339) 
Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-20 14:44:29 +08:00
Xiaohai Xu 07ece74b70
#3295 Server crashed during creating index (#3307) 
* fix binary case

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix validation

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* exception by reference

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-08-19 15:43:41 +08:00
del-zhenwu d9e9d52f3b
enable some cases (#3325) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-19 15:30:50 +08:00
del-zhenwu dfecfb85db
enable binary search cases (#3312) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-18 22:26:44 +08:00
ThreadDao cb74d0a30b
Fix invalid ranges and delete logging (#3303) 
* invalid ranges

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* delete gen invalid ranges

Signed-off-by: zongyufen <zongyufen@foxmail.com>
 2020-08-18 18:48:18 +08:00
del-zhenwu d993bcc989
remove todo case (#3296) 
* remove todo case

Signed-off-by: zw <zw@milvus.io>

* remove todo case

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-18 16:50:51 +08:00
Snyk bot 5d4f27bd6c
fix: upgrade com.alibaba:fastjson from 1.2.72 to 1.2.73 (#3292) 
Snyk has created this PR to upgrade com.alibaba:fastjson from 1.2.72 to 1.2.73.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.alibaba/fastjson/

See this project in Snyk:
https://app.snyk.io/org/cxie/project/2f701ce6-b421-4bbf-aaad-9d2bdb8569e4?utm_source=github&utm_medium=upgrade-pr
 2020-08-18 10:15:35 +08:00
Snyk bot ee4f949728
fix: upgrade org.apache.commons:commons-lang3 from 3.10 to 3.11 (#3118) 
Snyk has created this PR to upgrade org.apache.commons:commons-lang3 from 3.10 to 3.11.

See this package in Maven Repository:
https://mvnrepository.com/artifact/org.apache.commons/commons-lang3/

See this project in Snyk:
https://app.snyk.io/org/cxie/project/2f701ce6-b421-4bbf-aaad-9d2bdb8569e4?utm_source=github&utm_medium=upgrade-pr
 2020-08-15 01:18:46 +08:00
del-zhenwu 0dfe08471b
[skip ci] disable ubuntu && update case (#3244) 
* [skip ci] disable ubuntu && update case

Signed-off-by: zw <zw@milvus.io>

* some cases set level-1 from level-2

Signed-off-by: zw <zw@milvus.io>

* add get collection info case: after index created

Signed-off-by: zw <zw@milvus.io>

* add -1 in invalid ints

Signed-off-by: zw <zw@milvus.io>

* remove douban pip during install python-lib

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-15 01:18:24 +08:00
ThreadDao 892b16633b
update dsl search case (#3225) 
* [skip ci] add dsl search case

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci]fix test bug in whether user defined id (#3192)

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] add dsl search case

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* Fix TestSearchDSL level 2 bugs (#3185)

* Fix TestSearchDSL level 2 bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix QueryTest

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add annotation in milvus.proto

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] update dsl search case

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* fix valid ranges

Signed-off-by: zongyufen <zongyufen@foxmail.com>

Co-authored-by: chen qingxiang <67679556+godchen0212@users.noreply.github.com>
Co-authored-by: yukun <kun.yu@zilliz.com>
Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-08-14 15:02:42 +08:00
chen qingxiang 6f6a1bfd82
fix cmd req bug and fix test case bug (#3241) 
* [skip ci]fix test case bug

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* cancel change config

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix Cmd req bug and change config test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change test case in config and throw inmutable params problem

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-08-13 06:14:50 +00:00
yukun 92e2a26a78
Fix test_query_range_valid_ranges bug (#3224) 
* Fix TestSearchDSL level 2 bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix QueryTest

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add annotation in milvus.proto

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix CreateIndex in C++ sdk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix C++ sdk range test

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_search_ip_index_partitions

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_query_range_valid_ranges

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetCollectionInfo

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-08-12 14:29:33 +08:00
chen qingxiang 3ec8c382d6
fix compact bug and change some test case level from 2 to 1 (#3219) 
* fix compact bug and change some test case level from 2 to 1

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change wrong test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix ping test case bug

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-08-12 10:56:33 +08:00
del-zhenwu 46f2f20d77
[skip ci] fix compact case bug (#3212) 
* [skip ci] use pymilvus-test, remove personal git repo

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add pytest dry-run

Signed-off-by: zw <zw@milvus.io>

* [skip ci] fix compact case bug

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add search case: search with different metric_type

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add search case: search with different metric_type

Signed-off-by: zw <zw@milvus.io>

* fix index.py

Signed-off-by: zw <zw@milvus.io>

* get_stats changed: some cases disabled

Signed-off-by: zw <zw@milvus.io>

* fix case bug

Signed-off-by: zw <zw@milvus.io>

* fix case bug

Signed-off-by: zw <zw@milvus.io>

* set search binary level-2

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-08-11 20:46:34 +08:00
yukun 0b25f4c015
Fix CreateIndex bug in C++ sdk (#3216) 
* Fix TestSearchDSL level 2 bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix QueryTest

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add annotation in milvus.proto

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix CreateIndex in C++ sdk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix C++ sdk range test

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_search_ip_index_partitions

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-08-11 17:16:54 +08:00
chen qingxiang 202a8b7244
fix GetEntityBug and part of test case bug (#3200) 
* fix GetEntityBug and part of test case bug

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix test case bug

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-08-11 02:46:59 +00:00
del-zhenwu c4cb6f4bbd
[skip ci] use pymilvus-test, remove personal git repo (#3194) 
* [skip ci] use pymilvus-test, remove personal git repo

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add pytest dry-run

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-08-10 17:53:24 +08:00
yukun 773236b93e
Fix TestSearchDSL level 2 bugs (#3185) 
* Fix TestSearchDSL level 2 bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix QueryTest

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add annotation in milvus.proto

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-08-10 15:56:58 +08:00
chen qingxiang 30e02954f6
[skip ci]fix test bug in whether user defined id (#3192) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-08-10 12:06:11 +08:00
chen qingxiang 01b8057c63
fix the bug cpu cache not make effect (#3178) 
* fix the bug not make effect

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* code format

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change test case level

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change test case level

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change test case level

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-08-08 20:35:18 +08:00
chen qingxiang f9e8c16e29
fix bug caused by bloomfilter file not release (#3173) 
* fix bug caused by bloomfilter file not release

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix bug caused by apply delete

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* cancel annotation

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-08-08 09:41:33 +08:00
yukun 237e909e7c
Fix test_search.py::TestSearchDSL bugs (#3170) 
* Fix dsl test case nb bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix dsl test case bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add metric_type judge in search

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_search.py

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_db

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix search metric_type

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* ci retry

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_search.py::TestSearchDSL bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: Wang Xiangyu <xy.wang@zilliz.com>
 2020-08-07 20:36:12 +08:00