Commit Graph

5316 Commits (0ee3c633acb49bbc940f6d44a99e6ef4ae0a2b1e)

Author SHA1 Message Date
groot 0ee3c633ac
Merge pull request #2284 from del-zhenwu/java_case
Update server-version in cases && update java cases
2020-05-11 03:57:55 -05:00
zw 6ff1197c4f update version && disable http async
Signed-off-by: zw <zw@milvus.io>
2020-05-11 13:56:08 +08:00
zw e5b193a0d4 update server_version && update cases
Signed-off-by: zw <zw@milvus.io>
2020-05-11 10:00:18 +08:00
zw 1beaef5346 update java case
Signed-off-by: zw <zw@milvus.io>
2020-05-11 09:48:09 +08:00
zw 0acc0b9815 add java case
Signed-off-by: zw <zw@milvus.io>
2020-05-11 09:46:49 +08:00
groot f32cba6111
Merge strategy (#2277)
* merge manager

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix build error

Signed-off-by: groot <yihua.mo@zilliz.com>

* layered merge strategy

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* use simple

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix parallel multi collections query crashissue

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-05-11 01:38:50 +00:00
Wang XiangYu 369743c10d
Config upgrade (#2281)
* upgrade config to 0.4

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update milvus version in cmakelists.txt

Signed-off-by: wxyu <xy.wang@zilliz.com>

* disable make VERBOSE

Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-05-10 22:55:46 +08:00
BossZou 8d732656a7
Fix show partitions failed in http module (fix #2228) (#2234)
* Fix show partitions failed in http module (fix #2228)

Signed-off-by: yhz <413554850@qq.com>

* catch json string convert error

Signed-off-by: yhz <413554850@qq.com>
2020-05-10 12:49:26 +00:00
Cai Yudong e63904867b
update debug log (#2275)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-10 00:19:33 +08:00
op-hunter a37f9b0764
Openblas macro (#2269)
* save local work 4 add openblas macro to chose compile openblas lib or not

Signed-off-by: cmli <chengming.li@zilliz.com>

* compile openblas by auto detect

Signed-off-by: cmli <chengming.li@zilliz.com>

* Update build environment docker images

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* update changelog

Signed-off-by: cmli <chengming.li@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* set OpenBLAS_SOURCE auto in build.sh

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-05-09 22:47:03 +08:00
quicksilver ca484bbede
Deploy retry (#2276)
* Wait for helm uninstall chart

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Wait for helm uninstall chart

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-05-09 19:54:44 +08:00
groot aeb9edf5c6
#2261 (#2270)
* has collection bug

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #2261

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix typo

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-05-09 18:32:20 +08:00
Wang XiangYu 2c04cc0afe
upgrade config to 0.4 (#2273)
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-05-09 18:28:03 +08:00
del-zhenwu 7f744c036b
[skip ci] Filter id:-1 (#2274)
* add async

Signed-off-by: zw <zw@zilliz.com>

* Update case

Signed-off-by: zw <zw@zilliz.com>

* Update some cases

Signed-off-by: zw <zw@zilliz.com>

* add has_partition case

Signed-off-by: zw <zw@zilliz.com>

* add search_by_id case: ids duplicate

Signed-off-by: zw <zw@zilliz.com>

* add async add

Signed-off-by: zw <zw@zilliz.com>

* add flush case

Signed-off-by: zw <zw@zilliz.com>

* update case

Signed-off-by: zw <zw@zilliz.com>

* fix search by id case

Signed-off-by: zw <zw@zilliz.com>

* update case

Signed-off-by: zw <zw@zilliz.com>

* filter id:-1

Signed-off-by: zw <zw@zilliz.com>

* pq distance

Signed-off-by: zw <zw@zilliz.com>

* [skip ci] skip ci

Signed-off-by: zw <zw@zilliz.com>
2020-05-09 16:50:17 +08:00
quicksilver d49b609a14
Update build environment version to v0.9.0 (#2267)
* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* disable following sourced files

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-05-09 04:17:45 +00:00
yukun 3852d4ca71
0.8.0 id=-1 is returned when total count < topk (#2263)
* 0.8.0 id=-1 is returned when total count < topk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix for comments

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-05-09 10:03:41 +08:00
Cai Yudong cf6be092ab
code clean (#2265)
* use macro STATUS_CHECK

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* comment S3 related config APIs

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-09 01:51:04 +00:00
shengjun.li 4cea320943
k-means L2 (#2258)
* k-means L2

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix change log

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-05-08 14:03:50 +00:00
groot cf68c9918e
#1925 (#2257)
* write error

Signed-off-by: groot <yihua.mo@zilliz.com>

* out of storage

Signed-off-by: groot <yihua.mo@zilliz.com>

* clang format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix #1955

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* compact threashold

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* search by id for hnsw/pq/annoy

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* file cleanup timeout config

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #1925\

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-08 11:40:41 +00:00
BossZou 1811254de6
Obtain running rpc requests information (#2240) (#2241)
* add cmd to get requests

Signed-off-by: yhz <413554850@qq.com>

* forward class declaration

Signed-off-by: yhz <413554850@qq.com>

* Obtain running rpc requests information (fix #2240)

Signed-off-by: yhz <413554850@qq.com>

* Fix unittest compile failed issue

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Log error with msg

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-05-08 11:17:48 +00:00
BossZou 1016dbae1a
[skip ci] update shards requirements (#2262)
Signed-off-by: yhz <413554850@qq.com>
2020-05-08 19:14:33 +08:00
caosiyang 7b0998885c
Fix #2248: use hostname and port as instance label of metrics (#2249)
Signed-off-by: caosiyang <csy3228@gmail.com>
2020-05-08 19:08:04 +08:00
Wang XiangYu 104cda1a76
print warning on stdout (#2243)
* print warning on stdout

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix compile failed

Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-05-08 08:57:08 +00:00
BossZou 8a68d34919
Mishards upgrade (#2260)
* shards ci

Signed-off-by: yhz <413554850@qq.com>

* update interface

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update mishards

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update changlog

Signed-off-by: yhz <413554850@qq.com>

* [skip ci] mishards dev test pass (fix #2252)

Signed-off-by: yhz <413554850@qq.com>
2020-05-08 16:40:30 +08:00
del-zhenwu 6048a3bce6
Java sdk test cases filter id:-1 (#2255)
* update java tests

Signed-off-by: zw <zw@milvus.io>

* filter id:-1

Signed-off-by: zw <zw@milvus.io>

* Remove useless test files

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-05-08 14:30:50 +08:00
zw f4744c7d2e Remove useless test files
Signed-off-by: zw <zw@milvus.io>
2020-05-08 14:28:09 +08:00
groot da55622042
file cleanup timeout config (#2250)
* write error

Signed-off-by: groot <yihua.mo@zilliz.com>

* out of storage

Signed-off-by: groot <yihua.mo@zilliz.com>

* clang format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix #1955

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* compact threashold

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* search by id for hnsw/pq/annoy

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* file cleanup timeout config

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-08 06:24:29 +00:00
zw ba1af004a9 Merge branch 'master' of https://github.com/milvus-io/milvus into java_case 2020-05-08 14:20:20 +08:00
zw c79e5a1f79 filter id:-1
Signed-off-by: zw <zw@milvus.io>
2020-05-08 14:20:07 +08:00
Snyk bot 56055d9d00
fix: upgrade com.alibaba:fastjson from 1.2.47 to 1.2.68 (#2253)
Snyk has created this PR to upgrade com.alibaba:fastjson from 1.2.47 to 1.2.68.

See this package in NPM:
https://www.npmjs.com/package/com.alibaba:fastjson

See this project in Snyk:
https://app.snyk.io/org/cxie/project/2f701ce6-b421-4bbf-aaad-9d2bdb8569e4?utm_source=github&utm_medium=upgrade-pr
2020-05-08 14:19:26 +08:00
Snyk bot 4ebdbef82f
fix: upgrade org.apache.commons:commons-lang3 from 3.9 to 3.10 (#2254)
Snyk has created this PR to upgrade org.apache.commons:commons-lang3 from 3.9 to 3.10.

See this package in NPM:
https://www.npmjs.com/package/org.apache.commons:commons-lang3

See this project in Snyk:
https://app.snyk.io/org/cxie/project/2f701ce6-b421-4bbf-aaad-9d2bdb8569e4?utm_source=github&utm_medium=upgrade-pr
2020-05-08 14:18:51 +08:00
zw 98e1d2e677 filter id:-1
Signed-off-by: zw <zw@milvus.io>
2020-05-08 14:18:28 +08:00
del-zhenwu d6471e9c58
update java tests (#2246)
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-05-08 10:01:01 +08:00
quicksilver 80751436e5
Wait for helm uninstall chart (#2251)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-05-08 02:00:09 +00:00
Wang XiangYu ac69f1ab8d
add_dependencies in cmake (#2239)
* add_dependencies in cmake

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-05-07 14:51:38 +00:00
zw c5c7b97425 update java tests
Signed-off-by: zw <zw@milvus.io>
2020-05-07 18:09:26 +08:00
Wang XiangYu 7e3ba4ddd2
Catch exception and print in stderr (#2238)
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-05-07 10:04:35 +00:00
yukun 1516d71a55
Add attributes to mysql and wal (#2229)
* Add hybrid operation into mysql

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add Hybrid into wal

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add unittest for hybrid wal

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix wal unittest bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix hybrid_insert unittest bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix codacy/PR quality

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change test_rpc port to 19531

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-05-07 06:14:58 +00:00
zhoubo0317 6de141b2af
rm libopenblsa-dev (#2235)
Signed-off-by: zhoubo <zhoubo@hotmail.com>

Co-authored-by: zhoubo <zhoubo@hotmail.com>
2020-05-06 21:46:33 +08:00
Snyk bot f6938682ed
fix: tests/milvus_python_test/requirements_no_pymilvus.txt to reduce vulnerabilities (#2223)
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-PYLINT-568073
2020-05-06 21:44:40 +08:00
Snyk bot 22dd03f8a1
fix: shards/requirements.txt to reduce vulnerabilities (#2222)
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-PYLINT-568073
2020-05-06 21:44:13 +08:00
Snyk bot fca51c3133
fix: tests/milvus_python_test/requirements_cluster.txt to reduce vulnerabilities (#2221)
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-PYLINT-568073
2020-05-06 21:43:40 +08:00
dyhyfu 882ed76cda
[skip ci] remove 'openblas-devel' (#2208)
Signed-of-by: yaohong<dyhyfu@126.com>
2020-05-06 21:39:14 +08:00
Cai Yudong f218217064
optimize similarity template (#2227)
* optimize similarity template

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-06 08:53:16 +00:00
groot ac8e9ff020
write error (#2184)
* write error

Signed-off-by: groot <yihua.mo@zilliz.com>

* out of storage

Signed-off-by: groot <yihua.mo@zilliz.com>

* clang format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix #1955

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* compact threashold

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* search by id for hnsw/pq/annoy

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-06 16:52:37 +08:00
BossZou 82ab21aec3
Http update endpoints (#2187)
* replace table with collection in http module

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add search_by_ids in http module

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add API

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add new API and unittest

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Update endpoint in http module(#2186); change vector id to string format(2185)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* allow filter when show partition

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* move constant variables defination to .cpp

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-05-06 14:07:35 +08:00
Snyk bot fc1e6a74be
fix: tests/milvus_python_test/requirements.txt to reduce vulnerabilities (#2224)
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-PYLINT-568073
2020-05-06 12:00:38 +08:00
jackyu2020 86510aa295
check the return value of fscanf (#2218)
Signed-off-by: e <ych05zh@163.com>
2020-05-03 01:49:57 +00:00
Cai Yudong ed2ee8873b
fix SingleIndexTest.IVFSQHybrid unittest (#2215)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-02 10:24:35 +00:00
XuPeng-SH adccd3dbf0
Merge pull request #2211 from XuPeng-SH/master
[skip ci]: fix #2210
2020-04-30 23:49:25 +08:00