Commit Graph

5301 Commits (ca484bbede8dedeefa6f3f791b5989f11c94f086)

Author SHA1 Message Date
quicksilver ca484bbede
Deploy retry (#2276)
* Wait for helm uninstall chart

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Wait for helm uninstall chart

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-05-09 19:54:44 +08:00
groot aeb9edf5c6
#2261 (#2270)
* has collection bug

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #2261

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix typo

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-05-09 18:32:20 +08:00
Wang XiangYu 2c04cc0afe
upgrade config to 0.4 (#2273)
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-05-09 18:28:03 +08:00
del-zhenwu 7f744c036b
[skip ci] Filter id:-1 (#2274)
* add async

Signed-off-by: zw <zw@zilliz.com>

* Update case

Signed-off-by: zw <zw@zilliz.com>

* Update some cases

Signed-off-by: zw <zw@zilliz.com>

* add has_partition case

Signed-off-by: zw <zw@zilliz.com>

* add search_by_id case: ids duplicate

Signed-off-by: zw <zw@zilliz.com>

* add async add

Signed-off-by: zw <zw@zilliz.com>

* add flush case

Signed-off-by: zw <zw@zilliz.com>

* update case

Signed-off-by: zw <zw@zilliz.com>

* fix search by id case

Signed-off-by: zw <zw@zilliz.com>

* update case

Signed-off-by: zw <zw@zilliz.com>

* filter id:-1

Signed-off-by: zw <zw@zilliz.com>

* pq distance

Signed-off-by: zw <zw@zilliz.com>

* [skip ci] skip ci

Signed-off-by: zw <zw@zilliz.com>
2020-05-09 16:50:17 +08:00
quicksilver d49b609a14
Update build environment version to v0.9.0 (#2267)
* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* disable following sourced files

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-05-09 04:17:45 +00:00
yukun 3852d4ca71
0.8.0 id=-1 is returned when total count < topk (#2263)
* 0.8.0 id=-1 is returned when total count < topk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix for comments

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-05-09 10:03:41 +08:00
Cai Yudong cf6be092ab
code clean (#2265)
* use macro STATUS_CHECK

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* comment S3 related config APIs

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-09 01:51:04 +00:00
shengjun.li 4cea320943
k-means L2 (#2258)
* k-means L2

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix change log

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-05-08 14:03:50 +00:00
groot cf68c9918e
#1925 (#2257)
* write error

Signed-off-by: groot <yihua.mo@zilliz.com>

* out of storage

Signed-off-by: groot <yihua.mo@zilliz.com>

* clang format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix #1955

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* compact threashold

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* search by id for hnsw/pq/annoy

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* file cleanup timeout config

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #1925\

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-08 11:40:41 +00:00
BossZou 1811254de6
Obtain running rpc requests information (#2240) (#2241)
* add cmd to get requests

Signed-off-by: yhz <413554850@qq.com>

* forward class declaration

Signed-off-by: yhz <413554850@qq.com>

* Obtain running rpc requests information (fix #2240)

Signed-off-by: yhz <413554850@qq.com>

* Fix unittest compile failed issue

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Log error with msg

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-05-08 11:17:48 +00:00
BossZou 1016dbae1a
[skip ci] update shards requirements (#2262)
Signed-off-by: yhz <413554850@qq.com>
2020-05-08 19:14:33 +08:00
caosiyang 7b0998885c
Fix #2248: use hostname and port as instance label of metrics (#2249)
Signed-off-by: caosiyang <csy3228@gmail.com>
2020-05-08 19:08:04 +08:00
Wang XiangYu 104cda1a76
print warning on stdout (#2243)
* print warning on stdout

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix compile failed

Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-05-08 08:57:08 +00:00
BossZou 8a68d34919
Mishards upgrade (#2260)
* shards ci

Signed-off-by: yhz <413554850@qq.com>

* update interface

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update mishards

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update changlog

Signed-off-by: yhz <413554850@qq.com>

* [skip ci] mishards dev test pass (fix #2252)

Signed-off-by: yhz <413554850@qq.com>
2020-05-08 16:40:30 +08:00
del-zhenwu 6048a3bce6
Java sdk test cases filter id:-1 (#2255)
* update java tests

Signed-off-by: zw <zw@milvus.io>

* filter id:-1

Signed-off-by: zw <zw@milvus.io>

* Remove useless test files

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-05-08 14:30:50 +08:00
groot da55622042
file cleanup timeout config (#2250)
* write error

Signed-off-by: groot <yihua.mo@zilliz.com>

* out of storage

Signed-off-by: groot <yihua.mo@zilliz.com>

* clang format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix #1955

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* compact threashold

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* search by id for hnsw/pq/annoy

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* file cleanup timeout config

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-08 06:24:29 +00:00
Snyk bot 56055d9d00
fix: upgrade com.alibaba:fastjson from 1.2.47 to 1.2.68 (#2253)
Snyk has created this PR to upgrade com.alibaba:fastjson from 1.2.47 to 1.2.68.

See this package in NPM:
https://www.npmjs.com/package/com.alibaba:fastjson

See this project in Snyk:
https://app.snyk.io/org/cxie/project/2f701ce6-b421-4bbf-aaad-9d2bdb8569e4?utm_source=github&utm_medium=upgrade-pr
2020-05-08 14:19:26 +08:00
Snyk bot 4ebdbef82f
fix: upgrade org.apache.commons:commons-lang3 from 3.9 to 3.10 (#2254)
Snyk has created this PR to upgrade org.apache.commons:commons-lang3 from 3.9 to 3.10.

See this package in NPM:
https://www.npmjs.com/package/org.apache.commons:commons-lang3

See this project in Snyk:
https://app.snyk.io/org/cxie/project/2f701ce6-b421-4bbf-aaad-9d2bdb8569e4?utm_source=github&utm_medium=upgrade-pr
2020-05-08 14:18:51 +08:00
del-zhenwu d6471e9c58
update java tests (#2246)
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-05-08 10:01:01 +08:00
quicksilver 80751436e5
Wait for helm uninstall chart (#2251)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-05-08 02:00:09 +00:00
Wang XiangYu ac69f1ab8d
add_dependencies in cmake (#2239)
* add_dependencies in cmake

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-05-07 14:51:38 +00:00
Wang XiangYu 7e3ba4ddd2
Catch exception and print in stderr (#2238)
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-05-07 10:04:35 +00:00
yukun 1516d71a55
Add attributes to mysql and wal (#2229)
* Add hybrid operation into mysql

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add Hybrid into wal

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add unittest for hybrid wal

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix wal unittest bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix hybrid_insert unittest bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix codacy/PR quality

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change test_rpc port to 19531

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-05-07 06:14:58 +00:00
zhoubo0317 6de141b2af
rm libopenblsa-dev (#2235)
Signed-off-by: zhoubo <zhoubo@hotmail.com>

Co-authored-by: zhoubo <zhoubo@hotmail.com>
2020-05-06 21:46:33 +08:00
Snyk bot f6938682ed
fix: tests/milvus_python_test/requirements_no_pymilvus.txt to reduce vulnerabilities (#2223)
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-PYLINT-568073
2020-05-06 21:44:40 +08:00
Snyk bot 22dd03f8a1
fix: shards/requirements.txt to reduce vulnerabilities (#2222)
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-PYLINT-568073
2020-05-06 21:44:13 +08:00
Snyk bot fca51c3133
fix: tests/milvus_python_test/requirements_cluster.txt to reduce vulnerabilities (#2221)
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-PYLINT-568073
2020-05-06 21:43:40 +08:00
dyhyfu 882ed76cda
[skip ci] remove 'openblas-devel' (#2208)
Signed-of-by: yaohong<dyhyfu@126.com>
2020-05-06 21:39:14 +08:00
Cai Yudong f218217064
optimize similarity template (#2227)
* optimize similarity template

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-06 08:53:16 +00:00
groot ac8e9ff020
write error (#2184)
* write error

Signed-off-by: groot <yihua.mo@zilliz.com>

* out of storage

Signed-off-by: groot <yihua.mo@zilliz.com>

* clang format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix #1955

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* compact threashold

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* search by id for hnsw/pq/annoy

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-06 16:52:37 +08:00
BossZou 82ab21aec3
Http update endpoints (#2187)
* replace table with collection in http module

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add search_by_ids in http module

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add API

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add new API and unittest

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Update endpoint in http module(#2186); change vector id to string format(2185)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* allow filter when show partition

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* move constant variables defination to .cpp

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-05-06 14:07:35 +08:00
Snyk bot fc1e6a74be
fix: tests/milvus_python_test/requirements.txt to reduce vulnerabilities (#2224)
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-PYLINT-568073
2020-05-06 12:00:38 +08:00
jackyu2020 86510aa295
check the return value of fscanf (#2218)
Signed-off-by: e <ych05zh@163.com>
2020-05-03 01:49:57 +00:00
Cai Yudong ed2ee8873b
fix SingleIndexTest.IVFSQHybrid unittest (#2215)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-02 10:24:35 +00:00
XuPeng-SH adccd3dbf0
Merge pull request #2211 from XuPeng-SH/master
[skip ci]: fix #2210
2020-04-30 23:49:25 +08:00
peng.xu 7dfdcbb278
[skip ci](shards): print more server info for debug
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-04-30 23:43:45 +08:00
peng.xu 29a41ef645
[skip ci](shards): handle connection empty cases
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-04-30 23:43:42 +08:00
Wang XiangYu ff48427911
Log file rotating (#2207)
* log file rotating

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update changelog

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix compile failed

Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-04-30 23:31:14 +08:00
Cai Yudong 0032c13445
Error out when index SQ8H run in CPU mode (#2204)
* Error out when index SQ8H run in CPU mode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update cmake

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-30 15:22:29 +00:00
BossZou b458034ad5
Fix Fail to access WAL storage path (#2196) (#2198)
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-04-30 09:47:12 +00:00
zxf2017 14b3e95960
add head file to fix two build warnings (#2195)
* add head file to fix two build warnings

Signed-off-by: zxf <zhuxiaofeng07936@hellobike.com>

* fstream.h => fstream

Signed-off-by: zxf <zhuxiaofeng07936@hellobike.com>

Co-authored-by: zxf <zhuxiaofeng07936@hellobike.com>
2020-04-30 06:10:44 +00:00
Wang XiangYu be2feb1531
Log with request id (#2192)
* add function to get request id

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update log in GrpcRequestHandler

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update request id format

Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-04-30 13:39:55 +08:00
feisiyicl e77fd12286
Feisiyicl 2190 memory usage (#2191)
* rename MILVUS_ENABLE_PROFILING to ENABLE_CPU_PROFILING, and add ENABLE_MEM_PROFILING

Signed-off-by: feisiyicl <7764126@qq.com>

* optimize ReadOnlyArrayInvertedLists

Signed-off-by: feisiyicl <7764126@qq.com>

* update changelog

Signed-off-by: feisiyicl <7764126@qq.com>

* retry ci

Signed-off-by: feisiyicl <7764126@qq.com>

* fix build issue

Signed-off-by: feisiyicl <7764126@qq.com>
2020-04-30 02:03:54 +00:00
del-zhenwu 6283ee1bed
Remove connect (#2193)
* remove disconnect test case

Signed-off-by: zw <zw@zilliz.com>

* stable case

Signed-off-by: zw <zw@zilliz.com>

* re-trigger

Signed-off-by: zw <zw@zilliz.com>

* update cases

Signed-off-by: zw <zw@zilliz.com>
2020-04-30 01:36:24 +00:00
BossZou 2c889636ab
Check Storage permission (#2174)
* add class storage checker

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add cpu instruction sets check (#2055)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add more details for storage

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Check storage path permission (fix #2173)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Fix logs path access fail issue

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-04-29 17:23:32 +00:00
del-zhenwu 45b835cc15
remove disconnect test case (#2183)
* remove disconnect test case

Signed-off-by: zw <zw@zilliz.com>

* stable case

Signed-off-by: zw <zw@zilliz.com>

* re-trigger

Signed-off-by: zw <zw@zilliz.com>
2020-04-29 13:54:11 +00:00
feisiyicl 9b2368016c
#1946 fix load index file CPU2GPU fail during searching (#2182)
Signed-off-by: feisiyicl <7764126@qq.com>
2020-04-29 20:01:52 +08:00
shengjun.li a76e705a92
Using elkan K-Means to improve IVF (#2180)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-04-29 19:58:50 +08:00
feisiyicl b3aa06fce1
add config simd_type (#2179)
* add config simd_type

Signed-off-by: feisiyicl <7764126@qq.com>

* update changelog

Signed-off-by: feisiyicl <7764126@qq.com>
2020-04-29 17:46:36 +08:00
quicksilver e881ccbd30
Fix #2175 (#2177)
* Wait for helm uninstall chart

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Wait for helm uninstall chart

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-04-29 04:22:39 +00:00