Commit Graph

5392 Commits (38de8c92beba3d04ddd8f3ba294be34d2281ef75)

Author SHA1 Message Date
del-zhenwu 69a088cc12 Tear down in test_collection_add_rows_count_multi_threading (#2356)
* Update test_collection_add_rows_count_multi_threading

Signed-off-by: zw <zw@zilliz.com>

* remove repeat

Signed-off-by: zw <zw@zilliz.com>
2020-05-15 20:55:16 +08:00
Cai Yudong c902b0fdb5 Caiyd 090 rename config (#2340)
* rename config items

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update config unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update config unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update log rotate default value

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update parameter usage in LogUtil.cpp (#3)

Signed-off-by: wxyu <xy.wang@zilliz.com>

* retry ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix ut

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: Wang XiangYu <scsven@qq.com>
2020-05-15 20:54:34 +08:00
BossZou f6c03f47dc [skip ci] Update http document for v0.9.0 (#2347) (#2348)
Signed-off-by: yhz <413554850@qq.com>
2020-05-15 20:52:49 +08:00
del-zhenwu db5ef00cca add close cases (#2339)
* add close cases

Signed-off-by: zw <zw@milvus.io>

* fix case bug

Signed-off-by: zw <zw@milvus.io>

* reset case level

Signed-off-by: zw <zw@milvus.io>

* reset case level

Signed-off-by: zw <zw@milvus.io>

* fix case

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-05-15 20:52:35 +08:00
BossZou 3561014f5b Change url for behavior 'get_entities_by_id' (#2330) (#2336)
Signed-off-by: yhz <413554850@qq.com>
2020-05-15 20:52:15 +08:00
groot d5f7526cd5 #2338 (#2345)
* fix #2264

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* Remove unnecessary memcpy

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* remove SearchByID from C++SDK

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #2338

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-15 20:51:49 +08:00
groot 7f87248611 remove SearchByID (#2341)
* fix #2264

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* Remove unnecessary memcpy

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* remove SearchByID from C++SDK

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-15 20:51:38 +08:00
groot 299cd9cd94 Remove unnecessary memcpy (#2337)
* fix #2264

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* Remove unnecessary memcpy

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-15 20:51:24 +08:00
del-zhenwu 35ca72d6c8 fix ci helm params (#2333)
* fix ci helm params

* update cron
2020-05-15 20:50:53 +08:00
del-zhenwu 7eefda0586 [skip ci] update nightly cron (#2324)
* [skip ci] update nightly cron

Signed-off-by: zw <zw@milvus.io>

* update cron

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-05-15 20:47:58 +08:00
del-zhenwu c4e5846f01 Rename methods (#2312)
* rename interfaces in cases

Signed-off-by: zw <zw@zilliz.com>

* rename search_by_id

Signed-off-by: zw <zw@zilliz.com>

* remove test search_by_id

Signed-off-by: zw <zw@zilliz.com>

* [skip ci] Update CHANGELOG

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* rename methods

Signed-off-by: zw <zw@zilliz.com>

* rename methods

Signed-off-by: zw <zw@milvus.io>

* fix rename issue

Signed-off-by: zw <zw@zilliz.com>

* update hnsw default index param

Signed-off-by: zw <zw@zilliz.com>

* Update CHANGELOG.md

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: zw <zw@milvus.io>
2020-05-15 20:44:43 +08:00
BossZou 71145f73b3 [skip ci] Mishards 0.9.0 update (#2317)
* Update docker images and sdk invoke for preparing version 0.9.0 (#2311)

Signed-off-by: yhz <413554850@qq.com>

* [skip ci]Update mishards methods

Signed-off-by: yhz <413554850@qq.com>
2020-05-15 20:43:50 +08:00
Cai Yudong b2967574ef
enable config unittest (#2329)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-14 10:12:19 +08:00
quicksilver 1a6592f115
Improve efficiency in Docker build stage (#2334)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-05-13 22:26:11 +08:00
groot 5e777450b3 fix #2264 (#2323)
* fix #2264

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-13 21:01:50 +08:00
Cai Yudong 5293607359
Caiyd support disable sptag (#2308)
* remove KNOWHERE_GPU_VERSION

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add MILVUS_SUPPORT_SPTAG

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix SPTAG build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-13 16:52:48 +08:00
XuPeng-SH 03c106cd91
[skip ci]: add Snapshot design doc link (#2320)
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-05-12 23:33:09 +08:00
JinHai-CN fc75f6a07a [skip ci] Update CHANGELOG
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-12 11:39:06 +08:00
JinHai-CN 0d2f1f0508 [skip ci] Update CHANGELOG
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-12 11:36:43 +08:00
BossZou 1b7aeaffdf
Fix server start failed when mode is 'read_only' (#2294)
* fix deploy bug

Signed-off-by: yhz <413554850@qq.com>

* fix unittest fail

Signed-off-by: yhz <413554850@qq.com>

* remove unused yml

Signed-off-by: yhz <413554850@qq.com>

* change to readonly

Signed-off-by: yhz <413554850@qq.com>
2020-05-12 09:28:10 +08:00
groot fb49e580c5
rewrite HasPartition (#2289)
* rewrite HasPartition

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* miss file

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* use layered merge

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* sdk HasPartition

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* rename sdk api

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-12 09:27:58 +08:00
shengjun.li bc74d16376
#2283 Suspend the building tasks when any query command arrives (#2285)
* add builder suspend

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* IndexIVF builder check wait

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Build suspend for all IVF

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* HNSW suspend

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* HNSW suspend

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* HNSW suspend

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* HNSW suspend

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* HNSW suspend

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* cpubuilder

Signed-off-by: wxyu <xy.wang@zilliz.com>

* add suspend check during annoy build index

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix hnsw

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix changelog

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix clang format

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* suspend nsg

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: wxyu <xy.wang@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-12 09:27:45 +08:00
del-zhenwu 253cda3a93
Remove search_by_id in tests (#2302)
* rename interfaces in cases

Signed-off-by: zw <zw@zilliz.com>

* rename search_by_id

Signed-off-by: zw <zw@zilliz.com>

* remove test search_by_id

Signed-off-by: zw <zw@zilliz.com>
2020-05-11 23:24:56 +08:00
op-hunter b6e16af8f8
update unittest config version (#2299)
Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
2020-05-11 22:00:21 +08:00
del-zhenwu 69eeb4dfc0
rename interfaces in cases (#2298)
Signed-off-by: zw <zw@zilliz.com>
2020-05-11 21:13:06 +08:00
BossZou 15a603fa46
[skip ci] Upgrade mishrads configuration to version 0.4 (#2301)
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-05-11 21:03:17 +08:00
groot 0ee3c633ac
Merge pull request #2284 from del-zhenwu/java_case
Update server-version in cases && update java cases
2020-05-11 03:57:55 -05:00
zw 6ff1197c4f update version && disable http async
Signed-off-by: zw <zw@milvus.io>
2020-05-11 13:56:08 +08:00
zw e5b193a0d4 update server_version && update cases
Signed-off-by: zw <zw@milvus.io>
2020-05-11 10:00:18 +08:00
zw 1beaef5346 update java case
Signed-off-by: zw <zw@milvus.io>
2020-05-11 09:48:09 +08:00
zw 0acc0b9815 add java case
Signed-off-by: zw <zw@milvus.io>
2020-05-11 09:46:49 +08:00
groot f32cba6111
Merge strategy (#2277)
* merge manager

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix build error

Signed-off-by: groot <yihua.mo@zilliz.com>

* layered merge strategy

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* use simple

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix parallel multi collections query crashissue

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-05-11 01:38:50 +00:00
Wang XiangYu 369743c10d
Config upgrade (#2281)
* upgrade config to 0.4

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update milvus version in cmakelists.txt

Signed-off-by: wxyu <xy.wang@zilliz.com>

* disable make VERBOSE

Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-05-10 22:55:46 +08:00
BossZou 8d732656a7
Fix show partitions failed in http module (fix #2228) (#2234)
* Fix show partitions failed in http module (fix #2228)

Signed-off-by: yhz <413554850@qq.com>

* catch json string convert error

Signed-off-by: yhz <413554850@qq.com>
2020-05-10 12:49:26 +00:00
Cai Yudong e63904867b
update debug log (#2275)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-10 00:19:33 +08:00
op-hunter a37f9b0764
Openblas macro (#2269)
* save local work 4 add openblas macro to chose compile openblas lib or not

Signed-off-by: cmli <chengming.li@zilliz.com>

* compile openblas by auto detect

Signed-off-by: cmli <chengming.li@zilliz.com>

* Update build environment docker images

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* update changelog

Signed-off-by: cmli <chengming.li@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* set OpenBLAS_SOURCE auto in build.sh

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-05-09 22:47:03 +08:00
quicksilver ca484bbede
Deploy retry (#2276)
* Wait for helm uninstall chart

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Wait for helm uninstall chart

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-05-09 19:54:44 +08:00
groot aeb9edf5c6
#2261 (#2270)
* has collection bug

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #2261

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix typo

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-05-09 18:32:20 +08:00
Wang XiangYu 2c04cc0afe
upgrade config to 0.4 (#2273)
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-05-09 18:28:03 +08:00
del-zhenwu 7f744c036b
[skip ci] Filter id:-1 (#2274)
* add async

Signed-off-by: zw <zw@zilliz.com>

* Update case

Signed-off-by: zw <zw@zilliz.com>

* Update some cases

Signed-off-by: zw <zw@zilliz.com>

* add has_partition case

Signed-off-by: zw <zw@zilliz.com>

* add search_by_id case: ids duplicate

Signed-off-by: zw <zw@zilliz.com>

* add async add

Signed-off-by: zw <zw@zilliz.com>

* add flush case

Signed-off-by: zw <zw@zilliz.com>

* update case

Signed-off-by: zw <zw@zilliz.com>

* fix search by id case

Signed-off-by: zw <zw@zilliz.com>

* update case

Signed-off-by: zw <zw@zilliz.com>

* filter id:-1

Signed-off-by: zw <zw@zilliz.com>

* pq distance

Signed-off-by: zw <zw@zilliz.com>

* [skip ci] skip ci

Signed-off-by: zw <zw@zilliz.com>
2020-05-09 16:50:17 +08:00
quicksilver d49b609a14
Update build environment version to v0.9.0 (#2267)
* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update build environment dockerfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* disable following sourced files

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-05-09 04:17:45 +00:00
yukun 3852d4ca71
0.8.0 id=-1 is returned when total count < topk (#2263)
* 0.8.0 id=-1 is returned when total count < topk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix for comments

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-05-09 10:03:41 +08:00
Cai Yudong cf6be092ab
code clean (#2265)
* use macro STATUS_CHECK

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* comment S3 related config APIs

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-09 01:51:04 +00:00
shengjun.li 4cea320943
k-means L2 (#2258)
* k-means L2

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix change log

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-05-08 14:03:50 +00:00
groot cf68c9918e
#1925 (#2257)
* write error

Signed-off-by: groot <yihua.mo@zilliz.com>

* out of storage

Signed-off-by: groot <yihua.mo@zilliz.com>

* clang format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix #1955

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* compact threashold

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* search by id for hnsw/pq/annoy

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* file cleanup timeout config

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #1925\

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-08 11:40:41 +00:00
BossZou 1811254de6
Obtain running rpc requests information (#2240) (#2241)
* add cmd to get requests

Signed-off-by: yhz <413554850@qq.com>

* forward class declaration

Signed-off-by: yhz <413554850@qq.com>

* Obtain running rpc requests information (fix #2240)

Signed-off-by: yhz <413554850@qq.com>

* Fix unittest compile failed issue

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Log error with msg

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-05-08 11:17:48 +00:00
BossZou 1016dbae1a
[skip ci] update shards requirements (#2262)
Signed-off-by: yhz <413554850@qq.com>
2020-05-08 19:14:33 +08:00
caosiyang 7b0998885c
Fix #2248: use hostname and port as instance label of metrics (#2249)
Signed-off-by: caosiyang <csy3228@gmail.com>
2020-05-08 19:08:04 +08:00
Wang XiangYu 104cda1a76
print warning on stdout (#2243)
* print warning on stdout

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix compile failed

Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-05-08 08:57:08 +00:00
BossZou 8a68d34919
Mishards upgrade (#2260)
* shards ci

Signed-off-by: yhz <413554850@qq.com>

* update interface

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update mishards

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update changlog

Signed-off-by: yhz <413554850@qq.com>

* [skip ci] mishards dev test pass (fix #2252)

Signed-off-by: yhz <413554850@qq.com>
2020-05-08 16:40:30 +08:00