19a9d0d1f3
revert code ( #2525 )
...
* revert code
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-06-10 19:27:36 +08:00
7092c85ba6
[skip ci] disable restart case. ( #2515 )
...
* enable cron test on 0.10.0
Signed-off-by: zw <zw@milvus.io>
* fix merge result
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* import test_during_creating_index_restart
Signed-off-by: zw <zw@milvus.io>
* disable restart case
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-06-09 15:08:12 +00:00
34b4d72517
Add exception throw on mysql meta error ( #2490 )
...
* Add exception throw on mysql meta error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* [skip ci] update changelog
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix Unit test
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-06-08 21:16:22 +08:00
a6a9021974
Add http ( #2505 )
...
* enable cron test on 0.10.0
Signed-off-by: zw <zw@milvus.io>
* fix merge result
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* import test_during_creating_index_restart
Signed-off-by: zw <zw@milvus.io>
* add http test stage
Signed-off-by: zw <zw@milvus.io>
* remove
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-06-08 11:36:55 +00:00
bd0049ff14
return hnsw name ( #2501 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-06-07 12:03:01 +00:00
8254e9ed67
fix performance ( #2499 )
...
* optimize sq_get_distance_computer
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add sq_select_inverted_list_scanner_ref
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add sq_select_inverted_list_scanner_avx
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add sq_select_inverted_list_scanner_avx512
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize Codec
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize ScalarQuantizerCodec_avx.h
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize ScalarQuantizerCodec_avx512.h
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* clean code
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-06-06 07:41:57 +00:00
9f7995cbba
default nlist 2048 ( #2498 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-06-06 05:03:06 +00:00
4b5eff3672
Fix 2495: Add more reason of creating lock file failed ( #2496 )
...
* Fix 2495: Add more reason of creating lock file failed
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix 2495: Update changelog
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix lint
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compile error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-06-05 01:58:17 +00:00
167743c993
read_only node detect delete vector operation using mishards #2368 ( #2473 )
...
* Add new request ReLoadSegments
Signed-off-by: yhz <413554850@qq.com>
* Finish load segments functionality
Signed-off-by: yhz <413554850@qq.com>
* Add api in grpc
Signed-off-by: yhz <413554850@qq.com>
* update Reloadsegments
Signed-off-by: yhz <413554850@qq.com>
* .
Signed-off-by: yhz <413554850@qq.com>
* create new blacklist if not exists
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update api names
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Finish mishard for support api reloadsegments
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update changlog
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Add more details when failed in search task
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Fix compile issue
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update mishards requirements
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Code format
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* modify docker images in mysql all_in_one
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update shards code
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Move updatedeldocs function to dbimpl
Signed-off-by: yhz <413554850@qq.com>
* Move reload segment del docs function to dbimpl
Signed-off-by: yhz <413554850@qq.com>
* [skip ci] correct shards requirements
Signed-off-by: yhz <413554850@qq.com>
2020-06-02 14:34:19 +08:00
5ed7f40a49
Update helm charts dependencies ( #2481 )
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-06-02 10:17:51 +08:00
0710ececae
#2373 Build index for small segment waste time on waiting background index thread finish ( #2482 )
...
* #2349 Drop collection timeout if too many partitions created on collection
Signed-off-by: groot <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* #2373 Build index for small segment waste time on waiting background index thread finish
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-06-01 10:16:37 +00:00
257ea7782f
fix merge result ( #2463 )
...
* fix merge result
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix tests
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-06-01 07:31:58 +00:00
1daf00dcf7
#2394 Drop collection timeout if too many partitions created on colle… ( #2477 )
...
* #2349 Drop collection timeout if too many partitions created on collection
Signed-off-by: groot <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-06-01 11:19:50 +08:00
fdfb6526e0
fix test_during_creating_index_restart ( #2474 )
...
* enable cron test on 0.10.0
Signed-off-by: zw <zw@milvus.io>
* import test_during_creating_index_restart
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
2020-05-30 09:03:28 +00:00
9de7f710e6
optimize the implemention of k-selection on faiss gpu version ( #2467 )
...
* optimize the implemention of k-selection on faiss gpu version
Signed-off-by: cmli <chengming.li@zilliz.com>
* update change log, re-classified the pr from feature to improvement
Signed-off-by: cmli <chengming.li@zilliz.com>
* update change log
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-05-30 04:27:59 +00:00
b5498cc672
enable cron test on 0.10.0 ( #2469 )
...
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
2020-05-29 20:22:03 +08:00
ca6c645877
[skip ci] Update CHANGELOG
...
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-05-29 20:04:07 +08:00
27122acef1
Mishards 091 ( #2462 )
...
* Upgrade mishards for milvus 0.9.1 (#2461 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* [skip ci]add allowed server version 0.9.0
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-05-29 20:02:06 +08:00
ae98a92fc9
merge before index
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-05-29 20:00:57 +08:00
cab9e5c2a6
fix bug of openblas library install fail ( #2457 )
...
* fix bug of openblas library install fail
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix openblas install cmakelist error
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-05-29 20:00:24 +08:00
15b0867fef
Add cases ( #2451 )
...
* update shards deploy method
Signed-off-by: zw <zw@milvus.io>
* update run level
Signed-off-by: zw <zw@milvus.io>
* try connect set false
Signed-off-by: zw <zw@milvus.io>
* update shards deploy branch
Signed-off-by: zw <zw@milvus.io>
* add compact case
Signed-off-by: zw <zw@milvus.io>
* add #2424 case
Signed-off-by: zw <zw@milvus.io>
* add proxy
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
2020-05-29 20:00:09 +08:00
eefc152290
try connect set false ( #2443 )
...
* update shards deploy method
Signed-off-by: zw <zw@milvus.io>
* update run level
Signed-off-by: zw <zw@milvus.io>
* try connect set false
Signed-off-by: zw <zw@milvus.io>
* update shards deploy branch
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
2020-05-29 19:59:53 +08:00
d3eecfd8b5
update shards deploy method on 0.9.1 ( #2430 )
...
* update shards deploy method
Signed-off-by: zw <zw@milvus.io>
* update run level
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
2020-05-29 19:59:16 +08:00
0e25bab619
Fix inconsistent reading and writing when using mishards (# 2367) ( #2442 )
...
* Fix inconsistent reading and writing when using mishards (# 2367)
Signed-off-by: yhz <413554850@qq.com>
* CI retry
Signed-off-by: yhz <413554850@qq.com>
2020-05-29 13:32:49 +08:00
7c72dcf4d3
fix search by GPU ( #2453 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-05-28 15:39:16 +00:00
3d9cc6967b
[skip ci] Update CHANGELOG
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-28 10:47:49 +08:00
f4aeca2988
improve knowhere coverage ( #2444 )
...
* increase nb for NSG code coverage
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* test more APIs in test_annoy
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* disable get_vector_by_id and search_by_id
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* improve code coverage
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* improve code coverage
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* install test_instructionset
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-28 10:22:14 +08:00
dcb60f3021
performance issues ( #2438 )
...
* performance issues
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix bugs
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* preload collection issue
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* uncomment boring log
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* reduce unittest time
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* reduce metric test time cost
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-28 00:19:08 +08:00
4dc0098560
[skip ci] Update working flow
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-27 17:56:21 +08:00
ce4dcf69ae
add debug APIs and update GPU temp memory size ( #2420 )
...
* add debug APIs and update GPU temp memory size
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update thread name
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update DESIGN.md
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry ci
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-26 14:39:44 +08:00
2f94eb655e
update ci cron on 0.10.0 ( #2428 )
...
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
2020-05-25 18:32:57 +08:00
2d9b358e16
optimize merge process ( #2419 )
...
* optimize merge process
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo
Signed-off-by: groot <yihua.mo@zilliz.com>
* refine code
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* drop collecion issue
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-25 14:19:25 +08:00
2982004e2b
midify Binary IVF in faiss 1.6.3 ( #2416 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-05-23 11:01:54 +00:00
6809150b1d
#2395 Fix large nq cudaMalloc ( #2409 )
...
* fix large nq cuda malloc issue
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix clang format
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Change log
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-05-23 08:23:05 +00:00
077dfa4092
Wal lsn issue ( #2412 )
...
* set wal lsn after all mem files serialized
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo
Signed-off-by: groot <yihua.mo@zilliz.com>
* return status
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-05-23 06:51:18 +00:00
4ce3e2c03c
#2366 Reduce SQL execution times ( #2383 )
...
* #2366
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix ut
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix python test
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix ut
Signed-off-by: groot <yihua.mo@zilliz.com>
* changelog
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-05-23 11:13:09 +08:00
4f6fe96550
mysql meta connection pool issue ( #2413 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-05-23 01:26:15 +00:00
e40f0b3939
logging build index progress ( #2411 )
...
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-05-22 13:10:24 +00:00
344ae823b2
#2353 remove log_config ( #2406 )
...
* remove log_config from code and script
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update script
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-22 10:57:16 +00:00
2c2e1bb8f1
#2403 MySQL max_idle_time is 10 by default ( #2405 )
...
* #2403 MySQL max_idle_time is 10 by default
Signed-off-by: jinhai <hai.jin@zilliz.com>
* #2403 MySQL max_idle_time is 10 by default
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-05-22 14:35:11 +08:00
34fdc00d19
fix MatchNlist ( #2401 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-05-22 06:20:26 +00:00
386e58ce0d
upgrade faiss 1.6.3 ( #2400 )
...
* roll back to original faiss 1.6.0
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update to faiss_1.6.3
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* patch all change to faiss 1.6.3
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* faiss CPU version build pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* faiss GPU version build pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-22 01:27:16 +00:00
5dcd68bb73
Add go test && fix case bug ( #2396 )
...
* test level 3: restart
Signed-off-by: zw <zw@milvus.io>
* add namepsace
Signed-off-by: zw <zw@milvus.io>
* update
Signed-off-by: zw <zw@milvus.io>
* update
Signed-off-by: zw <zw@milvus.io>
* Update utils.py
Signed-off-by: zw <zw@milvus.io>
* Update test_level_3.py
Signed-off-by: zw <zw@milvus.io>
* Update Jenkinsfile
Signed-off-by: zw <zw@milvus.io>
* debug
Signed-off-by: zw <zw@milvus.io>
* debug
Signed-off-by: zw <zw@milvus.io>
* debug
Signed-off-by: zw <zw@milvus.io>
* debug
Signed-off-by: zw <zw@milvus.io>
* clean compile warning (#2380 )
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: zw <zw@milvus.io>
* delete pod
Signed-off-by: zw <zw@milvus.io>
* update
Signed-off-by: zw <zw@milvus.io>
* debug
Signed-off-by: zw <zw@milvus.io>
* debug
Signed-off-by: zw <zw@milvus.io>
* recover
Signed-off-by: zw <zw@milvus.io>
* add go test
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-05-21 09:58:29 +00:00
4c9684366c
#2378 ( #2388 )
...
* return partition lsn
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix wal lsn
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix wal issue
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* all collection include partition
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix build error
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix flush
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-05-21 02:13:46 +00:00
40055fcaf0
test level 3: restart ( #2384 )
...
* test level 3: restart
Signed-off-by: zw <zw@milvus.io>
* add namepsace
Signed-off-by: zw <zw@milvus.io>
* update
Signed-off-by: zw <zw@milvus.io>
* update
Signed-off-by: zw <zw@milvus.io>
* Update utils.py
Signed-off-by: zw <zw@milvus.io>
* Update test_level_3.py
Signed-off-by: zw <zw@milvus.io>
* Update Jenkinsfile
Signed-off-by: zw <zw@milvus.io>
* debug
Signed-off-by: zw <zw@milvus.io>
* debug
Signed-off-by: zw <zw@milvus.io>
* debug
Signed-off-by: zw <zw@milvus.io>
* debug
Signed-off-by: zw <zw@milvus.io>
* clean compile warning (#2380 )
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: zw <zw@milvus.io>
* delete pod
Signed-off-by: zw <zw@milvus.io>
* update
Signed-off-by: zw <zw@milvus.io>
* debug
Signed-off-by: zw <zw@milvus.io>
* debug
Signed-off-by: zw <zw@milvus.io>
* recover
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-05-20 18:51:50 +08:00
b532a69c8b
clean compile warning ( #2380 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-19 17:58:23 +00:00
b616dcb761
Update branch
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-19 11:27:57 +08:00
014a0e860c
QPS decrease ( #2372 )
...
* optimize merge strategy
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* #2365
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix typo
Signed-off-by: groot <yihua.mo@zilliz.com>
* optimize search
Signed-off-by: groot <yihua.mo@zilliz.com>
* code format
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-05-19 11:21:53 +08:00
b9e8acb5b2
#2370 clean compile warning ( #2371 )
...
* #2370 clean compile warning
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-18 02:35:14 +00:00
42f751047e
update branch version to 0.9.1 ( #2364 )
...
* update branch version to 0.9.1
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry ci
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry ci
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update test version
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-17 04:36:42 +00:00
groot
del-zhenwu
Jin Hai
Cai Yudong
BossZou
quicksilver
shengjun.li
op-hunter
groot
Xiaohai Xu
Wang XiangYu