0d4daa22e0
Update README
2021-04-21 14:04:22 +08:00
49058d5dfb
start 2.0
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-21 11:37:21 +08:00
1962b6e78b
Specifying distance type at runtime for Flat index ( #3273 )
...
* modfied IndexIDMAP.cpp && SearchTask.cpp
Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>
* Specifying distance type at runtime for Flat index(CPU)
Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>
* Specifying distance type at runtime for Flat index(GPU)
Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>
Co-authored-by: Zhengda Wu <wuzhengda55@gmail.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-17 17:05:59 +08:00
f59c240457
Update to 0.10.3
...
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-08-15 16:21:43 +08:00
f9f597b257
[v0.10.2] (mishards) Fix mishards search bug ( #3169 )
...
* [skip ci]Reverse query result if metric is IP
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* [skip ci] Update version check
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-08-07 19:33:49 +08:00
09cf1b323e
fix crash when GPU search ( #3074 )
...
* fix crash when GPU search
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-31 09:46:55 +08:00
b1b1165c56
Opt faiss builder ( #3067 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-31 09:35:31 +08:00
91d3fe5cbc
Improve IVF search performance when NQ and nProbe are both large ( #2984 )
...
* fix indexflat search
Signed-off-by: cqy <yaya645@126.com>
* add parallel_policy_threshold
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-24 15:56:47 +08:00
dd938878ea
fix ( #2981 )
...
Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
2020-07-23 17:02:28 +08:00
3908d10498
Fix the result merging of IVF_PQ IP ( #2953 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-22 10:08:05 +08:00
a88f5b6cbb
Fix index size ( #2941 )
...
* add virtual IF UpdateIndexSize
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* update ivf index size
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix PQ logic
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix index size of index hnsw, annoy and nsg
Signed-off-by: cmli <chengming.li@zilliz.com>
* add GetSize() interface 4 SPTAG
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix binary ivf
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-21 14:26:08 +08:00
1806e7e4b0
Update CHANGELOG.md
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-07-21 09:35:31 +08:00
7a594470cb
[skip ci] Upgrade mishards for milvus 0.10.1 ( #2933 )
...
Signed-off-by: yhz <413554850@qq.com>
2020-07-20 16:28:05 +08:00
8046f2946e
Hotfix 2487 ( #2892 )
...
* update.
Signed-off-by: Tinkerrr <linxiaojun.cn@outlook.com>
* update.
Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
* add fd check
Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
* fix
Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
2020-07-17 21:00:42 +08:00
a474ff269a
Server down during loading data ( #2807 )
...
* Server down during loading data
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix test_config.cpp
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* ci retry
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change limit_in_bytes init value to max
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-07-14 00:40:20 +08:00
585c8ea018
fix rnsg ip ( #2827 )
...
Signed-off-by: cqy <yaya645@126.com>
2020-07-13 14:05:28 +08:00
5447abec5b
fix #2768 ( #2809 )
...
* fix #2752
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix #2768
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo again
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-07-12 15:41:45 +08:00
d7c47a7905
fix #2752 ( #2789 )
...
* fix #2752
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-10 16:49:47 +08:00
4922c9532f
fix a bug of getting wrong nprobe limitation in knowhere on GPU version ( #2788 )
...
* fix a bug of getting wrong nprobe limitation in knowhere on GPU version
Signed-off-by: cmli <chengming.li@zilliz.com>
* update changelog and fix build error
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-09 23:15:07 +08:00
4038b0653e
fix too many data copies ( #2784 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-09 09:23:49 +08:00
8fcdf73bc8
fix 2739 ( #2746 )
...
Signed-off-by: Tinkerrr <linxiaojun.cn@outlook.com>
2020-07-07 14:45:37 +08:00
5bd75f9381
Web fix 2690 ( #2691 )
...
* Remove body parser in show partitions endpoints (fix #2690 )
Signed-off-by: yhz <413554850@qq.com>
* Remove surplus output and comments
Signed-off-by: yhz <413554850@qq.com>
* Remove surplus output and comments
Signed-off-by: yhz <413554850@qq.com>
* Remove space line
Signed-off-by: yhz <413554850@qq.com>
* Remove surplus ut
Signed-off-by: yhz <413554850@qq.com>
* laten sleep time in case test_delete_vector_collection_count_no_flush
Signed-off-by: yhz <413554850@qq.com>
2020-07-04 16:31:03 +08:00
367c72675c
#2692 Milvus hangs during multi-thread concurrent search ( #2715 )
...
* #2642 Create index failed caused by server crashed.
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* #2692 Milvus hangs during multi-thread concurrent search
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-02 19:03:24 +08:00
714b777d05
#2642 Create index failed caused by server crashed. ( #2701 )
...
* #2642 Create index failed caused by server crashed.
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-02 09:37:15 +08:00
3b38f7f198
#2649 Remove annoy search parameter validation ( #2650 )
...
* remove annoy search parameter validation
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix test failed
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix lint error
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix lint error again
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-06-23 23:41:04 +08:00
cd04f3fc9f
Suit the range of HNSW parameters ( #2638 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-06-22 16:42:15 +08:00
48e8cd36c2
Fix HNSW and RNSG index files size ( #2618 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-06-20 14:06:05 +08:00
6ce179b170
[skip ci] Enlarge timeout value for creating collection ( #2630 )
...
Signed-off-by: yhz <413554850@qq.com>
2020-06-19 19:46:25 +08:00
6ac3d2bd08
fix Milvus docker image report illegal instruction ( #2598 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-06-19 10:44:23 +08:00
290ff2e439
Support IVF_PQ on GPU with using metric_type IP ( #2593 )
...
* Support IVF_PQ on GPU with using metric_type IP
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* remove useless code
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-06-19 10:42:23 +08:00
bd7e0ee5c9
Update code due to 0.10.1
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-06-19 10:07:55 +08:00
5f3c005247
fix cache.cache_size range check error ( #2565 )
...
* fix cache.cache_size range check error
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update ci
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-06-15 22:44:58 +08:00
1f443acb3b
Mishards 010 upgrade & Add config unit in demo config ( #2550 )
...
* Update mishards config
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Update mishards config
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Upgrade mishards for milvus v0.10.0 (fix #2548 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Launch server fail using demo config (#2549 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* [skip ci] Remove surplus config yaml
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-06-13 19:45:31 +08:00
83cc812935
Upgrade config ( #2511 )
...
* enable cron test on 0.10.0
Signed-off-by: zw <zw@milvus.io>
* fix merge result
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* import test_during_creating_index_restart
Signed-off-by: zw <zw@milvus.io>
* config cluster
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config general
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config network
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config storage
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config wal
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config cache
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config gpu and metrics
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config logs
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update server_config.template
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update changelog
Signed-off-by: wxyu <xy.wang@zilliz.com>
* config with unit
Signed-off-by: wxyu <xy.wang@zilliz.com>
* fix clang-format
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update unittests
Signed-off-by: wxyu <xy.wang@zilliz.com>
* disable restart case
Signed-off-by: zw <zw@milvus.io>
* fix gpu compile failed
Signed-off-by: wxyu <xy.wang@zilliz.com>
* Fix lint and comments
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* fix wal unittest failed
Signed-off-by: wxyu <xy.wang@zilliz.com>
* fix some unittests
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update config test cases
Signed-off-by: zw <zw@milvus.io>
* Fix config error
Signed-off-by: yhz <413554850@qq.com>
* remove unused code
Signed-off-by: wxyu <xy.wang@zilliz.com>
* Update CHANGELOG
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* [skip-ci] fix test cases
Signed-off-by: zw <zw@milvus.io>
* fix config storage
Signed-off-by: wxyu <xy.wang@zilliz.com>
* make -j3 on ci
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update python test
Signed-off-by: wxyu <xy.wang@zilliz.com>
* remove unused code
Signed-off-by: wxyu <xy.wang@zilliz.com>
* fix ut
Signed-off-by: wxyu <xy.wang@zilliz.com>
* fix ut
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update status message
Signed-off-by: wxyu <xy.wang@zilliz.com>
* update
Signed-off-by: wxyu <xy.wang@zilliz.com>
* fix set config bug
Signed-off-by: wxyu <xy.wang@zilliz.com>
Co-authored-by: zw <zw@milvus.io>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: yhz <413554850@qq.com>
2020-06-12 09:22:26 +08:00
551be85d83
Improve ut coverage ( #2516 ) ( #2517 )
...
* Improve ut coverage (#2516 )
Signed-off-by: yhz <413554850@qq.com>
* Improve ut coverage
Signed-off-by: yhz <413554850@qq.com>
* CI retry
Signed-off-by: yhz <413554850@qq.com>
* Update helm config
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* CI retry
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* CI retry
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-06-11 01:25:55 +00:00
19a9d0d1f3
revert code ( #2525 )
...
* revert code
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-06-10 19:27:36 +08:00
34b4d72517
Add exception throw on mysql meta error ( #2490 )
...
* Add exception throw on mysql meta error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* [skip ci] update changelog
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix Unit test
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-06-08 21:16:22 +08:00
8254e9ed67
fix performance ( #2499 )
...
* optimize sq_get_distance_computer
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add sq_select_inverted_list_scanner_ref
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add sq_select_inverted_list_scanner_avx
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add sq_select_inverted_list_scanner_avx512
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize Codec
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize ScalarQuantizerCodec_avx.h
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize ScalarQuantizerCodec_avx512.h
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* clean code
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-06-06 07:41:57 +00:00
4b5eff3672
Fix 2495: Add more reason of creating lock file failed ( #2496 )
...
* Fix 2495: Add more reason of creating lock file failed
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix 2495: Update changelog
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix lint
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compile error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-06-05 01:58:17 +00:00
167743c993
read_only node detect delete vector operation using mishards #2368 ( #2473 )
...
* Add new request ReLoadSegments
Signed-off-by: yhz <413554850@qq.com>
* Finish load segments functionality
Signed-off-by: yhz <413554850@qq.com>
* Add api in grpc
Signed-off-by: yhz <413554850@qq.com>
* update Reloadsegments
Signed-off-by: yhz <413554850@qq.com>
* .
Signed-off-by: yhz <413554850@qq.com>
* create new blacklist if not exists
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update api names
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Finish mishard for support api reloadsegments
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update changlog
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Add more details when failed in search task
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Fix compile issue
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update mishards requirements
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Code format
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* modify docker images in mysql all_in_one
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update shards code
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Move updatedeldocs function to dbimpl
Signed-off-by: yhz <413554850@qq.com>
* Move reload segment del docs function to dbimpl
Signed-off-by: yhz <413554850@qq.com>
* [skip ci] correct shards requirements
Signed-off-by: yhz <413554850@qq.com>
2020-06-02 14:34:19 +08:00
0710ececae
#2373 Build index for small segment waste time on waiting background index thread finish ( #2482 )
...
* #2349 Drop collection timeout if too many partitions created on collection
Signed-off-by: groot <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* #2373 Build index for small segment waste time on waiting background index thread finish
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-06-01 10:16:37 +00:00
1daf00dcf7
#2394 Drop collection timeout if too many partitions created on colle… ( #2477 )
...
* #2349 Drop collection timeout if too many partitions created on collection
Signed-off-by: groot <yihua.mo@zilliz.com>
* changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-06-01 11:19:50 +08:00
9de7f710e6
optimize the implemention of k-selection on faiss gpu version ( #2467 )
...
* optimize the implemention of k-selection on faiss gpu version
Signed-off-by: cmli <chengming.li@zilliz.com>
* update change log, re-classified the pr from feature to improvement
Signed-off-by: cmli <chengming.li@zilliz.com>
* update change log
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-05-30 04:27:59 +00:00
ca6c645877
[skip ci] Update CHANGELOG
...
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-05-29 20:04:07 +08:00
27122acef1
Mishards 091 ( #2462 )
...
* Upgrade mishards for milvus 0.9.1 (#2461 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* [skip ci]add allowed server version 0.9.0
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-05-29 20:02:06 +08:00
cab9e5c2a6
fix bug of openblas library install fail ( #2457 )
...
* fix bug of openblas library install fail
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix openblas install cmakelist error
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-05-29 20:00:24 +08:00
0e25bab619
Fix inconsistent reading and writing when using mishards (# 2367) ( #2442 )
...
* Fix inconsistent reading and writing when using mishards (# 2367)
Signed-off-by: yhz <413554850@qq.com>
* CI retry
Signed-off-by: yhz <413554850@qq.com>
2020-05-29 13:32:49 +08:00
7c72dcf4d3
fix search by GPU ( #2453 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-05-28 15:39:16 +00:00
3d9cc6967b
[skip ci] Update CHANGELOG
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-28 10:47:49 +08:00
f4aeca2988
improve knowhere coverage ( #2444 )
...
* increase nb for NSG code coverage
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* test more APIs in test_annoy
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* disable get_vector_by_id and search_by_id
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* improve code coverage
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* improve code coverage
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* install test_instructionset
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-28 10:22:14 +08:00
zhenshan.cao
yefu.chen
MXDA
jinhai
BossZou
shengjun.li
cqy123456
Tinkerrr
yukun
groot
op-hunter
shengjun.li
Cai Yudong
Wang XiangYu