milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,503 Commits
160 Branches
132 Tags
551 MiB
Commit Graph

5503 Commits (v0.10.3)

Author SHA1 Message Date
BossZou 50d5b9f179
[skip ci] Upgrade mishards up to v0.10.3 (#3785) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-09-17 19:35:03 +08:00
shengjun.li f962e84822
[skip ci] modify the change log (#3761) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-16 10:32:35 +08:00
op-hunter 7a2d847743
raise the limitation of hnsw ef parameter to 32768 (#3738) 
* raise hnsw ef parameter to 32768

Signed-off-by: cmli <chengming.li@zilliz.com>
 2020-09-16 09:20:56 +08:00
shengjun.li 18695db507
If the GPU cache is too small, IVF_SQ8H using multiple GPUs will cause to crash (#3744) 
* fix ivf_sq8h

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix cache release

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-15 20:21:10 +08:00
BossZou 2737c3fbdd
[skip ci] Remove check for topk in mishards (fix #3709) (#3710) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-09-12 22:27:41 +08:00
shengjun.li 0af3804974
fix large param (#3684) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-10 19:32:51 +08:00
cqy123456 dad5806b61
Making the IVFSQ8H support auto-tune CPU search when nprobe > 2048 (#3677) 
* ivfsq8h

Signed-off-by: cqy <yaya645@126.com>

* fix gtest

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-10 14:14:34 +08:00
shengjun.li 384b09e993
fix stucked tasiks (#3666) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-10 09:14:03 +08:00
cqy123456 49a5cdf682
When the topk of GPU search larger than 2048,turning into the CPU search (#3647) 
* topk of GPU searching

Signed-off-by: cqy <yaya645@126.com>

* change the changelog

Signed-off-by: cqy <yaya645@126.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-09 13:32:10 +08:00
shengjun.li 74639a3ba7
fix to check search param of BIN_IVF_FLAT (#3660) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-09 09:14:40 +08:00
cqy123456 8a52fc70d9
selector code refactoring (#3617) 
* selector code refactoring

Signed-off-by: cqy <yaya645@126.com>

* modify test

Signed-off-by: cqy <yaya645@126.com>
 2020-09-08 13:58:50 +08:00
shengjun.li 18c630a4be
release search task in time (#3609) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-05 11:36:55 +08:00
cqy123456 d5ecdf2dda
GPU search turn into CPU search when nprobe >2048 (#3594) 
* gpu nprobe

Signed-off-by: cqy <yaya645@126.com>

* [skip ci] changelog

Signed-off-by: cqy <yaya645@126.com>
 2020-09-04 18:49:52 +08:00
del-zhenwu a9751fec4f
add test case: flat search with metric_type (#3558) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-09-03 11:30:17 +08:00
shengjun.li 273863f54d
fix users' metric type (#3568) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-03 10:21:26 +08:00
shengjun.li 5787a2af4d
[skip ci]add license (#3553) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-09-02 16:02:09 +08:00
flynn c2ba9be249
add NGT index (#3525) 
Signed-off-by: fenglv <fenglv15@mails.ucas.ac.cn>

add LISENCE

Signed-off-by: fenglv <fenglv15@mails.ucas.ac.cn>

format code style

Signed-off-by: fenglv <fenglv15@mails.ucas.ac.cn>
 2020-09-02 10:21:59 +08:00
cqy123456 a75c0a572c
Allow more choices for the parameter ‘m’ of CPU IVF_PQ (#3469) 
* fix the IVFPQ fixed M problem

Signed-off-by: cqy <yaya645@126.com>

* fix compile

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-08-27 11:37:25 +08:00
del-zhenwu 5897f4fa33
[skip ci] update shards install cmd (#3470) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-08-26 16:56:55 +08:00
shengjun.li 83cbe0f490
fix hamming (#3338) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-08-20 09:42:04 +08:00
MXDA 1962b6e78b
Specifying distance type at runtime for Flat index (#3273) 
* modfied IndexIDMAP.cpp && SearchTask.cpp

Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>

* Specifying distance type at runtime for Flat index(CPU)

Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>

* Specifying distance type at runtime for Flat index(GPU)

Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>

Co-authored-by: Zhengda Wu <wuzhengda55@gmail.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-08-17 17:05:59 +08:00
shengjun.li 5f830293f9
rm find faiss (#3269) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-08-15 19:18:03 +08:00
jinhai f59c240457 Update to 0.10.3 
Signed-off-by: jinhai <hai.jin@zilliz.com>
 2020-08-15 16:21:43 +08:00
BossZou cd689fd703
[skip ci] Upgrade mishards for milvus v0.10.2 (#3267) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-08-15 14:32:07 +08:00
BossZou 8a239355e3
[skip ci] Fix mishards query result reduce error (#3256) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-08-14 15:37:01 +08:00
shengjun.li 43c272fd13
fix annoy l2 (#3232) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-08-12 19:11:13 +08:00
BossZou f9f597b257
[v0.10.2] (mishards) Fix mishards search bug (#3169) 
* [skip ci]Reverse query result if metric is IP

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* [skip ci] Update version check

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-08-07 19:33:49 +08:00
Xiaohai Xu 058cdf03bb
Add ivf index nprobe logging (#3070) 
* add nprobe logging

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* add all cases

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-08-01 09:46:53 +08:00
shengjun.li 09cf1b323e
fix crash when GPU search (#3074) 
* fix crash when GPU search

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-31 09:46:55 +08:00
shengjun.li b1b1165c56
Opt faiss builder (#3067) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-31 09:35:31 +08:00
del-zhenwu 68b9a033a2
[skip ci] disable ping case when using http handler (#3064) 
* Update version in cases

Signed-off-by: zw <zw@milvus.io>

* update sdk in cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] disable ping case when using http handler

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-07-30 15:17:01 +08:00
del-zhenwu 845cf5000a
update sdk version on 0.10.2 (#3025) 
* Update version in cases

Signed-off-by: zw <zw@milvus.io>

* update sdk in cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-07-27 18:55:03 +08:00
shengjun.li 1c36e6d83d
optimizer parallel policy (#3014) 
* optimizer parallel policy

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* modify parallel policy

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-26 01:37:23 +08:00
del-zhenwu 7457438ba5
Update version in cases (#3007) 
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-07-25 14:47:52 +08:00
BossZou c394608d4f
[skip ci] Up to v0.10.2 (#3006) 
Signed-off-by: yhz <413554850@qq.com>
 2020-07-25 10:02:09 +08:00
cqy123456 91d3fe5cbc
Improve IVF search performance when NQ and nProbe are both large (#2984) 
* fix indexflat  search

Signed-off-by: cqy <yaya645@126.com>

* add parallel_policy_threshold

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-24 15:56:47 +08:00
Tinkerrr dd938878ea
fix (#2981) 
Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
 2020-07-23 17:02:28 +08:00
del-zhenwu c1e00357f4
[skip ci] add cron (#2968) 
* [skip ci] add cron

Signed-off-by: zw <zw@milvus.io>
 2020-07-22 16:33:49 +08:00
shengjun.li 3908d10498
Fix the result merging of IVF_PQ IP (#2953) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-22 10:08:05 +08:00
shengjun.li a88f5b6cbb
Fix index size (#2941) 
* add virtual IF UpdateIndexSize

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* update ivf index size

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix PQ logic

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix index size of index hnsw, annoy and nsg

Signed-off-by: cmli <chengming.li@zilliz.com>

* add GetSize() interface 4 SPTAG

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix binary ivf

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
 2020-07-21 14:26:08 +08:00
JinHai-CN 1806e7e4b0 Update CHANGELOG.md 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-07-21 09:35:31 +08:00
BossZou 7a594470cb
[skip ci] Upgrade mishards for milvus 0.10.1 (#2933) 
Signed-off-by: yhz <413554850@qq.com>
 2020-07-20 16:28:05 +08:00
ThreadDao bd02b19a71
add case nprobe>2048 (#2906) 2020-07-18 19:31:28 +08:00
groot f31a81ab16
add error log for empty result (#2923) 
* add error log for empty result

Signed-off-by: groot <yihua.mo@zilliz.com>

* add error log for empty result

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-07-18 19:30:29 +08:00
del-zhenwu 23683f8477
[skip ci] Update cases for the resources changed (#2907) 
* update cron on 0.10.1

Signed-off-by: zw <zw@milvus.io>

* enable ivf_pq <ip> search cases on GPU

Signed-off-by: zw <zw@milvus.io>

* [skip ci] debug

Signed-off-by: zw <zw@milvus.io>

* [skip ci] add artifacts

Signed-off-by: zw <zw@milvus.io>

* update shards ci && enable pq case

Signed-off-by: zw <zw@milvus.io>

* update assertion for pq

Signed-off-by: zw <zw@milvus.io>

* disable rnsg: issue #2813

Signed-off-by: zw <zw@milvus.io>

* add binary version in log file name

Signed-off-by: zw <zw@milvus.io>

* enable rnsg case

Signed-off-by: zw <zw@milvus.io>

* [skip ci] Update config cases for the resources changed

Signed-off-by: zw <zw@milvus.io>

* [skip ci] Fix limit

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-07-18 11:22:36 +08:00
godchen0212 c083556189
add web_impl util unittest (#2886) 
* add testcase of empty vector insert

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format python code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* add web_impl util unittest

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-07-18 10:38:46 +08:00
quicksilver 9efddeee15
Set MySQL host ip to 127.0.0.1 in jenkins unittest step (#2905) 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-07-18 10:21:04 +08:00
Tinkerrr 8046f2946e
Hotfix 2487 (#2892) 
* update.

Signed-off-by: Tinkerrr <linxiaojun.cn@outlook.com>

* update.

Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>

* add fd check

Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>

* fix

Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
 2020-07-17 21:00:42 +08:00
Wang XiangYu 283e087a78
add config value gpu.cache.enable (#2899) 
* add config value gpu.cache.enable

Signed-off-by: wxyu <xy.wang@zilliz.com>

* clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>

* clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix ut

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-07-17 20:59:31 +08:00
XuanYang-cn 8135cee414
Add some cpp unittests about scheduler algorithm (#2888) 
* add some testcases

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* reformat code

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
 2020-07-16 19:46:21 +08:00