64ddc2a556
Add an optional parameter 'nbtis' for IVF_PQ ( #4709 )
...
* Add an optional parameter 'nbtis' for IVF_PQ
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix test
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-19 18:12:24 +08:00
e8afb2ba65
The GPU cache holds much more data than the configured value ( #4720 )
...
* The GPU cache holds much more data than the configured value
Signed-off-by: cmli <chengming.li@zilliz.com>
* update changelog and remove the useless variable G_BYTE and unit
Signed-off-by: cmli <chengming.li@zilliz.com>
2021-02-19 11:49:17 +08:00
c8dec9f02f
[skip ci] update change log ( #4698 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-06 04:08:01 +00:00
1211e9bac3
BinaryFlat support AVX2 ( #4694 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-04 08:42:42 +00:00
bbbf254b7c
Fix binaryflat ( #4681 )
...
* fix binary distance
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* improve the performance of BinaryFlat
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* avoid negative zero in Tanimoto
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-02 17:11:02 +08:00
3efbab1df5
make metrics label configurable ( #4677 )
...
* update to 0.10.6
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* Configurable metric labels
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Roll back clienTest modify
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-02 10:45:36 +08:00
f942f0b823
fix errors in .mds ( #4644 )
...
* Updated logo and architecture links. (#2529 )
Signed-off-by: PahudPlus <haimeng.cai@zilliz.com>
* Fixed broken links. (#2902 )
Signed-off-by: PahudPlus <haimeng.cai@zilliz.com>
* Minor editorial updates. (#2946 )
Signed-off-by: Amy Hong <yun.hong@zilliz.com>
* fix cuda version requirement (#2909 )
Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>
* [skip ci] Updated INSTALL.md. (#3016 )
Signed-off-by: Amy Hong <yun.hong@zilliz.com>
* [skip ci] Fixed broken links. (#3304 )
Signed-off-by: Amy Hong <yun.hong@zilliz.com>
* [skip ci] update install from code (#3855 )
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* [skip ci] update cmake version (#4084 )
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* [skip ci] Update the foundation name. (#4438 )
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
* [skip ci] Added a space for readability (#4465 )
Added a space between the heart emoji and the word for better readability.
Signed-off-by: Mark Berger <maberger0811@gmail.com>
* [skip ci] Update links and fix dead links. (#4496 )
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
* [skip ci] fix errors in mds
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: PahudPlus <64403786+PahudPlus@users.noreply.github.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: AmyYH <68527082+AmyYH@users.noreply.github.com>
Co-authored-by: Wang XiangYu <xy.wang@zilliz.com>
Co-authored-by: ireneontheway5 <75291211+ireneontheway5@users.noreply.github.com>
Co-authored-by: Mark Berger <maberger0811@gmail.com>
2021-01-22 19:16:40 +08:00
9088b2c711
Fix shards mismatch pod name ( #4565 )
...
* skip pod if name mismatch
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* [skip ci] update changlog
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* [skip ci] fix variable name typo
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2021-01-05 03:12:36 +00:00
89bbe1ee4d
#4492 while share file system servcie became abnormal, the milvus can not supply query service ( #4506 )
...
* modify changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* #4492 while share file system servcie became abnormal, the milvus can not supply query service
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-25 02:12:58 +00:00
9ab4baacd5
[skip ci]Add a metric to display the number of files opened by Milvus ( #4509 )
...
* [skip ci]Add a metric to display the number of files opened by Milvus
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* [skip ci]Add dashboard.yml
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-12-25 02:06:07 +00:00
437f5d9777
modify changelog ( #4503 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-24 10:09:55 +08:00
607ec31fbc
#4484 Milvus only search default partition if search parameter partition_tags contains _default ( #4486 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-21 08:30:10 +00:00
a07526c98e
Optimize the process of indexing and querying ( #4455 )
...
* fix index
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix engine
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix ut
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-18 17:53:39 +08:00
62098d760e
#4378 Multi-threads to call load_collection and search cause Milvus hang ( #4408 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-12-08 19:14:53 +08:00
bf5fdc3131
Fix memory leak in IVF indexes ( #4325 )
...
* fix memory lead in IVF indexes
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* [skip ci] modify change log
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-01 09:36:04 +08:00
99245c0c63
#4174 Search out of memory: CPU2GPU1 with index flat ( #4178 )
...
* Fix gpu resource issue
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix_ut
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-11-05 13:57:50 +08:00
773deab62e
#4075 Improve performance for create large amount of partitions ( #4083 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-10-24 10:35:58 +08:00
8d5c1a87d5
#3773 milvus support IVF_PQ run on fpga device ( #3996 )
...
* This is my commit message Signed-off-by jack hou Developer <364427912@qq.com>
Signed-off-by: root <364427912@qq.com>
* fix build with -u -a
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix run on GPU
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix ThirdPartyPackages.cmake
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-10-23 09:41:28 +08:00
235c51c385
Fix server crashed during search with index pq ( #3954 )
...
* fix pq distances cal bug
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix pq distance calculation outofrange according to faiss suggests
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix change log
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-10-17 09:42:19 +08:00
19bda5cf97
The search of SQ8H index is slower than the previous version ( #3957 )
...
Signed-off-by: cqy <yaya645@126.com>
2020-10-12 19:55:26 +08:00
f46e2a621d
fix the bug of DeleteTask state not change ( #3935 )
...
* fix the bug of DeleteTask state not change
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-10-10 14:16:31 +08:00
7692a6d437
set blacklist a NULL pointer if no item deleted ( #3827 )
...
* set blacklist a nullptr is no item deleted
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix multi thread access bitset
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-22 10:01:04 +08:00
50d5b9f179
[skip ci] Upgrade mishards up to v0.10.3 ( #3785 )
...
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-09-17 19:35:03 +08:00
f962e84822
[skip ci] modify the change log ( #3761 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-16 10:32:35 +08:00
18695db507
If the GPU cache is too small, IVF_SQ8H using multiple GPUs will cause to crash ( #3744 )
...
* fix ivf_sq8h
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix cache release
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-15 20:21:10 +08:00
2737c3fbdd
[skip ci] Remove check for topk in mishards ( fix #3709 ) ( #3710 )
...
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-09-12 22:27:41 +08:00
49a5cdf682
When the topk of GPU search larger than 2048,turning into the CPU search ( #3647 )
...
* topk of GPU searching
Signed-off-by: cqy <yaya645@126.com>
* change the changelog
Signed-off-by: cqy <yaya645@126.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-09 13:32:10 +08:00
74639a3ba7
fix to check search param of BIN_IVF_FLAT ( #3660 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-09 09:14:40 +08:00
18c630a4be
release search task in time ( #3609 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-05 11:36:55 +08:00
d5ecdf2dda
GPU search turn into CPU search when nprobe >2048 ( #3594 )
...
* gpu nprobe
Signed-off-by: cqy <yaya645@126.com>
* [skip ci] changelog
Signed-off-by: cqy <yaya645@126.com>
2020-09-04 18:49:52 +08:00
a75c0a572c
Allow more choices for the parameter ‘m’ of CPU IVF_PQ ( #3469 )
...
* fix the IVFPQ fixed M problem
Signed-off-by: cqy <yaya645@126.com>
* fix compile
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-27 11:37:25 +08:00
1962b6e78b
Specifying distance type at runtime for Flat index ( #3273 )
...
* modfied IndexIDMAP.cpp && SearchTask.cpp
Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>
* Specifying distance type at runtime for Flat index(CPU)
Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>
* Specifying distance type at runtime for Flat index(GPU)
Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>
Co-authored-by: Zhengda Wu <wuzhengda55@gmail.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-17 17:05:59 +08:00
f59c240457
Update to 0.10.3
...
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-08-15 16:21:43 +08:00
f9f597b257
[v0.10.2] (mishards) Fix mishards search bug ( #3169 )
...
* [skip ci]Reverse query result if metric is IP
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* [skip ci] Update version check
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-08-07 19:33:49 +08:00
09cf1b323e
fix crash when GPU search ( #3074 )
...
* fix crash when GPU search
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-31 09:46:55 +08:00
b1b1165c56
Opt faiss builder ( #3067 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-31 09:35:31 +08:00
91d3fe5cbc
Improve IVF search performance when NQ and nProbe are both large ( #2984 )
...
* fix indexflat search
Signed-off-by: cqy <yaya645@126.com>
* add parallel_policy_threshold
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-24 15:56:47 +08:00
dd938878ea
fix ( #2981 )
...
Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
2020-07-23 17:02:28 +08:00
3908d10498
Fix the result merging of IVF_PQ IP ( #2953 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-22 10:08:05 +08:00
a88f5b6cbb
Fix index size ( #2941 )
...
* add virtual IF UpdateIndexSize
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* update ivf index size
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix PQ logic
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix index size of index hnsw, annoy and nsg
Signed-off-by: cmli <chengming.li@zilliz.com>
* add GetSize() interface 4 SPTAG
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix binary ivf
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-21 14:26:08 +08:00
1806e7e4b0
Update CHANGELOG.md
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-07-21 09:35:31 +08:00
7a594470cb
[skip ci] Upgrade mishards for milvus 0.10.1 ( #2933 )
...
Signed-off-by: yhz <413554850@qq.com>
2020-07-20 16:28:05 +08:00
8046f2946e
Hotfix 2487 ( #2892 )
...
* update.
Signed-off-by: Tinkerrr <linxiaojun.cn@outlook.com>
* update.
Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
* add fd check
Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
* fix
Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
2020-07-17 21:00:42 +08:00
a474ff269a
Server down during loading data ( #2807 )
...
* Server down during loading data
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix test_config.cpp
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* ci retry
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change limit_in_bytes init value to max
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-07-14 00:40:20 +08:00
585c8ea018
fix rnsg ip ( #2827 )
...
Signed-off-by: cqy <yaya645@126.com>
2020-07-13 14:05:28 +08:00
5447abec5b
fix #2768 ( #2809 )
...
* fix #2752
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix #2768
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo again
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-07-12 15:41:45 +08:00
d7c47a7905
fix #2752 ( #2789 )
...
* fix #2752
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-10 16:49:47 +08:00
4922c9532f
fix a bug of getting wrong nprobe limitation in knowhere on GPU version ( #2788 )
...
* fix a bug of getting wrong nprobe limitation in knowhere on GPU version
Signed-off-by: cmli <chengming.li@zilliz.com>
* update changelog and fix build error
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-09 23:15:07 +08:00
4038b0653e
fix too many data copies ( #2784 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-09 09:23:49 +08:00
8fcdf73bc8
fix 2739 ( #2746 )
...
Signed-off-by: Tinkerrr <linxiaojun.cn@outlook.com>
2020-07-07 14:45:37 +08:00
shengjun.li
op-hunter
yukun
BossZou
groot
Xiaohai Xu
jackhouchina
cqy123456
chen qingxiang
MXDA
jinhai
Tinkerrr
groot
op-hunter