3e03850169
Merge from 0.7.1 to master ( #1840 )
...
* update mishards images to 0.7.1 (fix #1799 ) (#1802 )
* update mishards images to 0.7.1 (fix #1799 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* [skip ci] Skip CI
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* [skip ci] Update CHANGELOG
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* fix lsn meta bug (#1813 )
* fix lsn meta bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix mysql lsn meta bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* Update CHANGELOG.md (#1814 )
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix compile (#1815 )
* Update CHANGELOG.md
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Update
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix compile (#1816 )
* Update CHANGELOG.md
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Update
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Update
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix compile (#1817 )
* Update CHANGELOG.md
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Update
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Update
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Increase Resources
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Decrease the compiling thread
Signed-off-by: jinhai <hai.jin@zilliz.com>
* #1818 Duplicate data generated after restart milvus server (#1819 )
* #1818 Duplicate data generated after restart milvus server
Signed-off-by: groot <yihua.mo@zilliz.com>
* set compile thread number
Signed-off-by: groot <yihua.mo@zilliz.com>
* [skip-ci]Remove auto flush interval from config (#1837 )
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Fix compile error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: BossZou <40255591+BossZou@users.noreply.github.com>
Co-authored-by: groot <yhmo@zeronedata.com>
2020-04-02 14:20:33 +08:00
74a1657752
Reorganize readme (update cn & en; delete jp) ( #1850 )
...
* [skip ci] Update readme
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
* [skip ci] Update readme
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
* [skip ci] Delete readme
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
2020-04-02 14:13:39 +08:00
0e0739ef87
1845 no UT log ( #1846 )
...
* #1845 No UT log
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* No UT log
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-02 09:48:29 +08:00
6e7fb831bd
add annoy params validate check ( #1829 )
...
* fix bug & solve compile warning from annoylib
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix lint error
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-04-02 09:47:45 +08:00
78a7aac6dc
Fix compile error ( #1844 )
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-01 23:38:24 +08:00
2fcf2855ce
fix sq8h deletion ( #1830 )
...
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-04-01 20:50:48 +08:00
a15124d6ab
Update community ( #1836 )
...
* [skip ci] Update COMMUNITY.md
Signed-off-by: jinhai <hai.jin@zilliz.com>
* [skip ci] Update COMMUNITY.md
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-01 19:34:21 +08:00
037e697524
[skip ci] Update COMMUNITY.md ( #1835 )
...
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-01 19:22:44 +08:00
d48b0f15f6
Refactor codeowners ( #1834 )
...
* Update CODEOWNERS
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Update CODEOWNERS
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Update CODEOWNERS
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-01 18:51:26 +08:00
c30a394805
Add annoy index type in C++ sdk ( #1826 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-04-01 18:46:57 +08:00
68625cbf1c
Fix 1724 ( #1821 )
...
* #1724 Remove unused unittests
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part2
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part3
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part4
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Remove unused unittests - part5
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change table_id to collection_id
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Change table to collection
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix format error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change table_ to collection_
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Change table_id_ to collection_id_
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Fix format error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* #1724 Change table_name to collection_name
Signed-off-by: jinhai <hai.jin@zilliz.com>
* Reformat
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change TableFile to Segment
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Change TableSchema to CollectionSchema
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* fix compile lint
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-01 17:37:55 +08:00
6f85895340
[skip ci] Update README.md ( #1822 )
...
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-01 13:29:49 +08:00
531fca8869
Caiyd 1655 gpu ivfflat delete ( #1809 )
...
* support GPUIVF delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* calc bitset offset correctly
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* support GPUSQ8 delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* support GPUIVFPQ delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest for GPU delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* delete FAISS compile option -DFAISS_USE_FLOAT16
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code opt
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-01 10:42:48 +08:00
c091929298
improve sdk_qps ( #1804 )
...
* improve sdk_qps
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* refine sdk code
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* sdk_qps improve
Signed-off-by: groot <yihua.mo@zilliz.com>
* sdk_qps improve
Signed-off-by: groot <yihua.mo@zilliz.com>
* add log
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-31 20:54:09 +08:00
b995ccfb56
Refactor CI workflow ( #1782 )
...
* Set helm deploy timeout to 600s
* Refactor CI workflow
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
* Refactor CI workflow
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
* Refactor CI workflow
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
* Refactor CI workflow
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-03-31 18:53:12 +08:00
a459a1efdd
[skip ci](shards): support server 0.7.1 ( #1811 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-03-31 18:52:44 +08:00
88cf5e2bd8
Optimize functions ( #1803 )
...
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-30 18:11:08 +08:00
dbbf91db28
remove unnecessary lock ( #1801 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-30 14:13:02 +08:00
8a731dea39
Add Unittest for IDMAP ( #1774 )
...
* gpu idmap unittest
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix clang format
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix build issue
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* small fix
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix case
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix back
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Compact code
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* efficient code
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix GPU search hang
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-30 14:08:56 +08:00
4574f9d998
Merge branch '0.7.1'
2020-03-29 18:50:10 +08:00
c14adeb5b1
Update CHANGELOG
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-29 17:44:54 +08:00
52ac810a1f
fix share_ptr array ( #1786 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-03-28 20:27:07 +08:00
3cdba5b62e
fix ( #1790 )
...
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-28 19:27:21 +08:00
a3935eed71
unitest validation ( #1788 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-28 19:26:39 +08:00
4cd5d8dd1b
Add Superstructure/Substructure in http module ( #1785 )
...
* add sub/super-structure in http module
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update http test case
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* add Superstructure/Substructure in http module (fix #1784 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-28 14:41:24 +08:00
ebc6c69b95
add qps sdk example ( #1779 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-28 13:57:23 +08:00
a7932b0365
#1781 fix search hang with SQ8H ( #1783 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-28 13:08:42 +08:00
af73dccb1c
fix combine result bug ( #1780 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-27 23:01:02 +08:00
ac443e37ac
Caiyd 1689 gpu out of memory ( #1776 )
...
* #1689 update cache stragegy
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1689 add lock when change cache capacity
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry CI
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1689 update cache
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry CI
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-27 19:24:10 +08:00
d92bcd2e54
Update CHANGLOG.md ( #1771 )
...
* Update CHANGLOG.md
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
* Update
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-27 14:02:54 +08:00
4b996cd622
fix commpile error because of interface changed ( #1773 )
...
* fix commpile error because of interface changed
Signed-off-by: lichengming <chengming.li@zilliz.com>
* fix comiple error
Signed-off-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
2020-03-27 13:07:57 +08:00
e4264d8461
Server is not forbidden to create new partition which tag is _default ( #1770 )
...
* HasTable with a not exist table name, return error status
Signed-off-by: groot <yihua.mo@zilliz.com>
* Server is not forbidden to create new partition which tag is _default
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-27 10:00:51 +08:00
310d5d70bc
Annoy support ( #1746 )
...
* add annoy source code
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* add annoy knowhere
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* annoy local gtest passed
Signed-off-by: lichengming <chengming.li@zilliz.com>
* fix lint error and update changelog
Signed-off-by: lichengming <chengming.li@zilliz.com>
* fix compile error
Signed-off-by: cmli <chengming.li@zilliz.com>
* Update connect timeout in test cases
Signed-off-by: zw <zw@milvus.io>
* fix some potential bugs
Signed-off-by: cmli <chengming.li@zilliz.com>
* retry ci
Signed-off-by: cmli <chengming.li@zilliz.com>
* rerun ci!
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix errors tested by c++ sdk
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix lint error
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: zw <zw@milvus.io>
2020-03-27 09:52:31 +08:00
7763caef09
Update CHANGLOG.md
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-26 23:45:00 +08:00
23e2780309
add delete case for hnsw/pq in cpu-version ( #1741 )
...
* add delete case for hnsw/pq in cpu-version
Signed-off-by: lizhenxiang <lizhenxiang@lianjia.com>
* Update compact timeout
Signed-off-by: zw <zw@milvus.io>
* add case: search with tag not existed
Signed-off-by: zw <zw@milvus.io>
* update compact timeout
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: lizhenxiang <lizhenxiang@lianjia.com>
Co-authored-by: zw <zw@milvus.io>
2020-03-26 23:17:04 +08:00
207b854c3f
Caiyd 1655 gpu ivfflat delete ( #1767 )
...
* update sdk
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update segment interfaces
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update some interfaces
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-26 21:58:48 +08:00
792538734b
Set helm deploy timeout to 600s ( #1769 )
2020-03-26 20:22:20 +08:00
0da3c712ec
HasTable with a not exist table name, return error status ( #1761 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-26 19:59:49 +08:00
f93b464172
#1654 GPU Index Flat Delete ( #1736 )
...
* Add Flat Index Delete
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix log
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix bitset
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* Fix reference
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix bug
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix bug
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix bug
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-26 18:36:46 +08:00
65ffaedae3
Update CHANGLOG.md
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-26 18:35:49 +08:00
243e843aac
fix #1747 ( #1757 )
...
* fix
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update.
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* lint pass
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* UPDATE CASE: search with tag not exist
Signed-off-by: zw <zw@zilliz.com>
Co-authored-by: zw <zw@zilliz.com>
2020-03-26 18:28:24 +08:00
e9f7422bc5
fix binary flat may retruns wrong distance when nq larger than 1 ( #1760 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-03-26 16:45:49 +08:00
c4b7be8ed6
#1728 Optimize request handler to combine similar query ( #1743 )
...
* modify changelog
Signed-off-by: groot <yihua.mo@zilliz.com>
* improve search qps
Signed-off-by: groot <yihua.mo@zilliz.com>
* changelog
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix hang bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix combine request result bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* add unittest for combine request
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test failure
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test failure
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest failure
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-26 14:26:02 +08:00
578d2633eb
#1756 fix memory exhausted during searching ( #1758 )
...
* #1756 fix memory exhausted during searching
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1756 update const names
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-26 13:55:11 +08:00
5a83ba4e49
Optimize behavior to get file ids from metadata in mishards ( #1754 ) ( #1755 )
...
* update mishards get file ids
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update behaviour for getting file ids
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* check default partition
Signed-off-by: yhz <413554850@qq.com>
* remove exception when file id not found
Signed-off-by: yhz <413554850@qq.com>
* Optimize behavior to get file ids from metadata in mishards (fix #1754 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* [skip ci] Update changlog
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-26 12:28:20 +08:00
d34bd505ba
#1735 fix search fail with gpu out of memory using ivf_flag ( #1748 )
...
* #1735 fix search fail with gpu out of memory using ivf_flag
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1735 add lock for each GpuCacheMgr instance
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1735 optimize cache debug info
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1735 set smaller cache threshold
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1735 update cache debug log
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1735 fix cache issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-25 19:54:50 +08:00
cda57cf77f
Update NSG ( #1744 )
...
* enable IP and fix crash
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update.
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* lint pass
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-25 16:24:18 +08:00
e865e9c893
modify changelog ( #1739 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-24 17:48:13 +08:00
0e914949e8
#1734 Opentracing for combined search request ( #1737 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-24 14:44:01 +08:00
13c8d55fbd
#1656 Limit the resources of publish docker container ( #1732 )
...
* Increase memory limit in Jenkins CI
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
* Add pod tolerations to slave pods
* Refactor ci/scripts/build.sh
* Refactor ci/scripts/build.sh
* Refactor CI
* Refactor CI
* Refactor CI
* Refactor CI
* Refactor CI
* Refactor CI
* Refactor CI
* Add timeout for whole Jenkins job
* cuda yum repository temporarily disabled
* Update ccache script file
* Update ccache script file
* Update ccache script file
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
* Update ccache script file
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
* Update ccache script file
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
* Update ccache script file
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
* Update ci/jenkins/pod/docker-pod.yaml
2020-03-24 10:47:41 +08:00
Jin Hai
Lutkin Wang
op-hunter
Xiaohai Xu
yukun
Cai Yudong
groot
quicksilver
XuPeng-SH
shengjun.li
Tinkerrr
BossZou
del-zhenwu