Commit Graph

5691 Commits (832a88068424df792f3c773603f8d8822bb0261c)

Author SHA1 Message Date
groot 6a960cda2c
refine meta code ()
*  Combine request target vectors exceed max nq

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine dbimpl

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine dbimpl

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* merge master

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine meta code

Signed-off-by: groot <yihua.mo@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-04-06 18:43:20 +08:00
groot 0fd4b244c0
refine dbimpl ()
*  Combine request target vectors exceed max nq

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine dbimpl

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine dbimpl

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failure

Signed-off-by: groot <yihua.mo@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-04-04 21:14:30 +08:00
Jin Hai 35276ffcb0
Rename from table to collection ()
* Change HasTable to HasCollection

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Change HasTable to HasCollection

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix compile

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Change table to collection

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Change Table to Collection

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Change Table to Collection

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Change Table to Collection

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Change Table to Collection

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Change Table to Collection

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix compiling error

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix compiling error

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix compiling error

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix lint

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix Unit test

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix lint

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-03 23:12:41 +08:00
Cai Yudong dc707bb8a3
Caiyd 1858 disable s3 build ()
*  disable s3 build

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* disable s3 in unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-03 16:35:48 +08:00
op-hunter 54337e9361
refactor knowhere inner unittest for annoy and hnsw, which a… ()
* skip ci, refactor knowhere inner unittest for annoy and hnsw, which aimed to remove logs of std output

Signed-off-by: cmli <chengming.li@zilliz.com>

* skip ci, fix lint error

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix annoy load bugs and add serialize test 4 annoy and hnsw

Signed-off-by: cmli <chengming.li@zilliz.com>

* update changelog

Signed-off-by: cmli <chengming.li@zilliz.com>

* update lower bound of annoy search_k param

Signed-off-by: cmli <chengming.li@zilliz.com>

* lint errorgit add src/utils/ValidationUtil.cpp

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
2020-04-03 14:14:04 +08:00
Jin Hai a57c97ddc3
[skip ci] Update COMMUNITY.md ()
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-03 11:28:19 +08:00
Jin Hai decd4e574a
[skip ci] Update README ()
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-03 11:15:43 +08:00
Cai Yudong 7ccfa5b9f0
Caiyd 1627 move rw index ()
*  move read/write index into codec

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update WriteVectorIndex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-02 22:44:45 +08:00
Xiaohai Xu f82aa4f493
Support NSG Deletion ()
* nsg delete

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix request

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Fix clang

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix typo

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* [skip ci] add changelog

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix test_nsg and changelog

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix test

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix test case

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix clang-format

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Polish

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-04-02 20:46:58 +08:00
groot f66b43b81b
Combine request target vectors exceed max nq ()
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-04-02 14:24:28 +08:00
Jin Hai 3e03850169
Merge from 0.7.1 to master ()
* update mishards images to 0.7.1 (fix ) ()

* update mishards images to 0.7.1 (fix )

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] Skip CI

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] Update CHANGELOG

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* fix lsn meta bug ()

* fix lsn meta bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix mysql lsn meta bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* Update CHANGELOG.md ()

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix compile ()

* Update CHANGELOG.md

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Update

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix compile ()

* Update CHANGELOG.md

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Update

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Update

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix compile ()

* Update CHANGELOG.md

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Update

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Update

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Increase Resources

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Decrease the compiling thread

Signed-off-by: jinhai <hai.jin@zilliz.com>

*  Duplicate data generated after restart milvus server ()

*  Duplicate data generated after restart milvus server

Signed-off-by: groot <yihua.mo@zilliz.com>

* set compile thread number

Signed-off-by: groot <yihua.mo@zilliz.com>

* [skip-ci]Remove auto flush interval from config ()

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix lint

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compile error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

Co-authored-by: BossZou <40255591+BossZou@users.noreply.github.com>
Co-authored-by: groot <yhmo@zeronedata.com>
2020-04-02 14:20:33 +08:00
Lutkin Wang 74a1657752
Reorganize readme (update cn & en; delete jp) ()
* [skip ci] Update readme

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

* [skip ci] Update readme

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

* [skip ci] Delete readme

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
2020-04-02 14:13:39 +08:00
Jin Hai 0e0739ef87
1845 no UT log ()
*  No UT log

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* No UT log

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-02 09:48:29 +08:00
op-hunter 6e7fb831bd
add annoy params validate check ()
* fix bug & solve compile warning from annoylib

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix lint error

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
2020-04-02 09:47:45 +08:00
Jin Hai 78a7aac6dc
Fix compile error ()
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-01 23:38:24 +08:00
Xiaohai Xu 2fcf2855ce
fix sq8h deletion ()
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-04-01 20:50:48 +08:00
Jin Hai a15124d6ab
Update community ()
* [skip ci] Update COMMUNITY.md

Signed-off-by: jinhai <hai.jin@zilliz.com>

* [skip ci] Update COMMUNITY.md

Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-01 19:34:21 +08:00
Jin Hai 037e697524
[skip ci] Update COMMUNITY.md ()
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-01 19:22:44 +08:00
Jin Hai d48b0f15f6
Refactor codeowners ()
* Update CODEOWNERS

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Update CODEOWNERS

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Update CODEOWNERS

Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-01 18:51:26 +08:00
yukun c30a394805
Add annoy index type in C++ sdk ()
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-04-01 18:46:57 +08:00
Jin Hai 68625cbf1c
Fix 1724 ()
*  Remove unused unittests

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

*  Remove unused unittests - part2

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

*  Remove unused unittests - part3

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

*  Remove unused unittests - part4

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

*  Remove unused unittests - part5

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Change table_id to collection_id

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Change table to collection

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix format error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Change table_ to collection_

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Change table_id_ to collection_id_

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix format error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

*  Change table_name to collection_name

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Reformat

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Change TableFile to Segment

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Change TableSchema to CollectionSchema

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* fix compile lint

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-01 17:37:55 +08:00
Jin Hai 6f85895340
[skip ci] Update README.md ()
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-01 13:29:49 +08:00
Cai Yudong 531fca8869
Caiyd 1655 gpu ivfflat delete ()
* support GPUIVF delete

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* calc bitset offset correctly

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* support GPUSQ8 delete

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* support GPUIVFPQ delete

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest for GPU delete

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* delete FAISS compile option -DFAISS_USE_FLOAT16

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-01 10:42:48 +08:00
groot c091929298
improve sdk_qps ()
* improve sdk_qps

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine sdk code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* sdk_qps improve

Signed-off-by: groot <yihua.mo@zilliz.com>

* sdk_qps improve

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-31 20:54:09 +08:00
quicksilver b995ccfb56
Refactor CI workflow ()
* Set helm deploy timeout to 600s

* Refactor CI workflow

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Refactor CI workflow

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Refactor CI workflow

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Refactor CI workflow

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-03-31 18:53:12 +08:00
XuPeng-SH a459a1efdd
[skip ci](shards): support server 0.7.1 ()
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-03-31 18:52:44 +08:00
Xiaohai Xu 88cf5e2bd8
Optimize functions ()
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-30 18:11:08 +08:00
Cai Yudong dbbf91db28
remove unnecessary lock ()
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-30 14:13:02 +08:00
Xiaohai Xu 8a731dea39
Add Unittest for IDMAP ()
* gpu idmap unittest

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix clang format

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix build issue

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* small fix

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix case

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix back

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Compact code

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* efficient code

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Fix GPU search hang

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-30 14:08:56 +08:00
JinHai-CN 4574f9d998 Merge branch '0.7.1' 2020-03-29 18:50:10 +08:00
JinHai-CN c14adeb5b1 Update CHANGELOG
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-29 17:44:54 +08:00
shengjun.li 52ac810a1f
fix share_ptr array ()
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-03-28 20:27:07 +08:00
Tinkerrr 3cdba5b62e
fix ()
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-28 19:27:21 +08:00
groot a3935eed71
unitest validation ()
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-28 19:26:39 +08:00
BossZou 4cd5d8dd1b
Add Superstructure/Substructure in http module ()
* add sub/super-structure in http module

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update http test case

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add Superstructure/Substructure in http module (fix )

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-28 14:41:24 +08:00
groot ebc6c69b95
add qps sdk example ()
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-28 13:57:23 +08:00
Cai Yudong a7932b0365
fix search hang with SQ8H ()
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-28 13:08:42 +08:00
groot af73dccb1c
fix combine result bug ()
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-27 23:01:02 +08:00
Cai Yudong ac443e37ac
Caiyd 1689 gpu out of memory ()
*  update cache stragegy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

*  add lock when change cache capacity

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry CI

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

*  update cache

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry CI

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-27 19:24:10 +08:00
Jin Hai d92bcd2e54
Update CHANGLOG.md ()
* Update CHANGLOG.md

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Update

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Update

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-27 14:02:54 +08:00
op-hunter 4b996cd622
fix commpile error because of interface changed ()
* fix commpile error because of interface changed

Signed-off-by: lichengming <chengming.li@zilliz.com>

* fix comiple error

Signed-off-by: lichengming <chengming.li@zilliz.com>

Co-authored-by: lichengming <chengming.li@zilliz.com>
2020-03-27 13:07:57 +08:00
groot e4264d8461
Server is not forbidden to create new partition which tag is _default ()
* HasTable with a not exist table name, return error status

Signed-off-by: groot <yihua.mo@zilliz.com>

* Server is not forbidden to create new partition which tag is _default

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-27 10:00:51 +08:00
op-hunter 310d5d70bc
Annoy support ()
* add annoy source code

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* add annoy knowhere

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* annoy local gtest passed

Signed-off-by: lichengming <chengming.li@zilliz.com>

* fix lint error and update changelog

Signed-off-by: lichengming <chengming.li@zilliz.com>

* fix compile error

Signed-off-by: cmli <chengming.li@zilliz.com>

* Update connect timeout in test cases

Signed-off-by: zw <zw@milvus.io>

* fix some potential bugs

Signed-off-by: cmli <chengming.li@zilliz.com>

* retry ci

Signed-off-by: cmli <chengming.li@zilliz.com>

* rerun ci!

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix errors tested by c++ sdk

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix lint error

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: zw <zw@milvus.io>
2020-03-27 09:52:31 +08:00
JinHai-CN 7763caef09 Update CHANGLOG.md
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-26 23:45:00 +08:00
del-zhenwu 23e2780309
add delete case for hnsw/pq in cpu-version ()
* add delete case for hnsw/pq in cpu-version

Signed-off-by: lizhenxiang <lizhenxiang@lianjia.com>

* Update compact timeout

Signed-off-by: zw <zw@milvus.io>

* add case: search with tag not existed

Signed-off-by: zw <zw@milvus.io>

* update compact timeout

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: lizhenxiang <lizhenxiang@lianjia.com>
Co-authored-by: zw <zw@milvus.io>
2020-03-26 23:17:04 +08:00
Cai Yudong 207b854c3f
Caiyd 1655 gpu ivfflat delete ()
* update sdk

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update segment interfaces

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update some interfaces

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-26 21:58:48 +08:00
quicksilver 792538734b
Set helm deploy timeout to 600s () 2020-03-26 20:22:20 +08:00
groot 0da3c712ec
HasTable with a not exist table name, return error status ()
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-26 19:59:49 +08:00
Xiaohai Xu f93b464172
GPU Index Flat Delete ()
* Add Flat Index Delete

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Fix log

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Fix bitset

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Fix reference

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix bug

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix bug

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix bug

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-26 18:36:46 +08:00
JinHai-CN 65ffaedae3 Update CHANGLOG.md
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-26 18:35:49 +08:00