Commit Graph

551 Commits (5d64a2012cdb2f4eb7b6a724b38eb0dfd2709e57)

Author SHA1 Message Date
Jin Hai ff0aad8123
Merge branch 'master' into fix_1517 2020-03-10 09:34:16 +08:00
JinHai-CN d466f3d447 Update CHANGELOG.md
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-10 01:05:07 +08:00
JinHai-CN 66a14e16e8 Update CHANGELOG.md
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-10 01:03:32 +08:00
Zhiru Zhu f811753c62
update
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-09 23:33:12 +08:00
groot 13d3cff9b7 #1580 Old segment folder not removed after merge / compact if create_index is called before adding data
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-09 20:52:10 +08:00
Zhiru Zhu 593077e85b
update
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-09 20:40:40 +08:00
xiaojun.lin 7b493cb835 fix
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-09 20:08:31 +08:00
Jin Hai c39ea4fd84
Merge branch 'master' into binary 2020-03-09 18:33:08 +08:00
Jin Hai 694aea22a9
Merge pull request #1579 from tinkerlin/fix_1564
fix
2020-03-09 18:31:37 +08:00
groot 4068c2ac3a merge master branch
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-09 18:17:53 +08:00
xiaojun.lin 95105bfdd1 Merge remote-tracking branch 'official/master' into fix_1564
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-09 15:38:04 +08:00
Zhiru Zhu 281d8ec53f
update
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-09 15:16:36 +08:00
Jin Hai 7cd727aaea
Merge pull request #1575 from youny626/fix#1574
Fix#1574
2020-03-09 15:10:59 +08:00
groot b8b86d77c4 typo
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-09 15:08:54 +08:00
xiaojun.lin f891a590b5 fix
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-09 15:06:26 +08:00
groot e9d32dc9de typo
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-09 13:33:57 +08:00
Zhiru Zhu a267c9a6fc
update
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-09 11:46:15 +08:00
groot 37fd79631d #1571 Meta engine type become IDMAP after drop index for BINARY table
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-09 11:14:12 +08:00
Yhz da469d1b3b Merge branch 'main' into config-bug 2020-03-09 09:23:15 +08:00
Jin Hai 037e4054b6
Merge pull request #1568 from cydrain/caiyd_1567_update_yaml_description
Caiyd 1567 update yaml description
2020-03-08 23:21:27 +08:00
yudong.cai aedde79f26 #1567 update yaml config description
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-08 19:14:40 +08:00
Yhz 01eb62836e merge main and fix conflict
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-08 16:19:28 +08:00
Yhz 24daade18e fix config wal valid_recovery_error_ignore bug
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-08 14:30:02 +08:00
xiaojun.lin c7bc4a8a22 update max_support_dim
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-08 14:21:59 +08:00
Cai Yudong 5afef85466
Merge branch 'master' into caiyd_codec_opt 2020-03-08 14:17:07 +08:00
JinHai-CN a96a837186 Update CHANGELOG.md
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-08 12:39:00 +08:00
groot 9f7bf032da typo
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-08 12:14:05 +08:00
groot 1829624a43 #1556 Index file not create after table and index create
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-08 11:59:25 +08:00
yudong.cai 7cd2138e3c Merge remote-tracking branch 'main/master' into caiyd_1546_move_config 2020-03-08 11:11:09 +08:00
groot b78521021b fix typo
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-07 22:48:02 +08:00
groot 9de0dea134 fix typo
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-07 22:34:07 +08:00
groot b729d04236 Merge remote-tracking branch 'source/master' 2020-03-07 22:26:18 +08:00
yudong.cai c29877901f Merge remote-tracking branch 'main/master' into caiyd_1546_move_config 2020-03-07 21:09:49 +08:00
BossZou 0fcdc31c7c
Update resources name in HTTP module (#1545)
* set preload_table correctly (fix #1524)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update res name in http module (fix #1544)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add bool convertor function

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix test fail

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* optimize update config method & add boolean conversion comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-07 20:56:01 +08:00
Cai Yudong 0fd9bf8e70
#1529 fix server crash when cache_insert_data enabled (#1541)
* #1529 fix server crash when cache_insert_data enabled

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1529 fix bug

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1529 code opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1529 set uids for CopyGpuToCpu()

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-07 20:54:26 +08:00
groot c2b5b00592 #1532 Search with ivf_flat failed with open-dataset: sift-256-hamming
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-07 19:50:57 +08:00
yudong.cai b277b48308 #1546 add changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-07 17:04:07 +08:00
groot a08b51c2b6
merge json to master to get docker image (#1500)
* General proto api for NNS libraries

Signed-off-by: groot <yihua.mo@zilliz.com>

* refactor confadapter

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* fix unittest failures

Signed-off-by: groot <yihua.mo@zilliz.com>

* update test_add

Signed-off-by: zhenwu <zw@zilliz.com>

* update knowhere

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update test cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* Update cases

* C++ sdk for json parameters

Signed-off-by: groot <yihua.mo@zilliz.com>

* update unittest

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* fix unittest failures

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix case

Signed-off-by: del-zhenwu <zw@zilliz.com>

* modify test_index.py

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* update

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update sptag

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* Build Pass

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* knowhere/wrapper ut pass

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* update util

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix wal case

Signed-off-by: del-zhenwu <zw@zilliz.com>

* modify test_search_vectors

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* update ci

Signed-off-by: del-zhenwu <zw@zilliz.com>

* update util

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* modify test_search_vectoes

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* add hnsw in http module & modify index apis

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify search in http module

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix build error

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix typo in test_index and test_search

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* update...

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* index apis in http module done

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix build index bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* search apis unittest pass

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* web test pass

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update confadapter

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update util

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* code format

Signed-off-by: groot <yihua.mo@zilliz.com>

* code format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix vectors results bug (fix #1476)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* clang format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update test

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* fix unittest

Signed-off-by: groot <yihua.mo@zilliz.com>

* add test_config

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix a build error

Signed-off-by: groot <yihua.mo@zilliz.com>

* add invalid param search test

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* fix range check

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* cpmpact/flush case passed

Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>

* fix unittest failures

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failures

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failures

Signed-off-by: groot <yihua.mo@zilliz.com>

* validate json parameters in request

Signed-off-by: groot <yihua.mo@zilliz.com>

* add unittest cases

Signed-off-by: groot <yihua.mo@zilliz.com>

* update test index/search

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* update test_config

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* support nsg and ivf-nlist

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* fix validation bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* code format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* remove rnsg cases

Signed-off-by: zhenwu <zw@zilliz.com>

* fix python test failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* Update changelog

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix typo

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* add pq to test_index && multithread test

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* add pq to test_search

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* Fix format

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Update CHANGELOG

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compiling error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compiling error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* fix config bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* code format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix config test

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* Update CHANGELOG.md

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Update CHANGELOG.md

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* disable config test case

Signed-off-by: zhenwu <zw@zilliz.com>

Co-authored-by: Nicky <nicky.xj.lin@gmail.com>
Co-authored-by: zhenwu <zw@zilliz.com>
Co-authored-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
Co-authored-by: shengjh <jianghong.sheng@zilliz.com>
Co-authored-by: xiaojun.lin <xiaojun.lin@zilliz.com>
Co-authored-by: Yhz <yinghao.zou@zilliz.com>
Co-authored-by: del-zhenwu <zhenxiang.li@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-07 15:23:34 +08:00
Cai Yudong 692986760b
Merge branch 'master' into caiyd_codec_opt 2020-03-07 14:38:57 +08:00
Cai Yudong 2a101eaab1
#1524 update config preload_table description (#1543)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-07 13:18:14 +08:00
BossZou 1963f3b9e9
Make cache_insert_data take effect in-service(# 1521) (#1540)
* make cache_insert_data take effect in-service (fix #1521)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* complete omitted config setter

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* cache_insert_data take effect for MemTable

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add config test

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* rename config handler

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-07 09:34:35 +08:00
Tinkerrr 8cd1ec9819
fix 1507 (#1509)
* fix

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update..

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* comment ut

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* Fix lint error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* update....

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* update....

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* Fix typo

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix typo

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-03-06 22:14:58 +08:00
Tinkerrr 626c9bc593
set size after load (#1539)
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-06 21:10:42 +08:00
yudong.cai 560f35a9d3 #1537 update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-06 19:19:39 +08:00
Zhiru Zhu 5bb1d001e2
Fix#1530 (#1533)
* update

Signed-off-by: youny626 <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-03-06 15:21:39 +08:00
Cai Yudong d28d1db907
#1531 remove S3 related config (#1534)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-06 13:33:35 +08:00
BossZou df47fad78c
Add setter API for config `preload_table` (#1526)
* update code

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* optimize http module code

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* move gpu res handler to config holder

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add setter API for config preload_table (fix #1525)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add else branch at end of if condition

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-06 13:26:01 +08:00
Zhiru Zhu b43e0fbada
Update compact (#1522)
* update

Signed-off-by: youny626 <zzhu@fandm.edu>

* update

Signed-off-by: youny626 <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* [skip ci] update CHANGELOG

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-06 09:40:29 +08:00
Jin Hai 19b8565748
Fix vectors results bug(#1476) & change vector id type to string(#1511) (#1514)
* add sign-off

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add index HNSW in http module

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-03-05 16:30:30 +08:00
Jin Hai 570ecf4266
Add cfg fun (#1501)
* save work

Signed-off-by: lichengming <chengming.li@zilliz.com>

* wal config&gtest

Signed-off-by: lichengming <chengming.li@zilliz.com>

* fix dco and lint error

Signed-off-by: lichengming <chengming.li@zilliz.com>

* try to fix lint error

Signed-off-by: lichengming <chengming.li@zilliz.com>

* try to fix clang-format issue

Signed-off-by: lichengming <chengming.li@zilliz.com>

* update change log

Signed-off-by: lichengming <chengming.li@zilliz.com>

* ajdjust the code by yudong's advice

Signed-off-by: lichengming <chengming.li@zilliz.com>

* fix error

Signed-off-by: lichengming <chengming.li@zilliz.com>

* recommit pr 1501,local gtest is ok

Signed-off-by: lichengming <chengming.li@zilliz.com>
2020-03-05 14:08:07 +08:00
Jin Hai 8c7ef47f20
Fix duplicate vector ID issue (#1508)
* #1499 Fix duplicated ID number issue

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #1499 Fix duplicated ID number issue - part 1

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1499 Fix duplicated ID number issue - part 2

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1499 Fix duplicated ID number issue - part 3

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #1499 Fix duplicated ID number issue - part 4

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix format issue

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Update CHANGELOG

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Add return value check

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-05 12:38:22 +08:00
Zhiru Zhu fc8a6e0779
Fix #1491 and #1504 (#1506)
* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* fix centos compile error

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-04 21:10:11 +08:00
Cai Yudong 600dac7500
#1463 update config version to 0.2 (#1466)
* #1463 update config version to 0.2

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1463 disable config version check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-04 00:02:48 +08:00
Zhiru Zhu 01b6ad3627
Fix#1484 (#1490)
* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* #1426 Support to configure whether to enabled autoflush (#1468)

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* fix cases: test_search_id/test_wal (#1486)

Signed-off-by: del-zhenwu <zw@zilliz.com>
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* #1480 add return code for AVX512 selection (#1482)

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

Co-authored-by: shengjun.li <49774184+shengjun1985@users.noreply.github.com>
Co-authored-by: del-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-03-03 18:31:49 +08:00
Cai Yudong d460f48ce9
#1480 add return code for AVX512 selection (#1482)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-03 13:55:26 +08:00
shengjun.li 6e3991d167
#1426 Support to configure whether to enabled autoflush (#1468)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-03-03 11:52:50 +08:00
Jin Hai 5b938659ac
Fix Markdown format (#1483)
* Fix #839 and improve the code quality

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compiling error and building threads number

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix Markdown quality

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix Markdown quality

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix Markdown quality

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-02 23:22:47 +08:00
Zhiru Zhu 52124d70e1
Improve delete (#1474)
* remove build openblas/lapack and use find_package

* update ubuntu_build_deps.sh

* update build image

* update build image

* update CHANGELOG

* trigger ci

* update image

* update centos build envvironment image on Jenkins CI

* trigger ci

* add serialize benchmark

Signed-off-by: Zhiru Zhu <zhiru.zhu@zilliz.com>

* update deleted doc codec

Signed-off-by: Zhiru Zhu <zhiru.zhu@zilliz.com>

* update delete in mem

Signed-off-by: Zhiru Zhu <zhiru.zhu@zilliz.com>

* update CHANGELOG

Signed-off-by: Zhiru Zhu <zhiru.zhu@zilliz.com>

* don't apply delete when force flush

Signed-off-by: Zhiru Zhu <zhiru.zhu@zilliz.com>

* lint

Signed-off-by: Zhiru Zhu <zhiru.zhu@zilliz.com>
2020-03-02 20:59:37 +08:00
BossZou 6862db78d4
Add crud APIs and segments APIs into http server (#1462)
* add new http api

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [DOC] modify comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* allow get whole tables & partitions

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add test case

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update changlog (fix #1461)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix cpu build issue

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix unittest fail on cpu version

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix get system config bug

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix crash when show tables

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix check server restart fail

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove some comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add count field into segment ids

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* optimize code fixing codegacy

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add default response string value

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-02 14:48:42 +08:00
groot 220ecf5fac
Server crashed when searching vectors using GPU(#1429) (#1458)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-01 15:51:28 +08:00
Lutkin Wang d380c8d69b
Add DCO content to CONTRIBUTING.md (#1460)
* Update CHANGELOG.md

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

* Update INSTALL.md

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

* Update INSTALL.md

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

* Update CONTRIBUTING.md

Add DCO rules.

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

* Update CHANGELOG.md

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

* Update CONTRIBUTING.md

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-03-01 12:21:15 +08:00
Cai Yudong c3bf270431
support avx512 (#1195)
* #1122 support AVX-512 for IVFFLAT distance calculation

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 support AVX-512 for IVFSQ8

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 fix avx512 build option

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 remove global faiss compile option -march=skylake-avx512

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 add InstructionSet and unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 update InstructionSet unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 add FaissHook

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 add distances_simd_avx512.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 fix build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 add ScalarQuantizer_avx512.cpp and IndexScalarQuantizer_avx512.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 fix build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 fix clang format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 move test_instructionset.cpp to index/unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 fix clang format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 set hook default to AVX

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 add hidden config use_avx512

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 fix faiss clone issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 fix faiss build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 fix faiss ScalarQuantizer_avx512

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 fix faiss ScalarQuantizer_avx512

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 clean code

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 remove ScalarQuantizer_avx512 and IndexScalarQuantizer_avx512

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 change back index_factory.cpp/index_read.cpp/index_write.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 split ScalarQuantizer to ScalarQuantizerCodec and Similarity

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 #1122 split ScalarQuantizer to ScalarQuantizerCodec

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 split ScalarQuantizerCodec.cpp to ScalarQuantizerOp.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 ScalarQuantizer support avx512

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 add hook sse for ScalarQuantizer

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 correct head file

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 add changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 fix CodeFactor

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1122 fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-02-29 21:01:48 +08:00
Jin Hai dab74700b2
Delete and WAL feature branch merge (#1436)
* add read/write lock

* change compact to ddl queue

* add api to get vector data

* add flush / merge / compact lock

* add api to get vector data

* add data size for table info

* add db recovery test

* add data_size check

* change file name to uppercase

Signed-off-by: jinhai <hai.jin@zilliz.com>

* update wal flush_merge_compact_mutex_

* update wal flush_merge_compact_mutex_

* change requirement

* change requirement

* upd requirement

* add logging

* add logging

* add logging

* add logging

* add logging

* add logging

* add logging

* add logging

* add logging

* delete part

* add all size checks

* fix bug

* update faiss get_vector_by_id

* add get_vector case

* update get vector by id

* update server

* fix DBImpl

* attempting to fix #1268

* lint

* update unit test

* fix #1259

* issue 1271 fix wal config

* update

* fix cases

Signed-off-by: del.zhenwu <zhenxiang.li@zilliz.com>

* update read / write error message

* update read / write error message

* [skip ci] get vectors by id from raw files instead faiss

* [skip ci] update FilesByType meta

* update

* fix ci error

* update

* lint

* Hide partition_name parameter

* Remove douban pip source

Signed-off-by: zhenwu <zw@zilliz.com>

* Update epsilon value in test cases

Signed-off-by: zhenwu <zw@zilliz.com>

* Add default partition

* Caiyd crud (#1313)

* fix clang format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest build error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add faiss_bitset_test

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* avoid user directly operate partition table

* fix has table bug

* Caiyd crud (#1323)

* fix clang format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest build error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* use compile option -O3

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update faiss_bitset_test.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change open flags

* change OngoingFileChecker to static instance

* mark ongoing files when applying deletes

* update clean up with ttl

* fix centos ci

* update

* lint

* update partition

Signed-off-by: zhenwu <zw@zilliz.com>

* update delete and flush to include partitions

* update

* Update cases

Signed-off-by: zhenwu <zw@zilliz.com>

* Fix test cases crud (#1350)

* fix order

* add wal case

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix wal case

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix wal case

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix wal case

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix invalid operation issue

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix invalid operation issue

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix bug

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix bug

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* crud fix

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* crud fix

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* add table info test cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* merge cases

Signed-off-by: zhenwu <zw@zilliz.com>

* Shengjun (#1349)

* Add GPU sharing solution on native Kubernetes  (#1102)

* run hadolint with reviewdog

* add LINCENSE in Dockerfile

* run hadolint with reviewdog

* Reporter of reviewdog command is "github-pr-check"

* format Dockerfile

* ignore DL3007 in hadolint

* clean up old docker images

* Add GPU sharing solution on native Kubernetes

* nightly test mailer

* Fix http server bug (#1096)

* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* change gpu resources invoke way to cmd()

* set advanced config name add DEFAULT

* change config setting to cmd

* modify ..

* optimize code

* assign TableDto' count default value 0 (fix #995)

* check if table exists when show partitions (fix #1028)

* check table exists when drop partition (fix #1029)

* check if partition name is legal (fix #1022)

* modify status code when partition tag is illegal

* update changlog

* add info to /system url

* add binary index and add bin uri & handler method(not completed)

* optimize http insert and search time(fix #1066) | add binary vectors support(fix #1067)

* fix test partition bug

* fix test bug when check insert records

* add binary vectors test

* add default for offset and page_size

* fix uinttest bug

* [skip ci] remove comments

* optimize web code for PR comments

* add new folder named utils

* check offset and pagesize (fix #1082)

* improve error message if offset or page_size is not legal (fix #1075)

* add log into web module

* update changlog

* check gpu sources setting when assign repeated value (fix #990)

* update changlog

* clang-format pass

* add default handler in http handler

* [skip ci] improve error msg when check gpu resources

* change check offset way

* remove func IsIntStr

* add case

* change int32 to int64 when check number str

* add log in we module(doing)

* update test case

* add log in web controller

Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>

* Filtering for specific paths in Jenkins CI  (#1107)

* run hadolint with reviewdog

* add LINCENSE in Dockerfile

* run hadolint with reviewdog

* Reporter of reviewdog command is "github-pr-check"

* format Dockerfile

* ignore DL3007 in hadolint

* clean up old docker images

* Add GPU sharing solution on native Kubernetes

* nightly test mailer

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Fix Filtering for specific paths in Jenkins CI bug (#1109)

* run hadolint with reviewdog

* add LINCENSE in Dockerfile

* run hadolint with reviewdog

* Reporter of reviewdog command is "github-pr-check"

* format Dockerfile

* ignore DL3007 in hadolint

* clean up old docker images

* Add GPU sharing solution on native Kubernetes

* nightly test mailer

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Fix Filtering for specific paths in Jenkins CI bug (#1110)

* run hadolint with reviewdog

* add LINCENSE in Dockerfile

* run hadolint with reviewdog

* Reporter of reviewdog command is "github-pr-check"

* format Dockerfile

* ignore DL3007 in hadolint

* clean up old docker images

* Add GPU sharing solution on native Kubernetes

* nightly test mailer

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Don't skip ci when triggered by a time (#1113)

* run hadolint with reviewdog

* add LINCENSE in Dockerfile

* run hadolint with reviewdog

* Reporter of reviewdog command is "github-pr-check"

* format Dockerfile

* ignore DL3007 in hadolint

* clean up old docker images

* Add GPU sharing solution on native Kubernetes

* nightly test mailer

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Don't skip ci when triggered by a time

* Don't skip ci when triggered by a time

* Set default sending to Milvus Dev mail group  (#1121)

* run hadolint with reviewdog

* add LINCENSE in Dockerfile

* run hadolint with reviewdog

* Reporter of reviewdog command is "github-pr-check"

* format Dockerfile

* ignore DL3007 in hadolint

* clean up old docker images

* Add GPU sharing solution on native Kubernetes

* nightly test mailer

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Test filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* Filtering for specific paths in Jenkins CI

* No skip ci when triggered by a time

* Don't skip ci when triggered by a time

* Set default sending to Milvus Dev

* Support hnsw (#1131)

* add hnsw

* add config

* format...

* format..

* Remove test.template (#1129)

* Update framework

* remove files

* Remove files

* Remove ann-acc cases && Update java-sdk cases

* change cn to en

* [skip ci] remove doc test

* [skip ci] change cn to en

* Case stability

* Add mail notification when test failed

* Add main notification

* Add main notification

* gen milvus instance from utils

* Distable case with multiprocess

* Add mail notification when nightly test failed

* add milvus handler param

* add http handler

* Remove test.template

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>

* Add doc for the RESTful API / Update contributor number in Milvus readme (#1100)

* [skip ci] Update contributor number.

* [skip ci] Add RESTful API doc.

* [skip ci] Some updates.

* [skip ci] Change port to 19121.

* [skip ci] Update README.md.

Update the descriptions for OPTIONS.

* Update README.md

Fix a typo.

* #1105 update error message when creating IVFSQ8H index without GPU resources (#1117)

* [skip ci] Update README (#1104)

* remove Nvidia owned files from faiss (#1136)

* #1135 remove Nvidia owned files from faiss

* Revert "#1135 remove Nvidia owned files from faiss"

This reverts commit 3bc007c28c.

* #1135 remove Nvidia API implementation

* #1135 remove Nvidia owned files from faiss

* Update CODE_OF_CONDUCT.md (#1163)

* Improve codecov (#1095)

* Optimize config test. Dir src/config 99% lines covered

* add unittest coverage

* optimize cache&config unittest

* code format

* format

* format code

* fix merge conflict

* cover src/utils unittest

*  '#831 fix exe_path judge error'

* #831 fix exe_path judge error

* add some unittest coverage

* add some unittest coverage

* improve coverage of src/wrapper

* improve src/wrapper coverage

* *test optimize db/meta unittest

* fix bug

* *test optimize mysqlMetaImpl unittest

* *style: format code

* import server& scheduler unittest coverage

* handover next work

* *test: add some test_meta test case

* *format code

* *fix: fix typo

* feat(codecov): improve code coverage for src/db(#872)

* feat(codecov): improve code coverage for src/db/engine(#872)

* feat(codecov): improve code coverage(#872)

* fix config unittest bug

* feat(codecov): improve code coverage core/db/engine(#872)

* feat(codecov): improve code coverage core/knowhere

* feat(codecov): improve code coverage core/knowhere

* feat(codecov): improve code coverage

* feat(codecov): fix cpu test some error

* feat(codecov): improve code coverage

* feat(codecov): rename some fiu

* fix(db/meta): fix switch/case default action

* feat(codecov): improve code coverage(#872)
* fix error caused by merge code
* format code

* feat(codecov): improve code coverage & format code(#872)

* feat(codecov): fix test error(#872)

* feat(codecov): fix unittest test_mem(#872)

* feat(codecov): fix unittest(#872)

* feat(codecov): fix unittest for resource manager(#872)

* feat(codecov): code format (#872)

* feat(codecov): trigger ci(#872)

* fix(RequestScheduler): remove a wrong sleep statement

* test(test_rpc): fix rpc test

* Fix format issue

* Remove unused comments

* Fix unit test error

Co-authored-by: ABNER-1 <ABNER-1@users.noreply.github.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>

* Support run dev test with http handler in python SDK (#1116)

* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* change gpu resources invoke way to cmd()

* set advanced config name add DEFAULT

* change config setting to cmd

* modify ..

* optimize code

* assign TableDto' count default value 0 (fix #995)

* check if table exists when show partitions (fix #1028)

* check table exists when drop partition (fix #1029)

* check if partition name is legal (fix #1022)

* modify status code when partition tag is illegal

* update changlog

* add info to /system url

* add binary index and add bin uri & handler method(not completed)

* optimize http insert and search time(fix #1066) | add binary vectors support(fix #1067)

* fix test partition bug

* fix test bug when check insert records

* add binary vectors test

* add default for offset and page_size

* fix uinttest bug

* [skip ci] remove comments

* optimize web code for PR comments

* add new folder named utils

* check offset and pagesize (fix #1082)

* improve error message if offset or page_size is not legal (fix #1075)

* add log into web module

* update changlog

* check gpu sources setting when assign repeated value (fix #990)

* update changlog

* clang-format pass

* add default handler in http handler

* [skip ci] improve error msg when check gpu resources

* change check offset way

* remove func IsIntStr

* add case

* change int32 to int64 when check number str

* add log in we module(doing)

* update test case

* add log in web controller

* remove surplus dot

* add preload into /system/

* change get_milvus() to get_milvus(args['handler'])

* support load table into memory with http server (fix #1115)

* [skip ci] comment surplus dto in VectorDto

Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>

* Fix #1140 (#1162)

* fix

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* fix2

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* fix3

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update changelog

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* Update INSTALL.md (#1175)

* Update INSTALL.md

1. Change image tag and Milvus source code to latest.
2. Fix a typo

Signed-off-by: Lu Wang <yamasite@qq.com>

* Update INSTALL.md

Signed-off-by: lu.wang <yamasite@qq.com>

* add Tanimoto ground truth (#1138)

* add milvus ground truth

* add milvus groundtruth

* [skip ci] add milvus ground truth

* [skip ci]add tanimoto ground truth

* fix mix case bug (#1208)

* fix mix case bug

Signed-off-by: del.zhenwu <zhenxiang.li@zilliz.com>

* Remove case.md

Signed-off-by: del.zhenwu <zhenxiang.li@zilliz.com>

* Update README.md (#1206)

Add LFAI mailing lists.

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Add design.md to store links to design docs (#1219)

* Update README.md

Add link to Milvus design docs

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Create design.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update design.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Add troubleshooting info about libmysqlpp.so.3 error (#1225)

* Update INSTALL.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update INSTALL.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update README.md (#1233)

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* #1240 Update license declaration of each file (#1241)

* #1240 Update license declaration of each files

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #1240 Update CHANGELOG

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Update README.md (#1258)

Add Jenkins master badge.

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update INSTALL.md (#1265)

Fix indentation.

* support CPU profiling (#1251)

* #1250 support CPU profiling

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1250 fix code coverage

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* Fix HNSW crash (#1262)

* fix

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* update.

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* Add troubleshooting information for INSTALL.md and enhance readability (#1274)

* Update INSTALL.md

1. Add new troubleshooting message;
2. Enhance readability.

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update INSTALL.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update INSTALL.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update INSTALL.md

Add CentOS link.

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Create COMMUNITY.md (#1292)

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* fix gtest

* add copyright

* fix gtest

* MERGE_NOT_YET

* fix lint

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
Co-authored-by: BossZou <40255591+BossZou@users.noreply.github.com>
Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Tinkerrr <linxiaojun.cn@outlook.com>
Co-authored-by: del-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
Co-authored-by: Lutkin Wang <yamasite@qq.com>
Co-authored-by: shengjh <46514371+shengjh@users.noreply.github.com>
Co-authored-by: ABNER-1 <ABNER-1@users.noreply.github.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
Co-authored-by: shiyu22 <cshiyu22@gmail.com>

* #1302 Get all record IDs in a segment by given a segment id

* Remove query time ranges

Signed-off-by: zhenwu <zw@zilliz.com>

* #1295 let wal enable by default

* fix cases

Signed-off-by: zhenwu <zw@zilliz.com>

* fix partition cases

Signed-off-by: zhenwu <zw@zilliz.com>

* [skip ci] update test_db

* update

* fix case bug

Signed-off-by: zhenwu <zw@zilliz.com>

* lint

* fix test case failures

* remove some code

* Caiyd crud 1 (#1377)

* fix clang format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest build error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix build issue when enable profiling

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix hastable bug

* update bloom filter

* update

* benchmark

* update benchmark

* update

* update

* remove wal record size

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* remove wal record size config

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* update apply deletes: switch to binary search

* update sdk_simple

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update apply deletes: switch to binary search

* add test_search_by_id

Signed-off-by: zhenwu <zw@zilliz.com>

* add more log

* flush error with multi same ids

Signed-off-by: zhenwu <zw@zilliz.com>

* modify wal config

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* update

* add binary search_by_id

* fix case bug

Signed-off-by: zhenwu <zw@zilliz.com>

* update cases

Signed-off-by: zhenwu <zw@zilliz.com>

* fix unit test #1395

* improve merge performance

* add uids_ for VectorIndex to improve search performance

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update

* fix search

* fix record num

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* refine code

* refine code

* Add get_vector_ids test cases (#1407)

* fix order

* add wal case

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix wal case

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix wal case

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix wal case

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix invalid operation issue

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix invalid operation issue

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix bug

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix bug

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* crud fix

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* crud fix

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* add table info test cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* add to compact case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* add to compact case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* add to compact case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* add case and debug compact

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* test pdb

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* test pdb

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* test pdb

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* update table_info case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* update table_info case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* update table_info case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* update get vector ids case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* update get vector ids case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* update get vector ids case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* update get vector ids case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* update case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* update case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* update case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* update case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* update case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* pdb test

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* pdb test

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* add tests for get_vector_ids

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix case

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* add binary and ip

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix binary index

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix pdb

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* #1408 fix search result in-correct after DeleteById

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add one case

* delete failed segment

* update serialize

* update serialize

* fix case

Signed-off-by: zhenwu <zw@zilliz.com>

* update

* update case assertion

Signed-off-by: zhenwu <zw@zilliz.com>

* [skip ci] update config

* change bloom filter msync flag to async

* #1319 add more timing debug info

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update

* update

* add normalize

Signed-off-by: zhenwu <zw@zilliz.com>

* add normalize

Signed-off-by: zhenwu <zw@zilliz.com>

* add normalize

Signed-off-by: zhenwu <zw@zilliz.com>

* Fix compiling error

Signed-off-by: jinhai <hai.jin@zilliz.com>

* support ip (#1383)

* support ip

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* IP result distance sort by descend

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* format

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* get table lsn

* Remove unused third party

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Refine code

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #1319 fix clang format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix wal applied lsn

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* validate partition tag

* #1319 improve search performance

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* build error

Co-authored-by: Zhiru Zhu <youny626@hotmail.com>
Co-authored-by: groot <yihua.mo@zilliz.com>
Co-authored-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
Co-authored-by: shengjh <46514371+shengjh@users.noreply.github.com>
Co-authored-by: del-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
Co-authored-by: shengjun.li <49774184+shengjun1985@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
Co-authored-by: BossZou <40255591+BossZou@users.noreply.github.com>
Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Tinkerrr <linxiaojun.cn@outlook.com>
Co-authored-by: Lutkin Wang <yamasite@qq.com>
Co-authored-by: ABNER-1 <ABNER-1@users.noreply.github.com>
Co-authored-by: shiyu22 <cshiyu22@gmail.com>
2020-02-29 16:11:31 +08:00
Cai Yudong 636f5c9cb6
#1234 do service check when Milvus startup (#1404)
* #1234 do service check when Milvus startup

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1234 update error log

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-02-28 10:05:30 +08:00
Lutkin Wang 09b0a69c1c
In INSTALL.md, compilation in docker images should be confined to the Linux platform (#1389)
* Update CHANGELOG.md

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

* Update INSTALL.md

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

* Update INSTALL.md

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-02-27 17:19:51 +08:00
BossZou c63a50c635
Allow system conf modifiable and some take effect directly #1263 (#1287)
* finish configure modifiable and some take effect runtime

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* move test file to unittet folder

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add test case for cofig

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix format issue

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* optimize callback

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix error when get config by http in CPU mode

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update callback map

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* correct typo

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update callback register

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add identity in registers

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add identity in FaissPass class

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add comments at cmd test if fail

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove some comments and add test for validate storage path

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* format pass

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove endpoint info and update CORS

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add test case in web module to test drop a non-existent table

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* optimize config store

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add check code in config

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add scheduler gpu handler

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update optimizer faiss pass

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add default value of gpu_enable_ in GpuCacheMgr

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* optimize code: remove comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* format pass

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add gpu macro in optimizer handler module to fix compile bug on cpu version

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* change cache setting unit  bytes

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* rename variables

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-02-26 18:54:32 +08:00
Lutkin Wang a55cb9fe7e
Add Git as a requirement for compilation (#1378)
* Update INSTALL.md

Add Git as a requirement.

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

* Update CHANGELOG.md

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
2020-02-26 11:56:16 +08:00
Jin Hai 31db46e82a
Exclude code from Codacy (#1381)
* #1240 Update license declaration of each files

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #1240 Update CHANGELOG

Signed-off-by: jinhai <hai.jin@zilliz.com>

* change file name to uppercase

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #1327 Exclude third-party code from codebeat

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1327 Exclude third-party code from codebeat

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1331 Exclude code from Codacy

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-02-25 23:30:30 +08:00
Jin Hai c6f5dad104
Exclude third-party code from codebeat (#1379)
* #1240 Update license declaration of each files

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #1240 Update CHANGELOG

Signed-off-by: jinhai <hai.jin@zilliz.com>

* change file name to uppercase

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #1327 Exclude third-party code from codebeat

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1327 Exclude third-party code from codebeat

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-02-25 23:09:31 +08:00
Lutkin Wang 3193ed24b3
Update badges for EN/CN/JP readme (#1342)
* Update CHANGELOG.md

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

* Update README_JP.md

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

* Update README_CN.md

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

* Update README.md

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
2020-02-24 20:04:56 +08:00
yudong.cai 52698ebc16 #1320 remove debug logging from faiss
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-02-22 20:58:43 +08:00
Tinkerrr 078825e92b
Fix #1298 (#1316)
* fix

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* update.

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* update

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* update..

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-02-22 19:34:10 +08:00
Lutkin Wang bfb40ca3fb
Update CN/JPN readme per the latest EN readme (#1305)
* Update README_JP.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update README_JP.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update README_CN.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update README_CN.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update README_JP.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update README_CN.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update README_JP.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update README_CN.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>

* Update CHANGELOG.md

Signed-off-by: Lutkin Wang <yamasite@qq.com>
2020-02-22 17:59:15 +08:00
Tinkerrr abd91eab82
Fix HNSW crash (#1262)
* fix

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* update.

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-02-19 17:16:48 +08:00
Jin Hai e1027e9e65
#1240 Update license declaration of each file (#1241)
* #1240 Update license declaration of each files

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #1240 Update CHANGELOG

Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-02-17 23:40:58 +08:00
Tinkerrr 191a8c9941
Fix #1140 (#1162)
* fix

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* fix2

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* fix3

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update changelog

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
2020-02-14 12:04:09 +08:00
BossZou f10f6cd5f4
Support run dev test with http handler in python SDK (#1116)
* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* change gpu resources invoke way to cmd()

* set advanced config name add DEFAULT

* change config setting to cmd

* modify ..

* optimize code

* assign TableDto' count default value 0 (fix #995)

* check if table exists when show partitions (fix #1028)

* check table exists when drop partition (fix #1029)

* check if partition name is legal (fix #1022)

* modify status code when partition tag is illegal

* update changlog

* add info to /system url

* add binary index and add bin uri & handler method(not completed)

* optimize http insert and search time(fix #1066) | add binary vectors support(fix #1067)

* fix test partition bug

* fix test bug when check insert records

* add binary vectors test

* add default for offset and page_size

* fix uinttest bug

* [skip ci] remove comments

* optimize web code for PR comments

* add new folder named utils

* check offset and pagesize (fix #1082)

* improve error message if offset or page_size is not legal (fix #1075)

* add log into web module

* update changlog

* check gpu sources setting when assign repeated value (fix #990)

* update changlog

* clang-format pass

* add default handler in http handler

* [skip ci] improve error msg when check gpu resources

* change check offset way

* remove func IsIntStr

* add case

* change int32 to int64 when check number str

* add log in we module(doing)

* update test case

* add log in web controller

* remove surplus dot

* add preload into /system/

* change get_milvus() to get_milvus(args['handler'])

* support load table into memory with http server (fix #1115)

* [skip ci] comment surplus dto in VectorDto

Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-02-14 11:07:09 +08:00
Cai Yudong ef0e3145eb
#1105 update error message when creating IVFSQ8H index without GPU resources (#1117) 2020-02-08 11:25:10 +08:00
BossZou 61517339ea Fix http server bug (#1096)
* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* change gpu resources invoke way to cmd()

* set advanced config name add DEFAULT

* change config setting to cmd

* modify ..

* optimize code

* assign TableDto' count default value 0 (fix #995)

* check if table exists when show partitions (fix #1028)

* check table exists when drop partition (fix #1029)

* check if partition name is legal (fix #1022)

* modify status code when partition tag is illegal

* update changlog

* add info to /system url

* add binary index and add bin uri & handler method(not completed)

* optimize http insert and search time(fix #1066) | add binary vectors support(fix #1067)

* fix test partition bug

* fix test bug when check insert records

* add binary vectors test

* add default for offset and page_size

* fix uinttest bug

* [skip ci] remove comments

* optimize web code for PR comments

* add new folder named utils

* check offset and pagesize (fix #1082)

* improve error message if offset or page_size is not legal (fix #1075)

* add log into web module

* update changlog

* check gpu sources setting when assign repeated value (fix #990)

* update changlog

* clang-format pass

* add default handler in http handler

* [skip ci] improve error msg when check gpu resources

* change check offset way

* remove func IsIntStr

* add case

* change int32 to int64 when check number str

* add log in we module(doing)

* update test case

* add log in web controller

Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-01-19 19:19:09 +08:00
Cai Yudong a909f95c6c #1078 Move 'insert_buffer_size' to Cache Config section (#1085)
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-01-18 10:08:46 +08:00
Cai Yudong 364fc25766 rename 'minio' to 's3' in Storage Config section (#1088)
* #1002 rename 'minio' to 's3' in Storage Config section

* #1002 clang format
2020-01-18 10:07:46 +08:00
BossZou 015f0352a6 Fix http bug & add binary vectors support (#1073)
* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* change gpu resources invoke way to cmd()

* set advanced config name add DEFAULT

* change config setting to cmd

* modify ..

* optimize code

* assign TableDto' count default value 0 (fix #995)

* check if table exists when show partitions (fix #1028)

* check table exists when drop partition (fix #1029)

* check if partition name is legal (fix #1022)

* modify status code when partition tag is illegal

* update changlog

* add info to /system url

* add binary index and add bin uri & handler method(not completed)

* optimize http insert and search time(fix #1066) | add binary vectors support(fix #1067)

* fix test partition bug

* fix test bug when check insert records

* add binary vectors test

* add default for offset and page_size

* fix uinttest bug

* [skip ci] remove comments

* optimize web code for PR comments

* add new folder named utils

Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-01-18 10:05:49 +08:00
groot 0f1aa5f8bb Tanimoto distance (#1016)
* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__

* clang-format

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* define interface

* Define interface (#832)

* If partition tag is similar, wrong partition is searched  (#825)

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* define interface Attach files by dragging & dropping, selecting or pasting them. 

Co-authored-by: groot <yihua.mo@zilliz.com>

* faiss & knowhere

* faiss & knowhere (#842)

* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__

* clang-format

* If partition tag is similar, wrong partition is searched  (#825)

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* faiss & knowhere

Co-authored-by: groot <yihua.mo@zilliz.com>

* support binary input

* code lint

* add wrapper interface

* add knowhere unittest

* sdk support binary

* support using metric tanimoto and hamming

* sdk binary insert/query example

* fix bug

* fix bug

* update wrapper

* format

* Improve unittest and fix bugs

* delete printresult

* fix bug

* #823 Support binary vector tanimoto metric

* fix typo

* dimension limit to 32768

* fix

* dimension limit to 32768

* fix describe index bug

* fix #886

* fix #889

* add jaccard cases

* hamming dev-test case

* change test_connect

* Add tanimoto cases

* change the output type of hamming

* add abs

* merge master

* rearrange changelog id

* modify feature description

Co-authored-by: Yukikaze-CZR <48198922+Yukikaze-CZR@users.noreply.github.com>
Co-authored-by: Tinkerrr <linxiaojun.cn@outlook.com>
2020-01-14 19:22:27 +08:00
groot f6b72d9605 #977 Server crash when create tables concurrently (#991)
* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* #977 Server crash when create tables concurrently
2020-01-13 13:59:08 +08:00
BossZou a0faf1a786 Add http server (#956)
* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* set advanced config name add DEFAULT

Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-01-13 13:55:48 +08:00
Cai Yudong b2f19ace0e #966 update NOTICE.md (#967) 2020-01-09 15:35:13 +08:00
Cai Yudong 69d42a3d70 remove collector from config (#939)
* #931 remove collector from config

* #931 fix test_metrics build error
2020-01-07 16:14:38 +08:00
yukun a92a43e282 Add push mode for prometheus monitor (#905)
* Add push mode for prometheus monitor

* format code

* fix for comments

* fix test_MetricBase bug

* Change ip to address in config
2020-01-06 18:35:10 +08:00
Jin Hai a876ae1b64
Change C++ standard to c++17 (#911)
* [skip ci]#668 - Update badge of README

* Fix README.md

* Fix README.md

* Merge remote-tracking branch 'upstream/master'

* #910 Change c++ standard to c++17

* Remove unused headers
2020-01-04 18:48:22 +08:00
李盛俊 82eb69fbed remove redundant checks (#860) (#907)
* delete redundant check (#860)

* add changelog

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-01-04 15:52:48 +08:00
Cai Yudong 28da6c73d0 #908 move primary_path and secondary_path to storage config (#909) 2020-01-04 15:44:46 +08:00
Cai Yudong b9d9b8ecc2 support minio storage (#895)
* #815 add S3 client

* #815 update S3 interface

* #815 add bucket_name_ as class field, add StartService() and StopService()

* #815 add FileIOReader and FileIOWriter

* #815 fix unittest test_storage build error

* #815 add GetObjectStr()

* #815 add S3IOReader/S3IOWriter

* #815 add ListObjects(), support put string with \0, launch S3 service when server start

* #815 read/write s3 index file pass

* #815 add MinIO related config

* #815 fix storage config issuegs

* #815 code clean

* #815 use local file or S3 via minio_enable

* #815 add DeleteObjects() for S3

* #815 print out IO rate when read_index & write_index

* #815 clean code

* #815 fix centos build error

* #815 support MinIO storage

* #815 fix typo
2020-01-04 10:39:52 +08:00
Yukikaze-CZR 397a757f6f IVFTest.gpu_seal_test unittest failed #805 (#888)
* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__

* clang-format

* IVFTest.gpu_seal_test unittest failed #805

* rerun jenkins CI

* fix test_util
2020-01-02 14:03:28 +08:00
Heisenberg-Y 1e72267a65 add cpu mode for built-in Faiss (#841)
* add cpu mode for built-in Faiss

* delete customization options on build stage

* delete faiss version

* delete customization options on build stage

* fix unittest problem in cpu mode

* fix unittest problem in cpu mode

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2019-12-28 17:28:11 +08:00
Cai Yudong 9f65f228a1 #848 add ready-to-use config files to the Milvus repo for enhanced user experience (#858) 2019-12-28 14:24:19 +08:00
ABNER-1 546a1fcb74 Fix common util judge error (#835)
*  '#831 fix exe_path judge error'

* #831 fix exe_path judge error
2019-12-26 14:18:11 +08:00
Cai Yudong 09701c3f2b #216 add CLI to get system info (#806) 2019-12-26 14:16:20 +08:00
groot df4cb81f69 If partition tag is similar, wrong partition is searched (#825)
* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo
2019-12-25 17:20:16 +08:00
Tinkerrr d37670bd3e Remove Arrow (#817)
* replace arrow

* format

* update changelog

* code-style

* fix bug

* fix 2

* fix 3

* fix 4

* change build timeout on Jenkinsfile
2019-12-25 15:34:51 +08:00
Zhiru Zhu 8e3b4ccd57 Use openblas / lapack from apt install (#739)
* remove build openblas/lapack and use find_package

* update ubuntu_build_deps.sh

* update build image

* update build image

* update CHANGELOG

* trigger ci

* update image

* update centos build envvironment image on Jenkins CI

* trigger ci
2019-12-21 13:37:53 +08:00
Cai Yudong 608c86e8cb #758 enhance config description (#804) 2019-12-21 11:02:01 +08:00
yukun 79957330d7 Put C++ sdk out of milvus/core (#785)
* Put C++ sdk out of milvus/core

* Delete core/src/sdk

* Add clang-format for c++ sdk

* Add README.md for sdk

* Server unittest run failed on low-end server

* set gpu_cache_capacity to 1G
2019-12-20 14:08:45 +08:00
Cai Yudong 04bd700668 fix Milvus crash when searching and building index simultaneously using SQ8H (#794)
* #715 fix Milvus crash when searching and building index simultaneously using SQ8H

* #715 fix update
2019-12-19 21:45:14 +08:00
Cai Yudong 7c02c3760e #771 add ProcessCommand() to process pre-defined commands (#777) 2019-12-17 10:48:28 +08:00
Cai Yudong 41d7500f61 support config cli test 2 (#764)
* #665 support get/set config via CLI

* #665 support get/set config via CLI

* #665 add unittest for config CLI

* #665 remove config_node_map_

* #665 remove config_node_map_

* #665 fix clang-format

* #665 fix clang-format

* #665 update changelog

* #665 code clean

* #665 update API interface

* #665 update API interface

* #665 handle server status

* #665 handle unknown command

* #665 update debug log

* #665 rollback CmdRequest.cpp
2019-12-14 15:11:02 +08:00
groot 86b83fb32a #744 do not return partition table for show_tables (#747) 2019-12-13 10:54:17 +08:00
BossZou 5e045af51f Refactor server module separating Grpc from server handler and scheduler (#757)
* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t
2019-12-12 14:13:22 +08:00
Zhiru Zhu e99896ac62 Add Opentracing (#729)
* add TracerUtil

* Interceptor ok

* add handler

* add context

* minor update

* keep span in trace context

* add span in search okay

* Update Context.cpp

* refactor

* refactor

* refactor

* format

* add context in SearchJob

* trace search okay

* add back finish span in interceptor

* add namespace

* add tracing config in server config

* add random id

* debug mode okay

* update CMakeLists

* add opentracing to cmake

* update unittest

* add tracing namespace

* remove std::run_time error

* add lock when erasing context_map

* update tracing config

* lint

* update CHANGELOG

* small fix

* fix server unit test

* fix scheduler unit test

* fix db unit test

* lint

* fix db unit test gpu version

* rename to tracing_config

* fix

* update

* trigger ci
2019-12-10 15:24:54 +08:00
Jin Hai 827ed1fd3d
Update CHANGELOG.md (#722) 2019-12-07 16:25:32 +08:00
Cai Yudong 1193526719 show last commit id when server start (#717)
* #709 show last commit id when server start

* #709 fix typo error
2019-12-06 14:31:53 +08:00
groot ebb4cedeb7 #696 metric_type changed from IP to L2 (#710)
* #670 Random failure of unittest db_test::SEARCH_TEST

* add an important log

* add an important log

* add an important log

* #674 server down in stability test

* add more log

* remove log

* #696 metric_type changed from IP to L2
2019-12-05 17:32:41 +08:00
groot 564095fd8d #674 server down in stability test (#708)
* #670 Random failure of unittest db_test::SEARCH_TEST

* add an important log

* add an important log

* add an important log

* #674 server down in stability test

* add more log

* remove log
2019-12-05 16:50:53 +08:00
Cai Yudong 5970450d48 #705 fix search SQ8H crash without GPU resource (#706) 2019-12-05 11:42:09 +08:00
Jin Hai c2328fbc18
[skip ci]#668 - Update badge of README (#669) 2019-12-04 10:14:42 +08:00
groot 3321a82c32 #670 Random failure of unittest db_test::SEARCH_TEST (#671) 2019-12-04 10:11:50 +08:00
Jin Hai 56e3b8feb1
Merge pull request #650 from Yukikaze-CZR/0.6.0
IP search metric_type shouldn't be supported by IVF_PQ index on GPU v…
2019-12-03 17:21:58 +08:00
yudong.cai f330d9f902 #658 Milvus error out when building SQ8H index without GPU resources 2019-12-03 15:50:27 +08:00
Yukikaze-CZR c018bf0a08 Merge remote-tracking branch 'upstream/0.6.0' into 0.6.0 2019-12-03 14:41:44 +08:00
groot 6b52973b04 #654 Random crash when frequently insert vector one by one 2019-12-02 19:51:33 +08:00
Yukikaze-CZR 4ff8e871ae changelog fix 2019-12-02 17:48:55 +08:00
Yukikaze-CZR b5916b41bf Merge remote-tracking branch 'upstream/0.6.0' into 0.6.0 2019-12-02 16:08:09 +08:00
groot 3df535e11e #649 Typo partiton should be partition 2019-12-02 15:39:16 +08:00
Jin Hai 51e8be0130
Merge pull request #607 from yhmo/ongoing
#596 Frequently insert operation cost too much disk space
2019-12-02 15:06:19 +08:00
Yukikaze-CZR bee37170f4 IP search metric_type shouldn't be supported by IVF_PQ index on GPU version #616 #636 2019-12-02 14:40:16 +08:00
wxyu b12f861b51 Add a new rpc command to get milvus build version whether cpu or gpu close#644 2019-12-02 11:17:24 +08:00
groot 07ac2e32c0 merge 0.6.0 2019-12-02 10:30:22 +08:00
Nicky 3a87f16b74 Merge remote-tracking branch 'official/0.6.0' into issue-548 2019-12-01 15:30:34 +08:00
Jin Hai 23dffbf3b5
Merge pull request #635 from JinHai-CN/GPUCompile
#634 - FAISS GPU version is compiled with O0
2019-12-01 13:13:45 +08:00
bugfixer 216a534eff #634 - FAISS GPU version is compiled with O0 2019-12-01 01:52:17 +00:00
bugfixer c1bd16a55e #631 - FAISS isn't compiled with O3 option 2019-12-01 01:40:11 +00:00
Nicky d721e385d1 Merge remote-tracking branch 'official/0.6.0' into issue-548 2019-11-30 20:40:00 +08:00
Jin Hai e705fa3007
Merge pull request #609 from cydrain/caiyd_handle_search_exception
handle search exception
2019-11-30 19:47:16 +08:00
xiaojun.lin 6b84ec5f79 Merge remote-tracking branch 'official/0.6.0' into issue-548 2019-11-30 18:04:22 +08:00
Jin Hai 91b165d3cc
Merge pull request #624 from cydrain/caiyd_fix_gpu_index
fix gpu index build hang when gpu resources disabled
2019-11-30 17:43:07 +08:00
xiaojun.lin 8f09b1f230 solve part of the problem about nsg 2019-11-30 17:23:10 +08:00
groot 0b3f7e15c0 Merge remote-tracking branch 'source/0.6.0' into ongoing 2019-11-30 16:26:02 +08:00
Jin Hai 6f58f7550b
Merge pull request #608 from fishpenguin/0.6.0-yk-refactor-scheduler
NSG build failed using GPU-edition if set gpu_enable false
2019-11-30 16:16:04 +08:00
yudong.cai dcbe1a0c3f #579 when gpu resources disabled, use cpu index instead 2019-11-30 11:26:40 +08:00
Jin Hai 7b949861a8
Merge pull request #614 from cydrain/caiyd_remove_cpu_version_macro
#611 remove MILVUS_CPU_VERSION
2019-11-30 10:13:05 +08:00
yudong.cai 9a467fb1a0 #331 update changelog 2019-11-30 09:29:34 +08:00
groot 5380e0c9df Merge remote-tracking branch 'source/0.6.0' into ongoing 2019-11-29 16:15:47 +08:00
yudong.cai a023511f16 #611 remove MILVUS_CPU_VERSION 2019-11-29 16:02:08 +08:00
fishpenguin b458bdbd33 Merge remote-tracking branch 'upstream/0.6.0' into 0.6.0-yk-refactor-scheduler 2019-11-29 15:57:52 +08:00
Jin Hai 3566fbbc55
Merge pull request #612 from cydrain/caiyd_add_more_message_when_start
#605 print more messages when server start
2019-11-29 15:27:35 +08:00
yudong.cai 59f17fcc59 #605 print more messages when server start 2019-11-29 15:02:13 +08:00
groot ce10d1c86e merge 0.6.0 2019-11-29 14:49:53 +08:00
groot af5c5b3bdb #606 no log generated during building index with CPU 2019-11-29 14:47:13 +08:00
fishpenguin 1b6d90a5e1 Merge remote-tracking branch 'upstream/0.6.0' into 0.6.0-yk-refactor-scheduler 2019-11-29 11:38:40 +08:00
fishpenguin 4b8a72f9ae NSG build failed using GPU-edition if set gpu_enable false 2019-11-29 11:38:27 +08:00
groot 3a36d75404 Merge remote-tracking branch 'source/0.6.0' into ongoing 2019-11-29 10:47:46 +08:00
Jin Hai 7d0a3ae05d
Merge pull request #604 from Yukikaze-CZR/0.6.0
Increase code coverage rate #485
2019-11-29 10:35:55 +08:00
Jin Hai bf1f07eca8
Merge pull request #603 from fishpenguin/0.6.0-yk-refactor-scheduler
Optimizer specify wrong gpu_id
2019-11-29 10:35:08 +08:00
Jin Hai fc364d25ce
Merge pull request #595 from cydrain/caiyd_config_version
#560 add version in server config file
2019-11-29 10:34:03 +08:00
groot 930097128b #596 Frequently insert operation cost too much disk space 2019-11-29 10:30:10 +08:00
Yukikaze-CZR 3a8a83369b add changelog 2019-11-28 19:39:43 +08:00
fishpenguin a718c7c9bb Optimizer specify wrong gpu_id 2019-11-28 19:08:15 +08:00
groot bdf531524b #599 Build index log is incorrect 2019-11-28 17:56:04 +08:00
Jin Hai 5ec1237a6b
Merge pull request #593 from yhmo/preload
#274 logger the time cost during preloading data
2019-11-28 17:10:25 +08:00
Yukikaze-CZR 82e011d147
Merge branch '0.6.0' into 0.6.0 2019-11-28 17:02:49 +08:00
yudong.cai 2aad94b678 #560 add version in server config file 2019-11-28 16:12:39 +08:00
groot 2ae5771603 #274 logger the time cost during preloading data 2019-11-28 15:25:20 +08:00
Jin Hai 2780da6858
Merge pull request #586 from yhmo/0.6.0
#561 Milvus server should report exception/error message or terminate
2019-11-28 15:22:39 +08:00
Yukikaze-CZR 5a5e76fe6a #552 Server down during building index_type: IVF_PQ using GPU-edition 2019-11-28 14:37:23 +08:00
groot e1ae8e9ff9 Merge remote-tracking branch 'source/0.6.0' into 0.6.0 2019-11-28 14:26:07 +08:00
groot e1c6aea6a4 #561 Milvus server should report exception/error message or terminate on mysql metadata backend error 2019-11-28 12:29:34 +08:00
JinHai-CN 88f7dc56a2 Integrate internal faiss
Remove faiss docs
2019-11-28 11:42:54 +08:00
groot c37aa5a54b code lint 2019-11-27 18:11:49 +08:00
Jin Hai b0a680f5bb
Merge pull request #575 from youny626/0.6.0
Add AVX flags when building faiss
2019-11-27 15:55:38 +08:00
Jin Hai 095d07bf01
Merge pull request #562 from yhmo/migration
#354 Build migration scripts into milvus docker image
2019-11-27 15:53:43 +08:00
Zhiru Zhu 9f1f76b1d4 update CHANGELOG 2019-11-27 15:07:22 +08:00
Yukikaze-CZR 47abe4ff47 #504 The code coverage rate of core/src/scheduler/optimizer is too low 2019-11-27 14:21:53 +08:00
groot b4a2aed41f #354 Build migration scripts into milvus docker image 2019-11-27 10:34:58 +08:00
Jin Hai 48bd34b00b
Merge pull request #555 from yhmo/clean_cache
#530 BuildIndex stop when do build index and search simultaneously
2019-11-26 20:11:01 +08:00
groot 87a36ebdd4 Merge remote-tracking branch 'source/0.6.0' into clean_cache 2019-11-26 19:24:00 +08:00
yhz 2d5b908c05 fix changlog conflict 2019-11-26 18:33:50 +08:00
groot 8b652a00e2 #530 BuildIndex stop when do build index and search simultaneously 2019-11-26 18:08:15 +08:00
xiaojun.lin 88cb2b5991 NSG support MetricType IP 2019-11-26 17:15:14 +08:00
yhz 006a480fc8 [skip ci] update changlog; fix #543 2019-11-26 14:42:56 +08:00
yhz 3a3daf083b fix changlog conflict 2019-11-26 12:03:25 +08:00
yhz 80608890fe update changlog 2019-11-26 10:50:02 +08:00
yhz 5b23a7c34c fix python sdk test case bug 2019-11-26 10:36:07 +08:00
fishpenguin f1f90ec3e0 fix conflict 2019-11-26 10:21:01 +08:00
fishpenguin c07aa9a015 BuildIndex stop when do build index and search simultaneously 2019-11-26 10:19:49 +08:00
Jin Hai 03fe979301
Merge pull request #528 from Heisenberg-Y/0.6.0-ezio
Fix building error in faiss benchmark when using faiss 1.6.0
2019-11-25 23:17:29 +08:00
Jin Hai 1184b5b70c
Merge pull request #522 from tinkerlin/issue-509
fix issue-509
2019-11-25 23:16:11 +08:00
Jin Hai 88ca2c805f
Merge pull request #521 from tinkerlin/issue-465
Fix Issue 465
2019-11-25 23:09:52 +08:00
Tinkerrr 038850d6a9
Merge branch '0.6.0' into issue-509 2019-11-25 22:09:13 +08:00
Heisenberg ac180d7188 fix merge conflict 2019-11-25 19:57:16 +08:00
Heisenberg cf1e03980e fix issue 527 2019-11-25 19:48:47 +08:00
groot c2971cfd1e fix typo 2019-11-25 16:56:41 +08:00
groot 0c7c4586c0 #513 DELETE_BY_RANGE sometimes failed 2019-11-25 16:41:48 +08:00
xiaojun.lin 17fda26922 fix issue-509 2019-11-25 16:17:16 +08:00
xiaojun.lin 6d0d67ca95 update changelog 2019-11-25 15:28:25 +08:00
yhz d3c232a39f Merge remote-tracking branch 'main/0.6.0' into 0.6.0 2019-11-25 11:41:05 +08:00
yhz 35a25e01eb fix changlog conflict 2019-11-25 11:40:40 +08:00
Yukikaze-CZR d394091928 #502 Changelog upgrade 2019-11-23 15:49:33 +08:00
fishpenguin 288490f980 gpu no usage during index building 2019-11-23 11:07:42 +08:00
fishpenguin b68f4f43c1 Add log in scheduler/optimizer 2019-11-23 10:29:11 +08:00
Jin Hai 85aca5faf4
Merge pull request #474 from yhmo/0.6.0
#470 raw files should not be build index
2019-11-22 19:12:17 +08:00
Jin Hai 9790fbdbcf
Merge branch '0.6.0' into 0.6.0 2019-11-22 19:09:14 +08:00
groot 853aa663e9 Merge remote-tracking branch 'source/0.6.0' into 0.6.0 2019-11-22 16:34:14 +08:00
groot e96c97c8f7 #470 raw files should not be build index 2019-11-22 11:28:31 +08:00
Jin Hai 872726c003
Merge pull request #463 from tinkerlin/issue-458
move seal to Load
2019-11-22 10:09:36 +08:00
wxyu a9bc655cfb Read gpu config only gpu_resource_config.enable=true fix #467 2019-11-21 17:26:11 +08:00
xiaojun.lin 1ac30913e7 move seal to Load 2019-11-21 15:06:00 +08:00
groot 7fa7a2a65b #449 Add ShowPartitions example for C++ SDK 2019-11-21 11:28:28 +08:00
Jin Hai 01f9d31d08
Merge pull request #443 from fishpenguin/0.6.0-yk-refactor-scheduler
Query API in customization still uses old version
2019-11-21 10:49:48 +08:00
fishpenguin 29006f3cb5 fix conflict 2019-11-20 19:00:56 +08:00
fishpenguin 8a42c8759e Query API in customization still uses old version 2019-11-20 18:44:11 +08:00
groot 3beea54090 Merge remote-tracking branch 'source/0.6.0' into 0.6.0 2019-11-20 17:55:01 +08:00
groot 7c9b627f2b #433 C++ SDK query result is not easy to use 2019-11-20 17:54:45 +08:00
yhz bcdb84b403 Merge remote-tracking branch 'main/0.6.0' into 0.6.0 2019-11-20 17:27:40 +08:00
xiaojun.lin 863cc5dbaf Merge branch '0.6.0' into 0.6.0-#227 2019-11-20 16:23:39 +08:00
yhz 45a81df240 Merge remote-tracking branch 'main/0.6.0' into 0.6.0 2019-11-20 15:46:10 +08:00
groot 75c1186cd2 fix conflict 2019-11-20 15:04:41 +08:00
yhz 71a786e3cd Merge remote-tracking branch 'main/0.6.0' into 0.6.0 2019-11-20 15:02:27 +08:00
yhz 2ec159de93 [skip ci] update changlog 2019-11-20 15:00:41 +08:00
yudong.cai 82e6b2738b #306 update changelog 2019-11-20 14:35:10 +08:00
groot 50c4f98dc5 merge from 0.6.0 2019-11-20 12:25:17 +08:00
groot 15dcce417e #377 Create partition success if tag name only contains spaces 2019-11-20 12:24:18 +08:00
fishpenguin 30dcfa6719 fix conflict in SchedInst 2019-11-19 19:30:53 +08:00
wxyu 9f063aa289 Add a Fallback pass in optimizer close #409
add Fallback pass condition
2019-11-19 17:11:14 +08:00
Jin Hai 928b3ad8b5
Merge pull request #405 from scsven/dev
Add virtual method Init() in Pass abstract class close #404
2019-11-19 14:56:20 +08:00
fishpenguin 0a85893967 Merge remote-tracking branch 'upstream/0.6.0' into 0.6.0-yk 2019-11-19 14:18:59 +08:00
wxyu 7ad5c51497 Add virtual method Init() in Pass abstract class close #404 2019-11-19 12:29:05 +08:00
Jin Hai 2abbcad294
Merge pull request #398 from yhmo/0.6.0
#397 sdk_simple return incorrect result
2019-11-19 11:44:19 +08:00
JinHai-CN e70c8e029e #255 - Add ivfsq8 test report detailed version, update CHANGELOG.md 2019-11-18 19:12:36 +08:00
groot 3eefd55059 #397 sdk_simple return incorrect result 2019-11-18 18:54:25 +08:00
fishpenguin 964d1bfb0a Merge remote-tracking branch 'upstream/0.6.0' into 0.6.0-yk 2019-11-18 18:42:07 +08:00
groot f3ae1bf155 #266 Rpc request source code refactor 2019-11-18 15:10:15 +08:00
fishpenguin 35f1796355 fix conflicts 2019-11-18 14:32:09 +08:00
fishpenguin 513ad3b842 Support build index with multiple gpu 2019-11-18 11:38:48 +08:00
fishpenguin cd80cdba02 sdk_simple return empty result 2019-11-16 15:53:45 +08:00
Jin Hai 0aa90ea91d
Merge pull request #365 from scsven/dev
#327 fix flat doesn't use gpu bug
2019-11-15 20:09:28 +08:00
wxyu 6d1de33292 solve conflict 2019-11-15 19:47:29 +08:00
zirui.chen 4d1345b453 clang-format 2019-11-15 19:47:12 +08:00
wxyu 1b0ef89e07 fix flat search doesn't use gpu bug 2019-11-15 19:45:17 +08:00
groot 29586ba725 #353 Rename config.h.in to version.h.in 2019-11-15 19:06:14 +08:00
Jin Hai b0f1ab7e99
Merge pull request #359 from youny626/0.6.0
Update build.sh and install.md
2019-11-15 18:55:56 +08:00
Zhiru Zhu baa14fc2ce update CHANGELOG 2019-11-15 17:55:00 +08:00
zirui.chen be0bf607ca fix changelog 2019-11-15 15:06:49 +08:00
zirui.chen 1e991d0f25 format changelog and fix several problems 2019-11-15 15:00:45 +08:00
groot 1502cf87e0 #340 Test cases run failed on 0.6.0 2019-11-15 14:31:51 +08:00
Jin Hai 49ec7e1a7e
Merge pull request #334 from yhmo/0.6.0
#316 Some files not merged after vectors added
2019-11-15 14:27:21 +08:00
Jin Hai db75a9aeff
Merge pull request #335 from fishpenguin/0.6.0-yk
memory usage increased slowly during searching vectors
2019-11-15 14:25:26 +08:00
fishpenguin e728c6999b Merge remote-tracking branch 'upstream/0.6.0' into 0.6.0-yk 2019-11-14 20:22:53 +08:00
fishpenguin 95ceb8c7ba memory usage increased slowly during searching vectors 2019-11-14 20:22:49 +08:00
groot bb5f38b0dd #316 Some files not merged after vectors added 2019-11-14 19:25:53 +08:00
zirui.chen 9b1c57e07b Merge remote-tracking branch 'upstream/0.6.0' into 0.6.0 2019-11-14 18:57:03 +08:00
Zhiru Zhu 5a0e63ed38 update CHANGELOG 2019-11-14 18:20:46 +08:00