Commit Graph

6149 Commits (7fd76c40720587ad868be8d9624db924af17672b)

Author SHA1 Message Date
XuanYang-cn 4460757f85
Optimize fiu and finish thirdparty optimization (#3412)
* fiu runable

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* runable riu

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* optimize fiu and rm ThirdPartyPackages.cmake

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix bug

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix test using fiu

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-08-23 23:07:31 +08:00
yukun 9fcc38346c
Fix TestSearchDSL multi fields bug (#3411)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-08-22 11:17:45 +00:00
chen qingxiang 2e5ff884c1
fix the bugs of delete all and compact (#3395)
* fix the bugs of delete all and compact

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix the wrong usages in unittest

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix the bug of insert makes no effect

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* add character check in ExtraFileInfo and change the const size and type

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix wrong test case

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-08-22 10:37:27 +00:00
Cai Yudong 21407a5ce0
enable clang-tidy check (#3396)
* enable clang-tidy check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update run_clang_tidy.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* enable clang-tidy check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update run_clang_tidy.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update run_clang_tidy.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update run_clang_tidy.py

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove rule modernize-use-equals-default

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-08-22 17:44:57 +08:00
BossZou c66e40ccff
[skip ci] comment unused insert case (#3405)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-08-22 16:54:18 +08:00
ThreadDao 49218f5490
fix dsl term with multi fields (#3403)
Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-08-22 16:41:31 +08:00
del-zhenwu 2633319c9d
[skip ci] add constants.java (#3404)
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-08-22 16:10:31 +08:00
cqy123456 74c68a1c57
Master codacy check (#3366)
* codacy fix

Signed-off-by: cqy <yaya645@126.com>

* codacy

Signed-off-by: cqy <yaya645@126.com>

* codacy

Signed-off-by: cqy <yaya645@126.com>

* codacy check

Signed-off-by: cqy <yaya645@126.com>

* codacy

Signed-off-by: cqy <yaya645@126.com>

* codacy

Signed-off-by: cqy <yaya645@126.com>

* codacy

Signed-off-by: cqy <yaya645@126.com>

* clang-tiny

Signed-off-by: cqy <yaya645@126.com>

* clang-tidy check

Signed-off-by: cqy <yaya645@126.com>

* clang-tindy check

Signed-off-by: cqy <yaya645@126.com>

* clang-tidy check

Signed-off-by: cqy <yaya645@126.com>

* clang-tidy

Signed-off-by: cqy <yaya645@126.com>

* clang-tidy check

Signed-off-by: cqy <yaya645@126.com>

* clang-tidy check

Signed-off-by: cqy <yaya645@126.com>

* clang-tidy check

Signed-off-by: cqy <yaya645@126.com>

* clang-tidy check

Signed-off-by: cqy <yaya645@126.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-08-22 15:51:59 +08:00
FluorineDog 1a5fad87f5
Split Ftype into Ftype and FEtype (#3341)
* fix include directories not find bug (#3323)

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* reduce grpc download file size from 380M to 130M  (#3326)

* reduce grpc download file size from 380M to 130M

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix bug

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* update clang-tidy config (#3314)

* update clang-tidy config

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update .clang-tidy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update clang-tidy config

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update clang-tidy HeaderFilterRegex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* enable fetype

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* rename field_element_method

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* add FETYPE_TYPE

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* Add WebServer unittest (#3321)

* Add web server interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add unittest/server

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add web server ut

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* modify db schema and remove conversion

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* weak fetype

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* enforce strong fetype

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* lint

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* format code

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* [skip ci] fix

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

Co-authored-by: XuanYang-cn <51370125+XuanYang-cn@users.noreply.github.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: yukun <kun.yu@zilliz.com>
2020-08-22 05:00:10 +00:00
XuanYang-cn 79709ddcda
optimize oatpp (#3377)
* optimize oatpp

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix some bug

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fit atomic not find bug

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* add one config fo oatpp

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* change oatpp version

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* comment url_md5

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* change oatpp version

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* change aws target name

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-08-22 04:09:21 +00:00
XuanYang-cn f2ef1cd07e
Fix thirdparty not find ccache but still use it (#3398)
* fix sqlite ccache

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* thirdparty EP using ccache configure

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-08-22 11:32:00 +08:00
yukun 31868b89ef
Add GetPageEntity unittest (#3397)
* Add web server interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add unittest/server

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add web server ut

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix web server insert bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix web server ut crash bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix web server ut gpu compile error

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix codacy quality

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix row_num error

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change row insert to column insert

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix dsl issue

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetEntityByID bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add GetPageEntity interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix some webserver bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove server_config.yaml

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-08-22 03:30:57 +00:00
BossZou 2e7182336b
Enlarge event queue (#3393)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-08-21 15:47:58 +00:00
quicksilver d849d0d0f7
Optimize thirdparty download workflow (#3394)
* Optimize thirdparty download workflow

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Optimize thirdparty download workflow

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Optimize thirdparty download workflow

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Optimize thirdparty download workflow

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-08-21 13:53:18 +00:00
ThreadDao 3f84777264
[skip ci] modify test flush and compact (#3390)
* java main class

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix generate default entities

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] modify test flush

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] modify test compact

Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-08-21 19:03:38 +08:00
XuanYang-cn c13b0a2543
Optimize download & compile of Aws (#3384)
* runable aws

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* optimize aws

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-08-21 08:45:27 +00:00
Cai Yudong af5f30448f
[skip ci] update clang-tidy rules (#3386)
* [skip ci] update clang-tidy rules

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* [skip ci] update clang-tidy rules

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-08-21 16:26:39 +08:00
del-zhenwu d34be8bc79
Skip flat search params (#3381)
* assert top ids

Signed-off-by: zw <zw@milvus.io>

* update milvus-helm to 0.11.0

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-08-21 16:25:28 +08:00
groot 75868b20b6
fix wal test case issue (#3380)
* prepare change memmanager for wal

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix wal test case

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-08-21 16:00:02 +08:00
ThreadDao 03c0415ec6
[skip ci] fix generate default entities (#3382)
* java main class

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix generate default entities

Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-08-21 14:19:13 +08:00
shengjun.li 7e9cffca1d
[skip ci] rm log (#3378)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-21 11:51:13 +08:00
XuanYang-cn e739fb1b81
optimize download & compile of sqlite (#3361)
* optimize sqlite

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* rm sqlite url

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix bug

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-08-21 11:50:36 +08:00
ThreadDao befc21ec37
[skip ci] fix java sdk test case (#3375)
* java main class

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>

* [skip ci] fix java sdk test

Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-08-21 11:50:22 +08:00
Wang Xiangyu 38f83f737e
[skip ci]update issue template (#3379)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-21 11:34:04 +08:00
groot 3d40a3886f
prepare change memmanager for wal (#3376)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-08-21 03:14:29 +00:00
Wang Xiangyu 15ee27f359
[skip ci]add google/crc32c into NOTICE.md (#3373)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-20 22:55:02 +08:00
quicksilver eb1f5b91b2
Find system headers with cmake and clang-tidy (#3364)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-08-20 14:45:05 +00:00
groot 7ee597bd02
add wal unittest (#3367)
* add wal unittest

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix test fail

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-08-20 22:42:21 +08:00
Wang Xiangyu 4d491d08c3
refactor LogMgr (#3372)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-20 22:41:49 +08:00
shengjun.li 830ff41374
fix param check (#3369)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-20 13:58:01 +00:00
Cai Yudong d4eadc0ba3
fix clang tidy warnings (#3371)
* fix clang-tidy warnings

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-08-20 20:55:38 +08:00
yukun 0bc69c4362
Add GetPageEntity interface (#3370)
* Add web server interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add unittest/server

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add web server ut

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix web server insert bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix web server ut crash bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix web server ut gpu compile error

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix codacy quality

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix row_num error

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change row insert to column insert

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix dsl issue

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix GetEntityByID bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add GetPageEntity interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-08-20 20:54:57 +08:00
Wang Xiangyu 9d21344826
#3301 rename configure file (#3355)
* #3301 rename configure file

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* fix clang-format

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-20 12:45:10 +00:00
XuanYang-cn 144523b480
Optimize download & compile of Prometheus (#3357)
* runable prometheus

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* add copyright

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-08-20 11:13:16 +00:00
Cai Yudong fb70337c74
fix clang tidy warnings (#3362)
* fix codacy warning

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update codacy rules

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update index unittest build option

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-08-20 18:34:44 +08:00
Xiaohai Xu b437639b7a
#3309 Error should be raised if search binary collection with metric_type: L2 (#3349)
* add check

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-08-20 18:22:09 +08:00
Wang Xiangyu 1938d6b769
#3265 clear finished task to release some resource (#3360)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-20 17:40:46 +08:00
Wang Xiangyu e24bf8b854
Refactor directory access check and add config system.lock.enable (#3354)
* refactor directory access and add config system.lock.enable

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* update namespace

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-20 17:37:49 +08:00
chen qingxiang f51959bb76
Add a feature of getting milvus all configs (#3347)
* change the header define to make it standardized

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* add a feature of getting milvus all configs

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change the position of header json

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* remove useless line

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix a magic bytes write bug and format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-08-20 16:00:18 +08:00
ThreadDao 2a2cf0fe9f
fix search without insert data (#3339)
Signed-off-by: zongyufen <zongyufen@foxmail.com>
2020-08-20 14:44:29 +08:00
groot 0f191bcb8f
Implement wal (#3345)
* implement wal

Signed-off-by: groot <yihua.mo@zilliz.com>

* wal unittest

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* add unittest

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-08-20 14:08:07 +08:00
XuanYang-cn 157f24b454
Download path can be configured (#3350)
* download path configuration

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* add -f to build.sh

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* change mysql cxx_flags to aviod print Wdeprecated warnings

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-08-20 04:46:46 +00:00
shengjun.li 1615e948cb
fix hamming (#3342)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-20 03:21:39 +00:00
Wang Xiangyu 2a6f797c29
refactor Server::Start() (#3343)
* refactor Server::Start()

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>

* remove unused file

Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-20 09:41:56 +08:00
Cai Yudong 6cb65a3a19
fix clang-tidy warnings (#3344)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-08-20 09:37:57 +08:00
XuanYang-cn fd7c25546e
Optimize download & compile of mysqlpp (#3337)
* runable mysqlpp

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* rm not using comments

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix format

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-08-19 15:30:10 +00:00
BossZou 81791fc803
Fix milvus crash when exiting (#3333)
* Fix server crash when exiting

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Simplify web server

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-08-19 15:17:24 +00:00
Cai Yudong 05a602fecc
fix clang tidy warnings (#3340)
* update GrpcRequestHandler namespace

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-tidy warnings

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optmize clang-tidy rules and clean warnings

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-08-19 22:25:35 +08:00
cqy123456 17ad160e4c
Master codacy v3 (#3322)
* codacy fix

Signed-off-by: cqy <yaya645@126.com>

* codacy

Signed-off-by: cqy <yaya645@126.com>

* codacy

Signed-off-by: cqy <yaya645@126.com>

* codacy check

Signed-off-by: cqy <yaya645@126.com>

* codacy

Signed-off-by: cqy <yaya645@126.com>

* codacy

Signed-off-by: cqy <yaya645@126.com>
2020-08-19 12:35:43 +00:00
yukun 68a2918c30
Add WebServer unittest (#3321)
* Add web server interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add unittest/server

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add web server ut

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-08-19 18:52:36 +08:00