Commit Graph

16 Commits (3d40a3886fa80e1364ff2633f17a830f4ceedf34)

Author SHA1 Message Date
XuanYang-cn 7b7f62820d
reduce grpc download file size from 380M to 130M (#3326)
* reduce grpc download file size from 380M to 130M

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* fix bug

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-08-19 08:26:31 +00:00
chen qingxiang fe905a0062
add file header and tail implementation (#3316)
* add file header and tail implementation

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* remove files and formate code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix bugs

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* fix bug in getEntityById

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* remove useless lines and add zip md5 cheksum

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* change crc32c thirdparty reposity

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-08-19 08:17:23 +00:00
BossZou e3f4ab92a7
Upgrade third-party oatpp up to v1.1.0 (#3272)
* Update oatpp link

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Update DATo

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Upgrade oatpp to v1.1.0 (fix #2568)

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Fix complie error in GPU version

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-08-17 11:17:10 +08:00
XuanYang-cn ae5f518f52
Optimize yaml-cpp download and build process (#3252)
* modify  yaml

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* config dependency altering

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* modify format

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-08-14 07:43:21 +00:00
Wang Xiangyu f18c95eed3
update grpc commit (#3125)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-05 09:44:10 +08:00
Wang Xiangyu 7861da3e92
[skip ci]update grpc commit and md5 (#3123)
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
2020-08-04 18:22:33 +08:00
BossZou 6675a9a421
(db/snapshot) Remove sqlite-orm (#3028)
* Remove SqliteMetaImpl

Signed-off-by: yhz <413554850@qq.com>

* Remove sqlite-orm

Signed-off-by: yhz <413554850@qq.com>
2020-07-27 18:51:42 +08:00
XuanYang-cn 7a39a00498
Fix Prometheus rebuild problem (#2878)
* Solve prometheus repeatedly build problem

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* recover build.sh

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* refactor build.sh

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* altering changelog

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* rm not-useful comments

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-07-16 19:45:24 +08:00
BossZou 8d732656a7
Fix show partitions failed in http module (fix #2228) (#2234)
* Fix show partitions failed in http module (fix #2228)

Signed-off-by: yhz <413554850@qq.com>

* catch json string convert error

Signed-off-by: yhz <413554850@qq.com>
2020-05-10 12:49:26 +00:00
BossZou 0a2b77c363
Upgrade http thirdparty oatpp to v1.0.0 (fix #2153) (#2157)
* Upgrade thirdparty oatpp to v1.0.0 (fix #2153)

Signed-off-by: yhz <413554850@qq.com>

* adjust header order

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-04-28 15:57:51 +00:00
BossZou a0faf1a786 Add http server (#956)
* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* set advanced config name add DEFAULT

Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-01-13 13:55:48 +08:00
Cai Yudong b9d9b8ecc2 support minio storage (#895)
* #815 add S3 client

* #815 update S3 interface

* #815 add bucket_name_ as class field, add StartService() and StopService()

* #815 add FileIOReader and FileIOWriter

* #815 fix unittest test_storage build error

* #815 add GetObjectStr()

* #815 add S3IOReader/S3IOWriter

* #815 add ListObjects(), support put string with \0, launch S3 service when server start

* #815 read/write s3 index file pass

* #815 add MinIO related config

* #815 fix storage config issuegs

* #815 code clean

* #815 use local file or S3 via minio_enable

* #815 add DeleteObjects() for S3

* #815 print out IO rate when read_index & write_index

* #815 clean code

* #815 fix centos build error

* #815 support MinIO storage

* #815 fix typo
2020-01-04 10:39:52 +08:00
XuPeng-SH d316f18cbc Integrate libfiu for fault injection (#784)
* (feat): add libfiu for fault injection

* (feat): change libfiu from static to shared

* (feat): install libfiu
2019-12-18 18:11:18 +08:00
Zhiru Zhu e99896ac62 Add Opentracing (#729)
* add TracerUtil

* Interceptor ok

* add handler

* add context

* minor update

* keep span in trace context

* add span in search okay

* Update Context.cpp

* refactor

* refactor

* refactor

* format

* add context in SearchJob

* trace search okay

* add back finish span in interceptor

* add namespace

* add tracing config in server config

* add random id

* debug mode okay

* update CMakeLists

* add opentracing to cmake

* update unittest

* add tracing namespace

* remove std::run_time error

* add lock when erasing context_map

* update tracing config

* lint

* update CHANGELOG

* small fix

* fix server unit test

* fix scheduler unit test

* fix db unit test

* lint

* fix db unit test gpu version

* rename to tracing_config

* fix

* update

* trigger ci
2019-12-10 15:24:54 +08:00
Zhiru Zhu a6279d2acb Speed up CMake build process
Former-commit-id: 2edb2ae26d93ed9b7a8d25b89d30152e60257250
2019-10-23 21:45:48 +08:00
starlord 41d37f9648 re-organize project
Former-commit-id: 898c2c8b0b2cfdc1b8664062aa0ea910a93566dd
2019-10-14 09:51:48 +08:00