Commit Graph

27 Commits (962a00c366d6ca956760de13c96ec670fbfd54c8)

Author SHA1 Message Date
Jin Hai e1027e9e65
#1240 Update license declaration of each file (#1241)
* #1240 Update license declaration of each files

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #1240 Update CHANGELOG

Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-02-17 23:40:58 +08:00
BossZou a0faf1a786 Add http server (#956)
* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* set advanced config name add DEFAULT

Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-01-13 13:55:48 +08:00
Cai Yudong b9d9b8ecc2 support minio storage (#895)
* #815 add S3 client

* #815 update S3 interface

* #815 add bucket_name_ as class field, add StartService() and StopService()

* #815 add FileIOReader and FileIOWriter

* #815 fix unittest test_storage build error

* #815 add GetObjectStr()

* #815 add S3IOReader/S3IOWriter

* #815 add ListObjects(), support put string with \0, launch S3 service when server start

* #815 read/write s3 index file pass

* #815 add MinIO related config

* #815 fix storage config issuegs

* #815 code clean

* #815 use local file or S3 via minio_enable

* #815 add DeleteObjects() for S3

* #815 print out IO rate when read_index & write_index

* #815 clean code

* #815 fix centos build error

* #815 support MinIO storage

* #815 fix typo
2020-01-04 10:39:52 +08:00
quicksilver 03ec41070a Remove Jfrog Cache on Jenkins CI (#827)
* specify multiple urls on sqlite_orm download stage

* fix bug

* fix bug

* specify multiple urls on opentracing download stage

* fix bug

* specify multiple urls on download stage

* delete jfrog cache

* print jenkins enviroment variables

* print jenkins enviroment variables

* fix check_ccache.sh bug

* debug

* Update Jenkinfile

* Add build enviroment resource limit on Jenkins CI

* remove Jfrog cache build option
2019-12-26 10:33:05 +08:00
quicksilver 685d199ae9 Specify multiple urls on download stage (#820)
* specify multiple urls on sqlite_orm download stage

* fix bug

* fix bug

* specify multiple urls on opentracing download stage

* fix bug

* specify multiple urls on download stage
2019-12-25 09:56:47 +08:00
quicksilver e1d20e4446
Merge pull request #790 from ZhifengZhang-CN/master
Add Codecov on Github Actions
2019-12-19 12:07:46 +08:00
XuPeng-SH d316f18cbc Integrate libfiu for fault injection (#784)
* (feat): add libfiu for fault injection

* (feat): change libfiu from static to shared

* (feat): install libfiu
2019-12-18 18:11:18 +08:00
quicksilver bdc0239eba update GRPC url 2019-12-17 19:15:17 +08:00
quicksilver c32f58d474 update GRPC url 2019-12-17 16:45:48 +08:00
Zhiru Zhu e99896ac62 Add Opentracing (#729)
* add TracerUtil

* Interceptor ok

* add handler

* add context

* minor update

* keep span in trace context

* add span in search okay

* Update Context.cpp

* refactor

* refactor

* refactor

* format

* add context in SearchJob

* trace search okay

* add back finish span in interceptor

* add namespace

* add tracing config in server config

* add random id

* debug mode okay

* update CMakeLists

* add opentracing to cmake

* update unittest

* add tracing namespace

* remove std::run_time error

* add lock when erasing context_map

* update tracing config

* lint

* update CHANGELOG

* small fix

* fix server unit test

* fix scheduler unit test

* fix db unit test

* lint

* fix db unit test gpu version

* rename to tracing_config

* fix

* update

* trigger ci
2019-12-10 15:24:54 +08:00
quicksilver f8e66f12a9 add FindGTest.cmake 2019-11-12 11:12:03 +08:00
Zhiru Zhu 530b2a0f28 fix cmake error: STRING sub-command REGEX, mode REPLACE needs at least 6 arguments total to
command


Former-commit-id: 773f938125ed03582fc8242af0a23076677bf848
2019-10-31 14:57:09 +08:00
Zhiru Zhu c99f407099 delete message
Former-commit-id: 577b8693eca42bf3537c8691f754dd1876d579a3
2019-10-30 15:30:28 +08:00
Zhiru Zhu c41ebb7e7d fix JFrog cache error
Former-commit-id: 8b75351080e9201d6f9f47c643dfb7eec32d5a86
2019-10-30 15:27:05 +08:00
Zhiru Zhu a6279d2acb Speed up CMake build process
Former-commit-id: 2edb2ae26d93ed9b7a8d25b89d30152e60257250
2019-10-23 21:45:48 +08:00
JinHai-CN 33f01a0653 Update CI files
Former-commit-id: 973fecf6705d97ca8ce5e6bc1ede5267fdbc59cc
2019-10-15 18:12:22 +08:00
Jeff 83fb150370 Merge branch 'branch-0.5.0' into 'branch-0.5.0'
switch back sqlite orm url

See merge request megasearch/milvus!720

Former-commit-id: 148ac2d9aa77bd67b1d7aec1b1ca43e2afa6eb3f
2019-10-14 20:21:43 +08:00
zhiru 63fbc43fbc switch back sqlite orm url
Former-commit-id: 1de6661e2ede4ef8336d812df61decca50f40d93
2019-10-14 20:20:52 +08:00
Jeff 8b952fcd7f Merge branch 'branch-0.5.0' into 'branch-0.5.0'
update grpc download md5

See merge request megasearch/milvus!719

Former-commit-id: ac6924caee8df7c83b4466b2c6f5bd12c4f9f981
2019-10-14 20:18:02 +08:00
zhiru b904029529 update grpc download md5
Former-commit-id: c6840e3bc4e8baaa09c457e3dd80c931f88c112c
2019-10-14 20:17:20 +08:00
quicksilver b5d1f57ff2 check thirdparty cache directory status
Former-commit-id: 573e28369c6466f9de23c6e92dac903bde23429e
2019-10-14 20:00:08 +08:00
zhiru 44eda65b41 update grpc download url to https://github.com/youny626/grpc-milvus/archive/master.zip
Former-commit-id: ae1134f8ab9b2e7c7f1c4c1464993c35d1491fd5
2019-10-14 17:35:21 +08:00
zhiru 0d6966b41b update grpc download url to https://github.com/youny626/grpc-milvus/archive/master.zip
Former-commit-id: 06dfa0e0876376498d48d09d5b7c4d2ee634fbbc
2019-10-14 17:19:10 +08:00
peng.xu 6b12678f06 Merge branch 'branch-0.5.0' into 'branch-0.5.0'
re-organize project directory

See merge request megasearch/milvus!706

Former-commit-id: 18490c4712a13e55cffd178d00821a70741fb9b7
2019-10-14 12:06:38 +08:00
starlord 2fc179104d Merge remote-tracking branch 'source/branch-0.5.0' into branch-0.5.0
Former-commit-id: 7e210e1c775b9acef194ac6f53cf0dc1a671b04d
2019-10-14 11:45:40 +08:00
starlord 004bd81ac8 Merge remote-tracking branch 'source/branch-0.5.0' into branch-0.5.0
Former-commit-id: 4496b80869e6be02b8fbbe92a3ab08f8bf763acf
2019-10-14 09:51:56 +08:00
starlord 41d37f9648 re-organize project
Former-commit-id: 898c2c8b0b2cfdc1b8664062aa0ea910a93566dd
2019-10-14 09:51:48 +08:00