milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,703 Commits
170 Branches
145 Tags
578 MiB
Commit Graph

378 Commits (cbba262442a42cc22ae24e00842d901b58321c97)

Author SHA1 Message Date
quicksilver 952f34352a enable build milvus on centos7 (#769) 
* enable build milvus on centos7

* Update build enviroment Centos7 dockerfile

* Update Dockerfile

* Update Dockerfile

* Update Dockerfile

* Update Dockerfile

* Update Dockerfile

* Update Dockerfile

* Update Dockerfile

* add centos7_build_deps.sh

* add centos7 build cpu version enviroment

* add centos7 on github actions

* fix bug

* fix bug

* fix bug

* update ci/docker/centos-7-core.dockerfile

* fix github actions bug

* update centos7 case on github actions

* update docker-compose.yml

* debug centos case on github actions

* debug centos case on github actions

* add centos7 deploy dockerfile
 2019-12-16 14:07:20 +08:00
Cai Yudong 41d7500f61 support config cli test 2 (#764) 
* #665 support get/set config via CLI

* #665 support get/set config via CLI

* #665 add unittest for config CLI

* #665 remove config_node_map_

* #665 remove config_node_map_

* #665 fix clang-format

* #665 fix clang-format

* #665 update changelog

* #665 code clean

* #665 update API interface

* #665 update API interface

* #665 handle server status

* #665 handle unknown command

* #665 update debug log

* #665 rollback CmdRequest.cpp
 2019-12-14 15:11:02 +08:00
BossZou 5e045af51f Refactor server module separating Grpc from server handler and scheduler (#757) 
* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t
 2019-12-12 14:13:22 +08:00
Zhiru Zhu e99896ac62 Add Opentracing (#729) 
* add TracerUtil

* Interceptor ok

* add handler

* add context

* minor update

* keep span in trace context

* add span in search okay

* Update Context.cpp

* refactor

* refactor

* refactor

* format

* add context in SearchJob

* trace search okay

* add back finish span in interceptor

* add namespace

* add tracing config in server config

* add random id

* debug mode okay

* update CMakeLists

* add opentracing to cmake

* update unittest

* add tracing namespace

* remove std::run_time error

* add lock when erasing context_map

* update tracing config

* lint

* update CHANGELOG

* small fix

* fix server unit test

* fix scheduler unit test

* fix db unit test

* lint

* fix db unit test gpu version

* rename to tracing_config

* fix

* update

* trigger ci
 2019-12-10 15:24:54 +08:00
Wang XiangYu 4847e5027f Remove unused codes (#732) 
* remove unused function and comments

* remove always-true parameter

* run on python2 explicitly

* fix clang-format
 2019-12-09 19:09:14 +08:00
groot 2b40ddbb27 fix unittest (#720) 
* #670 Random failure of unittest db_test::SEARCH_TEST

* add an important log

* add an important log

* add an important log

* #674 server down in stability test

* add more log

* remove log

* #696 metric_type changed from IP to L2

* #696 metric_type changed from IP to L2

* #696 metric_type changed from IP to L2

* #696 metric_type changed from IP to L2
 2019-12-06 16:40:51 +08:00
groot b6f22c7370 Fix unittest failure (#714) 2019-12-05 20:08:15 +08:00
Yukikaze-CZR 8574b8b93f add code coverage rate and fix #670 (#693) 2019-12-04 19:37:13 +08:00
groot 3321a82c32 #670 Random failure of unittest db_test::SEARCH_TEST (#671) 2019-12-04 10:11:50 +08:00
Lizhou Gao 6c14297a29 use better names for timing MACROs milvus-io#556 2019-12-03 10:49:00 +08:00
groot 3df535e11e #649 Typo partiton should be partition 2019-12-02 15:39:16 +08:00
groot 0b3f7e15c0 Merge remote-tracking branch 'source/0.6.0' into ongoing 2019-11-30 16:26:02 +08:00
groot c220e0e157 refine code 2019-11-29 16:18:57 +08:00
yudong.cai a023511f16 #611 remove MILVUS_CPU_VERSION 2019-11-29 16:02:08 +08:00
groot 85211d537f reconstruct code 2019-11-29 12:38:18 +08:00
groot 3a36d75404 Merge remote-tracking branch 'source/0.6.0' into ongoing 2019-11-29 10:47:46 +08:00
groot 50cd6dd8d2 add unittest case 2019-11-29 10:47:23 +08:00
Jin Hai 7d0a3ae05d
Merge pull request #604 from Yukikaze-CZR/0.6.0 
Increase code coverage rate #485
 2019-11-29 10:35:55 +08:00
Jin Hai fc364d25ce
Merge pull request #595 from cydrain/caiyd_config_version 
#560 add version in server config file
 2019-11-29 10:34:03 +08:00
groot 930097128b #596 Frequently insert operation cost too much disk space 2019-11-29 10:30:10 +08:00
Yukikaze-CZR 09d6165290 Increase code coverage rate #485 2019-11-28 19:37:36 +08:00
yudong.cai 2aad94b678 #560 add version in server config file 2019-11-28 16:12:39 +08:00
Yukikaze-CZR 5a5e76fe6a #552 Server down during building index_type: IVF_PQ using GPU-edition 2019-11-28 14:37:23 +08:00
Jin Hai 095d07bf01
Merge pull request #562 from yhmo/migration 
#354 Build migration scripts into milvus docker image
 2019-11-27 15:53:43 +08:00
Yukikaze-CZR 47abe4ff47 #504 The code coverage rate of core/src/scheduler/optimizer is too low 2019-11-27 14:21:53 +08:00
groot 73f12432cc random failure of unittest 2019-11-27 11:01:29 +08:00
groot 8b652a00e2 #530 BuildIndex stop when do build index and search simultaneously 2019-11-26 18:08:15 +08:00
groot 8aac809ad7 fix typo 2019-11-23 14:36:22 +08:00
groot 2b805489a1 #485 Increase code coverage rate 2019-11-23 11:34:45 +08:00
groot d3ab5ffa40 add unittest case 2019-11-22 19:35:42 +08:00
groot e96c97c8f7 #470 raw files should not be build index 2019-11-22 11:28:31 +08:00
fishpenguin 29006f3cb5 fix conflict 2019-11-20 19:00:56 +08:00
fishpenguin 8a42c8759e Query API in customization still uses old version 2019-11-20 18:44:11 +08:00
xiaojun.lin 863cc5dbaf Merge branch '0.6.0' into 0.6.0-#227 2019-11-20 16:23:39 +08:00
xiaojun.lin bfd4c6c522 upgrade SPTAG and support KDT and BKT 2019-11-20 16:08:18 +08:00
groot 75c1186cd2 fix conflict 2019-11-20 15:04:41 +08:00
yudong.cai c89bb6699e #306 Use int64 for all config integer 2019-11-20 14:26:39 +08:00
groot b65685df8f fix typo 2019-11-20 14:15:57 +08:00
groot 50c4f98dc5 merge from 0.6.0 2019-11-20 12:25:17 +08:00
groot 15dcce417e #377 Create partition success if tag name only contains spaces 2019-11-20 12:24:18 +08:00
yudong.cai 37df2b6fc4 #346 rename gpu_resource_config.enable_gpu to gpu_resource_config.enable 2019-11-20 10:22:42 +08:00
fishpenguin fdb7decdd3 Remove DefaultLabel 2019-11-19 20:30:43 +08:00
fishpenguin 7f5c2fefd8 Remove OnlyGpuPass and add MILVUS_GPU_VERSION define 2019-11-19 19:18:54 +08:00
yudong.cai 0d1923c61f #346 update gpu resource config APIs 2019-11-19 15:49:40 +08:00
fishpenguin 0a85893967 Merge remote-tracking branch 'upstream/0.6.0' into 0.6.0-yk 2019-11-19 14:18:59 +08:00
Jin Hai 316a5383d5
Merge pull request #381 from tinkerlin/issue-247 
fix by reduce knng size
 2019-11-18 18:59:09 +08:00
yudong.cai fddfd1eb03 #346 update config APIs to support build index with multiple GPUs 2019-11-18 18:47:52 +08:00
Jin Hai a47b728488
Merge pull request #369 from youny626/0.6.0 
remove gpu in db unittest
 2019-11-18 17:46:09 +08:00
groot f3ae1bf155 #266 Rpc request source code refactor 2019-11-18 15:10:15 +08:00
xiaojun.lin 82cb637ca8 code style format 2019-11-18 10:50:20 +08:00
xiaojun.lin d5eb5675b7 fix by reduce knng size 2019-11-18 09:53:38 +08:00
Zhiru Zhu a7cb907e44 remove gpu in unittest 2019-11-15 20:15:34 +08:00
groot 29586ba725 #353 Rename config.h.in to version.h.in 2019-11-15 19:06:14 +08:00
zirui.chen 48ed10abdc fix problem of hardcore nprobe 2019-11-15 18:54:19 +08:00
zirui.chen 1e991d0f25 format changelog and fix several problems 2019-11-15 15:00:45 +08:00
Zhiru Zhu 8ae3a83948
Update CMakeLists.txt 2019-11-14 21:12:51 +08:00
zirui.chen 98571d5f44 #127 makeNlist & unittest change 2019-11-14 21:04:10 +08:00
Zhiru Zhu 13cb3b8914
Update CMakeLists.txt 2019-11-14 21:02:23 +08:00
zirui.chen 9b1c57e07b Merge remote-tracking branch 'upstream/0.6.0' into 0.6.0 2019-11-14 18:57:03 +08:00
Zhiru Zhu 34c579cc1d fix merge conflicts 2019-11-14 18:18:40 +08:00
zirui.chen f4536ac888 #127 Support new Index type IVFPQ 2019-11-14 16:40:36 +08:00
groot a57bfae626 merge 0.5.3 to 0.6.0 2019-11-14 16:16:11 +08:00
Zhiru Zhu bf0e5cbc9d Add option to disable/enble prometheus when compiling 2019-11-14 11:22:07 +08:00
zirui.chen 8c412093ca Support new Index type IVFPQ #127 2019-11-14 11:13:35 +08:00
wxyu f251d26bbb Reside src/external in thirdparty 2019-11-13 16:35:37 +08:00
fishpenguin fceb3ba714 Decrease test_rpc run time 2019-11-08 11:03:27 +08:00
groot 57e3c14825 fix unittest failure 2019-11-07 18:46:27 +08:00
groot f3c7fcf80e merge 0.6.0 2019-11-07 16:47:38 +08:00
groot dbe90c7abc support table partition 2019-11-07 16:46:31 +08:00
Zhiru Zhu 3c0c4646b0 issue 229, 230 and 237 2019-11-07 15:35:53 +08:00
fishpenguin 07dfe09aed #204 - improve grpc performance in search 2019-11-07 15:23:28 +08:00
yudong.cai 2deba2dcb9 #208 optimize unittest to support run single test more easily 2019-11-06 16:22:38 +08:00
yudong.cai 5a9f7997ab #207 fix unittest build error 2019-11-06 13:12:04 +08:00
yudong.cai 1b0d453379 #207 add more unittest for config set/get 2019-11-06 11:56:06 +08:00
groot 55bfdd3fb6 merge 0.5.2 into 0.6.0 2019-11-06 11:39:30 +08:00
youny626 2a1f2ab09d change default config to gpu 2019-11-05 21:48:23 +08:00
youny626 bede77751e clang format 2019-11-05 13:35:24 +08:00
groot bc802b04a0 fix build error 2019-11-05 12:02:58 +08:00
youny626 4ca6b59b91 add CPU version 2019-11-05 10:23:59 +08:00
yudong.cai ad395a7f06 #175 update invalid config unittest 
Former-commit-id: 06ef1ca314a4ad5d55a5a3352f75ec6e265cb4a0
 2019-11-03 16:05:38 +08:00
yudong.cai bfafb8cdef #175 fix clang-format 
Former-commit-id: e7818d67ca090ced2a934e885074700b46619e15
 2019-11-03 14:28:15 +08:00
yudong.cai 9ff83e140e add invalid config unittest 
Former-commit-id: b2201e3394a953e7e2055bdf351a094a6d6e5315
 2019-11-03 12:51:47 +08:00
yudong.cai 5150647eeb #168 fix reduce bug 
Former-commit-id: 5c6f2e25cbf9efe4a58bf89757fc4983ebda4f35
 2019-11-02 21:54:01 +08:00
yudong.cai f49d23badd #168 improve result reduce 
Former-commit-id: 21887800b9afe47b759a09c1f9fbed97b467cab1
 2019-11-02 21:54:01 +08:00
wxyu 3f8a3ca9fe Merge remote-tracking branch 'main/0.5.1' into dev 
Former-commit-id: 1301dfebe6a4adffd65bf50a4a52f6b33765de7f
 2019-10-30 12:34:21 +08:00
wxyu 3fa2c1e69a Set task state MOVED after resource copy it completed 
Former-commit-id: a97e306b62f6a0a7a06c881e93a973ad75b8ac9d
 2019-10-30 12:34:09 +08:00
Jin Hai 8970efae49 Merge pull request #128 from tinkerlin/upgrade_faiss 
Upgrade faiss

Former-commit-id: 0ed5ef40de13008935dbdbe3852e1af47c4d2283
 2019-10-29 20:16:03 +08:00
xiaojun.lin 39e127d707 Upgrade Faiss to v1.6 
Former-commit-id: 637f6933c77c2644d4d90120d9d2aed77e4e70ff
 2019-10-29 20:05:01 +08:00
starlord e743adb373 Merge remote-tracking branch 'source/0.5.1' into 0.5.1 
Former-commit-id: 4ee722e2074ee58dce001b46ff05fd4c8152beb6
 2019-10-29 15:14:18 +08:00
xiaojun.lin 789403b0c1 Merge remote-tracking branch 'gitlab/0.5.1' into upgrade_faiss 
Former-commit-id: 826c673ce80978ab416b0e6568328e4028cad607
 2019-10-29 11:18:56 +08:00
starlord 12b7d6f5d8 #90 The server start error messages could be improved to enhance user experience 
Former-commit-id: 746b126621cd845c2848bb850b5c2eb6d3b65a6d
 2019-10-28 20:24:13 +08:00
wxyu 53b3b60db2 Using shared_ptr instead of weak_ptr to avoid performance loss 
Former-commit-id: 250cb7200b6eefdd9cbb9fd631379d59aca2f368
 2019-10-28 19:19:42 +08:00
wxyu 5e504b3435 rename functions tasktable, make it accessing likes standard structure 
Former-commit-id: c0ba41635e710e0807af0fe07d0b6a266f60d044
 2019-10-28 17:27:49 +08:00
wxyu 37e4b0a934 Using new structure for tasktable 
Former-commit-id: 80376dce0fd24c8c541c05363d702941f69dca0e
 2019-10-28 16:35:53 +08:00
wxyu 80b9c79c5d Using new structure for tasktable 
Former-commit-id: 6742f21a429da87456ded0a910d248948dc948b4
 2019-10-28 12:23:25 +08:00
Jin Hai 42e1ec8bd3 Merge pull request #93 from youny626/0.5.1 
Speed up CMake build process

Former-commit-id: d113c6903c01f10958d85f70152640b82838b3cd
 2019-10-24 18:48:18 +08:00
Zhiru Zhu a6279d2acb Speed up CMake build process 
Former-commit-id: 2edb2ae26d93ed9b7a8d25b89d30152e60257250
 2019-10-23 21:45:48 +08:00
starlord e25caa572c remove unused files of wrapper test 
Former-commit-id: b2b30f0d09085207c70d386e19c3c1fb6bbc0e2f
 2019-10-23 20:19:45 +08:00
starlord e7876f6343 avoid relative header path 
Former-commit-id: d4a01b720ac7011e17076b7c36a20af0ebe2b58a
 2019-10-23 15:05:22 +08:00
Jin Hai 53b4f43bbd Merge pull request #83 from scsven/dev 
Move easyloggingpp into external directory

Former-commit-id: 17ebea24c357123aeda8c92baaa8b8785761c6ac
 2019-10-23 10:42:20 +08:00
wxyu 4f3fa67be3 Move easyloggingpp into external directory 
Former-commit-id: f2392522699d094720b92e5ee281973e3835bb18
 2019-10-22 19:11:17 +08:00
starlord bbc2c90741 format code 
Former-commit-id: 1e15f2112b93a17958c2e663fafc79cf39dd3148
 2019-10-21 19:30:54 +08:00
starlord 19dca4c969 #59 Topk result is incorrect for small dataset 
Former-commit-id: f8c4a38365881252e66f280647aedf1e4c6395e5
 2019-10-21 19:24:18 +08:00
JinHai-CN 74736236e7 Merge branch '0.5.0' into 0.5.1 
Former-commit-id: a04484fa5b0adfc77ea742c4d7c38a52e8209603
 2019-10-21 14:31:52 +08:00
starlord 6e11f4e4e7 #48 Config unittest failed 
Former-commit-id: e07a067382ed00efc9c5d914b4100592bb7aee44
 2019-10-19 19:31:22 +08:00
starlord 73d2f7c765 fix jenkins build error 
Former-commit-id: bb994c21d69fb9f8c2c6c57e5389b6133e662c0d
 2019-10-19 17:52:51 +08:00
xiaojun.lin 6572e6bf25 MS-671 Fix HybridIndex Crash 
MS-670 Adapt to faiss-1.6


Former-commit-id: 12300b390b6d300dc460f0729a368a240c972a80
 2019-10-19 17:49:28 +08:00
starlord ff27d56571 format code 
Former-commit-id: 633b98f2bae4b9ab323ca2e3a74fc080bfb2f909
 2019-10-19 17:08:50 +08:00
starlord e621dfd1e7 #48 Config unittest failed 
Former-commit-id: 6590479cac96b17485104da98c35d322b563f573
 2019-10-19 17:04:02 +08:00
starlord e153262f3f fix config test bug 
Former-commit-id: aa548a904c54747c22b34c7d847ca87ed32698f1
 2019-10-19 16:48:56 +08:00
yudong.cai 4d1fb143e1 MS-665 rename build_index_gpu to index_build_device, and move it to resource config 
Former-commit-id: f3da7963531406da7a22fbf5ab95caa8e920344a
 2019-10-18 16:32:28 +08:00
Yu Kun 7a10d01fa1 add wrapper unittest 
Former-commit-id: b4f68eeaf55e4960f25239e983c3ae75e5e5ed40
 2019-10-17 19:37:17 +08:00
xiaojun.lin 4958d57c0d Merge branch '0.5.0' into knowhere_ut 
# Conflicts:
#	core/src/index/unittest/test_nsg/test_nsg.cpp


Former-commit-id: a451f75d2014fdb8f258f25a6d7f403a3e1e0f7f
 2019-10-17 16:48:36 +08:00
xiaojun.lin c19a6ee483 MS-648 add ut v3 
Former-commit-id: f9127c08e1bf0d2244fbed8113a003e52d781df4
 2019-10-17 16:31:02 +08:00
xiaojun.lin 472679ba54 MS-648 add ut 
Former-commit-id: e96fea6842855868e960d0c959407fa9b5eeb0d8
 2019-10-17 16:08:43 +08:00
Yu Kun e819c96777 23 Add unittest to improve code coverage 
Former-commit-id: 5d5629da7cad9503816f63917425bcde3c5b6a90
 2019-10-17 09:56:56 +08:00
Yu Kun e7dd603dba Merge remote-tracking branch 'upstream/0.5.0' into branch-0.5.0-yk 
Former-commit-id: e2b4b40f924f3adaab8b801102ae7bdfdd53781e
 2019-10-16 20:46:26 +08:00
Yu Kun 6c7bb57cb2 add unitteest 
Former-commit-id: 9ad0fddedf0ace50845a7d516452b986162204f8
 2019-10-16 20:46:09 +08:00
starlord 2ca99346f4 #20 C++ sdk example get grpc error 
Former-commit-id: 3439c9fb0490dd2725fac48cf93e2cf44e87c2ff
 2019-10-16 19:49:45 +08:00
JinHai-CN ae30b7fbe5 #6 Use system boost instead of compiling boost source code. 
Former-commit-id: 982ca5d9cf921b325f6f92d7e52e08c8ee61c998
 2019-10-16 10:15:34 +08:00
starlord 098bf357ba rename some compile virables 
Former-commit-id: 885d2246e9547e78acbf9eb4f6d74d3e7720cacb
 2019-10-15 17:06:05 +08:00
yudong.cai 08416ed198 MS-653 fix config unittest 
Former-commit-id: fbe4b893ae3b84a860cd6a95c15bd05ead4d33a3
 2019-10-15 16:44:43 +08:00
yudong.cai 38747d9fae MS-653 fix config unittest 
Former-commit-id: bd20d3caff96edc92625dbc333feaa94c5e3b841
 2019-10-15 16:41:08 +08:00
xiaojun.lin 38b90033b2 update 
Former-commit-id: 51ae3d7d749b7b429c12abce28ffc7111fa012ee
 2019-10-15 16:15:39 +08:00
JinHai-CN 0789af25c9 MS-658 SQ8Hybrid can't search 
Former-commit-id: 9dc0507a4eaebb9f87aeca23d9b6b46f05b80b3c
 2019-10-15 14:38:02 +08:00
yudong.cai 44b830639a MS-606 fix result reduce bug 
Former-commit-id: 86bf350874b7a5ec72e77eea2be1f8a5a8548e19
 2019-10-14 18:20:15 +08:00
starlord 004bd81ac8 Merge remote-tracking branch 'source/branch-0.5.0' into branch-0.5.0 
Former-commit-id: 4496b80869e6be02b8fbbe92a3ab08f8bf763acf
 2019-10-14 09:51:56 +08:00
starlord 41d37f9648 re-organize project 
Former-commit-id: 898c2c8b0b2cfdc1b8664062aa0ea910a93566dd
 2019-10-14 09:51:48 +08:00