Commit Graph

297 Commits (d460f48ce9d30ffcc09d17834272ce9855d9dadd)

Author SHA1 Message Date
Cai Yudong 41d7500f61 support config cli test 2 (#764)
* #665 support get/set config via CLI

* #665 support get/set config via CLI

* #665 add unittest for config CLI

* #665 remove config_node_map_

* #665 remove config_node_map_

* #665 fix clang-format

* #665 fix clang-format

* #665 update changelog

* #665 code clean

* #665 update API interface

* #665 update API interface

* #665 handle server status

* #665 handle unknown command

* #665 update debug log

* #665 rollback CmdRequest.cpp
2019-12-14 15:11:02 +08:00
groot 86b83fb32a #744 do not return partition table for show_tables (#747) 2019-12-13 10:54:17 +08:00
BossZou 5e045af51f Refactor server module separating Grpc from server handler and scheduler (#757)
* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t
2019-12-12 14:13:22 +08:00
Zhiru Zhu e99896ac62 Add Opentracing (#729)
* add TracerUtil

* Interceptor ok

* add handler

* add context

* minor update

* keep span in trace context

* add span in search okay

* Update Context.cpp

* refactor

* refactor

* refactor

* format

* add context in SearchJob

* trace search okay

* add back finish span in interceptor

* add namespace

* add tracing config in server config

* add random id

* debug mode okay

* update CMakeLists

* add opentracing to cmake

* update unittest

* add tracing namespace

* remove std::run_time error

* add lock when erasing context_map

* update tracing config

* lint

* update CHANGELOG

* small fix

* fix server unit test

* fix scheduler unit test

* fix db unit test

* lint

* fix db unit test gpu version

* rename to tracing_config

* fix

* update

* trigger ci
2019-12-10 15:24:54 +08:00
Jin Hai 827ed1fd3d
Update CHANGELOG.md (#722) 2019-12-07 16:25:32 +08:00
Cai Yudong 1193526719 show last commit id when server start (#717)
* #709 show last commit id when server start

* #709 fix typo error
2019-12-06 14:31:53 +08:00
groot ebb4cedeb7 #696 metric_type changed from IP to L2 (#710)
* #670 Random failure of unittest db_test::SEARCH_TEST

* add an important log

* add an important log

* add an important log

* #674 server down in stability test

* add more log

* remove log

* #696 metric_type changed from IP to L2
2019-12-05 17:32:41 +08:00
groot 564095fd8d #674 server down in stability test (#708)
* #670 Random failure of unittest db_test::SEARCH_TEST

* add an important log

* add an important log

* add an important log

* #674 server down in stability test

* add more log

* remove log
2019-12-05 16:50:53 +08:00
Cai Yudong 5970450d48 #705 fix search SQ8H crash without GPU resource (#706) 2019-12-05 11:42:09 +08:00
Jin Hai c2328fbc18
[skip ci]#668 - Update badge of README (#669) 2019-12-04 10:14:42 +08:00
groot 3321a82c32 #670 Random failure of unittest db_test::SEARCH_TEST (#671) 2019-12-04 10:11:50 +08:00
Jin Hai 56e3b8feb1
Merge pull request #650 from Yukikaze-CZR/0.6.0
IP search metric_type shouldn't be supported by IVF_PQ index on GPU v…
2019-12-03 17:21:58 +08:00
yudong.cai f330d9f902 #658 Milvus error out when building SQ8H index without GPU resources 2019-12-03 15:50:27 +08:00
Yukikaze-CZR c018bf0a08 Merge remote-tracking branch 'upstream/0.6.0' into 0.6.0 2019-12-03 14:41:44 +08:00
groot 6b52973b04 #654 Random crash when frequently insert vector one by one 2019-12-02 19:51:33 +08:00
Yukikaze-CZR 4ff8e871ae changelog fix 2019-12-02 17:48:55 +08:00
Yukikaze-CZR b5916b41bf Merge remote-tracking branch 'upstream/0.6.0' into 0.6.0 2019-12-02 16:08:09 +08:00
groot 3df535e11e #649 Typo partiton should be partition 2019-12-02 15:39:16 +08:00
Jin Hai 51e8be0130
Merge pull request #607 from yhmo/ongoing
#596 Frequently insert operation cost too much disk space
2019-12-02 15:06:19 +08:00
Yukikaze-CZR bee37170f4 IP search metric_type shouldn't be supported by IVF_PQ index on GPU version #616 #636 2019-12-02 14:40:16 +08:00
wxyu b12f861b51 Add a new rpc command to get milvus build version whether cpu or gpu close#644 2019-12-02 11:17:24 +08:00
groot 07ac2e32c0 merge 0.6.0 2019-12-02 10:30:22 +08:00
Nicky 3a87f16b74 Merge remote-tracking branch 'official/0.6.0' into issue-548 2019-12-01 15:30:34 +08:00
Jin Hai 23dffbf3b5
Merge pull request #635 from JinHai-CN/GPUCompile
#634 - FAISS GPU version is compiled with O0
2019-12-01 13:13:45 +08:00
bugfixer 216a534eff #634 - FAISS GPU version is compiled with O0 2019-12-01 01:52:17 +00:00
bugfixer c1bd16a55e #631 - FAISS isn't compiled with O3 option 2019-12-01 01:40:11 +00:00
Nicky d721e385d1 Merge remote-tracking branch 'official/0.6.0' into issue-548 2019-11-30 20:40:00 +08:00
Jin Hai e705fa3007
Merge pull request #609 from cydrain/caiyd_handle_search_exception
handle search exception
2019-11-30 19:47:16 +08:00
xiaojun.lin 6b84ec5f79 Merge remote-tracking branch 'official/0.6.0' into issue-548 2019-11-30 18:04:22 +08:00
Jin Hai 91b165d3cc
Merge pull request #624 from cydrain/caiyd_fix_gpu_index
fix gpu index build hang when gpu resources disabled
2019-11-30 17:43:07 +08:00
xiaojun.lin 8f09b1f230 solve part of the problem about nsg 2019-11-30 17:23:10 +08:00
groot 0b3f7e15c0 Merge remote-tracking branch 'source/0.6.0' into ongoing 2019-11-30 16:26:02 +08:00
Jin Hai 6f58f7550b
Merge pull request #608 from fishpenguin/0.6.0-yk-refactor-scheduler
NSG build failed using GPU-edition if set gpu_enable false
2019-11-30 16:16:04 +08:00
yudong.cai dcbe1a0c3f #579 when gpu resources disabled, use cpu index instead 2019-11-30 11:26:40 +08:00
Jin Hai 7b949861a8
Merge pull request #614 from cydrain/caiyd_remove_cpu_version_macro
#611 remove MILVUS_CPU_VERSION
2019-11-30 10:13:05 +08:00
yudong.cai 9a467fb1a0 #331 update changelog 2019-11-30 09:29:34 +08:00
groot 5380e0c9df Merge remote-tracking branch 'source/0.6.0' into ongoing 2019-11-29 16:15:47 +08:00
yudong.cai a023511f16 #611 remove MILVUS_CPU_VERSION 2019-11-29 16:02:08 +08:00
fishpenguin b458bdbd33 Merge remote-tracking branch 'upstream/0.6.0' into 0.6.0-yk-refactor-scheduler 2019-11-29 15:57:52 +08:00
Jin Hai 3566fbbc55
Merge pull request #612 from cydrain/caiyd_add_more_message_when_start
#605 print more messages when server start
2019-11-29 15:27:35 +08:00
yudong.cai 59f17fcc59 #605 print more messages when server start 2019-11-29 15:02:13 +08:00
groot ce10d1c86e merge 0.6.0 2019-11-29 14:49:53 +08:00
groot af5c5b3bdb #606 no log generated during building index with CPU 2019-11-29 14:47:13 +08:00
fishpenguin 1b6d90a5e1 Merge remote-tracking branch 'upstream/0.6.0' into 0.6.0-yk-refactor-scheduler 2019-11-29 11:38:40 +08:00
fishpenguin 4b8a72f9ae NSG build failed using GPU-edition if set gpu_enable false 2019-11-29 11:38:27 +08:00
groot 3a36d75404 Merge remote-tracking branch 'source/0.6.0' into ongoing 2019-11-29 10:47:46 +08:00
Jin Hai 7d0a3ae05d
Merge pull request #604 from Yukikaze-CZR/0.6.0
Increase code coverage rate #485
2019-11-29 10:35:55 +08:00
Jin Hai bf1f07eca8
Merge pull request #603 from fishpenguin/0.6.0-yk-refactor-scheduler
Optimizer specify wrong gpu_id
2019-11-29 10:35:08 +08:00
Jin Hai fc364d25ce
Merge pull request #595 from cydrain/caiyd_config_version
#560 add version in server config file
2019-11-29 10:34:03 +08:00
groot 930097128b #596 Frequently insert operation cost too much disk space 2019-11-29 10:30:10 +08:00
Yukikaze-CZR 3a8a83369b add changelog 2019-11-28 19:39:43 +08:00
fishpenguin a718c7c9bb Optimizer specify wrong gpu_id 2019-11-28 19:08:15 +08:00
groot bdf531524b #599 Build index log is incorrect 2019-11-28 17:56:04 +08:00
Jin Hai 5ec1237a6b
Merge pull request #593 from yhmo/preload
#274 logger the time cost during preloading data
2019-11-28 17:10:25 +08:00
Yukikaze-CZR 82e011d147
Merge branch '0.6.0' into 0.6.0 2019-11-28 17:02:49 +08:00
yudong.cai 2aad94b678 #560 add version in server config file 2019-11-28 16:12:39 +08:00
groot 2ae5771603 #274 logger the time cost during preloading data 2019-11-28 15:25:20 +08:00
Jin Hai 2780da6858
Merge pull request #586 from yhmo/0.6.0
#561 Milvus server should report exception/error message or terminate
2019-11-28 15:22:39 +08:00
Yukikaze-CZR 5a5e76fe6a #552 Server down during building index_type: IVF_PQ using GPU-edition 2019-11-28 14:37:23 +08:00
groot e1ae8e9ff9 Merge remote-tracking branch 'source/0.6.0' into 0.6.0 2019-11-28 14:26:07 +08:00
groot e1c6aea6a4 #561 Milvus server should report exception/error message or terminate on mysql metadata backend error 2019-11-28 12:29:34 +08:00
JinHai-CN 88f7dc56a2 Integrate internal faiss
Remove faiss docs
2019-11-28 11:42:54 +08:00
groot c37aa5a54b code lint 2019-11-27 18:11:49 +08:00
Jin Hai b0a680f5bb
Merge pull request #575 from youny626/0.6.0
Add AVX flags when building faiss
2019-11-27 15:55:38 +08:00
Jin Hai 095d07bf01
Merge pull request #562 from yhmo/migration
#354 Build migration scripts into milvus docker image
2019-11-27 15:53:43 +08:00
Zhiru Zhu 9f1f76b1d4 update CHANGELOG 2019-11-27 15:07:22 +08:00
Yukikaze-CZR 47abe4ff47 #504 The code coverage rate of core/src/scheduler/optimizer is too low 2019-11-27 14:21:53 +08:00
groot b4a2aed41f #354 Build migration scripts into milvus docker image 2019-11-27 10:34:58 +08:00
Jin Hai 48bd34b00b
Merge pull request #555 from yhmo/clean_cache
#530 BuildIndex stop when do build index and search simultaneously
2019-11-26 20:11:01 +08:00
groot 87a36ebdd4 Merge remote-tracking branch 'source/0.6.0' into clean_cache 2019-11-26 19:24:00 +08:00
yhz 2d5b908c05 fix changlog conflict 2019-11-26 18:33:50 +08:00
groot 8b652a00e2 #530 BuildIndex stop when do build index and search simultaneously 2019-11-26 18:08:15 +08:00
xiaojun.lin 88cb2b5991 NSG support MetricType IP 2019-11-26 17:15:14 +08:00
yhz 006a480fc8 [skip ci] update changlog; fix #543 2019-11-26 14:42:56 +08:00
yhz 3a3daf083b fix changlog conflict 2019-11-26 12:03:25 +08:00
yhz 80608890fe update changlog 2019-11-26 10:50:02 +08:00
yhz 5b23a7c34c fix python sdk test case bug 2019-11-26 10:36:07 +08:00
fishpenguin f1f90ec3e0 fix conflict 2019-11-26 10:21:01 +08:00
fishpenguin c07aa9a015 BuildIndex stop when do build index and search simultaneously 2019-11-26 10:19:49 +08:00
Jin Hai 03fe979301
Merge pull request #528 from Heisenberg-Y/0.6.0-ezio
Fix building error in faiss benchmark when using faiss 1.6.0
2019-11-25 23:17:29 +08:00
Jin Hai 1184b5b70c
Merge pull request #522 from tinkerlin/issue-509
fix issue-509
2019-11-25 23:16:11 +08:00
Jin Hai 88ca2c805f
Merge pull request #521 from tinkerlin/issue-465
Fix Issue 465
2019-11-25 23:09:52 +08:00
Tinkerrr 038850d6a9
Merge branch '0.6.0' into issue-509 2019-11-25 22:09:13 +08:00
Heisenberg ac180d7188 fix merge conflict 2019-11-25 19:57:16 +08:00
Heisenberg cf1e03980e fix issue 527 2019-11-25 19:48:47 +08:00
groot c2971cfd1e fix typo 2019-11-25 16:56:41 +08:00
groot 0c7c4586c0 #513 DELETE_BY_RANGE sometimes failed 2019-11-25 16:41:48 +08:00
xiaojun.lin 17fda26922 fix issue-509 2019-11-25 16:17:16 +08:00
xiaojun.lin 6d0d67ca95 update changelog 2019-11-25 15:28:25 +08:00
yhz d3c232a39f Merge remote-tracking branch 'main/0.6.0' into 0.6.0 2019-11-25 11:41:05 +08:00
yhz 35a25e01eb fix changlog conflict 2019-11-25 11:40:40 +08:00
Yukikaze-CZR d394091928 #502 Changelog upgrade 2019-11-23 15:49:33 +08:00
fishpenguin 288490f980 gpu no usage during index building 2019-11-23 11:07:42 +08:00
fishpenguin b68f4f43c1 Add log in scheduler/optimizer 2019-11-23 10:29:11 +08:00
Jin Hai 85aca5faf4
Merge pull request #474 from yhmo/0.6.0
#470 raw files should not be build index
2019-11-22 19:12:17 +08:00
Jin Hai 9790fbdbcf
Merge branch '0.6.0' into 0.6.0 2019-11-22 19:09:14 +08:00
groot 853aa663e9 Merge remote-tracking branch 'source/0.6.0' into 0.6.0 2019-11-22 16:34:14 +08:00
groot e96c97c8f7 #470 raw files should not be build index 2019-11-22 11:28:31 +08:00
Jin Hai 872726c003
Merge pull request #463 from tinkerlin/issue-458
move seal to Load
2019-11-22 10:09:36 +08:00
wxyu a9bc655cfb Read gpu config only gpu_resource_config.enable=true fix #467 2019-11-21 17:26:11 +08:00