Commit Graph

340 Commits (a57e84e0a1bad291c34cc861bfe24ef598f14064)

Author SHA1 Message Date
wxyu 52a87782a4 MS-445 Rename CopyCompleted to LoadCompleted
Former-commit-id: 58cac18427a9e8b0deb407d63229d6cf9ae3132f
2019-08-30 11:11:54 +08:00
xj.lin d1a57fadcd MS-442 merge knowhere
Former-commit-id: a6aca189dc11c69364f1e9bc9287867a4ebbf84c
2019-08-29 21:39:51 +08:00
jinhai b4c7cf26eb Merge branch 'branch-0.4.0' into 'branch-0.4.0'
Fix bug in OnCopyCompleted and Add DumpTaskTables in sdk

See merge request megasearch/milvus!449

Former-commit-id: ff855832f9bead4dadcf898c13ed6d08ab946922
2019-08-29 19:42:53 +08:00
Yu Kun a5c0612aac MS-440 Add DumpTaskTables in sdk
Former-commit-id: b1655726666737d9732f236ed766ad8288f4ac1d
2019-08-29 19:27:08 +08:00
starlord 28a1b2523d MS-430 Search no result if index created with FLAT
Former-commit-id: cd4c3674863f084e25cb87fcb278674c94a6876e
2019-08-29 19:19:33 +08:00
starlord ec802368d0 MS-331 Crate Table : when table exists, error code is META_FAILED
Former-commit-id: c8dd9e9faca7e13e950f9aa5ce7fa2a8a34a010f
2019-08-29 12:35:23 +08:00
starlord c32da34302 MS-432 Search vectors params nprobe need to check max number
Former-commit-id: 5ad3c313de2028cd49512dbb740e2f401ac6a577
2019-08-29 11:08:17 +08:00
starlord cf815ea3a2 MS-427 Describe index error after drop index
Former-commit-id: c72a434f9f5502c1aee209097bd84fa8ad709fe3
2019-08-28 19:45:15 +08:00
Yu Kun 61d5836e82 MS-428 Add PushTaskByDataLocality in scheduler
Former-commit-id: 38e41878cf9cd90703270253b5e1b873b4cc1377
2019-08-27 22:17:10 +08:00
starlord d599ebae06 MS-413 - MS-413 - Create index failed and server exited
Former-commit-id: a484d70aed5b3d9a61d6c4acc5917cab9394019e
2019-08-27 22:17:02 +08:00
wxyu b725f8872f MS-422 Support DeleteTask in Multi-GpuResource case
Former-commit-id: eea952afdf004ba46b9a55b58818ece35ecc9179
2019-08-26 20:06:44 +08:00
wxyu 63b43a2aa4 MS-421 Add TaskLabel in scheduler
Former-commit-id: 5a96ba4e51f67d13e2440af594034dacd6b6097b
2019-08-26 15:36:19 +08:00
wxyu e5c4476db4 solve conflicts
Former-commit-id: 79d4e00b90019c196b065b2654535c689dec3900
2019-08-24 17:50:23 +08:00
starlord 36c93cb8f9 MS-419 Move index_file_size from IndexParam to TableSchema
Former-commit-id: f0457d9ac25559b0b64deb0aa3bfaccdcc1b1de2
2019-08-24 17:35:03 +08:00
wxyu 539dade5b2 MS-418 Update server_config.template file, set CPU compute only default
Former-commit-id: 62ea51804d4c6ba538de6c329d80411774137a75
2019-08-24 16:57:15 +08:00
wxyu 527026c4a0 MS-417 YAML sequence load disable cause scheduler startup failed
Former-commit-id: d9055c6ed60306ee8cfc09f13694b9186167a4a5
2019-08-24 16:44:30 +08:00
wxyu 2e8f018e40 MS-416 ExecutionEngineImpl::GpuCache has not return value cause crash
Former-commit-id: 298969de85a0a8cb4a4e48da21d45fde30df64d1
2019-08-24 16:42:15 +08:00
wxyu 14b2254060 MS-415 Add command tasktable to dump all tasktables
Former-commit-id: 7ce1dedf36d020668af2bcaafa66b5232d4c18a5
2019-08-24 16:39:47 +08:00
wxyu 2d9762afce Merge remote-tracking branch 'main/branch-0.4.0' into branch-0.4.0
Former-commit-id: c624889110dcaa88a161f39c21baa08b87db9215
2019-08-24 16:37:17 +08:00
wxyu 35e28f81b5 MS-414 Add TaskType in Scheduler::Task
Former-commit-id: d470511e0d22832db09607ad017c6dd4a697cf05
2019-08-24 16:36:56 +08:00
starlord 4b73bda00e MS-413 Remove thrift dependency
Former-commit-id: 62ed2b780dc79f8415b3d63b902fb3757e523ef7
2019-08-24 14:19:09 +08:00
starlord 86ca848f2d MS-413 Remove thrift dependency
Former-commit-id: 00ef82d80e81b0076299436ec109025e6551e215
2019-08-24 12:20:32 +08:00
wxyu 662320c07d MS-412 Fix gpu cache logical error
Former-commit-id: 6bd2a056feee54393fa4bc16b1b233f54dac0500
2019-08-24 11:24:36 +08:00
wxyu 4023e110c0 MS-411 Fix metric unittest linking error
Former-commit-id: 166e354d7289a67a8950bbcc2baeb5ede1eb4c3f
2019-08-24 11:13:38 +08:00
wxyu 60bc80ab76 MS-410 Add resource config comment
Former-commit-id: 804219cc7376652e3397e6195e094aaebc784adb
2019-08-24 10:22:05 +08:00
wxyu 59d66f490e solve conflicts
Former-commit-id: 3598c2e165c6f019ae291d5e3ae3fd4a19359f6b
2019-08-23 21:08:41 +08:00
wxyu d233de81ff MS-409 Using new scheduler
Former-commit-id: bde50afd3f74e5b17405de9c21d0b5852b81c5df
2019-08-23 21:07:01 +08:00
Yu Kun 7f9def461c merge upstream
Former-commit-id: 161080a5b239ecaab6bddca8dd7a539ae067c799
2019-08-23 19:09:16 +08:00
peng.xu 88f4a8bf57 Merge branch 'branch-0.4.0' into 'branch-0.4.0'
MS-408 Add device_id in resource construct function

See merge request megasearch/milvus!415

Former-commit-id: f4e03522076d4f25678d1f2afd606c7cf748e13e
2019-08-23 18:59:24 +08:00
wxyu 7f20eac0b2 Merge branch 'branch-0.4.0' of 192.168.1.105:wxyu/milvus into branch-0.4.0
Former-commit-id: 369dd0e5daba8dd3c61c6c8c754a01169026dade
2019-08-23 18:56:38 +08:00
wxyu 75370da1c7 MS-408 Add device_id in resource construct function
Former-commit-id: 770dfe33d2773fce93ec7f3824bfb052f7899fc5
2019-08-23 18:56:02 +08:00
Yu Kun 61c66f5fa1 merge upstream
Former-commit-id: 5eefea12fc2e60084e0a2a86588534969d14d070
2019-08-23 17:31:57 +08:00
Yu Kun 2cd296875b reconstruct MetricsCollector
Former-commit-id: 4f7a219b9eb10d98068a5488967319b039fd695a
2019-08-23 17:25:49 +08:00
starlord ceb4cc523b MS-406 add table flag for meta
Former-commit-id: 8e4aa5e4b4aa9844c82b262ce2ab3910a9b27aea
2019-08-23 16:38:03 +08:00
starlord c600b71224 MS-406 add table flag for meta
Former-commit-id: acd9e3cbb26b7c2e74c1c566ba4ea8427a1da58d
2019-08-23 16:07:47 +08:00
wxyu ed6ad2bac8 fix conflicts
Former-commit-id: d357aa8b25ecb26fcc11c89a98c2c6f0d690c1e2
2019-08-23 14:50:03 +08:00
wxyu 94a4183b42 MS-405 Add delete task support
Former-commit-id: 8c7a9055a7c59fd29d0cec778080a75146d881a7
2019-08-23 11:34:31 +08:00
wxyu 49276fbf8c MS-404 Release index after search task done avoid memory increment continues
Former-commit-id: c73ee0674a6481aeabd4b055f7e62223cae9e205
2019-08-23 11:30:48 +08:00
Yu Kun e5383064a2 add changelog
Former-commit-id: 57c78623348c789206a5588aaf57f45046e052f9
2019-08-23 11:19:15 +08:00
peng.xu 86779397b1 Merge branch 'branch-0.4.0' into 'branch-0.4.0'
MS-402 Add dump implementation for TaskTableItem

See merge request megasearch/milvus!405

Former-commit-id: 2e0906cdbc8e4bae7c14e3ae25f71683a71344c0
2019-08-22 19:02:20 +08:00
wxyu bfa7f7c95f MS-402 Add dump implementation for TaskTableItem
Former-commit-id: f2957c7e7cf0c719b9b814f2e8ac16b42c396b2b
2019-08-22 19:01:44 +08:00
peng.xu e66685c1fa Merge branch 'branch-0.4.0' into 'branch-0.4.0'
MS-400 Add timestamp record in task state change function

See merge request megasearch/milvus!401

Former-commit-id: 574adedca801d53ece9360c542e07803cc57bac8
2019-08-22 11:58:28 +08:00
wxyu 4f5466dbe8 MS-400 Add timestamp record in task state change function
Former-commit-id: 062045c8e5cbd0b0c71a05e0f5650ea943e4b3fa
2019-08-22 11:56:45 +08:00
starlord 5b918a4028 MS-339 implement new api
Former-commit-id: 53e4a9309807b06dc43761755146d54d5ef63cf5
2019-08-22 11:50:18 +08:00
peng.xu f31ae64221 Merge branch 'branch-0.4.0' into 'branch-0.4.0'
MS-394 Update scheduler unittest

See merge request megasearch/milvus!397

Former-commit-id: 2ad26a7acb68a6928150131526ed78ed2e0d373e
2019-08-21 19:25:28 +08:00
wxyu 598f9f30dc MS-394 Update scheduler unittest
Former-commit-id: b4f0fe18d00b17c47a39e2a06cdd1119ae00d7fc
2019-08-21 19:22:38 +08:00
starlord d30e432e16 merge 0.3.1
Former-commit-id: a538685c673319581c756289a4c003fa5833d829
2019-08-21 18:35:57 +08:00
wxyu 8b7273dadb MS-391 Add PushTaskToNeighbourHasExecutor action
Former-commit-id: 11c3e1f9fce24225d16c2d3f500c2f76e46388e2
2019-08-21 18:27:05 +08:00
wxyu 1c89d40c94 MS-390 Update resource construct function
Former-commit-id: 1f87f3e285798b2bf3dda78537fdb2b0fc7cc6ef
2019-08-21 18:22:52 +08:00
wxyu a79017ef8f MS-389 Add clone interface in Task
Former-commit-id: bf4681eec6cc6e6b21087b82e5bb5676ec3418d9
2019-08-21 18:01:23 +08:00
wxyu 6171d3bbe0 MS-384 Add global instance of ResourceMgr and Scheduler
Former-commit-id: f176c49d75dbb820b37c356fde99cd62cdc2c9c9
2019-08-20 11:10:52 +08:00
wxyu 03b049b10b MS-383 Modify condition variable usage in scheduler
Former-commit-id: 5be1c8879d1a77d444a5722dbd806a5eb00973e5
2019-08-19 22:01:39 +08:00
wxyu 842fa507fb MS-380 Update resource loader and executor, work util all finished
Former-commit-id: 712a0aceaa4c8d4ebbea40f5d18f524afeb38559
2019-08-19 11:48:45 +08:00
wxyu 41f3a2ac2b MS-379 Add Dump implementation in Resource
Former-commit-id: 0ad824b5d582fc7235a0e29919fdf5a2975bf534
2019-08-19 10:47:30 +08:00
wxyu 08a0f545da MS-378 Debug and Update normal_test in scheduler unittest
Former-commit-id: 7b5add0a2d27185abeec2a1c5df51716aa9fc361
2019-08-18 20:10:32 +08:00
wxyu 07ec15f9cd MS-377 Improve process thread trigger in ResourceMgr, Scheduler and TaskTable
Former-commit-id: f121fba66ae395b03ae31c400216b5e9c301f0cf
2019-08-18 20:08:15 +08:00
wxyu 4ed498893d MS-376 Add loader and executor enable flag in Resource avoid diskresource execute task
Former-commit-id: 489f60f97444c963a3dbfd913672f79b8a9a330e
2019-08-18 20:04:54 +08:00
wxyu de6d68238f MS-375 Add Dump implementation for Event
Former-commit-id: c8518b48914da67bce45660866970c8c4eee915a
2019-08-18 20:01:44 +08:00
wxyu ac230a7ec3 MS-374 Add action definition
Former-commit-id: d3ed4be48d8c27f380b9d20d7eb1bff6abe7cee0
2019-08-18 19:59:15 +08:00
wxyu a591e965c9 MS-373 Add resource test
Former-commit-id: 64c86f4852c4d0cb6d31a679e63ad7555e03d088
2019-08-17 19:08:10 +08:00
wxyu 4cb3e103fc MS-371 Add TaskTableUpdatedEvent
Former-commit-id: f252d63664cb09b502c7280d7a82f0cb1fcac169
2019-08-17 19:05:58 +08:00
wxyu 2ea773b930 MS-368 Implement cost.cpp
Former-commit-id: 554f06b109662bb381bb06aa73ddab956fb8c47c
2019-08-16 17:51:05 +08:00
wxyu 484f255f5e MS-366 Implement TaskTable
Former-commit-id: e6d189c5c63b0477384353bf6f75482eeb196c7d
2019-08-16 16:09:02 +08:00
wxyu 404bc88b3f MS-365 Use tasktableitemptr instead in event
Former-commit-id: a2d8fe7456dc59da280f475ae489a63fa9c3d362
2019-08-16 15:36:56 +08:00
wxyu 8ffd68ec51 MS-364 Modify tasktableitem in tasktable
Former-commit-id: 79ac92b18cc3842d6ccaceb6bdd50ff636ca80ab
2019-08-16 15:29:35 +08:00
wxyu df382a1644 MS-361 Add event in resource
Former-commit-id: d5f18c13d7111a582ad0bc839aa49879c6bb7d32
2019-08-16 15:03:10 +08:00
wxyu c3469fa561 MS-359 Add cost test in new scheduler
Former-commit-id: 5ec53217a216927e3b0ddf211f1a56bb1a44f2b4
2019-08-15 19:09:59 +08:00
wxyu 9400101582 MS-357 Add minimum schedule function
Former-commit-id: da78df540b934e3f1d881b16f023d749e4b37101
2019-08-15 15:57:12 +08:00
wxyu c11c58a555 MS-355 Add copy interface in ExcutionEngine
Former-commit-id: 9320dde8c2452982c552f604289d2661e5c1907e
2019-08-14 21:24:20 +08:00
wxyu 9d7302cd7c MS-354 Add task class and interface in scheduler
Former-commit-id: a8697bf20ed0db126cc6857c6d7719a4731bd87d
2019-08-14 20:10:31 +08:00
wxyu 4de6f675ec MS-354 Add task class and interface in scheduler
Former-commit-id: 0a61d095db7144006b80bc0824886e62be71a5d5
2019-08-14 20:09:00 +08:00
starlord 88d4020b4f fix conflict
Former-commit-id: 307526aa00a017b74c28b9a4d123b885631dd673
2019-08-14 14:46:30 +08:00
starlord d46d1e7f0d MS-350 remove submodule
Former-commit-id: 34c3bc3c966b666534229bed1ef03e30ad9c527b
2019-08-14 14:44:50 +08:00
wxyu a0c52e3730 MS-348 Add ResourceFactory Test
Former-commit-id: 2b8519881eb88c532b0a02f7f515f345545cd55c
2019-08-13 20:18:21 +08:00
wxyu 7b83d2a62f MS-346 add .cpp to solve compile error
Former-commit-id: 3db400a1bd346ca72e591fbd6b3557387f435b0c
2019-08-13 17:55:12 +08:00
wxyu 46a184f1e3 Merge remote-tracking branch 'main/branch-0.4.0' into branch-0.4.0
Former-commit-id: 567d2b89bf0e202d39bcf81c9b1e8121dea254e4
2019-08-13 16:45:55 +08:00
wxyu 741035b408 MS-345 Add Node Test
Former-commit-id: 71877f19888587a8ede17babdd332e852f587731
2019-08-13 16:45:39 +08:00
starlord 549b18f871 MS-343 implement ResourceMgr
Former-commit-id: 4cafc2cadf229ab61952233f1abc04d4ffdf9129
2019-08-13 15:22:01 +08:00
jinhai e7c202b79c Merge branch 'branch-0.3.1' into branch-0.4.0
Former-commit-id: 0158e842f89d68cb712a3a19cda55678a47256ff
2019-08-12 15:01:17 +08:00
starlord 414be9021d MS-330 Stability test failed caused by server core dumped
Former-commit-id: 66079f9b51b0e40adfc6dfbcf2d2156431124ebb
2019-08-09 18:19:07 +08:00
Yu Kun ebd8cd9aeb merge upstream and fix bug
Former-commit-id: 45fa6852c3ad2303263cc836d30f3d2f76dd964f
2019-08-09 17:00:32 +08:00
jinhai 6e04bf9ef2 Merge branch 'branch-0.4.0' into 'branch-0.4.0'
MS-313: add GRPC

See merge request megasearch/milvus!311

Former-commit-id: d488459184731d5c12599d1ecd5f3774b747ae69
2019-08-08 15:56:51 +08:00
jinhai 9620a673fe Merge branch 'branch-0.3.1' into branch-0.4.0
Former-commit-id: d3f1d181c97f95d9bee881adb0ff9be20aa0d951
2019-08-08 15:11:34 +08:00
Yu Kun 179a0feabf modify format
Former-commit-id: 74f43325a1b8ae17b1b7a5aeb61f0c6d7fd42de4
2019-08-08 15:02:27 +08:00
starlord 3f699e1757 MS-328 Check metric type on server start
Former-commit-id: 736c87b1731618461082b7171ffb366396a1dbd2
2019-08-08 14:29:07 +08:00
starlord 4d5618f4c3 MS-327 clean code
Former-commit-id: 9ca0ea6cb89b3fb95e17b0c0d6f647fe0c3ff7c4
2019-08-08 14:20:00 +08:00
kun yu 01a30b2ea6 merge upstream/branch-0.4.0
Former-commit-id: db495b0e7f256b98485986281fe83edf8beb6970
2019-08-07 20:23:39 +08:00
kun yu bbb49b4443 add changelog
Former-commit-id: 9eec1e77d6566b2142adcbb751668c810fa65646
2019-08-07 20:08:49 +08:00
jinhai 79ea7ecbec Merge branch 'branch-0.3.1' into branch-0.4.0
Former-commit-id: b479db2044d96bd9cd84e3ed6d5a33c8df2442a6
2019-08-07 17:30:16 +08:00
starlord 29d7913485 MS-324 Show error when there is not enough gpu memory to build index
Former-commit-id: f0dff85efafe0a74629bfc766c05387e37e8a743
2019-08-07 17:27:31 +08:00
zhiru bdc18ec361 add grpc
Former-commit-id: 5d2b02bc28510c77628b62ffdff7c01918b99a1e
2019-08-06 18:11:51 +08:00
zhiru 66d1cfe0c3 cmake: add grpc
Former-commit-id: 95283ed048e3c441c5005191adcccc29df04c4c3
2019-08-06 18:09:39 +08:00
starlord e9bb2e77fa MS-312 Set openmp thread number by config
Former-commit-id: 897d1c7387655046b4f769d695b9415785bd5108
2019-08-06 17:33:33 +08:00
starlord d2aa02084d MS-312 Set openmp thread number by config
Former-commit-id: 6ef7343aa6b908e6cd319271d4c60a49789eaf03
2019-08-06 17:31:43 +08:00
kun yu 6d41eb5650 add temperature and pcpu
Former-commit-id: 79e80d6e4ee42e05a5f9e60021fc4cc7ff9cc04d
2019-08-06 11:27:23 +08:00
quicksilver 945f5cdc2f MS-306 - Optimize build efficiency
Former-commit-id: a86e15afb113af0aed667a8a99bb164fa8bc00a0
2019-08-01 22:31:30 +08:00
zhiru b06cc9fe02 disable mysql unit test
Former-commit-id: 4f07286e00ceabe8fb700206ff45bbdda6bfe8d9
2019-07-30 13:53:45 +08:00
zhiru c16eabb538 disable mysql unit test
Former-commit-id: da61f1ae35c9ed2d8a363ffd2e85dfb634ae4b32
2019-07-30 13:51:59 +08:00
jinhai 5740985e0e Merge branch 'branch-0.3.1-xiaojun' into branch-0.4.0
Former-commit-id: a4c620656251f284789bead020c70a8fd64b4143
2019-07-28 09:30:31 +08:00
xj.lin 3314d47114 MS-288 update build stage
Former-commit-id: d9e0bfbbbb5060b65311b2f6eb8eadf531b918c2
2019-07-27 14:30:52 +08:00