Commit Graph

192 Commits (2428ff11608f567744f3b76e68810045369b3b50)

Author SHA1 Message Date
zhiru b102998ad6 update
Former-commit-id: 865e3d32a9cc754345b1ed89bdbe95cfd8232fc8
2019-06-20 16:14:58 +08:00
groot ec42c86ecb Merge remote-tracking branch 'origin/branch-0.3.0' into refact
Former-commit-id: 3b55ccd2a1ebb119cdd4a4955bda1cf339936c2b
2019-06-20 16:06:52 +08:00
groot e050719b2b delete table issue
Former-commit-id: d1a8e64086c11081917058623d344ac3c567a74b
2019-06-20 16:05:44 +08:00
zhiru c119bc36a1 fix merge conflicts
Former-commit-id: f89544589769736d6f57f912636b7ef6070f0149
2019-06-20 11:59:25 +08:00
zhiru b33165f6c9 cmake: fix AWS build issue
Former-commit-id: 5a7e5b182441a5780d95914ee40b138ea25abac2
2019-06-20 11:54:47 +08:00
zhiru 75a9b4fbd9 finished MySQLMetaImpl; need to test with DBImpl
Former-commit-id: f3a9848f5f2d7a8b15945ae824827371316d0b79
2019-06-20 10:02:02 +08:00
jinhai 03b79aba64 MS-99 Fix compilation bug
Former-commit-id: d6f1c84398057572bfb6004935dbec6f1fb7117a
2019-06-19 16:35:49 +08:00
jinhai 6c836b451f MS-98 Install unit test to installation directory
Former-commit-id: 26e87924a3a67cf766e471af5d7ee4b84de1b191
2019-06-19 15:46:14 +08:00
jinhai d65a7a156b MS-97 Integrate S3 storage sdk and provide storage api
Former-commit-id: 1fa5865169a2673806dad78916b87e3f30de188e
2019-06-19 12:04:02 +08:00
groot 374b30794c MS-92 - Unify behavior of debug and release build
Former-commit-id: cf2ab198bf28c9bf26cd0acb239c203626f7592f
2019-06-17 19:25:48 +08:00
zhiru 47537d0783 update
Former-commit-id: d6d4456d9b9638a7ac149155e1cd851b3105dc0e
2019-06-16 10:24:23 +08:00
zhiru d9076789d0 update
Former-commit-id: c72896aebcabce77cb12c4912b75aa109468a225
2019-06-14 19:02:06 +08:00
groot d031bb9e26 remove old names from source code
Former-commit-id: 3fcd7e5e6d2a8d147f09aa455c4a3f3eab20a24a
2019-06-14 17:29:29 +08:00
yu yunfeng 3aebfec225 add netio
Former-commit-id: 68d34cf2f54e893cbd0bb2c04b89994ec3b1b752
2019-06-14 10:29:25 +08:00
yu yunfeng 52e23c4760 merge 0.3.0
Former-commit-id: 9e30f64b77a970d48e627bd5c518a7c17f498fd5
2019-06-14 09:59:28 +08:00
yu yunfeng f30bb1d35d add netio
Former-commit-id: 778661eb22ca5e6e697afe00df3dac4aca416125
2019-06-14 09:23:39 +08:00
jinhai 94612238e5 MS-82 & MS-83 Update vecwise to Milvus
Former-commit-id: 69d1f1b661e6fc7779b4ae3abae60eeb28fa2b04
2019-06-13 16:02:25 +08:00
groot 235b85f63b changelog
Former-commit-id: 6b2099e086696dfbf956e0778d0941ec89bb4812
2019-06-11 16:43:05 +08:00
groot 3ee722ae85 merge remote branch 0.3.0
Former-commit-id: e7cc89f6bd93693ca0b6501293b91646ef47130d
2019-06-11 16:38:36 +08:00
zhiru 8328391443 cmake: delete civetweb
Former-commit-id: 9433a000ba9da1916ef85288316477069d2019c7
2019-06-11 16:23:55 +08:00
groot db3f0e9ba7 support delete table
Former-commit-id: 3b728c4dfc0b9a6c8803538c89961e4b43c6ca67
2019-06-11 14:54:09 +08:00
yu yunfeng dfda1e2f56 fetch from main/branch0.3.0
Former-commit-id: 9058453cf58e85bc177e385c6d465a1d21d80282
2019-06-10 14:19:28 +08:00
groot cf94a753d7 return search score
Former-commit-id: e141cb974769ee0e7ee06eb7635eb458622af60c
2019-06-09 17:35:52 +08:00
groot ff7cab7006 refacture db code
Former-commit-id: d232155b1de07bd7b66a64f39417f25118b59891
2019-06-09 15:45:43 +08:00
groot a1e652088d refacture db code
Former-commit-id: 4aa8a2bb10b44d9315431a79ec6c140e4735aff5
2019-06-09 09:43:05 +08:00
yu yunfeng 6ab97a7314 Merge remote-tracking branch 'main/branch-0.3.0' into branch-1.2
Former-commit-id: fb9ce866c473954800fe47b104eafeae4eab70ce
2019-06-05 15:46:16 +08:00
yu yunfeng 24863f63e5 all metrics are done
Former-commit-id: 68275f6545ac62a28899f4b6bbb687365c52d52e
2019-06-05 15:45:48 +08:00
groot 22b5b6cbf1 pipeline for loading/searching
Former-commit-id: 93cd16549fcd392de487237df21e2df14ef8321a
2019-06-04 19:32:43 +08:00
yu yunfeng 8367c9aaa7 add vps qeury_summary metircs
Former-commit-id: ec3f9e3dd9338332d2e40dbae8b5d4b672b1cef1
2019-05-31 18:26:44 +08:00
yu yunfeng 2ab5e246ac add metrics
Former-commit-id: d7acd398be8aeee11de3f972d9bcf6e84df39358
2019-05-31 14:36:36 +08:00
yu yunfeng f8c46af560 fix metrics test and add prometheus conf
Former-commit-id: 0c7ff6f49880db0ce4dd22ea1375886fb0e9b03d
2019-05-30 14:50:16 +08:00
groot 39df2d4d1e fix third-party link error
Former-commit-id: 54782a2d0812e836544ca8667c1ee42a4e934830
2019-05-29 17:30:27 +08:00
zhiru 31a00449a4 MS-26 cmake. Add thirdparty packages
Former-commit-id: a68611c035820a429ae5ef1ae104a9826838dcca
2019-05-29 16:14:15 +08:00
yu yunfeng 4116f710f5 merge branch from Xu and add metrics
Former-commit-id: a5d3e97dbd87c6478ece637046a2d9545fbc973f
2019-05-28 18:46:07 +08:00
yu yunfeng 80db8aaf20 Fix compile error
Former-commit-id: 07f4dd06011ef519e29744dcd5b8ac9e407b2505
2019-05-28 17:50:20 +08:00
yu yunfeng 815bf5550f add metrics_unitest
Former-commit-id: 783161b2f8a70b24b605f2040f9381f4aa0fff07
2019-05-28 15:33:42 +08:00
Xu Peng c5501202ad refactor(db): whole db api refactor
Former-commit-id: 3519e8a464bcd66b6da8ef2c579c08eaf13d17bd
2019-05-28 13:49:59 +08:00
yu yunfeng 1563f81ac2 add metrics
Former-commit-id: 3e811d555cf69eb2c8f515ada44c8df43e460de0
2019-05-28 13:34:47 +08:00
Xu Peng ca33fbbe14 refactor(db): DropAll -Count CleanUp CleanUpFilesWithTTL
Former-commit-id: b718bb89945651de19a1263eaf64eab22d11eb6c
2019-05-28 11:04:37 +08:00
Xu Peng 874eeb8f7a refactor(db): FilesToIndex
Former-commit-id: fe5bd8ca372d0a4d5bf257f3f10853179d2356ce
2019-05-28 11:04:37 +08:00
Xu Peng 7fe5346f14 refactor(db): Archive
Former-commit-id: 21f153c1a57ad4bb706f6b177a10d45faf88ed99
2019-05-28 11:04:37 +08:00
Xu Peng 2789234931 refactor(db): FilesToMerge
Former-commit-id: 9101dcd75943bc241094af92156805090bf8e408
2019-05-28 11:04:37 +08:00
Xu Peng 09fdd0f849 refactor(db): FilesToSearch
Former-commit-id: dcb7f972ee13a0916129dfec5b05dad66025dfbf
2019-05-28 11:04:37 +08:00
Xu Peng ec4e83db3f refactor(db): UpdateTableFile
Former-commit-id: e5b29fa1396d5a06c26a4917e15fed0082bbc7ae
2019-05-28 11:04:37 +08:00
Xu Peng ba8929e9a4 refactor(db): GetTableFile
Former-commit-id: 9b5f8d3a6c3202acc5b16f9b75f4ebe9cb2c6c50
2019-05-28 11:04:37 +08:00
Xu Peng fbe1278a3a refactor(db): DropPartitionsByDates
Former-commit-id: 2534fa34f690ba60788e3619b6a87a9a7ed8650e
2019-05-28 11:04:37 +08:00
Xu Peng 01e4e605e2 refactor(db): CreateTableFile
Former-commit-id: c29b8ccc97cc327ec9c278f2ea5456369365c4f3
2019-05-28 11:04:37 +08:00
Xu Peng 624e34f10d refactor(db): refactor DescribeTable
Former-commit-id: 021d731f3be6f338423caabef59bdd4c46ed02d8
2019-05-28 11:04:37 +08:00
Xu Peng 3d330e0aa4 refactor(db): change group_info to table_schema and add_group to CreateTable
Former-commit-id: e8d48ec8e54429bf5d1080997ca329b42ddcab82
2019-05-28 11:04:37 +08:00
Xu Peng f2bb20c90d refactor(db): change group_id to table_id
Former-commit-id: bf0cec2552fcad95bf1b77cdfbdd423984e6f18f
2019-05-28 11:04:37 +08:00
Xu Peng 209d0e4806 refactor(db): change groupfilesschema to table*
Former-commit-id: e786234155eecb9d22ad2b6a8b2c9357675e5de4
2019-05-28 11:03:45 +08:00
Xu Peng e94499cdff refactor(db): change groupschema and groupfileschema to table*
Former-commit-id: fbc69151149faa8ed32547bcdd1a9935dac34070
2019-05-28 11:03:45 +08:00
yu yunfeng 8510104066 fix conflict
Former-commit-id: cffe275e0430a89b99c17574766dff7c972d810d
2019-05-28 10:02:20 +08:00
yu yunfeng 1392e0d5c7 c
Former-commit-id: 420c70f051d7cbd2f9a0a5c4d8181ba11bb93f27
2019-05-27 16:31:20 +08:00
Xu Peng c5b931d59e test(db): fix test error after impl exception
Former-commit-id: 71184ffe49ac0130d2002aef4f8f55c825414d0c
2019-05-27 14:59:00 +08:00
Xu Peng 7337cef31c Merge branch 'release-v1.1' into impl_simple_delete
Former-commit-id: 10d74a865946328366a49fb389d0038858064e83
2019-05-26 17:37:52 +08:00
Xu Peng 1c6a012b46 Merge branch 'branch-1.2' of http://192.168.1.105:6060/megasearch/vecwise_engine into release-v1.1
Former-commit-id: 56c25fba480cf53fed8e03f820a597dfd8138436
2019-05-26 17:34:32 +08:00
Xu Peng 74e6ef4a9c test(db): fix for ARHIVE_DISK_CHECK
Former-commit-id: 1a82a410db91e2b6f9ddc38bafc491a1204c0dd1
2019-05-26 16:51:30 +08:00
jinhai 8d3ad6aeae MS-4 Refactor the code structure
Former-commit-id: ab2c7af5968b367ca27bac2d991b0dae5ad2dc75
2019-05-26 14:46:38 +08:00
Xu Peng 92da0fa4ca refactor(db): for schema changes
Former-commit-id: 3d1aa65da396177ff49e1922ae032cec834f7850
2019-05-26 13:02:22 +08:00
Xu Peng e09240e45f test(db): refactor with meta consts
Former-commit-id: a611af0886bdeb51b4a38da2e80b84a4fd13d0cc
2019-05-26 12:26:23 +08:00
Xu Peng f9889598d7 test(db): check size
Former-commit-id: 115707db134408a52f14e95d25c5d434c05d1c9f
2019-05-26 11:27:31 +08:00
Xu Peng 3f28d33b6e test(db): add test for overall archive
Former-commit-id: 34b7aa89adc45c2505619b902e7701ce7df4e91a
2019-05-26 11:27:31 +08:00
Xu Peng 80860535a7 test(db): add test for archive days
Former-commit-id: 10dcbdf0d3f32fd90904150c294cbe87a0ebfa7b
2019-05-26 11:27:31 +08:00
Xu Peng 4c44b02b5e test(db): add archive test
Former-commit-id: 7fc4969944759203524c0dbac8fc4421fd528f28
2019-05-26 11:27:31 +08:00
Xu Peng 73fb498ff7 feat(db): add Archive conf in options
Former-commit-id: caa950e7119264fd911f21cd10b4fbb2db896b7d
2019-05-26 11:27:31 +08:00
Xu Peng a7c22f8e53 test(db): test delete group partitions
Former-commit-id: af392c6bf9440a5d29ee152e4d4129153b499f94
2019-05-26 11:27:31 +08:00
Xu Peng 4eea03af5c feat(db): add simple delete partitions
Former-commit-id: ed39bb26d68f4ea576e824c081e72bfb17d15b8a
2019-05-26 11:27:31 +08:00
yhmo 011be04411 Merge branch 'jinhai' into 'release-v1'
# Conflicts:
#   cpp/src/utils/Error.h

Former-commit-id: 18470ad3970bec55315d738a006355c1ce2c1f4c
2019-05-15 16:40:00 +08:00
yangwei.yao 74d5802ba4 unit test
Former-commit-id: 3806f1d475b2dd1259fe48a013f01389f8975e5c
2019-05-15 15:01:07 +08:00
yangwei.yao 35eeae6f08 license check is vaild
Former-commit-id: 7381ad310d5b554c99f1f19f7fc460b33c36659f
2019-05-15 15:01:07 +08:00
yangwei.yao 384b9b8af2 1
Former-commit-id: 3642cd8f4089038eade6857854d1d1b42c5eceb8
2019-05-15 11:26:56 +08:00
jinhai 7c512bf752 Update on license check
Former-commit-id: ef039b5663e0a68c1dfdea7244de4d2e7e16c10e
2019-05-15 11:26:56 +08:00
yangwei.yao 128bc2b420 Refactor
Former-commit-id: 5c57d9054cae1e468a5795b928ecab4d18c1d4af
2019-05-15 11:26:56 +08:00
jinhai 06dd990b18 Refactor code
Former-commit-id: 31caf05ec1b75d9cd1de476104cdc0abf62acedd
2019-05-15 11:26:56 +08:00
yangwei.yao 5eb854b1b6 license_run
Former-commit-id: dbfbeafc516f45c89cf2b693f40ac19abf903df3
2019-05-15 11:24:37 +08:00
yangwei.yao c7ba2112bb 05.11
Former-commit-id: 22e7d5214db47ac228d50989b01e3a5e71a719d4
2019-05-15 11:24:37 +08:00
groot 678f1010a1 use rocksdb column family
Former-commit-id: dbf59149386a71807ff3ea4498240afd102b5001
2019-05-14 11:16:18 +08:00
groot 56291b218d use rocksdb column family
Former-commit-id: 8cbc5d91e02e6bbc0eff1e329b4c76687d2c1f74
2019-05-13 15:17:05 +08:00
xj.lin 364af3b1a8 redefine default index build type
Former-commit-id: 1f10a7774b80b596323882bb74a46484a917344f
2019-05-11 11:27:06 +08:00
xj.lin 876f6a4c66 1 Support Cpu-version
2 Update build.sh support both cpu-build and gpu-build


Former-commit-id: 3c0ddd7fb2f93ab45b6f9878b71b6541617f92c4
2019-05-11 11:27:06 +08:00
Xu Peng 2a8c45d394 test(db): check add vectors result size
Former-commit-id: d72021ae7c0fc69c840780d023d6a7573b618ce5
2019-05-11 11:19:21 +08:00
jinhai 77f86fdeee License tests success
Former-commit-id: e10d0146a51286664bb01f5d55f694e547a8f597
2019-05-08 17:38:37 +08:00
yangwei.yao 414cbf860f Update CMakeLists.txt
Former-commit-id: 6007ad4c75ca615d6d21236a2ea5affe347672d1
2019-05-08 17:01:11 +08:00
Xu Peng 4428d56670 refactor(db): trait for engine and dbimpl
Former-commit-id: c42d9f4d7168b4d8e374ddb5ed0499ea1394a306
2019-05-08 12:13:01 +08:00
Xu Peng 9adc7bdf82 env(unittest): add missing lib
Former-commit-id: 3d923d0a8588226084f6935b184798f2a402849c
2019-05-08 11:05:09 +08:00
Xu Peng 0fb7334220 test(db): enhancement for unit test
Former-commit-id: 2fdacaf3f80a70c3319d9dc7b2756f042b5b5106
2019-05-07 09:44:35 +08:00
Xu Peng b8949ca86f fix(env): fix compile error
Former-commit-id: 63a2957e3c226bdb08658d96738d30dc98a73619
2019-05-06 20:52:02 +08:00
xj.lin 2ac87c1e47 1. support IDMap
2. fix some bug
3. background job from IDMap -> IVF


Former-commit-id: ba8f24f09c5481103ad3f4c1c91d4deb70f26dad
2019-05-06 10:24:07 +08:00
xj.lin 56bbe40faf 1. fix operand serialize bug
2. support gpu-build
3. add unittest


Former-commit-id: bb36dcb05220d8f0648f282c7e38fe20f4ab3c16
2019-05-06 09:53:59 +08:00
Xu Peng ce54690910 test(db): small change
Former-commit-id: 8cf0fe13bfd7715a491f00cc24e2efa37fd8decd
2019-04-30 14:17:24 +08:00
Xu Peng 21a98c0e02 test(db): refactor db test
Former-commit-id: c85ed1e09b51f9c883426f7c77da3261232f0745
2019-04-29 20:22:24 +08:00
Xu Peng 61854a6c23 test(db): refactor SetUp
Former-commit-id: dfbb0f819705c0fca4b5e0a7fb37ce7bc52761d6
2019-04-29 19:05:48 +08:00
Xu Peng ed9dc51f27 test(db): samll change
Former-commit-id: 1bdf8515f7914a43e965334db36d253fea12abb7
2019-04-29 19:01:18 +08:00
Xu Peng e78481f5e4 test(db): add meta files test
Former-commit-id: bd7b5371b11ddd769b178fe0e263b5759398e0d3
2019-04-29 18:10:30 +08:00
Xu Peng f7853fcd20 test(db): add group file test
Former-commit-id: 8fa440c2be5f525388d45fca7e92244718e8c2fc
2019-04-29 18:10:30 +08:00
groot bd9c14a871 typo
Former-commit-id: 89e00f1b579a2f78737efcafc04507f0f31049b1
2019-04-29 16:20:21 +08:00
groot 16df78caee add attribute for vector
Former-commit-id: e520d4e7aaceb1fedae62cc67326a550666efc6b
2019-04-29 16:14:21 +08:00
Xu Peng c26629756a test(db): impl more group test
Former-commit-id: 5de1604a22951a2e96253f994d6af95ccd8bf019
2019-04-29 15:56:07 +08:00
Xu Peng 9ff65dc76c test(db): group test more
Former-commit-id: 31949c0387e3400c63d7387664dc8e142ce1ce17
2019-04-29 15:50:52 +08:00