Commit Graph

482 Commits (120a52c184e43f4abdb79135111a8d9a81d6d2e4)

Author SHA1 Message Date
Xu Peng ed9dc51f27 test(db): samll change
Former-commit-id: 1bdf8515f7914a43e965334db36d253fea12abb7
2019-04-29 19:01:18 +08:00
Xu Peng 7680d5c731 feat(db): change default options values
Former-commit-id: 8c4aeb5206d7532ac524956e225779ce2e29766e
2019-04-29 18:56:40 +08:00
Xu Peng e78481f5e4 test(db): add meta files test
Former-commit-id: bd7b5371b11ddd769b178fe0e263b5759398e0d3
2019-04-29 18:10:30 +08:00
Xu Peng 0bbae88f3f fix(db): add to index files in files to search list
Former-commit-id: 8174f890208374835a7d0b0c310fdeb7f016bd32
2019-04-29 18:10:30 +08:00
Xu Peng f7853fcd20 test(db): add group file test
Former-commit-id: 8fa440c2be5f525388d45fca7e92244718e8c2fc
2019-04-29 18:10:30 +08:00
groot 363de87bdb gen python api
Former-commit-id: 1c9b4a1fea7c450b55e8d683085d8779460ea3c4
2019-04-29 17:58:08 +08:00
groot 231b216963 add namespace for thrift api
Former-commit-id: 92f9e0a0f7d2e301120573976984f99062b8f44e
2019-04-29 17:55:50 +08:00
groot e1efe942da fix test load config failure
Former-commit-id: 7781b6ff8a4c1d72dfe4f872a7765424af40286e
2019-04-29 16:34:43 +08:00
groot bd9c14a871 typo
Former-commit-id: 89e00f1b579a2f78737efcafc04507f0f31049b1
2019-04-29 16:20:21 +08:00
groot 16df78caee add attribute for vector
Former-commit-id: e520d4e7aaceb1fedae62cc67326a550666efc6b
2019-04-29 16:14:21 +08:00
groot fe5909a597 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 69eee8018a8a7d7478181c11fef7ef4206ee0784
2019-04-29 16:12:40 +08:00
groot 592dde4dd7 add attribute for vector
Former-commit-id: c2a1a5cd917abe1cf3e8ef327bba5c2ed1cf8008
2019-04-29 16:12:35 +08:00
Xu Peng c26629756a test(db): impl more group test
Former-commit-id: 5de1604a22951a2e96253f994d6af95ccd8bf019
2019-04-29 15:56:07 +08:00
Xu Peng 9ff65dc76c test(db): group test more
Former-commit-id: 31949c0387e3400c63d7387664dc8e142ce1ce17
2019-04-29 15:50:52 +08:00
Xu Peng 4b18d9fec1 test(db): add more meta test
Former-commit-id: b8078e972d1c08b38cd6ff272ec2cd6ab1d895b2
2019-04-29 15:47:09 +08:00
Xu Peng 4a66580f4f test(db): add meta test
Former-commit-id: 9668abe43a31a04c58311c12834fe5b89da23c07
2019-04-29 15:29:28 +08:00
Xu Peng f096e0a109 feat(db): add meta impl factory
Former-commit-id: e9af01dea914b32192efe1c534e174810be5a02a
2019-04-29 15:06:35 +08:00
Xu Peng c1d40bfb3d feat(db): add db factories
Former-commit-id: df8ec1140cc82755e14a739cbb22fb035b3c7d18
2019-04-29 14:06:40 +08:00
Xu Peng 3dfdfef07a test(db): add utils in db test
Former-commit-id: 0e65a0a885cc3ead0fb233bd041bb4f8b8645898
2019-04-29 13:17:19 +08:00
groot cdda6e5769 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: b50f73905441637b4751f55509b74b82cf3329ad
2019-04-29 12:46:01 +08:00
groot bdef129e3a fix unitest load config error
Former-commit-id: e1ff282a7eb4c81ee76efe43751f9d7329e8ddf3
2019-04-29 12:45:53 +08:00
Xu Peng 096c4639b7 refactor(db): remove dummy includes
Former-commit-id: b25398a114a59e79b0e20fca60843aecdbec51b5
2019-04-29 12:38:27 +08:00
groot b8148d8e13 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: bd511cfab2d3813dee05c34dcf068622da2fef94
2019-04-29 12:31:56 +08:00
groot 1aefac8ae0 fix unitest load config error
Former-commit-id: 8bf7417881a421bf5c28a31474743484e8fea155
2019-04-29 12:31:48 +08:00
Xu Peng 5d5bbe842d feat(db): add dates filter for search
Former-commit-id: 04ba53b11c8bb7fbd90877d1be6e82bb80e2247c
2019-04-29 12:05:03 +08:00
groot 688a9992be fix make error
Former-commit-id: 7a5d078a48a92b0595e67bf8fe9891a075044bf4
2019-04-29 12:04:56 +08:00
groot 4cbdb58718 redefine thrift api
Former-commit-id: ed64f6205c2723111f3bc2771836a265b2474817
2019-04-29 11:09:57 +08:00
groot 487ea03461 redefine thrift api
Former-commit-id: 0dc225d0372e6e2260126a301552a37d161ccec8
2019-04-29 11:01:01 +08:00
Xu Peng 2ff4cae2cf test(db): change test
Former-commit-id: e1922a567069b4c058acad186b8186b4cbbe0f4a
2019-04-28 21:01:30 +08:00
Xu Peng 5569f22de2 fix(db): no transaction for update_group_file
Former-commit-id: 22b364f8f07cd009391952ba66478879f6b86b6d
2019-04-28 21:01:30 +08:00
groot d6dc77ced2 fix cmake warning
Former-commit-id: a3c4cb47f43d54e44f8a6b7f887e61f2182d998a
2019-04-28 20:51:21 +08:00
groot 2005f2c1c8 refine test code
Former-commit-id: c44c49b22ad20188bcc2ac339cbb659e29ac661b
2019-04-28 19:28:05 +08:00
Xu Peng 57dfdae3e3 feat(db): fix bug and add exception catch in meta operation
Former-commit-id: 6d33945997e7a528bc729efdad6076d6532f79b3
2019-04-28 18:44:25 +08:00
Xu Peng 486c175b4e feat(db): add serialization mutex
Former-commit-id: f8a3b14c0209a9e36b0510ce48754deefc4ee442
2019-04-28 18:44:25 +08:00
Xu Peng f7cd398c3b test(db): change test case
Former-commit-id: 4d371cf9f3cb591eafff64373aaaabaabd90118c
2019-04-28 18:44:25 +08:00
Xu Peng 32b64ab724 feat(db): add more print
Former-commit-id: 42486eb1e1c804e7b5120dc1f0dd12d2f7bd6a96
2019-04-28 18:44:25 +08:00
Xu Peng 8c01725ff7 test(db): add more friendly timing print for test
Former-commit-id: 2a87319062a6f753881efd898517ac67fd4d3216
2019-04-28 18:44:25 +08:00
groot 66565bd74d refine test code
Former-commit-id: 9b8ccd59cff07cc22a23e156b01beba4ca637c08
2019-04-28 16:53:48 +08:00
groot f773ac9a20 refine test code
Former-commit-id: d137fe1c53e2e05950361f2f376aea1f33a0a228
2019-04-28 16:10:37 +08:00
groot 149c245958 add rocksdb option
Former-commit-id: cebc9569d8dca44c360ac68510427f1447105ddc
2019-04-28 14:48:05 +08:00
groot 0108db9840 add log
Former-commit-id: 0bf2f53f1d9b5c89cceaf6a2e4b11257683d4645
2019-04-28 14:20:29 +08:00
groot 8e23d2eb66 change test_client to unittest
Former-commit-id: 8efbb1314e6cebd5c36643cca0d31668a8be639d
2019-04-28 12:42:04 +08:00
groot 95f3900910 add new api for batch binary search
Former-commit-id: c035ac8fcfe672576c6207fca149c3d4030e7b53
2019-04-28 12:07:59 +08:00
groot 13d7ebb5cf add new api for batch binary search
Former-commit-id: 3729408c50d0ab9a482e3ddea8e1672188a9acd8
2019-04-28 12:07:15 +08:00
groot 167ae9c22c add new api for binary vector
Former-commit-id: e450d463c9bb6473f6da93602bdf306dd48c65f7
2019-04-28 10:43:49 +08:00
groot a5682c301f add new api for binary vector
Former-commit-id: 0c37b1fa7ab1a3da301da0371ae275f0a118931f
2019-04-26 20:57:06 +08:00
groot 9f35b62289 fix cache manager bug
Former-commit-id: d1b7f43865f6e0a059081531e1549a975c86d4aa
2019-04-26 19:45:26 +08:00
groot 541e0d610e Merge branch 'new_orm' into jinhai
Former-commit-id: 3cc778a3f03cd9d71f91e0bb8b12f16f0aea7fbc
2019-04-26 18:35:22 +08:00
Xu Peng 7e00f351e1 test(db): change log format for unittest
Former-commit-id: a364d3800fbefbd9287df906b5e69f4ec89d1aa7
2019-04-26 17:59:51 +08:00
Xu Peng 5fbe3d9641 feat(db): remove limit for id generator
Former-commit-id: a110cfa01b6207cd76fd1ee000945c04c48b0d88
2019-04-26 17:59:14 +08:00
Xu Peng 062c3aad91 feat(db): merge file optimize
Former-commit-id: fea0d7970fab88f995d9d16d7dfea84dd4fbacb7
2019-04-26 17:18:27 +08:00
groot 52234126de fix test bug
Former-commit-id: 1a16c14bf6ce3faf71c4b912c554dab223b86f62
2019-04-26 17:01:46 +08:00
Xu Peng 1d9946ff87 feat(db): change sqlite_orm header dependency
Former-commit-id: d682b364b1b27a2af27f0246460bb9bbb6370fd0
2019-04-26 15:37:54 +08:00
groot a21ad0b743 fix task bug
Former-commit-id: f5debab3ff1c4000596f4cf625f37ba83ec54296
2019-04-26 15:37:10 +08:00
groot 75410aed03 refine scheduler
Former-commit-id: 9b772adf62a9f7f2ae349f3a2420fcecb08af6ce
2019-04-25 16:41:01 +08:00
yhmo 87d0ed293e Merge branch 'scheduler' into 'jinhai'
Scheduler

See merge request jinhai/vecwise_engine!16

Former-commit-id: 1adc4d5f745ac461680ce6f7d7bb14d8044ef87a
2019-04-25 12:18:41 +08:00
groot b03aafdc41 implement scheduler
Former-commit-id: 1be5a738138a626ddb4a7412e798c74debbc4c3a
2019-04-25 12:17:56 +08:00
groot 11cb43ac2e add scheduler
Former-commit-id: aead7396cc627fc680408188d3182fd098b5271d
2019-04-25 09:38:27 +08:00
Xu Peng b9af8670db test(db): update test
Former-commit-id: f3bf72ecd3c482d9a270342009f13be5263f89ca
2019-04-24 20:12:26 +08:00
groot 4864a960b2 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 32f8a5ce257cf776000a93e865bdb7a41f8e31e8
2019-04-24 19:23:45 +08:00
groot 7d2b94f4ae print cache info
Former-commit-id: 056e15ab3715f03b89648c84d5ea6498708971c1
2019-04-24 19:23:37 +08:00
xj.lin ce7bc10f8c fix search
Former-commit-id: 14a6408d66811f1d1a1d5bb1cbbddbecb5dd4d51
2019-04-24 18:19:29 +08:00
groot 3815528396 modify thrift api
Former-commit-id: 9516c969a09e06c073e02b1186503776df2f370a
2019-04-24 17:34:21 +08:00
Xu Peng d402dd9dce fix(db): code fix
Former-commit-id: fbb9040ada2c355dad1e13526f8f16c36e155716
2019-04-24 16:25:50 +08:00
Xu Peng a6369c7a4e feat(db): cache for search
Former-commit-id: 8e13efdaa593b4ebb83b06d33d5127180d756597
2019-04-24 16:20:36 +08:00
Xu Peng 4e59f966c3 feat(db): cache for mem merge
Former-commit-id: bff342710683954dcd4b72b890fff483708ceba0
2019-04-24 16:04:14 +08:00
Xu Peng 22281e8ea5 feat(db): cache for mem serialization
Former-commit-id: 9d3211b9c4bfa6132cd52822e19c1ae5d287d9a2
2019-04-24 15:47:34 +08:00
Xu Peng 7150d3c5aa feat(db): cache for index
Former-commit-id: e33cb100824e8714e539bec4f6622753001a9606
2019-04-24 15:42:08 +08:00
Xu Peng 1fa42f9d61 feat(db): add data api for wrapper
Former-commit-id: baabe91cc364d832e17016c554d66e29e400dfd4
2019-04-24 15:29:45 +08:00
Xu Peng 2e8d45aad3 feat(db): cache merged file
Former-commit-id: d236a8dbfcb01d07b6b544aa98a7e1dd179fc477
2019-04-24 15:16:38 +08:00
groot d6044cfc32 fix build error
Former-commit-id: d06ecbf29ddd4b70bfd056341c6537c66f9dbb55
2019-04-24 15:16:32 +08:00
groot 8185c9fb27 rewrite cache code
Former-commit-id: d4a2336ade2a39d34380dba715290992dcdabc84
2019-04-24 13:57:22 +08:00
groot 41cb7fa0ec Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 3446551c5ae37cb4e54349d98227d5105abcb54e
2019-04-24 12:10:42 +08:00
groot 01c5b43130 rewrite cache code
Former-commit-id: 7dc429b553891f98baa0cef21bee58c545ab9748
2019-04-24 12:10:37 +08:00
Xu Peng 918c113727 fix(db): fix memory leak
Former-commit-id: 1c5b7e0ab18f9508aa5aeecfc7caecf5ac74fd45
2019-04-24 11:53:26 +08:00
groot 97d4738bc6 rewrite cache code
Former-commit-id: 00247bcda3df3d0e29bc4a809f7894ce92470e0e
2019-04-24 11:52:13 +08:00
Xu Peng 06ab815c7b feat(db): add count api
Former-commit-id: 9fb2b765a48d1753ba31a68e7b9b207273adb199
2019-04-24 10:28:05 +08:00
groot 4ce28a1e21 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 6ef6cb1953310c4e01b1787e1a041c25f7dfd951
2019-04-24 10:25:11 +08:00
groot dc3e4f58a8 rewrite cache code
Former-commit-id: 8e76ab5219eedd24563ece59f70dec8a4464c44d
2019-04-24 10:25:00 +08:00
Xu Peng 7509e28d91 feat(db): try build index every interval
Former-commit-id: 15571dc68be30524189c73800ce8050ed8a2f9aa
2019-04-23 20:57:00 +08:00
Xu Peng af39787c92 feat(test): add unit test
Former-commit-id: 614f9c9b275b1893f212b0de966e069264fd13cc
2019-04-23 20:55:15 +08:00
Xu Peng d6344006e5 feat(db): add drop_all
Former-commit-id: 70720144d39f5ca18d349e475e66fb6ccca7bacf
2019-04-23 20:03:55 +08:00
Xu Peng d7a87d14b1 feat(db): try build index every merege interval
Former-commit-id: ee639ab9b93b0a3bd5950276749f0dad3dc53227
2019-04-23 16:48:24 +08:00
groot 0bcb727b46 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 086d172e4c9ba7db6a271940f2baa6ab5ede6069
2019-04-23 16:34:56 +08:00
groot f642a7b38e redefine id mapper interface
Former-commit-id: 6fa296aa09aae1019ed1e49a481c3a1e34440071
2019-04-23 16:34:43 +08:00
xj.lin db32c300e8 feat: add search support
Former-commit-id: 0bb20ad7b80ca432b83154efd59cb89e7cc2867c
2019-04-23 11:58:43 +08:00
groot 82fe888083 add unittest
Former-commit-id: 9c22540ce32d94d7f17626edb985d9c00af8fdec
2019-04-23 11:21:14 +08:00
groot 2d9fb6b959 fix a bug
Former-commit-id: 26f6048d0c32fe83cc2bdc377efcde41f8877d2a
2019-04-23 10:51:18 +08:00
groot 3f7fe2548a add id mapper
Former-commit-id: 56cfee9e3beeb474e2a56c3e3a3fdda111cfabb2
2019-04-23 10:10:20 +08:00
groot 8909b19722 add id mapper class
Former-commit-id: 6d9b05faca8200417e68de306abe2f1a35b601ff
2019-04-22 17:50:52 +08:00
groot e9b7063402 add id mapper class
Former-commit-id: b12be12ea33f4b3f99a4f65b1156d7a86007dcc1
2019-04-22 17:27:03 +08:00
Xu Peng d8f40536c5 feat(db): add easylogging for debug log
Former-commit-id: 85e3e48f3b917d7ecf716805fa8d19af349bc35f
2019-04-22 17:00:39 +08:00
Xu Peng 2943126bda feat(db): add ttl files cleanup api
Former-commit-id: bb84f6f2baa8c20c9f0e745c67213af236609507
2019-04-22 15:08:26 +08:00
Xu Peng abacf3e234 feat(db): change updated_time type of long
Former-commit-id: e58de06418bdb6b4f40f646ff5dc3d6a0efb12c0
2019-04-22 14:50:47 +08:00
Xu Peng 216aeb6bd0 feat(db): add updated_time in group_file meta
Former-commit-id: 0a2c3549b8b82267db3facc9606d8f8f90b02de2
2019-04-22 14:15:58 +08:00
Xu Peng b377266934 feat(db): add some print
Former-commit-id: 200b365c40532a13d777457bd53e6788fd613559
2019-04-22 14:15:58 +08:00
groot dbadb94091 add id mapper class
Former-commit-id: f0c14a9905825c0970f19b2bd53da610954c07c0
2019-04-22 14:07:29 +08:00
groot e7075c185d modify server api
Former-commit-id: 3eff45989dd09bf7b7aae8b2a004f83898708dd6
2019-04-22 13:56:38 +08:00
groot 41220cb25d add db unittest
Former-commit-id: 5a9e4a10ada30d19fee14b1d2e1d4123ac6dee04
2019-04-21 17:01:02 +08:00
groot 0b545a70d8 change build settings
Former-commit-id: fe3df7b281a528d4e07669c7c4e0e1521eb6bf2a
2019-04-21 16:19:04 +08:00
groot 2b035e54a6 index search unittest
Former-commit-id: 9632c0668ce71d07bba6f13e9ee46df4e1af6b38
2019-04-21 15:55:48 +08:00
groot 885b95e2ea refine code
Former-commit-id: 5916e0c3afaa752bcc3ff3cef69d30244be0b6c7
2019-04-21 11:31:36 +08:00
Xu Peng cb82771ef4 feat(db): change open db api
Former-commit-id: f9c5b0714096075d7a869b248a8b44201b41d0e0
2019-04-19 21:39:59 +08:00
xj.lin 457688d787 add search support
Former-commit-id: 4aae0710844eff71fb83f3d73f3fa7463b00e99b
2019-04-19 21:39:39 +08:00
xj.lin d7c7720ef6 update cmakefile
Former-commit-id: 2827b60ab09f52a244a6da690c42340884a48f39
2019-04-19 16:43:30 +08:00
Xu Peng 8e1e03b2ba feat(db): cleanup pre db destruction
Former-commit-id: 98270b53f6bafcde31d44039bb224d547ce71b07
2019-04-19 16:08:12 +08:00
Xu Peng 2de4f04771 fix(db): no default sqlite dumped
Former-commit-id: d5b6964706cbb0870e5cc9c8fab048a849dd3fa1
2019-04-19 16:08:12 +08:00
Xu Peng fe93299d9a fix(db): set new file rows to 0
Former-commit-id: a8690d08c1563f0c7ddd91d5709912a5aab49899
2019-04-19 16:08:12 +08:00
Xu Peng a9ed75fc46 feat(db): remove mutex for meta operation
Former-commit-id: f5f168c15284d7fd9d9353cf78b2d421ae310187
2019-04-19 16:08:12 +08:00
xj.lin cc641236d2 add TopK
Former-commit-id: 847a46e3b7ab8bead610ec9888fce5a4279a6920
2019-04-19 16:07:45 +08:00
Xu Peng a6e92dc9ab feat(db): update for merege and index
Former-commit-id: b06f36ce5a8ebca0f1f4554437b19233f8f6f723
2019-04-18 21:00:40 +08:00
Xu Peng 08a1527b66 feat(db): fix missing location
Former-commit-id: 1a4a5c09c9b48e4d70a660050a289f9c7af59750
2019-04-18 21:00:40 +08:00
Xu Peng 2780b1a6d6 feat(db): fix meta lock issue
Former-commit-id: 9c276ca661d234e3e1268836fc6efddef408be3e
2019-04-18 21:00:40 +08:00
Xu Peng 58c0a6f838 feat(db): fix insert group bug
Former-commit-id: ff93f2cd24c2d952c95f55dd141f693ad995ec51
2019-04-18 21:00:40 +08:00
Xu Peng a1ebba77e6 feat(db): fix insert bug
Former-commit-id: be162dd2b77e8ea1b47253f5f404a8874b46bddd
2019-04-18 21:00:40 +08:00
Xu Peng 98270ac004 feat(db): create group and partition folders
Former-commit-id: 8ac0992576c47435723d70d131d83571f30345b7
2019-04-18 21:00:40 +08:00
Xu Peng 75c35f5184 feat(db): serialize file bug fix
Former-commit-id: 0596a907902f32e7cb172d471eea66714912fe5f
2019-04-18 21:00:40 +08:00
Xu Peng 8d5ef3fb27 feat(db): add where condition in files_to_merege
Former-commit-id: df201faf70298a074ac794fb4e4964b6b2426a69
2019-04-18 21:00:40 +08:00
Xu Peng 44f5d3e7eb feat(db): meta operation
Former-commit-id: 6f7cd4ec069195d659585b321fc5f6e6f20bb719
2019-04-18 21:00:40 +08:00
groot 6e1e282865 refine code
Former-commit-id: d5ee6d0520568a27f7e75754ec05c98a05b7f246
2019-04-18 17:26:03 +08:00
groot 6fbb37a759 avoid build failure
Former-commit-id: 7790321f9a935ea784a8ffdb845f5c2391bc6da2
2019-04-18 15:37:31 +08:00
xj.lin 465bd19948 fix bug
Former-commit-id: 1c21d81875ec000c6f26ef8f2c367df8992fde59
2019-04-18 11:21:49 +08:00
xj.lin a7657e1e3d update dbschema
Former-commit-id: dbccc662f41d36199fd59000a02de7693acda4e8
2019-04-18 10:57:38 +08:00
xj.lin eef523f8ba Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 0256614a23ffa2504065fa978cbe869e5f99aba7
2019-04-18 10:50:44 +08:00
Xu Peng 9171a64170 feat(db): impl has_group
Former-commit-id: 8b58eef49cc7b1f328f8d2bd3bd42077cd6bf427
2019-04-18 10:50:24 +08:00
Xu Peng 1b4ccfdba4 feat(db): impl get_group
Former-commit-id: 5519dfb718d786120322faacd32ef364bcf8b82a
2019-04-18 10:50:24 +08:00
Xu Peng 0e6881d94c refactor(db): change get_group and add_group apis
Former-commit-id: 1b542b4b99af0ba88c7093584d9fc11fc3919560
2019-04-18 10:50:24 +08:00
Xu Peng 0935924798 feat(env): add sqlite3 in dependency
Former-commit-id: 192593de9056e0dfba3110221b3d4f6e869a8354
2019-04-18 10:50:24 +08:00
Xu Peng d4c835f975 feat(db): init sql orm unique ptr
Former-commit-id: bb0251bcd0349c1c9656dc6be908d3700c16f4bb
2019-04-18 10:50:24 +08:00
Xu Peng fd2aee96b5 feat(db): impl add_group in meta
Former-commit-id: 3459cff7d6ccaa7e4b47fec7bcb1b5bbd44e1737
2019-04-18 10:50:24 +08:00
Xu Peng eb8907667b feat(db): fake data for db meta
Former-commit-id: b6fb08599a93f48cc123998da9fa2c0f771a0d93
2019-04-18 10:50:24 +08:00
Xu Peng adc087c57e feat(db): changes to local meta
Former-commit-id: 95ddf67ccd65c7a00a4f23599947ba9693fea78a
2019-04-18 10:50:24 +08:00
Xu Peng cc5290693d fix(db): fix compile error
Former-commit-id: b0734cdc673bbc74ef8b670e2d6f56edc5364eec
2019-04-18 10:50:24 +08:00
Xu Peng 2bc205b791 feat(db): add local meta
Former-commit-id: 30814a42efc7ad53847fc00d93903e1201c125d2
2019-04-18 10:50:24 +08:00
Xu Peng f5348ed57c feat(db): file name mock
Former-commit-id: e99baa04809535f5f3c10d5b0c007c9c06ab159c
2019-04-18 10:50:24 +08:00
Xu Peng de8e9176ce feat(db): impl build_index
Former-commit-id: 983d243660ad2a71f8a62c7ed81d4b6f521c03d0
2019-04-18 10:50:24 +08:00
Xu Peng 4b5044daf0 fix(wrapper): fix write index
Former-commit-id: 3e96e1039dc77d768695e1a1f5bcdb72bc4866d3
2019-04-18 10:50:24 +08:00
groot c224e5bcac build faiss thrift optional
Former-commit-id: e0f2c5408bbd830220a1d43432695442aa6d53c7
2019-04-18 10:50:24 +08:00
Xu Peng 86342b9578 feat(wrapper): add one more build_all api in IndexBuilder
Former-commit-id: b24296b10003d45616d3a38c86ab4657f691713a
2019-04-18 10:50:24 +08:00
Xu Peng 2269c0d980 feat(db): mock build_index related
Former-commit-id: eea24e1c5846af870694a10e865140efb0566a42
2019-04-18 10:50:24 +08:00
Xu Peng 817d032a02 refactor(db): using wrapper write_index
Former-commit-id: d72e2bb4ee8122da76a23661df802adc3447d3f7
2019-04-18 10:50:24 +08:00
Xu Peng e60b4f0bd1 refactor(db): using index factory in MemManager
Former-commit-id: 31cc3fe760f94eb9c5e673f44b0a0d1de8c98c40
2019-04-18 10:50:24 +08:00
Xu Peng 6ea0bbadaf refactor(db): using index factory
Former-commit-id: aa34392ec71eb4181a37625f07c2995a57e8cc57
2019-04-18 10:50:24 +08:00
groot 3224c4eb70 client call api
Former-commit-id: f2d5ccecb8359642ba8d63ef538b90fba209b2b5
2019-04-18 10:50:24 +08:00
Xu Peng 8b5aa978ec feat(db): add build index thread
Former-commit-id: f3df7ccdd381ec67aaca4a66401644249bdb0b3d
2019-04-18 10:48:56 +08:00
groot e568941180 refine code
Former-commit-id: 4406ca272f134594421b89aa34b6f91a3d8a92a4
2019-04-18 10:48:56 +08:00
Xu Peng c2cfc98b77 refactor(db): refactor options
Former-commit-id: 53812504248a4a81f2f65ee07e81ad2d5e31eb38
2019-04-18 10:48:56 +08:00
Xu Peng 53270e4b97 refactor(db): file name refactor
Former-commit-id: af418586311c0857e5c1e9fdd543806bb4ad7184
2019-04-18 10:48:56 +08:00
groot 8d4d0c07e3 support more protocol
Former-commit-id: c064f5c924b24857c114178f3ab310ae67d553c2
2019-04-18 10:48:56 +08:00
Xu Peng 212d393712 refactor(db): mv types.h to Types.h
Former-commit-id: 5a36823d84570784113420afa4fff7d0cd1ef1d2
2019-04-18 10:48:56 +08:00
groot fe20a302ba refine log code
Former-commit-id: fefbec403f92cf851f3810d3bc78109fb89bb768
2019-04-18 10:48:56 +08:00
Xu Peng bdd137e1b2 feat(db): merge file changes
Former-commit-id: 38e1bf124e5cd4bbf2a838494c7962e928f05a17
2019-04-18 10:48:56 +08:00
groot e4666f04f0 response signal 2
Former-commit-id: 8d3a36a2d332d05d48f9ecae990b70c35aee0072
2019-04-18 10:48:56 +08:00
groot 8b689e8e2a client sucessfully connect to server
Former-commit-id: 1e9186c606ae9ca46f9b2f57ccaeeb50b4cc6c3a
2019-04-18 10:48:56 +08:00
Xu Peng 1b9aeb89b2 feat(db): add merge files
Former-commit-id: 715b6eeae4b1c45ef5e8536536ab9b0faf720e42
2019-04-18 10:48:56 +08:00
groot 719c232528 modify test client
Former-commit-id: d9bd14f32c078b87bdb58e46efe6e45912a5baef
2019-04-18 10:48:56 +08:00
groot 836bfb5c07 build debug thrift
Former-commit-id: 252bae2826946ae61a1a2ada570844b413f3df02
2019-04-18 10:48:56 +08:00
Xu Peng fbb817a412 feat(db): add some meta data logic and update db bg merge jobs
Former-commit-id: 36bc3fbacf36450b863d69bd83a8ba3b9daffedb
2019-04-18 10:48:56 +08:00
Xu Peng 076ad6f511 feat(db): add group_id related info for memvertor apis
Former-commit-id: 102f857ae32bedb2dd42ebf951197c59f9e1d772
2019-04-18 10:48:56 +08:00
groot 758337f73e refine code
Former-commit-id: f03943ce54db1fdc11c00fc625dabdcdd0bbf817
2019-04-18 10:48:56 +08:00
groot 2a850821b5 add test client
Former-commit-id: af73a98aad00251fa5432d39e092ee950fe2db2b
2019-04-18 10:48:56 +08:00
xj.lin a25a7a24a7 add db setting file
Former-commit-id: 184bf9c48a5b659a85a11b09aa694165ee6b7b61
2019-04-18 10:37:06 +08:00
Xu Peng a8a1d3abcd feat(db): impl has_group
Former-commit-id: 785fb73b07ef58017a6e1f04cd2f997f43f89b88
2019-04-18 10:02:12 +08:00
Xu Peng 92e30f4e7a feat(db): impl get_group
Former-commit-id: d40df7e09e60dfa682d28481a2fe320d57819baa
2019-04-18 09:54:50 +08:00
Xu Peng e47b6cf9cc refactor(db): change get_group and add_group apis
Former-commit-id: c235588d9c2901e5065997dc1917cc30df9ae623
2019-04-17 20:46:40 +08:00
Xu Peng 608c5692b4 feat(env): add sqlite3 in dependency
Former-commit-id: d09d22ca49cbf18b5647558f6c52c39fc6242baf
2019-04-17 20:29:56 +08:00
Xu Peng 0c8b4b04e8 feat(db): init sql orm unique ptr
Former-commit-id: 41a4a96958a81482d2700a4bc3973d8d91d678c0
2019-04-17 20:28:16 +08:00
Xu Peng 2aa2720dbd feat(db): impl add_group in meta
Former-commit-id: 49bb87da9b121a67f439c46f4dc7651f7bafaa4e
2019-04-17 19:54:37 +08:00
Xu Peng e624b1a1c5 feat(db): fake data for db meta
Former-commit-id: 17f7dfa12376ec11084e8d5e3897b851a22ab35f
2019-04-17 18:37:12 +08:00
Xu Peng 72869830d9 feat(db): changes to local meta
Former-commit-id: ad3fc4b0634dcba15ce68e45af6c336aa762b07b
2019-04-17 18:22:12 +08:00
Xu Peng 0b5d7e0437 fix(db): fix compile error
Former-commit-id: e260fd302903e714dd2eb8fcf2e589f3ecdcc029
2019-04-17 16:59:31 +08:00
Xu Peng 33ffb08a88 feat(db): add local meta
Former-commit-id: ccb9e8080ad0a1c610ff5b3afe0d9d3c4c4e5366
2019-04-17 16:53:44 +08:00
Xu Peng f297367987 feat(db): file name mock
Former-commit-id: 0ccabc6d787c1f974df4958763075b35332ab7a6
2019-04-17 14:25:27 +08:00
Xu Peng 074523368e feat(db): impl build_index
Former-commit-id: cf2b9ca3555675d6304ea273bdfeac0e15bb7271
2019-04-17 13:44:37 +08:00
Xu Peng 92983fcfbf fix(wrapper): fix write index
Former-commit-id: 98af046872115568f3b4e7859bf6b6970b0655f6
2019-04-17 13:44:37 +08:00
groot 8d163abd42 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: ec359e3f7b884e87cd3d629ac7bf722a9b0b3ef5
2019-04-17 12:15:25 +08:00
groot b8b84abea5 build faiss thrift optional
Former-commit-id: 26ae31415424b7c86f8c7f99d0e30cc73c32f3f6
2019-04-17 12:15:12 +08:00
Xu Peng c0326906d9 feat(wrapper): add one more build_all api in IndexBuilder
Former-commit-id: d6d7187a419bafb81751b815e2ebd235058e43f9
2019-04-17 11:47:57 +08:00
Xu Peng c87cdc8736 feat(db): mock build_index related
Former-commit-id: a4908e8eaf9b8ba57d873e0f9b1128980edbf3ff
2019-04-17 11:08:16 +08:00
Xu Peng 5c3319d5d2 refactor(db): using wrapper write_index
Former-commit-id: a7ce7f72f6c50385c32d14aa01530db8fbfcdc3b
2019-04-17 10:46:24 +08:00
Xu Peng ada3903352 refactor(db): using index factory in MemManager
Former-commit-id: 808f882176b0f933c609475bbd3930b3402525a8
2019-04-17 10:46:24 +08:00
Xu Peng 45a74e1560 refactor(db): using index factory
Former-commit-id: 7026fb087240214666a43f1c486d2683a5a1ecb2
2019-04-17 10:46:24 +08:00
groot 32b5d7c4a4 client call api
Former-commit-id: 1abe8528051e0fb01dc2922f3ac71c739ae6df57
2019-04-17 10:45:39 +08:00
Xu Peng a7cefc6a33 feat(db): add build index thread
Former-commit-id: f184776634884331e6920f53ac8186cc721176a1
2019-04-16 20:47:06 +08:00
groot 21e51ff638 refine code
Former-commit-id: aca348ba7691ed82df6f8fcae687b7015e6cf401
2019-04-16 18:45:52 +08:00
Xu Peng 062e370bee refactor(db): refactor options
Former-commit-id: 2631c7298346b6dcfbde0d43bc58f36e36eef807
2019-04-16 18:05:04 +08:00
Xu Peng a5f318d33e refactor(db): file name refactor
Former-commit-id: 8b42724cd45f62b6e65a1704d5c0f37cb50dd9ef
2019-04-16 17:39:20 +08:00
groot dd92d0043b Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: d71fc0fa0898f04eb5b72c28241fec1b000b1de3
2019-04-16 17:20:18 +08:00
groot 7f14f8a155 support more protocol
Former-commit-id: b69bcf707d83ddcc90f27037b4391790011dcc7d
2019-04-16 17:20:09 +08:00
Xu Peng 03cd4a676f refactor(db): mv types.h to Types.h
Former-commit-id: 2e20d1e22d2ef198ec7d2992f027736614c0ca9b
2019-04-16 16:58:55 +08:00
groot 4ec7b45488 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: bb71b649430ce6ef4a794ae366e377ed246608c3
2019-04-16 16:50:41 +08:00
groot 5a8b70b779 refine log code
Former-commit-id: 96584eb602bacf90d6482cdef60608fa31f488f1
2019-04-16 16:50:34 +08:00
Xu Peng dfdc514886 feat(db): merge file changes
Former-commit-id: 806100220b3af5d11d0a6d99ecc16fe55536b9fd
2019-04-16 16:47:22 +08:00
groot 18994f2aa9 response signal 2
Former-commit-id: 1506ef55ee42647da9a76512b277007828b945c9
2019-04-16 16:32:55 +08:00
groot 4c260cd8dd Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 10e67885c5ef64f1791f6e646c663e90f9f05efa
2019-04-16 16:25:20 +08:00
groot 5b791bf4b0 client sucessfully connect to server
Former-commit-id: f2bdb21901c8f11b434421c5c33148b177fbf082
2019-04-16 16:25:14 +08:00
Xu Peng 3917084e01 feat(db): add merge files
Former-commit-id: 9673339417ce0eb4f4d767420e4a87aa551b1edc
2019-04-16 16:19:12 +08:00
groot 7e38ce21b0 modify test client
Former-commit-id: 2be1d99889a53e0236d3050a77ad2adee0aa9fcd
2019-04-16 15:49:10 +08:00
groot e8707d6485 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 0f2498cbd94b36dd35305d984d6a58feb65dfb4c
2019-04-16 15:40:35 +08:00
groot 98fe81f667 build debug thrift
Former-commit-id: 6016c4de9ba0c4349a4d485c3f86199aad6f0ce4
2019-04-16 15:40:29 +08:00
Xu Peng 846a05459e feat(db): add some meta data logic and update db bg merge jobs
Former-commit-id: 6f899d8efdf831b286e1af8a9e6490dde1acedc0
2019-04-16 14:49:29 +08:00
Xu Peng 83cff9fac0 feat(db): add group_id related info for memvertor apis
Former-commit-id: 561ecf8893c38246fa1fb3ed33603d3de67e1126
2019-04-16 14:49:29 +08:00
groot 9dd6b39536 refine code
Former-commit-id: 67d36b9a87addf76364175af90d4f05ab85bc7e5
2019-04-16 12:34:35 +08:00
groot 397d1cfcd2 add thrift service
Former-commit-id: a26d0befbb2d06095c003edc3d87e79ca4911b41
2019-04-16 12:10:27 +08:00
groot 4342b747f9 add test client
Former-commit-id: cebc4c2bfaec125003e0b6e60534e69514796fd7
2019-04-16 12:03:33 +08:00
Xu Peng ee5d02939e feat(db): add search api for db
Former-commit-id: 593c7ef1ea7a37022773cf49d82bd2b16763f173
2019-04-16 11:17:02 +08:00
Xu Peng fa33addbf7 faker(db): mock some testing data
Former-commit-id: 17e28faece56f38b37c7d5ae00758b7ea5392464
2019-04-16 11:17:02 +08:00
Xu Peng fd8365a098 fix(db): fix id generator runtime error
Former-commit-id: fc964ebe4af0d31527b9b6ec01558d84199efbff
2019-04-16 11:17:02 +08:00
Xu Peng 803686b8c6 fix(db): fix mem runtime error
Former-commit-id: c12e6e99c8c7de1b62c2d2e7f9fecf3775715326
2019-04-16 11:17:02 +08:00
Xu Peng 8eebbf65b4 fix(db): fix runtime error due to missing return value
Former-commit-id: 592d640810b741d8fbdaf04a248f1938f485b1d7
2019-04-16 11:17:02 +08:00
Xu Peng ff120dba16 fix(db): fix compile error
Former-commit-id: dbf6519efd3a0bac6f8ef2c617fcc08b879543f4
2019-04-16 11:17:02 +08:00
Xu Peng 424b938c82 fix(db): fix db compile errors
Former-commit-id: 8c013a54ad53efcce47f4f9480164052ecfa9249
2019-04-16 11:17:02 +08:00
Xu Peng d4dae8127b fix(db): fix meta compile error
Former-commit-id: dde5e3262cc177db2fad98d82ee129718936fa01
2019-04-16 11:17:02 +08:00
Xu Peng e6b0c5a099 fix(db): fix env compile error
Former-commit-id: 683cb59254dfec9cd6a2d93270cde064a4222779
2019-04-16 11:17:02 +08:00
Xu Peng 28e42d0ee5 fix(db): fix id generator errors
Former-commit-id: 1068933b6c74775bfc1ee8641c41d095babaea0c
2019-04-16 11:17:02 +08:00
Xu Peng 3863f2d3b3 fix(db): fix status compile error
Former-commit-id: 1d896ef1c7970c9c418683560e760762d828be84
2019-04-16 11:17:02 +08:00
Xu Peng 1bc01da85f feat(cpp/db): add timer thread
Former-commit-id: e94c2675e8e4294620c94669fa1d3208af7fcc40
2019-04-16 11:17:02 +08:00
Xu Peng 3e8213ff47 feat(cpp/db): update for memory and meta operations
Former-commit-id: 34cc6ca2c596870ad8152ab0da4d187fb518093a
2019-04-16 11:17:02 +08:00
Xu Peng c6f36c8fba refactor(cpp/db): remove dummy apis
Former-commit-id: 900f085c733a2131c6db9de8940403635898e955
2019-04-16 11:17:02 +08:00
Xu Peng e1a5d5effa feat(cpp/db): add meta related method in db api
Former-commit-id: d9cab929294aeb154e245e8cdc96b6c3a460af91
2019-04-16 11:17:02 +08:00
Xu Peng 771155df1a feat(cpp/db): meta schema update
Former-commit-id: de373b37b4132f5f62818216728fa29564a43927
2019-04-16 11:17:02 +08:00
Xu Peng 1fc48aaa8b refactor(cpp/db): unified namespace
Former-commit-id: 9544c6ed95bcba1f8feb7e7f1d7a7b07ccd40872
2019-04-16 11:17:02 +08:00
Xu Peng 90f95f3bd6 refactor(cpp/db): move files from storage to db
Former-commit-id: 2f397b13a75cdee3fdf956f64a69cfc9e4966391
2019-04-16 11:17:02 +08:00
Xu Peng e4b9a62edf feat(cpp/db): add background handling
Former-commit-id: c10f382912f3cfbeb45cedc0e17d355f9e2b0bc6
2019-04-16 11:17:02 +08:00
Xu Peng 0352db4023 feat(db/env): add threading related schedule
Former-commit-id: d685ead572b229a60aad1342ec821d0b37d58c70
2019-04-16 11:17:02 +08:00
Xu Peng 34d50b5a55 refactor(cpp/db): arguments name refactor
Former-commit-id: 9ff72aa338aa58c3f142d2cbfe27d173a3ec5864
2019-04-16 11:17:02 +08:00
Xu Peng ba16e25fd1 refactor(cpp/db): move file locations to db dir
Former-commit-id: 10bc6d99e5ad34b38e3fddbdf25cc1cfcbe91dfe
2019-04-16 11:17:02 +08:00
Xu Peng 68280f967a feat(cpp/db): add meta and status
Former-commit-id: 22848aa9bf9eee1f059ad91aac298e2ea9f579b4
2019-04-16 11:17:02 +08:00
Xu Peng 6a21b8e1a0 feat(cpp): add db and env
Former-commit-id: 7389217522cd58b7746ffbf441c740466714f6c5
2019-04-16 11:17:02 +08:00
Xu Peng 6b754b5975 feat(storage): add id generators and memvectors
Former-commit-id: 28d27b5729ef5b1885a9d78e3f885bc7fc80fe12
2019-04-16 11:17:02 +08:00
groot 135282c45f add block queue class
Former-commit-id: e5ac4fa08104fac608992ca1f6acc6d17e3c7505
2019-04-16 11:17:02 +08:00
groot f92df0d044 refine log code
Former-commit-id: b043a1372bf79e3fc7dc9a277ba2cc62bbfc32ba
2019-04-16 11:17:02 +08:00
jinhai 22d2236f42 Update CMakeLists.txt
Former-commit-id: e925f6f8bf3ca3f92c9328600ee450320b255e94
2019-04-16 11:17:02 +08:00
jinhai 06e207b1df Update README.md and conf
Former-commit-id: 5b2944eeaba1d2bcd34ef23cc971f3d9c9b113d9
2019-04-16 11:17:02 +08:00
groot 49b4614b89 add log util
Former-commit-id: 4ef6aa4f14c95a9635aa9747b47cb3c3ad002a65
2019-04-16 11:17:02 +08:00
xj.lin 3fd083c987 add wrapper and unittest file
Former-commit-id: 9b115de1c9d84ed4c790980793fec28169ca7837
2019-04-16 11:05:38 +08:00
Xu Peng 194dcc145c faker(db): mock some testing data
Former-commit-id: 29c187ff28d41d70f2049fcaa931538f0acd0654
2019-04-15 20:49:30 +08:00
Xu Peng 7296ca7084 fix(db): fix id generator runtime error
Former-commit-id: 0de40fb0a90c1f1a09d7f800e523d811a2031caa
2019-04-15 20:49:30 +08:00
Xu Peng 7d76589dbd fix(db): fix mem runtime error
Former-commit-id: e173bfdd8760a56733122c03128e9d6137171418
2019-04-15 20:49:30 +08:00
Xu Peng bf0afceec3 fix(db): fix runtime error due to missing return value
Former-commit-id: daa9d86441d94dd0c3d82a49d1d276676915f124
2019-04-15 20:49:30 +08:00
Xu Peng b162ab0a04 fix(db): fix compile error
Former-commit-id: d6d70bd6a6607001e90b920726c62af48b5341f5
2019-04-15 20:49:30 +08:00
Xu Peng 5c5e3205f0 fix(db): fix db compile errors
Former-commit-id: ac0e3e3a6a6bc82dec43eb431592633ce1292db2
2019-04-15 20:49:30 +08:00
Xu Peng 94c7204d7c fix(db): fix meta compile error
Former-commit-id: 7217f5dc230517a1d0445bfb156e3ba45af094ae
2019-04-15 20:49:30 +08:00
Xu Peng ea1241dc21 fix(db): fix env compile error
Former-commit-id: aaf0f190a14e88cdfeb69e6ededc14f739181841
2019-04-15 20:49:30 +08:00
Xu Peng 89125a9fb6 fix(db): fix id generator errors
Former-commit-id: 898a8d587fe81717bc51aba9d5672775b819f100
2019-04-15 20:49:30 +08:00
Xu Peng f0a66cac52 fix(db): fix status compile error
Former-commit-id: be4be51b0e1e456db2f12a809dddf2b293ece40f
2019-04-15 20:49:30 +08:00
Xu Peng 33d96b02b1 feat(cpp/db): add timer thread
Former-commit-id: 47f932b6d49c14b11e3ed69dbfbf0de840f6d98d
2019-04-15 20:49:30 +08:00
Xu Peng 79ce07c15c feat(cpp/db): update for memory and meta operations
Former-commit-id: 69a8c7b6b9656532d4908013f8158d848481a8e6
2019-04-15 20:49:30 +08:00
Xu Peng 41f85d341c refactor(cpp/db): remove dummy apis
Former-commit-id: ae045a47ba22ed7ca5084700359e508ce5070491
2019-04-15 20:49:30 +08:00
Xu Peng 0d176701fb feat(cpp/db): add meta related method in db api
Former-commit-id: b1fd80b76ae93535dacc049d9ec3ce909fa73b28
2019-04-15 20:49:30 +08:00