milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
774 Commits
146 Branches
120 Tags
575 MiB
Commit Graph

557 Commits (eeeada4e4f94ea1f958058703ee7365850731ec6)

Author SHA1 Message Date
xj.lin 876f6a4c66 1 Support Cpu-version 
2 Update build.sh support both cpu-build and gpu-build


Former-commit-id: 3c0ddd7fb2f93ab45b6f9878b71b6541617f92c4
 2019-05-11 11:27:06 +08:00
Xu Peng 2a8c45d394 test(db): check add vectors result size 
Former-commit-id: d72021ae7c0fc69c840780d023d6a7573b618ce5
 2019-05-11 11:19:21 +08:00
Xu Peng ac7092f556 fix(db): bug fix for add vectors 
Former-commit-id: 84cfcf89843bfd79e226ef3fd8c6d9a273a1f4dc
 2019-05-11 11:17:07 +08:00
groot 99b61e3b9b fix bug 
Former-commit-id: 4f365862e364a8b6232a9d959354dd609db6a040
 2019-05-10 14:33:23 +08:00
groot b2d988b9c6 fix bug 
Former-commit-id: 53fa5d480d001cc82145710fa0329604b85bab19
 2019-05-10 14:32:43 +08:00
groot 7e6b928ce8 modify thrift api 
Former-commit-id: 6a9222b918447562add54efb852bb8716c5ed254
 2019-05-10 10:39:59 +08:00
groot f9967cd744 modify thrift api 
Former-commit-id: 744dec10d157280d9776a7507aaa428ca76aad66
 2019-05-10 10:39:21 +08:00
groot f7a2ac7b00 refine code 
Former-commit-id: 9205f1d9bfcd3f4a48688b989cfe52b26dba29de
 2019-05-09 21:41:44 +08:00
groot 6a27275486 regen thrift py 
Former-commit-id: a199ad849e1a0a6534bd343deaf8e4aa6a1335d5
 2019-05-09 19:16:40 +08:00
groot b97b406ce6 regen thrift cpp 
Former-commit-id: 2d37cc786425da956db94fc2f3f5de824ad54b94
 2019-05-09 19:16:13 +08:00
xj.lin 146bb9e6d4 support install prefix and default install 
Former-commit-id: cada287cbf3b4ef2e32e8039aa7836bb76a6adb1
 2019-05-09 12:05:35 +08:00
jinhai 77f86fdeee License tests success 
Former-commit-id: e10d0146a51286664bb01f5d55f694e547a8f597
 2019-05-08 17:38:37 +08:00
yangwei.yao 414cbf860f Update CMakeLists.txt 
Former-commit-id: 6007ad4c75ca615d6d21236a2ea5affe347672d1
 2019-05-08 17:01:11 +08:00
jinhai 51d9e2c21e Add license check functions 
Former-commit-id: d3120c7b805a59bcb736908990d68652008eca8d
 2019-05-08 14:55:21 +08:00
Xu Peng 56ffd6bad3 fix(db): db destruction bug fix 
Former-commit-id: d77e18e428bc43b2cc1316f0d77b6807192f6662
 2019-05-08 13:58:16 +08:00
Xu Peng 4428d56670 refactor(db): trait for engine and dbimpl 
Former-commit-id: c42d9f4d7168b4d8e374ddb5ed0499ea1394a306
 2019-05-08 12:13:01 +08:00
Xu Peng b36a524739 refactor(db): using traits 
Former-commit-id: 6496aa13a3ba40d4bec2e32a1ad6f10377055775
 2019-05-08 12:13:01 +08:00
Xu Peng 9e43c45de4 feat(db): support trait for engine 
Former-commit-id: cfb90e35386177032fa0c4ac7b8c81f29a536571
 2019-05-08 12:13:01 +08:00
Xu Peng 372adf6c80 fix(cache): add pragma once in header 
Former-commit-id: cb9b838950c536fa4a582c92cf0df634c0780764
 2019-05-08 12:13:01 +08:00
Xu Peng 9adc7bdf82 env(unittest): add missing lib 
Former-commit-id: 3d923d0a8588226084f6935b184798f2a402849c
 2019-05-08 11:05:09 +08:00
jinhai 15afc4b4bb ./build.sh -t Release will make a release version 
Former-commit-id: 7acb08bb5d8d2d64ab1b64ac73ae5373c01d6e80
 2019-05-07 16:45:03 +08:00
groot 5897f415ad addd log 
Former-commit-id: e950e203afc9c259a4530fd8c9b6ce95da4cb4bc
 2019-05-07 12:11:39 +08:00
groot 8e1415ba11 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai 
Former-commit-id: 97a4429aed85095d23e6dd85e3329df38b47f3d6
 2019-05-07 10:10:29 +08:00
groot 00ba6f4783 modify readme 
Former-commit-id: f2fa8b895b16184a28ac338f8962b3e6907df953
 2019-05-07 10:10:20 +08:00
Xu Peng 0fb7334220 test(db): enhancement for unit test 
Former-commit-id: 2fdacaf3f80a70c3319d9dc7b2756f042b5b5106
 2019-05-07 09:44:35 +08:00
jinhai 7c0d0179fb Merge branch 'jinhai' of http://192.168.1.105:6060/jinhai/vecwise_engine into jinhai 
Former-commit-id: af885c2b110e3f4061c22e593fca973a87673bd5
 2019-05-06 22:12:42 +08:00
jinhai 9bf75e809a Add static linking 
Former-commit-id: 95e2ccc0112a0cff1f1520c7ec8caee07be442d6
 2019-05-06 22:11:02 +08:00
groot e661ba82fe build error 
Former-commit-id: 0764940092b64cca42918e542b9d8702cab1c55e
 2019-05-06 22:01:28 +08:00
groot f17bac3272 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai 
Former-commit-id: 8be4107f8aa5d1a6b556d2d249b202e85a7747b7
 2019-05-06 21:14:48 +08:00
groot b51a88abfd build error 
Former-commit-id: 927fdda8e7b2d7782c800cdff83b9966a26f25f2
 2019-05-06 21:14:39 +08:00
Xu Peng b8949ca86f fix(env): fix compile error 
Former-commit-id: 63a2957e3c226bdb08658d96738d30dc98a73619
 2019-05-06 20:52:02 +08:00
groot 0ce9502a3e fix bug 
Former-commit-id: daf197368b50cd764df893949abb5f2956c9c560
 2019-05-06 11:24:36 +08:00
groot e472c605d2 modify readme 
Former-commit-id: d5fe9fbbe444e2580714ad4fc741b61048dbe01c
 2019-05-06 11:10:14 +08:00
groot a34d995195 modify readme 
Former-commit-id: 2297c0decb034ceda163a996f6d24604875f6495
 2019-05-06 10:47:55 +08:00
xj.lin 2ac87c1e47 1. support IDMap 
2. fix some bug
3. background job from IDMap -> IVF


Former-commit-id: ba8f24f09c5481103ad3f4c1c91d4deb70f26dad
 2019-05-06 10:24:07 +08:00
xj.lin 56bbe40faf 1. fix operand serialize bug 
2. support gpu-build
3. add unittest


Former-commit-id: bb36dcb05220d8f0648f282c7e38fe20f4ab3c16
 2019-05-06 09:53:59 +08:00
jinhai 675777d072 Add libzstd-dev to solve the linking error 
Former-commit-id: 993f2b5e526a3d073820f80b8ce473842ab937b5
 2019-05-05 20:42:33 +08:00
groot faa2c4b4b1 support empty id 
Former-commit-id: 1a5303b58f3f3b0154f1609ff1acc0d00007c569
 2019-05-05 20:13:34 +08:00
Xu Peng 496989bbe4 refactor(db): add more debug log 
Former-commit-id: 7c196e05c60567216938115e081438beeecb0f47
 2019-05-05 18:02:11 +08:00
Xu Peng d3cbc1ccad fix(db): db desctruction bug fix 
Former-commit-id: e456a0d76c2b1401107d47600c34d4622ca8cd8a
 2019-05-05 17:26:50 +08:00
Xu Peng 8a029c9b0d refactor(db): add copyright header 
Former-commit-id: 45606fe09972ab741faa4ee8061ef7d307c20c49
 2019-05-05 13:10:04 +08:00
Xu Peng 72f096bfca refactor(db): typedef ptr for memvectors 
Former-commit-id: 92289614937b7803fc41bf5cb7d50f468192aaa4
 2019-05-05 12:55:42 +08:00
Xu Peng c64e8c9621 refactor(db): typdef meta ptr 
Former-commit-id: 1fcbd80c65a1ee2815a57127f04807ce7d9f23f3
 2019-05-05 10:28:40 +08:00
Xu Peng f5b0ec50cf refactor(db): typedef engine ptr 
Former-commit-id: 4629cac435fd484ab949ab112b639a4849e37fca
 2019-05-05 10:21:26 +08:00
Xu Peng 85707aa3e9 refactor(db): impl template for engine type part 2 
Former-commit-id: 8be264a9ecc7704f63a978fb862b95140a19e1c0
 2019-05-05 09:38:37 +08:00
Xu Peng 166289cafa refactor(db): impl template for engine type 
Former-commit-id: 2e9a6fa992f58dfe567f7c274b9327454cf3f89e
 2019-04-30 21:02:13 +08:00
Xu Peng 0e37089c6a refactor(db): refactor all for crtp replacement 
Former-commit-id: 3c5d3ddeec04d573ef3916f673a7504c51a0a3bf
 2019-04-30 20:23:11 +08:00
Xu Peng 67960d5a55 refactor(db): dbimpl refactor for ee 
Former-commit-id: 5c762120594c4ab76237cc9d713dde3f4a57931a
 2019-04-30 20:16:54 +08:00
Xu Peng 8866d36252 refactor(db): refactor execution_engine 
Former-commit-id: 90ddd165224135d190108f5d7bce544b5c0f305e
 2019-04-30 20:14:38 +08:00
Xu Peng ca195424c5 refactor(db): refactor small part 
Former-commit-id: 58fc916c28a94ccecd67c58d5cf3620c51fbe4c4
 2019-04-30 18:44:00 +08:00
Xu Peng 62440022d9 refactor(db): remove dummy includes 
Former-commit-id: 6cf84f4b81e93c4a02ec7467b14e0ebc9227585d
 2019-04-30 18:34:32 +08:00
Xu Peng 94057d9d95 refactor(db): refactor search with execution engine 
Former-commit-id: 1625a8aff9582e61e6bb687b4da40f7721610f91
 2019-04-30 18:32:40 +08:00
Xu Peng 473d603a89 refactor(db): refactor build_index with execution engine 
Former-commit-id: a37b3096ae6883f6633fd3c1f986ca0f45955a0b
 2019-04-30 18:11:38 +08:00
Xu Peng 95adef2988 feat(db): add build_index api for ee 
Former-commit-id: 75f268e4494d383f7a7b9e32c634a44f7beeba1c
 2019-04-30 18:11:38 +08:00
Xu Peng 4cc5b8d523 refactor(db): replace faiss with execution engine 
Former-commit-id: 7e7949541e39bc18f30c5aafa7968fdacf709719
 2019-04-30 18:11:38 +08:00
groot a724141e73 use multithreads to do id mapping 
Former-commit-id: 10b201d3801b146fa6335e4dfd20c877cfb2e948
 2019-04-30 17:37:50 +08:00
groot b67c731b90 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai 
Former-commit-id: 730d1e5d7acd6ff2250ea1a453c2d4127f081356
 2019-04-30 17:00:05 +08:00
groot 2e76522151 refine code 
Former-commit-id: f81a57c8340d7cfcea9db3d8219612f6108eeda6
 2019-04-30 17:00:00 +08:00
Xu Peng 7f000e7979 refactor(db): rename 
Former-commit-id: 60c982ed5e500d958182bbc0816731d9423b509a
 2019-04-30 16:08:28 +08:00
Xu Peng 204c68879c refactor(db): replace faiss with serializer wrapper 
Former-commit-id: 62b5a7d8353c2b0ef4017f43d03d1c6944685400
 2019-04-30 16:08:28 +08:00
Xu Peng 713d1ec6b7 feat(db): add cache 
Former-commit-id: 2dd8078d8df484ddac54379bc6c84c015c1fc530
 2019-04-30 16:08:28 +08:00
Xu Peng 052f7e2f11 feat(db): add more api for serializer 
Former-commit-id: d15d7dfecb9964ca2e3ba4e5b469137d1cc85057
 2019-04-30 16:08:28 +08:00
Xu Peng cf19e90af3 feat(db): add serializer 
Former-commit-id: ab412bbb430e7711ddee0ad26b34f7b3b6c43582
 2019-04-30 16:08:28 +08:00
Xu Peng 39be106baa refactor(db): code optimization 
Former-commit-id: 320733b50aba32e5bd99853933e7e1eafdbcdbcf
 2019-04-30 16:08:28 +08:00
groot 83ed0fa4e6 fix typo 
Former-commit-id: 5eb1054016ec8fe6dbf173f1e32c0d37330cd87f
 2019-04-30 15:03:06 +08:00
groot 74eee9dc77 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai 
Former-commit-id: 00d18f20fb408445831a00a5385a244c49786910
 2019-04-30 14:47:46 +08:00
groot 905722bd0e add python sample 
Former-commit-id: 2c0825ad6ed774eb5ad1999b1439f840dc602bf1
 2019-04-30 14:47:36 +08:00
Xu Peng ce54690910 test(db): small change 
Former-commit-id: 8cf0fe13bfd7715a491f00cc24e2efa37fd8decd
 2019-04-30 14:17:24 +08:00
Xu Peng 3a05719e5a refactor(db): disable some print 
Former-commit-id: 09fb8ca768ba06af3407df8d9ec307f259650eae
 2019-04-30 14:17:24 +08:00
Xu Peng 9cb81455a1 refactor(db): change print for search 
Former-commit-id: c1df662f54ba5132db8d4fbbbd9b1e9998a61e7a
 2019-04-30 14:17:24 +08:00
groot ae5e672061 refine test code 
Former-commit-id: 25266f1e3574d2ffa42ab8299cc8e5a4ac5b651a
 2019-04-30 14:00:22 +08:00
groot dbf9de9a62 refine 
Former-commit-id: 46e81a09c49f06c6b80bedfb90c2767bb54ec5f7
 2019-04-30 11:44:58 +08:00
groot aa591114c4 time range search 
Former-commit-id: 182c5c9db2d3aeaafc4d4878f060435c442b366c
 2019-04-30 11:18:08 +08:00
Xu Peng 21a98c0e02 test(db): refactor db test 
Former-commit-id: c85ed1e09b51f9c883426f7c77da3261232f0745
 2019-04-29 20:22:24 +08:00
Xu Peng 61854a6c23 test(db): refactor SetUp 
Former-commit-id: dfbb0f819705c0fca4b5e0a7fb37ce7bc52761d6
 2019-04-29 19:05:48 +08:00
Xu Peng ed9dc51f27 test(db): samll change 
Former-commit-id: 1bdf8515f7914a43e965334db36d253fea12abb7
 2019-04-29 19:01:18 +08:00
Xu Peng 7680d5c731 feat(db): change default options values 
Former-commit-id: 8c4aeb5206d7532ac524956e225779ce2e29766e
 2019-04-29 18:56:40 +08:00
Xu Peng e78481f5e4 test(db): add meta files test 
Former-commit-id: bd7b5371b11ddd769b178fe0e263b5759398e0d3
 2019-04-29 18:10:30 +08:00
Xu Peng 0bbae88f3f fix(db): add to index files in files to search list 
Former-commit-id: 8174f890208374835a7d0b0c310fdeb7f016bd32
 2019-04-29 18:10:30 +08:00
Xu Peng f7853fcd20 test(db): add group file test 
Former-commit-id: 8fa440c2be5f525388d45fca7e92244718e8c2fc
 2019-04-29 18:10:30 +08:00
groot 363de87bdb gen python api 
Former-commit-id: 1c9b4a1fea7c450b55e8d683085d8779460ea3c4
 2019-04-29 17:58:08 +08:00
groot 231b216963 add namespace for thrift api 
Former-commit-id: 92f9e0a0f7d2e301120573976984f99062b8f44e
 2019-04-29 17:55:50 +08:00
groot e1efe942da fix test load config failure 
Former-commit-id: 7781b6ff8a4c1d72dfe4f872a7765424af40286e
 2019-04-29 16:34:43 +08:00
groot bd9c14a871 typo 
Former-commit-id: 89e00f1b579a2f78737efcafc04507f0f31049b1
 2019-04-29 16:20:21 +08:00
groot 16df78caee add attribute for vector 
Former-commit-id: e520d4e7aaceb1fedae62cc67326a550666efc6b
 2019-04-29 16:14:21 +08:00
groot fe5909a597 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai 
Former-commit-id: 69eee8018a8a7d7478181c11fef7ef4206ee0784
 2019-04-29 16:12:40 +08:00
groot 592dde4dd7 add attribute for vector 
Former-commit-id: c2a1a5cd917abe1cf3e8ef327bba5c2ed1cf8008
 2019-04-29 16:12:35 +08:00
Xu Peng c26629756a test(db): impl more group test 
Former-commit-id: 5de1604a22951a2e96253f994d6af95ccd8bf019
 2019-04-29 15:56:07 +08:00
Xu Peng 9ff65dc76c test(db): group test more 
Former-commit-id: 31949c0387e3400c63d7387664dc8e142ce1ce17
 2019-04-29 15:50:52 +08:00
Xu Peng 4b18d9fec1 test(db): add more meta test 
Former-commit-id: b8078e972d1c08b38cd6ff272ec2cd6ab1d895b2
 2019-04-29 15:47:09 +08:00
Xu Peng 4a66580f4f test(db): add meta test 
Former-commit-id: 9668abe43a31a04c58311c12834fe5b89da23c07
 2019-04-29 15:29:28 +08:00
Xu Peng f096e0a109 feat(db): add meta impl factory 
Former-commit-id: e9af01dea914b32192efe1c534e174810be5a02a
 2019-04-29 15:06:35 +08:00
Xu Peng c1d40bfb3d feat(db): add db factories 
Former-commit-id: df8ec1140cc82755e14a739cbb22fb035b3c7d18
 2019-04-29 14:06:40 +08:00
Xu Peng 3dfdfef07a test(db): add utils in db test 
Former-commit-id: 0e65a0a885cc3ead0fb233bd041bb4f8b8645898
 2019-04-29 13:17:19 +08:00
groot cdda6e5769 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai 
Former-commit-id: b50f73905441637b4751f55509b74b82cf3329ad
 2019-04-29 12:46:01 +08:00
groot bdef129e3a fix unitest load config error 
Former-commit-id: e1ff282a7eb4c81ee76efe43751f9d7329e8ddf3
 2019-04-29 12:45:53 +08:00
Xu Peng 096c4639b7 refactor(db): remove dummy includes 
Former-commit-id: b25398a114a59e79b0e20fca60843aecdbec51b5
 2019-04-29 12:38:27 +08:00
groot b8148d8e13 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai 
Former-commit-id: bd511cfab2d3813dee05c34dcf068622da2fef94
 2019-04-29 12:31:56 +08:00
groot 1aefac8ae0 fix unitest load config error 
Former-commit-id: 8bf7417881a421bf5c28a31474743484e8fea155
 2019-04-29 12:31:48 +08:00
Xu Peng 5d5bbe842d feat(db): add dates filter for search 
Former-commit-id: 04ba53b11c8bb7fbd90877d1be6e82bb80e2247c
 2019-04-29 12:05:03 +08:00
groot 688a9992be fix make error 
Former-commit-id: 7a5d078a48a92b0595e67bf8fe9891a075044bf4
 2019-04-29 12:04:56 +08:00
groot 4cbdb58718 redefine thrift api 
Former-commit-id: ed64f6205c2723111f3bc2771836a265b2474817
 2019-04-29 11:09:57 +08:00
groot 487ea03461 redefine thrift api 
Former-commit-id: 0dc225d0372e6e2260126a301552a37d161ccec8
 2019-04-29 11:01:01 +08:00
Xu Peng 2ff4cae2cf test(db): change test 
Former-commit-id: e1922a567069b4c058acad186b8186b4cbbe0f4a
 2019-04-28 21:01:30 +08:00
Xu Peng 5569f22de2 fix(db): no transaction for update_group_file 
Former-commit-id: 22b364f8f07cd009391952ba66478879f6b86b6d
 2019-04-28 21:01:30 +08:00
groot d6dc77ced2 fix cmake warning 
Former-commit-id: a3c4cb47f43d54e44f8a6b7f887e61f2182d998a
 2019-04-28 20:51:21 +08:00
groot 2005f2c1c8 refine test code 
Former-commit-id: c44c49b22ad20188bcc2ac339cbb659e29ac661b
 2019-04-28 19:28:05 +08:00
Xu Peng 57dfdae3e3 feat(db): fix bug and add exception catch in meta operation 
Former-commit-id: 6d33945997e7a528bc729efdad6076d6532f79b3
 2019-04-28 18:44:25 +08:00
Xu Peng 486c175b4e feat(db): add serialization mutex 
Former-commit-id: f8a3b14c0209a9e36b0510ce48754deefc4ee442
 2019-04-28 18:44:25 +08:00
Xu Peng f7cd398c3b test(db): change test case 
Former-commit-id: 4d371cf9f3cb591eafff64373aaaabaabd90118c
 2019-04-28 18:44:25 +08:00
Xu Peng 32b64ab724 feat(db): add more print 
Former-commit-id: 42486eb1e1c804e7b5120dc1f0dd12d2f7bd6a96
 2019-04-28 18:44:25 +08:00
Xu Peng 8c01725ff7 test(db): add more friendly timing print for test 
Former-commit-id: 2a87319062a6f753881efd898517ac67fd4d3216
 2019-04-28 18:44:25 +08:00
groot 66565bd74d refine test code 
Former-commit-id: 9b8ccd59cff07cc22a23e156b01beba4ca637c08
 2019-04-28 16:53:48 +08:00
groot f773ac9a20 refine test code 
Former-commit-id: d137fe1c53e2e05950361f2f376aea1f33a0a228
 2019-04-28 16:10:37 +08:00
groot 149c245958 add rocksdb option 
Former-commit-id: cebc9569d8dca44c360ac68510427f1447105ddc
 2019-04-28 14:48:05 +08:00
groot 0108db9840 add log 
Former-commit-id: 0bf2f53f1d9b5c89cceaf6a2e4b11257683d4645
 2019-04-28 14:20:29 +08:00
groot 8e23d2eb66 change test_client to unittest 
Former-commit-id: 8efbb1314e6cebd5c36643cca0d31668a8be639d
 2019-04-28 12:42:04 +08:00
groot 95f3900910 add new api for batch binary search 
Former-commit-id: c035ac8fcfe672576c6207fca149c3d4030e7b53
 2019-04-28 12:07:59 +08:00
groot 13d7ebb5cf add new api for batch binary search 
Former-commit-id: 3729408c50d0ab9a482e3ddea8e1672188a9acd8
 2019-04-28 12:07:15 +08:00
groot 167ae9c22c add new api for binary vector 
Former-commit-id: e450d463c9bb6473f6da93602bdf306dd48c65f7
 2019-04-28 10:43:49 +08:00
groot a5682c301f add new api for binary vector 
Former-commit-id: 0c37b1fa7ab1a3da301da0371ae275f0a118931f
 2019-04-26 20:57:06 +08:00
groot 9f35b62289 fix cache manager bug 
Former-commit-id: d1b7f43865f6e0a059081531e1549a975c86d4aa
 2019-04-26 19:45:26 +08:00
groot 541e0d610e Merge branch 'new_orm' into jinhai 
Former-commit-id: 3cc778a3f03cd9d71f91e0bb8b12f16f0aea7fbc
 2019-04-26 18:35:22 +08:00
Xu Peng 7e00f351e1 test(db): change log format for unittest 
Former-commit-id: a364d3800fbefbd9287df906b5e69f4ec89d1aa7
 2019-04-26 17:59:51 +08:00
Xu Peng 5fbe3d9641 feat(db): remove limit for id generator 
Former-commit-id: a110cfa01b6207cd76fd1ee000945c04c48b0d88
 2019-04-26 17:59:14 +08:00
Xu Peng 062c3aad91 feat(db): merge file optimize 
Former-commit-id: fea0d7970fab88f995d9d16d7dfea84dd4fbacb7
 2019-04-26 17:18:27 +08:00
groot 52234126de fix test bug 
Former-commit-id: 1a16c14bf6ce3faf71c4b912c554dab223b86f62
 2019-04-26 17:01:46 +08:00
Xu Peng 1d9946ff87 feat(db): change sqlite_orm header dependency 
Former-commit-id: d682b364b1b27a2af27f0246460bb9bbb6370fd0
 2019-04-26 15:37:54 +08:00
groot a21ad0b743 fix task bug 
Former-commit-id: f5debab3ff1c4000596f4cf625f37ba83ec54296
 2019-04-26 15:37:10 +08:00
groot 75410aed03 refine scheduler 
Former-commit-id: 9b772adf62a9f7f2ae349f3a2420fcecb08af6ce
 2019-04-25 16:41:01 +08:00
yhmo 87d0ed293e Merge branch 'scheduler' into 'jinhai' 
Scheduler

See merge request jinhai/vecwise_engine!16

Former-commit-id: 1adc4d5f745ac461680ce6f7d7bb14d8044ef87a
 2019-04-25 12:18:41 +08:00
groot b03aafdc41 implement scheduler 
Former-commit-id: 1be5a738138a626ddb4a7412e798c74debbc4c3a
 2019-04-25 12:17:56 +08:00
groot 11cb43ac2e add scheduler 
Former-commit-id: aead7396cc627fc680408188d3182fd098b5271d
 2019-04-25 09:38:27 +08:00
Xu Peng b9af8670db test(db): update test 
Former-commit-id: f3bf72ecd3c482d9a270342009f13be5263f89ca
 2019-04-24 20:12:26 +08:00
groot 4864a960b2 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai 
Former-commit-id: 32f8a5ce257cf776000a93e865bdb7a41f8e31e8
 2019-04-24 19:23:45 +08:00
groot 7d2b94f4ae print cache info 
Former-commit-id: 056e15ab3715f03b89648c84d5ea6498708971c1
 2019-04-24 19:23:37 +08:00
xj.lin ce7bc10f8c fix search 
Former-commit-id: 14a6408d66811f1d1a1d5bb1cbbddbecb5dd4d51
 2019-04-24 18:19:29 +08:00
groot 3815528396 modify thrift api 
Former-commit-id: 9516c969a09e06c073e02b1186503776df2f370a
 2019-04-24 17:34:21 +08:00
Xu Peng d402dd9dce fix(db): code fix 
Former-commit-id: fbb9040ada2c355dad1e13526f8f16c36e155716
 2019-04-24 16:25:50 +08:00
Xu Peng a6369c7a4e feat(db): cache for search 
Former-commit-id: 8e13efdaa593b4ebb83b06d33d5127180d756597
 2019-04-24 16:20:36 +08:00
Xu Peng 4e59f966c3 feat(db): cache for mem merge 
Former-commit-id: bff342710683954dcd4b72b890fff483708ceba0
 2019-04-24 16:04:14 +08:00
Xu Peng 22281e8ea5 feat(db): cache for mem serialization 
Former-commit-id: 9d3211b9c4bfa6132cd52822e19c1ae5d287d9a2
 2019-04-24 15:47:34 +08:00
Xu Peng 7150d3c5aa feat(db): cache for index 
Former-commit-id: e33cb100824e8714e539bec4f6622753001a9606
 2019-04-24 15:42:08 +08:00
Xu Peng 1fa42f9d61 feat(db): add data api for wrapper 
Former-commit-id: baabe91cc364d832e17016c554d66e29e400dfd4
 2019-04-24 15:29:45 +08:00
Xu Peng 2e8d45aad3 feat(db): cache merged file 
Former-commit-id: d236a8dbfcb01d07b6b544aa98a7e1dd179fc477
 2019-04-24 15:16:38 +08:00
groot d6044cfc32 fix build error 
Former-commit-id: d06ecbf29ddd4b70bfd056341c6537c66f9dbb55
 2019-04-24 15:16:32 +08:00
groot 8185c9fb27 rewrite cache code 
Former-commit-id: d4a2336ade2a39d34380dba715290992dcdabc84
 2019-04-24 13:57:22 +08:00
groot 41cb7fa0ec Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai 
Former-commit-id: 3446551c5ae37cb4e54349d98227d5105abcb54e
 2019-04-24 12:10:42 +08:00
groot 01c5b43130 rewrite cache code 
Former-commit-id: 7dc429b553891f98baa0cef21bee58c545ab9748
 2019-04-24 12:10:37 +08:00
Xu Peng 918c113727 fix(db): fix memory leak 
Former-commit-id: 1c5b7e0ab18f9508aa5aeecfc7caecf5ac74fd45
 2019-04-24 11:53:26 +08:00
groot 97d4738bc6 rewrite cache code 
Former-commit-id: 00247bcda3df3d0e29bc4a809f7894ce92470e0e
 2019-04-24 11:52:13 +08:00
Xu Peng 06ab815c7b feat(db): add count api 
Former-commit-id: 9fb2b765a48d1753ba31a68e7b9b207273adb199
 2019-04-24 10:28:05 +08:00
groot 4ce28a1e21 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai 
Former-commit-id: 6ef6cb1953310c4e01b1787e1a041c25f7dfd951
 2019-04-24 10:25:11 +08:00
groot dc3e4f58a8 rewrite cache code 
Former-commit-id: 8e76ab5219eedd24563ece59f70dec8a4464c44d
 2019-04-24 10:25:00 +08:00
Xu Peng 7509e28d91 feat(db): try build index every interval 
Former-commit-id: 15571dc68be30524189c73800ce8050ed8a2f9aa
 2019-04-23 20:57:00 +08:00
Xu Peng af39787c92 feat(test): add unit test 
Former-commit-id: 614f9c9b275b1893f212b0de966e069264fd13cc
 2019-04-23 20:55:15 +08:00
Xu Peng d6344006e5 feat(db): add drop_all 
Former-commit-id: 70720144d39f5ca18d349e475e66fb6ccca7bacf
 2019-04-23 20:03:55 +08:00
Xu Peng d7a87d14b1 feat(db): try build index every merege interval 
Former-commit-id: ee639ab9b93b0a3bd5950276749f0dad3dc53227
 2019-04-23 16:48:24 +08:00
groot 0bcb727b46 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai 
Former-commit-id: 086d172e4c9ba7db6a271940f2baa6ab5ede6069
 2019-04-23 16:34:56 +08:00
groot f642a7b38e redefine id mapper interface 
Former-commit-id: 6fa296aa09aae1019ed1e49a481c3a1e34440071
 2019-04-23 16:34:43 +08:00
xj.lin db32c300e8 feat: add search support 
Former-commit-id: 0bb20ad7b80ca432b83154efd59cb89e7cc2867c
 2019-04-23 11:58:43 +08:00
groot 82fe888083 add unittest 
Former-commit-id: 9c22540ce32d94d7f17626edb985d9c00af8fdec
 2019-04-23 11:21:14 +08:00
groot 2d9fb6b959 fix a bug 
Former-commit-id: 26f6048d0c32fe83cc2bdc377efcde41f8877d2a
 2019-04-23 10:51:18 +08:00
groot 3f7fe2548a add id mapper 
Former-commit-id: 56cfee9e3beeb474e2a56c3e3a3fdda111cfabb2
 2019-04-23 10:10:20 +08:00
groot 8909b19722 add id mapper class 
Former-commit-id: 6d9b05faca8200417e68de306abe2f1a35b601ff
 2019-04-22 17:50:52 +08:00
groot e9b7063402 add id mapper class 
Former-commit-id: b12be12ea33f4b3f99a4f65b1156d7a86007dcc1
 2019-04-22 17:27:03 +08:00
Xu Peng d8f40536c5 feat(db): add easylogging for debug log 
Former-commit-id: 85e3e48f3b917d7ecf716805fa8d19af349bc35f
 2019-04-22 17:00:39 +08:00
Xu Peng 2943126bda feat(db): add ttl files cleanup api 
Former-commit-id: bb84f6f2baa8c20c9f0e745c67213af236609507
 2019-04-22 15:08:26 +08:00
Xu Peng abacf3e234 feat(db): change updated_time type of long 
Former-commit-id: e58de06418bdb6b4f40f646ff5dc3d6a0efb12c0
 2019-04-22 14:50:47 +08:00
Xu Peng 216aeb6bd0 feat(db): add updated_time in group_file meta 
Former-commit-id: 0a2c3549b8b82267db3facc9606d8f8f90b02de2
 2019-04-22 14:15:58 +08:00
Xu Peng b377266934 feat(db): add some print 
Former-commit-id: 200b365c40532a13d777457bd53e6788fd613559
 2019-04-22 14:15:58 +08:00
groot dbadb94091 add id mapper class 
Former-commit-id: f0c14a9905825c0970f19b2bd53da610954c07c0
 2019-04-22 14:07:29 +08:00
groot e7075c185d modify server api 
Former-commit-id: 3eff45989dd09bf7b7aae8b2a004f83898708dd6
 2019-04-22 13:56:38 +08:00
groot 41220cb25d add db unittest 
Former-commit-id: 5a9e4a10ada30d19fee14b1d2e1d4123ac6dee04
 2019-04-21 17:01:02 +08:00
groot 0b545a70d8 change build settings 
Former-commit-id: fe3df7b281a528d4e07669c7c4e0e1521eb6bf2a
 2019-04-21 16:19:04 +08:00
groot 2b035e54a6 index search unittest 
Former-commit-id: 9632c0668ce71d07bba6f13e9ee46df4e1af6b38
 2019-04-21 15:55:48 +08:00
groot 885b95e2ea refine code 
Former-commit-id: 5916e0c3afaa752bcc3ff3cef69d30244be0b6c7
 2019-04-21 11:31:36 +08:00
Xu Peng cb82771ef4 feat(db): change open db api 
Former-commit-id: f9c5b0714096075d7a869b248a8b44201b41d0e0
 2019-04-19 21:39:59 +08:00
xj.lin 457688d787 add search support 
Former-commit-id: 4aae0710844eff71fb83f3d73f3fa7463b00e99b
 2019-04-19 21:39:39 +08:00
xj.lin d7c7720ef6 update cmakefile 
Former-commit-id: 2827b60ab09f52a244a6da690c42340884a48f39
 2019-04-19 16:43:30 +08:00
Xu Peng 8e1e03b2ba feat(db): cleanup pre db destruction 
Former-commit-id: 98270b53f6bafcde31d44039bb224d547ce71b07
 2019-04-19 16:08:12 +08:00
Xu Peng 2de4f04771 fix(db): no default sqlite dumped 
Former-commit-id: d5b6964706cbb0870e5cc9c8fab048a849dd3fa1
 2019-04-19 16:08:12 +08:00
Xu Peng fe93299d9a fix(db): set new file rows to 0 
Former-commit-id: a8690d08c1563f0c7ddd91d5709912a5aab49899
 2019-04-19 16:08:12 +08:00
Xu Peng a9ed75fc46 feat(db): remove mutex for meta operation 
Former-commit-id: f5f168c15284d7fd9d9353cf78b2d421ae310187
 2019-04-19 16:08:12 +08:00
xj.lin cc641236d2 add TopK 
Former-commit-id: 847a46e3b7ab8bead610ec9888fce5a4279a6920
 2019-04-19 16:07:45 +08:00
Xu Peng a6e92dc9ab feat(db): update for merege and index 
Former-commit-id: b06f36ce5a8ebca0f1f4554437b19233f8f6f723
 2019-04-18 21:00:40 +08:00
Xu Peng 08a1527b66 feat(db): fix missing location 
Former-commit-id: 1a4a5c09c9b48e4d70a660050a289f9c7af59750
 2019-04-18 21:00:40 +08:00
Xu Peng 2780b1a6d6 feat(db): fix meta lock issue 
Former-commit-id: 9c276ca661d234e3e1268836fc6efddef408be3e
 2019-04-18 21:00:40 +08:00
Xu Peng 58c0a6f838 feat(db): fix insert group bug 
Former-commit-id: ff93f2cd24c2d952c95f55dd141f693ad995ec51
 2019-04-18 21:00:40 +08:00
Xu Peng a1ebba77e6 feat(db): fix insert bug 
Former-commit-id: be162dd2b77e8ea1b47253f5f404a8874b46bddd
 2019-04-18 21:00:40 +08:00
Xu Peng 98270ac004 feat(db): create group and partition folders 
Former-commit-id: 8ac0992576c47435723d70d131d83571f30345b7
 2019-04-18 21:00:40 +08:00
Xu Peng 75c35f5184 feat(db): serialize file bug fix 
Former-commit-id: 0596a907902f32e7cb172d471eea66714912fe5f
 2019-04-18 21:00:40 +08:00
Xu Peng 8d5ef3fb27 feat(db): add where condition in files_to_merege 
Former-commit-id: df201faf70298a074ac794fb4e4964b6b2426a69
 2019-04-18 21:00:40 +08:00
Xu Peng 44f5d3e7eb feat(db): meta operation 
Former-commit-id: 6f7cd4ec069195d659585b321fc5f6e6f20bb719
 2019-04-18 21:00:40 +08:00
groot 6e1e282865 refine code 
Former-commit-id: d5ee6d0520568a27f7e75754ec05c98a05b7f246
 2019-04-18 17:26:03 +08:00
groot 6fbb37a759 avoid build failure 
Former-commit-id: 7790321f9a935ea784a8ffdb845f5c2391bc6da2
 2019-04-18 15:37:31 +08:00
xj.lin 465bd19948 fix bug 
Former-commit-id: 1c21d81875ec000c6f26ef8f2c367df8992fde59
 2019-04-18 11:21:49 +08:00
xj.lin a7657e1e3d update dbschema 
Former-commit-id: dbccc662f41d36199fd59000a02de7693acda4e8
 2019-04-18 10:57:38 +08:00
xj.lin eef523f8ba Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai 
Former-commit-id: 0256614a23ffa2504065fa978cbe869e5f99aba7
 2019-04-18 10:50:44 +08:00
Xu Peng 9171a64170 feat(db): impl has_group 
Former-commit-id: 8b58eef49cc7b1f328f8d2bd3bd42077cd6bf427
 2019-04-18 10:50:24 +08:00
Xu Peng 1b4ccfdba4 feat(db): impl get_group 
Former-commit-id: 5519dfb718d786120322faacd32ef364bcf8b82a
 2019-04-18 10:50:24 +08:00
Xu Peng 0e6881d94c refactor(db): change get_group and add_group apis 
Former-commit-id: 1b542b4b99af0ba88c7093584d9fc11fc3919560
 2019-04-18 10:50:24 +08:00
Xu Peng 0935924798 feat(env): add sqlite3 in dependency 
Former-commit-id: 192593de9056e0dfba3110221b3d4f6e869a8354
 2019-04-18 10:50:24 +08:00
Xu Peng d4c835f975 feat(db): init sql orm unique ptr 
Former-commit-id: bb0251bcd0349c1c9656dc6be908d3700c16f4bb
 2019-04-18 10:50:24 +08:00
Xu Peng fd2aee96b5 feat(db): impl add_group in meta 
Former-commit-id: 3459cff7d6ccaa7e4b47fec7bcb1b5bbd44e1737
 2019-04-18 10:50:24 +08:00
Xu Peng eb8907667b feat(db): fake data for db meta 
Former-commit-id: b6fb08599a93f48cc123998da9fa2c0f771a0d93
 2019-04-18 10:50:24 +08:00
Xu Peng adc087c57e feat(db): changes to local meta 
Former-commit-id: 95ddf67ccd65c7a00a4f23599947ba9693fea78a
 2019-04-18 10:50:24 +08:00
Xu Peng cc5290693d fix(db): fix compile error 
Former-commit-id: b0734cdc673bbc74ef8b670e2d6f56edc5364eec
 2019-04-18 10:50:24 +08:00
Xu Peng 2bc205b791 feat(db): add local meta 
Former-commit-id: 30814a42efc7ad53847fc00d93903e1201c125d2
 2019-04-18 10:50:24 +08:00
Xu Peng f5348ed57c feat(db): file name mock 
Former-commit-id: e99baa04809535f5f3c10d5b0c007c9c06ab159c
 2019-04-18 10:50:24 +08:00
Xu Peng de8e9176ce feat(db): impl build_index 
Former-commit-id: 983d243660ad2a71f8a62c7ed81d4b6f521c03d0
 2019-04-18 10:50:24 +08:00
Xu Peng 4b5044daf0 fix(wrapper): fix write index 
Former-commit-id: 3e96e1039dc77d768695e1a1f5bcdb72bc4866d3
 2019-04-18 10:50:24 +08:00
groot c224e5bcac build faiss thrift optional 
Former-commit-id: e0f2c5408bbd830220a1d43432695442aa6d53c7
 2019-04-18 10:50:24 +08:00
Xu Peng 86342b9578 feat(wrapper): add one more build_all api in IndexBuilder 
Former-commit-id: b24296b10003d45616d3a38c86ab4657f691713a
 2019-04-18 10:50:24 +08:00
Xu Peng 2269c0d980 feat(db): mock build_index related 
Former-commit-id: eea24e1c5846af870694a10e865140efb0566a42
 2019-04-18 10:50:24 +08:00
Xu Peng 817d032a02 refactor(db): using wrapper write_index 
Former-commit-id: d72e2bb4ee8122da76a23661df802adc3447d3f7
 2019-04-18 10:50:24 +08:00
Xu Peng e60b4f0bd1 refactor(db): using index factory in MemManager 
Former-commit-id: 31cc3fe760f94eb9c5e673f44b0a0d1de8c98c40
 2019-04-18 10:50:24 +08:00
Xu Peng 6ea0bbadaf refactor(db): using index factory 
Former-commit-id: aa34392ec71eb4181a37625f07c2995a57e8cc57
 2019-04-18 10:50:24 +08:00
groot 3224c4eb70 client call api 
Former-commit-id: f2d5ccecb8359642ba8d63ef538b90fba209b2b5
 2019-04-18 10:50:24 +08:00
Xu Peng 8b5aa978ec feat(db): add build index thread 
Former-commit-id: f3df7ccdd381ec67aaca4a66401644249bdb0b3d
 2019-04-18 10:48:56 +08:00
groot e568941180 refine code 
Former-commit-id: 4406ca272f134594421b89aa34b6f91a3d8a92a4
 2019-04-18 10:48:56 +08:00
Xu Peng c2cfc98b77 refactor(db): refactor options 
Former-commit-id: 53812504248a4a81f2f65ee07e81ad2d5e31eb38
 2019-04-18 10:48:56 +08:00
Xu Peng 53270e4b97 refactor(db): file name refactor 
Former-commit-id: af418586311c0857e5c1e9fdd543806bb4ad7184
 2019-04-18 10:48:56 +08:00
groot 8d4d0c07e3 support more protocol 
Former-commit-id: c064f5c924b24857c114178f3ab310ae67d553c2
 2019-04-18 10:48:56 +08:00
Xu Peng 212d393712 refactor(db): mv types.h to Types.h 
Former-commit-id: 5a36823d84570784113420afa4fff7d0cd1ef1d2
 2019-04-18 10:48:56 +08:00
groot fe20a302ba refine log code 
Former-commit-id: fefbec403f92cf851f3810d3bc78109fb89bb768
 2019-04-18 10:48:56 +08:00
Xu Peng bdd137e1b2 feat(db): merge file changes 
Former-commit-id: 38e1bf124e5cd4bbf2a838494c7962e928f05a17
 2019-04-18 10:48:56 +08:00
groot e4666f04f0 response signal 2 
Former-commit-id: 8d3a36a2d332d05d48f9ecae990b70c35aee0072
 2019-04-18 10:48:56 +08:00
groot 8b689e8e2a client sucessfully connect to server 
Former-commit-id: 1e9186c606ae9ca46f9b2f57ccaeeb50b4cc6c3a
 2019-04-18 10:48:56 +08:00
Xu Peng 1b9aeb89b2 feat(db): add merge files 
Former-commit-id: 715b6eeae4b1c45ef5e8536536ab9b0faf720e42
 2019-04-18 10:48:56 +08:00
groot 719c232528 modify test client 
Former-commit-id: d9bd14f32c078b87bdb58e46efe6e45912a5baef
 2019-04-18 10:48:56 +08:00
groot 836bfb5c07 build debug thrift 
Former-commit-id: 252bae2826946ae61a1a2ada570844b413f3df02
 2019-04-18 10:48:56 +08:00
Xu Peng fbb817a412 feat(db): add some meta data logic and update db bg merge jobs 
Former-commit-id: 36bc3fbacf36450b863d69bd83a8ba3b9daffedb
 2019-04-18 10:48:56 +08:00
Xu Peng 076ad6f511 feat(db): add group_id related info for memvertor apis 
Former-commit-id: 102f857ae32bedb2dd42ebf951197c59f9e1d772
 2019-04-18 10:48:56 +08:00
groot 758337f73e refine code 
Former-commit-id: f03943ce54db1fdc11c00fc625dabdcdd0bbf817
 2019-04-18 10:48:56 +08:00
groot 2a850821b5 add test client 
Former-commit-id: af73a98aad00251fa5432d39e092ee950fe2db2b
 2019-04-18 10:48:56 +08:00
xj.lin a25a7a24a7 add db setting file 
Former-commit-id: 184bf9c48a5b659a85a11b09aa694165ee6b7b61
 2019-04-18 10:37:06 +08:00
Xu Peng a8a1d3abcd feat(db): impl has_group 
Former-commit-id: 785fb73b07ef58017a6e1f04cd2f997f43f89b88
 2019-04-18 10:02:12 +08:00
Xu Peng 92e30f4e7a feat(db): impl get_group 
Former-commit-id: d40df7e09e60dfa682d28481a2fe320d57819baa
 2019-04-18 09:54:50 +08:00
Xu Peng e47b6cf9cc refactor(db): change get_group and add_group apis 
Former-commit-id: c235588d9c2901e5065997dc1917cc30df9ae623
 2019-04-17 20:46:40 +08:00
Xu Peng 608c5692b4 feat(env): add sqlite3 in dependency 
Former-commit-id: d09d22ca49cbf18b5647558f6c52c39fc6242baf
 2019-04-17 20:29:56 +08:00
Xu Peng 0c8b4b04e8 feat(db): init sql orm unique ptr 
Former-commit-id: 41a4a96958a81482d2700a4bc3973d8d91d678c0
 2019-04-17 20:28:16 +08:00
Xu Peng 2aa2720dbd feat(db): impl add_group in meta 
Former-commit-id: 49bb87da9b121a67f439c46f4dc7651f7bafaa4e
 2019-04-17 19:54:37 +08:00
Xu Peng e624b1a1c5 feat(db): fake data for db meta 
Former-commit-id: 17f7dfa12376ec11084e8d5e3897b851a22ab35f
 2019-04-17 18:37:12 +08:00
Xu Peng 72869830d9 feat(db): changes to local meta 
Former-commit-id: ad3fc4b0634dcba15ce68e45af6c336aa762b07b
 2019-04-17 18:22:12 +08:00
Xu Peng 0b5d7e0437 fix(db): fix compile error 
Former-commit-id: e260fd302903e714dd2eb8fcf2e589f3ecdcc029
 2019-04-17 16:59:31 +08:00
Xu Peng 33ffb08a88 feat(db): add local meta 
Former-commit-id: ccb9e8080ad0a1c610ff5b3afe0d9d3c4c4e5366
 2019-04-17 16:53:44 +08:00
Xu Peng f297367987 feat(db): file name mock 
Former-commit-id: 0ccabc6d787c1f974df4958763075b35332ab7a6
 2019-04-17 14:25:27 +08:00
Xu Peng 074523368e feat(db): impl build_index 
Former-commit-id: cf2b9ca3555675d6304ea273bdfeac0e15bb7271
 2019-04-17 13:44:37 +08:00
Xu Peng 92983fcfbf fix(wrapper): fix write index 
Former-commit-id: 98af046872115568f3b4e7859bf6b6970b0655f6
 2019-04-17 13:44:37 +08:00