Commit Graph

500 Commits (be8a94529185529fd3ea39020556e58adec20538)

Author SHA1 Message Date
xj.lin b482d1ff86 1. 只MKL-BLAS库进行向量计算,替换掉SSE部分
Former-commit-id: 5efc18ce6aa97ff54bb8e5d738843d78ce6f7d29
2019-05-06 14:57:23 +08:00
groot 0ce9502a3e fix bug
Former-commit-id: daf197368b50cd764df893949abb5f2956c9c560
2019-05-06 11:24:36 +08:00
groot e472c605d2 modify readme
Former-commit-id: d5fe9fbbe444e2580714ad4fc741b61048dbe01c
2019-05-06 11:10:14 +08:00
groot a34d995195 modify readme
Former-commit-id: 2297c0decb034ceda163a996f6d24604875f6495
2019-05-06 10:47:55 +08:00
groot 4808c72a34 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 9ad0e47971fa7bd3559877bc76b3edbf08ac1fdc
2019-05-06 10:38:57 +08:00
groot 2d3335b143 thrift ignore php
Former-commit-id: 18e4e30b14e8675f98615cd2aed3fe29a487460b
2019-05-06 10:38:48 +08:00
xj.lin 96c64e0b40 Merge branch 'support-gpu-build' into jinhai
Former-commit-id: eb83a5a6a9379760bd83ba6c29f401b64682d9ce
2019-05-06 10:25:03 +08:00
xj.lin 2ac87c1e47 1. support IDMap
2. fix some bug
3. background job from IDMap -> IVF


Former-commit-id: ba8f24f09c5481103ad3f4c1c91d4deb70f26dad
2019-05-06 10:24:07 +08:00
xj.lin 56bbe40faf 1. fix operand serialize bug
2. support gpu-build
3. add unittest


Former-commit-id: bb36dcb05220d8f0648f282c7e38fe20f4ab3c16
2019-05-06 09:53:59 +08:00
jinhai 675777d072 Add libzstd-dev to solve the linking error
Former-commit-id: 993f2b5e526a3d073820f80b8ce473842ab937b5
2019-05-05 20:42:33 +08:00
groot faa2c4b4b1 support empty id
Former-commit-id: 1a5303b58f3f3b0154f1609ff1acc0d00007c569
2019-05-05 20:13:34 +08:00
Xu Peng 496989bbe4 refactor(db): add more debug log
Former-commit-id: 7c196e05c60567216938115e081438beeecb0f47
2019-05-05 18:02:11 +08:00
Xu Peng d3cbc1ccad fix(db): db desctruction bug fix
Former-commit-id: e456a0d76c2b1401107d47600c34d4622ca8cd8a
2019-05-05 17:26:50 +08:00
Xu Peng 8a029c9b0d refactor(db): add copyright header
Former-commit-id: 45606fe09972ab741faa4ee8061ef7d307c20c49
2019-05-05 13:10:04 +08:00
Xu Peng 72f096bfca refactor(db): typedef ptr for memvectors
Former-commit-id: 92289614937b7803fc41bf5cb7d50f468192aaa4
2019-05-05 12:55:42 +08:00
Xu Peng c64e8c9621 refactor(db): typdef meta ptr
Former-commit-id: 1fcbd80c65a1ee2815a57127f04807ce7d9f23f3
2019-05-05 10:28:40 +08:00
Xu Peng f5b0ec50cf refactor(db): typedef engine ptr
Former-commit-id: 4629cac435fd484ab949ab112b639a4849e37fca
2019-05-05 10:21:26 +08:00
Xu Peng 85707aa3e9 refactor(db): impl template for engine type part 2
Former-commit-id: 8be264a9ecc7704f63a978fb862b95140a19e1c0
2019-05-05 09:38:37 +08:00
Xu Peng 166289cafa refactor(db): impl template for engine type
Former-commit-id: 2e9a6fa992f58dfe567f7c274b9327454cf3f89e
2019-04-30 21:02:13 +08:00
Xu Peng 0e37089c6a refactor(db): refactor all for crtp replacement
Former-commit-id: 3c5d3ddeec04d573ef3916f673a7504c51a0a3bf
2019-04-30 20:23:11 +08:00
Xu Peng 67960d5a55 refactor(db): dbimpl refactor for ee
Former-commit-id: 5c762120594c4ab76237cc9d713dde3f4a57931a
2019-04-30 20:16:54 +08:00
Xu Peng 8866d36252 refactor(db): refactor execution_engine
Former-commit-id: 90ddd165224135d190108f5d7bce544b5c0f305e
2019-04-30 20:14:38 +08:00
Xu Peng ca195424c5 refactor(db): refactor small part
Former-commit-id: 58fc916c28a94ccecd67c58d5cf3620c51fbe4c4
2019-04-30 18:44:00 +08:00
Xu Peng 62440022d9 refactor(db): remove dummy includes
Former-commit-id: 6cf84f4b81e93c4a02ec7467b14e0ebc9227585d
2019-04-30 18:34:32 +08:00
Xu Peng 94057d9d95 refactor(db): refactor search with execution engine
Former-commit-id: 1625a8aff9582e61e6bb687b4da40f7721610f91
2019-04-30 18:32:40 +08:00
Xu Peng 473d603a89 refactor(db): refactor build_index with execution engine
Former-commit-id: a37b3096ae6883f6633fd3c1f986ca0f45955a0b
2019-04-30 18:11:38 +08:00
Xu Peng 95adef2988 feat(db): add build_index api for ee
Former-commit-id: 75f268e4494d383f7a7b9e32c634a44f7beeba1c
2019-04-30 18:11:38 +08:00
Xu Peng 4cc5b8d523 refactor(db): replace faiss with execution engine
Former-commit-id: 7e7949541e39bc18f30c5aafa7968fdacf709719
2019-04-30 18:11:38 +08:00
groot a724141e73 use multithreads to do id mapping
Former-commit-id: 10b201d3801b146fa6335e4dfd20c877cfb2e948
2019-04-30 17:37:50 +08:00
groot b67c731b90 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 730d1e5d7acd6ff2250ea1a453c2d4127f081356
2019-04-30 17:00:05 +08:00
groot 2e76522151 refine code
Former-commit-id: f81a57c8340d7cfcea9db3d8219612f6108eeda6
2019-04-30 17:00:00 +08:00
Xu Peng 7f000e7979 refactor(db): rename
Former-commit-id: 60c982ed5e500d958182bbc0816731d9423b509a
2019-04-30 16:08:28 +08:00
Xu Peng 204c68879c refactor(db): replace faiss with serializer wrapper
Former-commit-id: 62b5a7d8353c2b0ef4017f43d03d1c6944685400
2019-04-30 16:08:28 +08:00
Xu Peng 713d1ec6b7 feat(db): add cache
Former-commit-id: 2dd8078d8df484ddac54379bc6c84c015c1fc530
2019-04-30 16:08:28 +08:00
Xu Peng 052f7e2f11 feat(db): add more api for serializer
Former-commit-id: d15d7dfecb9964ca2e3ba4e5b469137d1cc85057
2019-04-30 16:08:28 +08:00
Xu Peng cf19e90af3 feat(db): add serializer
Former-commit-id: ab412bbb430e7711ddee0ad26b34f7b3b6c43582
2019-04-30 16:08:28 +08:00
Xu Peng 39be106baa refactor(db): code optimization
Former-commit-id: 320733b50aba32e5bd99853933e7e1eafdbcdbcf
2019-04-30 16:08:28 +08:00
groot 83ed0fa4e6 fix typo
Former-commit-id: 5eb1054016ec8fe6dbf173f1e32c0d37330cd87f
2019-04-30 15:03:06 +08:00
groot 74eee9dc77 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 00d18f20fb408445831a00a5385a244c49786910
2019-04-30 14:47:46 +08:00
groot 905722bd0e add python sample
Former-commit-id: 2c0825ad6ed774eb5ad1999b1439f840dc602bf1
2019-04-30 14:47:36 +08:00
Xu Peng ce54690910 test(db): small change
Former-commit-id: 8cf0fe13bfd7715a491f00cc24e2efa37fd8decd
2019-04-30 14:17:24 +08:00
Xu Peng 3a05719e5a refactor(db): disable some print
Former-commit-id: 09fb8ca768ba06af3407df8d9ec307f259650eae
2019-04-30 14:17:24 +08:00
Xu Peng 9cb81455a1 refactor(db): change print for search
Former-commit-id: c1df662f54ba5132db8d4fbbbd9b1e9998a61e7a
2019-04-30 14:17:24 +08:00
groot ae5e672061 refine test code
Former-commit-id: 25266f1e3574d2ffa42ab8299cc8e5a4ac5b651a
2019-04-30 14:00:22 +08:00
groot dbf9de9a62 refine
Former-commit-id: 46e81a09c49f06c6b80bedfb90c2767bb54ec5f7
2019-04-30 11:44:58 +08:00
groot aa591114c4 time range search
Former-commit-id: 182c5c9db2d3aeaafc4d4878f060435c442b366c
2019-04-30 11:18:08 +08:00
Xu Peng 21a98c0e02 test(db): refactor db test
Former-commit-id: c85ed1e09b51f9c883426f7c77da3261232f0745
2019-04-29 20:22:24 +08:00
Xu Peng 61854a6c23 test(db): refactor SetUp
Former-commit-id: dfbb0f819705c0fca4b5e0a7fb37ce7bc52761d6
2019-04-29 19:05:48 +08:00
Xu Peng ed9dc51f27 test(db): samll change
Former-commit-id: 1bdf8515f7914a43e965334db36d253fea12abb7
2019-04-29 19:01:18 +08:00
Xu Peng 7680d5c731 feat(db): change default options values
Former-commit-id: 8c4aeb5206d7532ac524956e225779ce2e29766e
2019-04-29 18:56:40 +08:00