Commit Graph

6143 Commits (76a7684d96bb042f4dd3da6579d926d534983966)

Author SHA1 Message Date
xj.lin 2ac87c1e47 1. support IDMap
2. fix some bug
3. background job from IDMap -> IVF


Former-commit-id: ba8f24f09c5481103ad3f4c1c91d4deb70f26dad
2019-05-06 10:24:07 +08:00
xj.lin 56bbe40faf 1. fix operand serialize bug
2. support gpu-build
3. add unittest


Former-commit-id: bb36dcb05220d8f0648f282c7e38fe20f4ab3c16
2019-05-06 09:53:59 +08:00
jinhai 675777d072 Add libzstd-dev to solve the linking error
Former-commit-id: 993f2b5e526a3d073820f80b8ce473842ab937b5
2019-05-05 20:42:33 +08:00
groot faa2c4b4b1 support empty id
Former-commit-id: 1a5303b58f3f3b0154f1609ff1acc0d00007c569
2019-05-05 20:13:34 +08:00
Xu Peng 496989bbe4 refactor(db): add more debug log
Former-commit-id: 7c196e05c60567216938115e081438beeecb0f47
2019-05-05 18:02:11 +08:00
Xu Peng d3cbc1ccad fix(db): db desctruction bug fix
Former-commit-id: e456a0d76c2b1401107d47600c34d4622ca8cd8a
2019-05-05 17:26:50 +08:00
Xu Peng 8a029c9b0d refactor(db): add copyright header
Former-commit-id: 45606fe09972ab741faa4ee8061ef7d307c20c49
2019-05-05 13:10:04 +08:00
Xu Peng 72f096bfca refactor(db): typedef ptr for memvectors
Former-commit-id: 92289614937b7803fc41bf5cb7d50f468192aaa4
2019-05-05 12:55:42 +08:00
Xu Peng c64e8c9621 refactor(db): typdef meta ptr
Former-commit-id: 1fcbd80c65a1ee2815a57127f04807ce7d9f23f3
2019-05-05 10:28:40 +08:00
Xu Peng f5b0ec50cf refactor(db): typedef engine ptr
Former-commit-id: 4629cac435fd484ab949ab112b639a4849e37fca
2019-05-05 10:21:26 +08:00
Xu Peng 85707aa3e9 refactor(db): impl template for engine type part 2
Former-commit-id: 8be264a9ecc7704f63a978fb862b95140a19e1c0
2019-05-05 09:38:37 +08:00
Xu Peng 166289cafa refactor(db): impl template for engine type
Former-commit-id: 2e9a6fa992f58dfe567f7c274b9327454cf3f89e
2019-04-30 21:02:13 +08:00
Xu Peng 0e37089c6a refactor(db): refactor all for crtp replacement
Former-commit-id: 3c5d3ddeec04d573ef3916f673a7504c51a0a3bf
2019-04-30 20:23:11 +08:00
Xu Peng 67960d5a55 refactor(db): dbimpl refactor for ee
Former-commit-id: 5c762120594c4ab76237cc9d713dde3f4a57931a
2019-04-30 20:16:54 +08:00
Xu Peng 8866d36252 refactor(db): refactor execution_engine
Former-commit-id: 90ddd165224135d190108f5d7bce544b5c0f305e
2019-04-30 20:14:38 +08:00
Xu Peng ca195424c5 refactor(db): refactor small part
Former-commit-id: 58fc916c28a94ccecd67c58d5cf3620c51fbe4c4
2019-04-30 18:44:00 +08:00
Xu Peng 62440022d9 refactor(db): remove dummy includes
Former-commit-id: 6cf84f4b81e93c4a02ec7467b14e0ebc9227585d
2019-04-30 18:34:32 +08:00
Xu Peng 94057d9d95 refactor(db): refactor search with execution engine
Former-commit-id: 1625a8aff9582e61e6bb687b4da40f7721610f91
2019-04-30 18:32:40 +08:00
Xu Peng 473d603a89 refactor(db): refactor build_index with execution engine
Former-commit-id: a37b3096ae6883f6633fd3c1f986ca0f45955a0b
2019-04-30 18:11:38 +08:00
Xu Peng 95adef2988 feat(db): add build_index api for ee
Former-commit-id: 75f268e4494d383f7a7b9e32c634a44f7beeba1c
2019-04-30 18:11:38 +08:00
Xu Peng 4cc5b8d523 refactor(db): replace faiss with execution engine
Former-commit-id: 7e7949541e39bc18f30c5aafa7968fdacf709719
2019-04-30 18:11:38 +08:00
groot a724141e73 use multithreads to do id mapping
Former-commit-id: 10b201d3801b146fa6335e4dfd20c877cfb2e948
2019-04-30 17:37:50 +08:00
groot b67c731b90 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 730d1e5d7acd6ff2250ea1a453c2d4127f081356
2019-04-30 17:00:05 +08:00
groot 2e76522151 refine code
Former-commit-id: f81a57c8340d7cfcea9db3d8219612f6108eeda6
2019-04-30 17:00:00 +08:00
Xu Peng 7f000e7979 refactor(db): rename
Former-commit-id: 60c982ed5e500d958182bbc0816731d9423b509a
2019-04-30 16:08:28 +08:00
Xu Peng 204c68879c refactor(db): replace faiss with serializer wrapper
Former-commit-id: 62b5a7d8353c2b0ef4017f43d03d1c6944685400
2019-04-30 16:08:28 +08:00
Xu Peng 713d1ec6b7 feat(db): add cache
Former-commit-id: 2dd8078d8df484ddac54379bc6c84c015c1fc530
2019-04-30 16:08:28 +08:00
Xu Peng 052f7e2f11 feat(db): add more api for serializer
Former-commit-id: d15d7dfecb9964ca2e3ba4e5b469137d1cc85057
2019-04-30 16:08:28 +08:00
Xu Peng cf19e90af3 feat(db): add serializer
Former-commit-id: ab412bbb430e7711ddee0ad26b34f7b3b6c43582
2019-04-30 16:08:28 +08:00
Xu Peng 39be106baa refactor(db): code optimization
Former-commit-id: 320733b50aba32e5bd99853933e7e1eafdbcdbcf
2019-04-30 16:08:28 +08:00
groot 83ed0fa4e6 fix typo
Former-commit-id: 5eb1054016ec8fe6dbf173f1e32c0d37330cd87f
2019-04-30 15:03:06 +08:00
groot 74eee9dc77 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 00d18f20fb408445831a00a5385a244c49786910
2019-04-30 14:47:46 +08:00
groot 905722bd0e add python sample
Former-commit-id: 2c0825ad6ed774eb5ad1999b1439f840dc602bf1
2019-04-30 14:47:36 +08:00
Xu Peng ce54690910 test(db): small change
Former-commit-id: 8cf0fe13bfd7715a491f00cc24e2efa37fd8decd
2019-04-30 14:17:24 +08:00
Xu Peng 3a05719e5a refactor(db): disable some print
Former-commit-id: 09fb8ca768ba06af3407df8d9ec307f259650eae
2019-04-30 14:17:24 +08:00
Xu Peng 9cb81455a1 refactor(db): change print for search
Former-commit-id: c1df662f54ba5132db8d4fbbbd9b1e9998a61e7a
2019-04-30 14:17:24 +08:00
groot ae5e672061 refine test code
Former-commit-id: 25266f1e3574d2ffa42ab8299cc8e5a4ac5b651a
2019-04-30 14:00:22 +08:00
groot dbf9de9a62 refine
Former-commit-id: 46e81a09c49f06c6b80bedfb90c2767bb54ec5f7
2019-04-30 11:44:58 +08:00
groot aa591114c4 time range search
Former-commit-id: 182c5c9db2d3aeaafc4d4878f060435c442b366c
2019-04-30 11:18:08 +08:00
Xu Peng 21a98c0e02 test(db): refactor db test
Former-commit-id: c85ed1e09b51f9c883426f7c77da3261232f0745
2019-04-29 20:22:24 +08:00
Xu Peng 61854a6c23 test(db): refactor SetUp
Former-commit-id: dfbb0f819705c0fca4b5e0a7fb37ce7bc52761d6
2019-04-29 19:05:48 +08:00
Xu Peng ed9dc51f27 test(db): samll change
Former-commit-id: 1bdf8515f7914a43e965334db36d253fea12abb7
2019-04-29 19:01:18 +08:00
Xu Peng 7680d5c731 feat(db): change default options values
Former-commit-id: 8c4aeb5206d7532ac524956e225779ce2e29766e
2019-04-29 18:56:40 +08:00
Xu Peng e78481f5e4 test(db): add meta files test
Former-commit-id: bd7b5371b11ddd769b178fe0e263b5759398e0d3
2019-04-29 18:10:30 +08:00
Xu Peng 0bbae88f3f fix(db): add to index files in files to search list
Former-commit-id: 8174f890208374835a7d0b0c310fdeb7f016bd32
2019-04-29 18:10:30 +08:00
Xu Peng f7853fcd20 test(db): add group file test
Former-commit-id: 8fa440c2be5f525388d45fca7e92244718e8c2fc
2019-04-29 18:10:30 +08:00
groot 363de87bdb gen python api
Former-commit-id: 1c9b4a1fea7c450b55e8d683085d8779460ea3c4
2019-04-29 17:58:08 +08:00
groot 231b216963 add namespace for thrift api
Former-commit-id: 92f9e0a0f7d2e301120573976984f99062b8f44e
2019-04-29 17:55:50 +08:00
groot e1efe942da fix test load config failure
Former-commit-id: 7781b6ff8a4c1d72dfe4f872a7765424af40286e
2019-04-29 16:34:43 +08:00
groot bd9c14a871 typo
Former-commit-id: 89e00f1b579a2f78737efcafc04507f0f31049b1
2019-04-29 16:20:21 +08:00