Commit Graph

556 Commits (e95f5110252352c69d586cd35eba5fedea59ba48)

Author SHA1 Message Date
Xu Peng a7c22f8e53 test(db): test delete group partitions
Former-commit-id: af392c6bf9440a5d29ee152e4d4129153b499f94
2019-05-26 11:27:31 +08:00
Xu Peng 4e1736f3ab feat(db): add get group file api
Former-commit-id: 1c8ed181f4a38203300d48bbca0ed11b7a0185be
2019-05-26 11:27:31 +08:00
Xu Peng 315e532792 fix(db): get group bug fix
Former-commit-id: 0a7cc7e3791bf02ea899a3cafdc5698e52334027
2019-05-26 11:27:31 +08:00
Xu Peng 4eea03af5c feat(db): add simple delete partitions
Former-commit-id: ed39bb26d68f4ea576e824c081e72bfb17d15b8a
2019-05-26 11:27:31 +08:00
groot 9c95423231 prepare for gpu index
Former-commit-id: 764288e406f3a03822bca5e79b8d0ba9a3f4e13e
2019-05-23 11:01:11 +08:00
groot 0c699ac84b prepare for gpu index
Former-commit-id: 048b5c0f4ae84a1afcb57d43c7763c7617d64d26
2019-05-23 10:46:20 +08:00
groot 5f4e16f3d7 avoid potential multi-threads risk
Former-commit-id: c99078422d17cc33ebb4c74e5e85ca0f4203a4b1
2019-05-19 10:59:35 +08:00
jinhai bef742c0a9 Merge branch 'jinhai' of http://192.168.1.105:6060/jinhai/vecwise_engine into jinhai
Former-commit-id: 662de1631e4fe01c940b471f98fce654c52c0495
2019-05-17 20:18:24 +08:00
jinhai 2c42210e8c MS-1 Add Change log
Former-commit-id: 681054dc191d1f4cbdebf215c3fd0905aeb53e94
2019-05-17 20:17:51 +08:00
jinhai af77eb7f89 MS-1 Add Change log
Former-commit-id: 5ab75cc621527fd2e095748728dcfe9731673fd4
2019-05-17 20:16:18 +08:00
yhmo c19b49abc4 Merge branch 'id_bug' into 'release-v1.1'
fix id miss bug

See merge request megasearch/vecwise_engine!27

Former-commit-id: 5505393398813c49a428511d378da6af2f703c1a
2019-05-17 17:50:18 +08:00
groot 833f52c7a1 fix id miss bug
Former-commit-id: ad0d56ad7e1faef38e31c773fcc8fd3f7c1fe664
2019-05-17 17:33:28 +08:00
Xu Peng c04a7c0e78 fix(db): fix create directory bug in release
Former-commit-id: e060ff269f66c02c69978e0a7c77afae59528eb4
2019-05-16 11:24:21 +08:00
Xu Peng 4380016d4a fix(db): fix create directory bug in release
Former-commit-id: 511730da61c4afac4b09e38aafaf77ea9617b822
2019-05-16 11:20:10 +08:00
jinhai 0d0c10df11 Update license check
Former-commit-id: ab88deb5aaeadda3626106a3a4cf3600131f528e
2019-05-15 20:22:04 +08:00
groot c078cc8516 avoid add vector to invalid group
Former-commit-id: 3df82dd670ada8f24b3fb3a2411337e953b7c1b5
2019-05-15 19:57:31 +08:00
jinhai c7f4708fe7 Update README.md and conf
Former-commit-id: 014cd72b6c70e8924758236798ad4d0c12fa099e
2019-05-15 17:28:02 +08:00
groot 7cfd01a2ba build test_client
Former-commit-id: d10961136389a1218dbea8e77a72d5b1b884d2d7
2019-05-15 17:09:43 +08:00
yhmo 011be04411 Merge branch 'jinhai' into 'release-v1'
# Conflicts:
#   cpp/src/utils/Error.h

Former-commit-id: 18470ad3970bec55315d738a006355c1ce2c1f4c
2019-05-15 16:40:00 +08:00
yangwei.yao 74d5802ba4 unit test
Former-commit-id: 3806f1d475b2dd1259fe48a013f01389f8975e5c
2019-05-15 15:01:07 +08:00
yangwei.yao 35eeae6f08 license check is vaild
Former-commit-id: 7381ad310d5b554c99f1f19f7fc460b33c36659f
2019-05-15 15:01:07 +08:00
Xu Peng a6853a5726 fix(db): fix cache error after load file from disk part 2
Former-commit-id: e684913260dee0f4e5c39729f12e29925c1fb118
2019-05-15 13:21:58 +08:00
Xu Peng 59544b0341 fix(db): fix cache error after load file from disk
Former-commit-id: 23dd81d168caa49451634ef7a97c6fa618c92957
2019-05-15 11:47:21 +08:00
yangwei.yao 384b9b8af2 1
Former-commit-id: 3642cd8f4089038eade6857854d1d1b42c5eceb8
2019-05-15 11:26:56 +08:00
jinhai 7c512bf752 Update on license check
Former-commit-id: ef039b5663e0a68c1dfdea7244de4d2e7e16c10e
2019-05-15 11:26:56 +08:00
yangwei.yao 128bc2b420 Refactor
Former-commit-id: 5c57d9054cae1e468a5795b928ecab4d18c1d4af
2019-05-15 11:26:56 +08:00
jinhai 06dd990b18 Refactor code
Former-commit-id: 31caf05ec1b75d9cd1de476104cdc0abf62acedd
2019-05-15 11:26:56 +08:00
yangwei.yao 5eb854b1b6 license_run
Former-commit-id: dbfbeafc516f45c89cf2b693f40ac19abf903df3
2019-05-15 11:24:37 +08:00
yangwei.yao c7ba2112bb 05.11
Former-commit-id: 22e7d5214db47ac228d50989b01e3a5e71a719d4
2019-05-15 11:24:37 +08:00
groot d918a22c33 Merge branch 'release-v1' of 192.168.1.105:jinhai/vecwise_engine into release-v1
Former-commit-id: 48c50673ea7e468d7ec4d9f5c2bc6b92bb4da5d7
2019-05-14 15:29:46 +08:00
groot d14b718862 change api namespace
Former-commit-id: ad513035c3db217c61e0eddcfaa633237564311c
2019-05-14 15:29:37 +08:00
xj.lin 077c36eecb Merge branch 'release-v1' of 192.168.1.105:jinhai/vecwise_engine into release-v1
Former-commit-id: ec5221f0b08674678633ec4415b48399bb52b820
2019-05-14 14:11:09 +08:00
groot cc2edace95 add test infomation
Former-commit-id: a5ac7a483a0f21182069dd2727f1832d0f94ae97
2019-05-14 12:03:50 +08:00
jinhai 7aea1dbccc Update Documents
Former-commit-id: 66643e729c7f190d38e460c903b874e5a1c64aa6
2019-05-14 11:55:18 +08:00
groot 202e4fcbd8 no change config
Former-commit-id: b97f814d0db3052d41eaeb9f7990b271565dbb8f
2019-05-14 11:49:32 +08:00
groot 1a8a97a960 no change config
Former-commit-id: 792765d33c0a448432830a9b3cdfec5272b378cc
2019-05-14 11:37:37 +08:00
groot 678f1010a1 use rocksdb column family
Former-commit-id: dbf59149386a71807ff3ea4498240afd102b5001
2019-05-14 11:16:18 +08:00
xj.lin 70dda63820 fix topk_2
Former-commit-id: 573d80b6d51407cc80e92989c11e3d74f2531d66
2019-05-14 10:26:46 +08:00
groot 70521c45e4 Merge branch 'release-v1' into rocksdb
Former-commit-id: 9efa6d93a63167d98a3e379dc8baa30a2cd18b86
2019-05-13 17:12:37 +08:00
groot a56333b55d throw exception
Former-commit-id: 6a8ae6f0c0b73fc9411b039143a1650e6ab7cc02
2019-05-13 17:05:24 +08:00
groot 56291b218d use rocksdb column family
Former-commit-id: 8cbc5d91e02e6bbc0eff1e329b4c76687d2c1f74
2019-05-13 15:17:05 +08:00
xj.lin 354f68a96f fix TopK bug
Former-commit-id: 76e24617b83d49b2a4808a0cd7406edb849e767e
2019-05-11 18:49:30 +08:00
xj.lin c4244fdc6d fix search stack overflow
Former-commit-id: 39801544686f061a63f4c3f1dec11565164a928d
2019-05-11 16:52:16 +08:00
xj.lin fddf73204a update config
Former-commit-id: 5004449f97f88acac31e01c3d83b7302059091b5
2019-05-11 13:21:19 +08:00
xj.lin 527651bbc6 update conf files
Former-commit-id: 28cf4be27eb0fe9d74046bb609dba103d162e7b2
2019-05-11 12:10:30 +08:00
xj.lin 0f6be5f022 1 update conf files
2 new scripts dir
3 update Readme


Former-commit-id: 0b0c4ca55fc05e459c3e2ed7e8c9c83b3752cbd3
2019-05-11 12:04:47 +08:00
jinhai 1390398cdb Merge branch 'jinhai' of http://191.168.1.105:6060/jinhai/vecwise_engine into jinhai
Former-commit-id: 4d8bb348e42f7d791daf9dc5c59e66d45d395214
2019-05-10 23:44:19 -04:00
zilliz e734d06809 Update CMakeLists.txt
Former-commit-id: 846f7f0401519246676ff1385677da1c4a07a521
2019-05-10 23:43:44 -04:00
xj.lin 364af3b1a8 redefine default index build type
Former-commit-id: 1f10a7774b80b596323882bb74a46484a917344f
2019-05-11 11:27:06 +08:00
xj.lin 876f6a4c66 1 Support Cpu-version
2 Update build.sh support both cpu-build and gpu-build


Former-commit-id: 3c0ddd7fb2f93ab45b6f9878b71b6541617f92c4
2019-05-11 11:27:06 +08:00
Xu Peng 2a8c45d394 test(db): check add vectors result size
Former-commit-id: d72021ae7c0fc69c840780d023d6a7573b618ce5
2019-05-11 11:19:21 +08:00
Xu Peng ac7092f556 fix(db): bug fix for add vectors
Former-commit-id: 84cfcf89843bfd79e226ef3fd8c6d9a273a1f4dc
2019-05-11 11:17:07 +08:00
groot 99b61e3b9b fix bug
Former-commit-id: 4f365862e364a8b6232a9d959354dd609db6a040
2019-05-10 14:33:23 +08:00
groot b2d988b9c6 fix bug
Former-commit-id: 53fa5d480d001cc82145710fa0329604b85bab19
2019-05-10 14:32:43 +08:00
groot 7e6b928ce8 modify thrift api
Former-commit-id: 6a9222b918447562add54efb852bb8716c5ed254
2019-05-10 10:39:59 +08:00
groot f9967cd744 modify thrift api
Former-commit-id: 744dec10d157280d9776a7507aaa428ca76aad66
2019-05-10 10:39:21 +08:00
groot f7a2ac7b00 refine code
Former-commit-id: 9205f1d9bfcd3f4a48688b989cfe52b26dba29de
2019-05-09 21:41:44 +08:00
groot 6a27275486 regen thrift py
Former-commit-id: a199ad849e1a0a6534bd343deaf8e4aa6a1335d5
2019-05-09 19:16:40 +08:00
groot b97b406ce6 regen thrift cpp
Former-commit-id: 2d37cc786425da956db94fc2f3f5de824ad54b94
2019-05-09 19:16:13 +08:00
xj.lin 146bb9e6d4 support install prefix and default install
Former-commit-id: cada287cbf3b4ef2e32e8039aa7836bb76a6adb1
2019-05-09 12:05:35 +08:00
jinhai 77f86fdeee License tests success
Former-commit-id: e10d0146a51286664bb01f5d55f694e547a8f597
2019-05-08 17:38:37 +08:00
yangwei.yao 414cbf860f Update CMakeLists.txt
Former-commit-id: 6007ad4c75ca615d6d21236a2ea5affe347672d1
2019-05-08 17:01:11 +08:00
jinhai 51d9e2c21e Add license check functions
Former-commit-id: d3120c7b805a59bcb736908990d68652008eca8d
2019-05-08 14:55:21 +08:00
Xu Peng 56ffd6bad3 fix(db): db destruction bug fix
Former-commit-id: d77e18e428bc43b2cc1316f0d77b6807192f6662
2019-05-08 13:58:16 +08:00
Xu Peng 4428d56670 refactor(db): trait for engine and dbimpl
Former-commit-id: c42d9f4d7168b4d8e374ddb5ed0499ea1394a306
2019-05-08 12:13:01 +08:00
Xu Peng b36a524739 refactor(db): using traits
Former-commit-id: 6496aa13a3ba40d4bec2e32a1ad6f10377055775
2019-05-08 12:13:01 +08:00
Xu Peng 9e43c45de4 feat(db): support trait for engine
Former-commit-id: cfb90e35386177032fa0c4ac7b8c81f29a536571
2019-05-08 12:13:01 +08:00
Xu Peng 372adf6c80 fix(cache): add pragma once in header
Former-commit-id: cb9b838950c536fa4a582c92cf0df634c0780764
2019-05-08 12:13:01 +08:00
Xu Peng 9adc7bdf82 env(unittest): add missing lib
Former-commit-id: 3d923d0a8588226084f6935b184798f2a402849c
2019-05-08 11:05:09 +08:00
jinhai 15afc4b4bb ./build.sh -t Release will make a release version
Former-commit-id: 7acb08bb5d8d2d64ab1b64ac73ae5373c01d6e80
2019-05-07 16:45:03 +08:00
groot 5897f415ad addd log
Former-commit-id: e950e203afc9c259a4530fd8c9b6ce95da4cb4bc
2019-05-07 12:11:39 +08:00
groot 8e1415ba11 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 97a4429aed85095d23e6dd85e3329df38b47f3d6
2019-05-07 10:10:29 +08:00
groot 00ba6f4783 modify readme
Former-commit-id: f2fa8b895b16184a28ac338f8962b3e6907df953
2019-05-07 10:10:20 +08:00
Xu Peng 0fb7334220 test(db): enhancement for unit test
Former-commit-id: 2fdacaf3f80a70c3319d9dc7b2756f042b5b5106
2019-05-07 09:44:35 +08:00
jinhai 7c0d0179fb Merge branch 'jinhai' of http://192.168.1.105:6060/jinhai/vecwise_engine into jinhai
Former-commit-id: af885c2b110e3f4061c22e593fca973a87673bd5
2019-05-06 22:12:42 +08:00
jinhai 9bf75e809a Add static linking
Former-commit-id: 95e2ccc0112a0cff1f1520c7ec8caee07be442d6
2019-05-06 22:11:02 +08:00
groot e661ba82fe build error
Former-commit-id: 0764940092b64cca42918e542b9d8702cab1c55e
2019-05-06 22:01:28 +08:00
groot f17bac3272 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 8be4107f8aa5d1a6b556d2d249b202e85a7747b7
2019-05-06 21:14:48 +08:00
groot b51a88abfd build error
Former-commit-id: 927fdda8e7b2d7782c800cdff83b9966a26f25f2
2019-05-06 21:14:39 +08:00
Xu Peng b8949ca86f fix(env): fix compile error
Former-commit-id: 63a2957e3c226bdb08658d96738d30dc98a73619
2019-05-06 20:52:02 +08:00
groot 0ce9502a3e fix bug
Former-commit-id: daf197368b50cd764df893949abb5f2956c9c560
2019-05-06 11:24:36 +08:00
groot e472c605d2 modify readme
Former-commit-id: d5fe9fbbe444e2580714ad4fc741b61048dbe01c
2019-05-06 11:10:14 +08:00
groot a34d995195 modify readme
Former-commit-id: 2297c0decb034ceda163a996f6d24604875f6495
2019-05-06 10:47:55 +08:00
xj.lin 2ac87c1e47 1. support IDMap
2. fix some bug
3. background job from IDMap -> IVF


Former-commit-id: ba8f24f09c5481103ad3f4c1c91d4deb70f26dad
2019-05-06 10:24:07 +08:00
xj.lin 56bbe40faf 1. fix operand serialize bug
2. support gpu-build
3. add unittest


Former-commit-id: bb36dcb05220d8f0648f282c7e38fe20f4ab3c16
2019-05-06 09:53:59 +08:00
jinhai 675777d072 Add libzstd-dev to solve the linking error
Former-commit-id: 993f2b5e526a3d073820f80b8ce473842ab937b5
2019-05-05 20:42:33 +08:00
groot faa2c4b4b1 support empty id
Former-commit-id: 1a5303b58f3f3b0154f1609ff1acc0d00007c569
2019-05-05 20:13:34 +08:00
Xu Peng 496989bbe4 refactor(db): add more debug log
Former-commit-id: 7c196e05c60567216938115e081438beeecb0f47
2019-05-05 18:02:11 +08:00
Xu Peng d3cbc1ccad fix(db): db desctruction bug fix
Former-commit-id: e456a0d76c2b1401107d47600c34d4622ca8cd8a
2019-05-05 17:26:50 +08:00
Xu Peng 8a029c9b0d refactor(db): add copyright header
Former-commit-id: 45606fe09972ab741faa4ee8061ef7d307c20c49
2019-05-05 13:10:04 +08:00
Xu Peng 72f096bfca refactor(db): typedef ptr for memvectors
Former-commit-id: 92289614937b7803fc41bf5cb7d50f468192aaa4
2019-05-05 12:55:42 +08:00
Xu Peng c64e8c9621 refactor(db): typdef meta ptr
Former-commit-id: 1fcbd80c65a1ee2815a57127f04807ce7d9f23f3
2019-05-05 10:28:40 +08:00
Xu Peng f5b0ec50cf refactor(db): typedef engine ptr
Former-commit-id: 4629cac435fd484ab949ab112b639a4849e37fca
2019-05-05 10:21:26 +08:00
Xu Peng 85707aa3e9 refactor(db): impl template for engine type part 2
Former-commit-id: 8be264a9ecc7704f63a978fb862b95140a19e1c0
2019-05-05 09:38:37 +08:00
Xu Peng 166289cafa refactor(db): impl template for engine type
Former-commit-id: 2e9a6fa992f58dfe567f7c274b9327454cf3f89e
2019-04-30 21:02:13 +08:00
Xu Peng 0e37089c6a refactor(db): refactor all for crtp replacement
Former-commit-id: 3c5d3ddeec04d573ef3916f673a7504c51a0a3bf
2019-04-30 20:23:11 +08:00
Xu Peng 67960d5a55 refactor(db): dbimpl refactor for ee
Former-commit-id: 5c762120594c4ab76237cc9d713dde3f4a57931a
2019-04-30 20:16:54 +08:00
Xu Peng 8866d36252 refactor(db): refactor execution_engine
Former-commit-id: 90ddd165224135d190108f5d7bce544b5c0f305e
2019-04-30 20:14:38 +08:00
Xu Peng ca195424c5 refactor(db): refactor small part
Former-commit-id: 58fc916c28a94ccecd67c58d5cf3620c51fbe4c4
2019-04-30 18:44:00 +08:00
Xu Peng 62440022d9 refactor(db): remove dummy includes
Former-commit-id: 6cf84f4b81e93c4a02ec7467b14e0ebc9227585d
2019-04-30 18:34:32 +08:00
Xu Peng 94057d9d95 refactor(db): refactor search with execution engine
Former-commit-id: 1625a8aff9582e61e6bb687b4da40f7721610f91
2019-04-30 18:32:40 +08:00
Xu Peng 473d603a89 refactor(db): refactor build_index with execution engine
Former-commit-id: a37b3096ae6883f6633fd3c1f986ca0f45955a0b
2019-04-30 18:11:38 +08:00
Xu Peng 95adef2988 feat(db): add build_index api for ee
Former-commit-id: 75f268e4494d383f7a7b9e32c634a44f7beeba1c
2019-04-30 18:11:38 +08:00
Xu Peng 4cc5b8d523 refactor(db): replace faiss with execution engine
Former-commit-id: 7e7949541e39bc18f30c5aafa7968fdacf709719
2019-04-30 18:11:38 +08:00
groot a724141e73 use multithreads to do id mapping
Former-commit-id: 10b201d3801b146fa6335e4dfd20c877cfb2e948
2019-04-30 17:37:50 +08:00
groot b67c731b90 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 730d1e5d7acd6ff2250ea1a453c2d4127f081356
2019-04-30 17:00:05 +08:00
groot 2e76522151 refine code
Former-commit-id: f81a57c8340d7cfcea9db3d8219612f6108eeda6
2019-04-30 17:00:00 +08:00
Xu Peng 7f000e7979 refactor(db): rename
Former-commit-id: 60c982ed5e500d958182bbc0816731d9423b509a
2019-04-30 16:08:28 +08:00
Xu Peng 204c68879c refactor(db): replace faiss with serializer wrapper
Former-commit-id: 62b5a7d8353c2b0ef4017f43d03d1c6944685400
2019-04-30 16:08:28 +08:00
Xu Peng 713d1ec6b7 feat(db): add cache
Former-commit-id: 2dd8078d8df484ddac54379bc6c84c015c1fc530
2019-04-30 16:08:28 +08:00
Xu Peng 052f7e2f11 feat(db): add more api for serializer
Former-commit-id: d15d7dfecb9964ca2e3ba4e5b469137d1cc85057
2019-04-30 16:08:28 +08:00
Xu Peng cf19e90af3 feat(db): add serializer
Former-commit-id: ab412bbb430e7711ddee0ad26b34f7b3b6c43582
2019-04-30 16:08:28 +08:00
Xu Peng 39be106baa refactor(db): code optimization
Former-commit-id: 320733b50aba32e5bd99853933e7e1eafdbcdbcf
2019-04-30 16:08:28 +08:00
groot 83ed0fa4e6 fix typo
Former-commit-id: 5eb1054016ec8fe6dbf173f1e32c0d37330cd87f
2019-04-30 15:03:06 +08:00
groot 74eee9dc77 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 00d18f20fb408445831a00a5385a244c49786910
2019-04-30 14:47:46 +08:00
groot 905722bd0e add python sample
Former-commit-id: 2c0825ad6ed774eb5ad1999b1439f840dc602bf1
2019-04-30 14:47:36 +08:00
Xu Peng ce54690910 test(db): small change
Former-commit-id: 8cf0fe13bfd7715a491f00cc24e2efa37fd8decd
2019-04-30 14:17:24 +08:00
Xu Peng 3a05719e5a refactor(db): disable some print
Former-commit-id: 09fb8ca768ba06af3407df8d9ec307f259650eae
2019-04-30 14:17:24 +08:00
Xu Peng 9cb81455a1 refactor(db): change print for search
Former-commit-id: c1df662f54ba5132db8d4fbbbd9b1e9998a61e7a
2019-04-30 14:17:24 +08:00
groot ae5e672061 refine test code
Former-commit-id: 25266f1e3574d2ffa42ab8299cc8e5a4ac5b651a
2019-04-30 14:00:22 +08:00
groot dbf9de9a62 refine
Former-commit-id: 46e81a09c49f06c6b80bedfb90c2767bb54ec5f7
2019-04-30 11:44:58 +08:00
groot aa591114c4 time range search
Former-commit-id: 182c5c9db2d3aeaafc4d4878f060435c442b366c
2019-04-30 11:18:08 +08:00
Xu Peng 21a98c0e02 test(db): refactor db test
Former-commit-id: c85ed1e09b51f9c883426f7c77da3261232f0745
2019-04-29 20:22:24 +08:00
Xu Peng 61854a6c23 test(db): refactor SetUp
Former-commit-id: dfbb0f819705c0fca4b5e0a7fb37ce7bc52761d6
2019-04-29 19:05:48 +08:00
Xu Peng ed9dc51f27 test(db): samll change
Former-commit-id: 1bdf8515f7914a43e965334db36d253fea12abb7
2019-04-29 19:01:18 +08:00
Xu Peng 7680d5c731 feat(db): change default options values
Former-commit-id: 8c4aeb5206d7532ac524956e225779ce2e29766e
2019-04-29 18:56:40 +08:00
Xu Peng e78481f5e4 test(db): add meta files test
Former-commit-id: bd7b5371b11ddd769b178fe0e263b5759398e0d3
2019-04-29 18:10:30 +08:00
Xu Peng 0bbae88f3f fix(db): add to index files in files to search list
Former-commit-id: 8174f890208374835a7d0b0c310fdeb7f016bd32
2019-04-29 18:10:30 +08:00
Xu Peng f7853fcd20 test(db): add group file test
Former-commit-id: 8fa440c2be5f525388d45fca7e92244718e8c2fc
2019-04-29 18:10:30 +08:00
groot 363de87bdb gen python api
Former-commit-id: 1c9b4a1fea7c450b55e8d683085d8779460ea3c4
2019-04-29 17:58:08 +08:00
groot 231b216963 add namespace for thrift api
Former-commit-id: 92f9e0a0f7d2e301120573976984f99062b8f44e
2019-04-29 17:55:50 +08:00
groot e1efe942da fix test load config failure
Former-commit-id: 7781b6ff8a4c1d72dfe4f872a7765424af40286e
2019-04-29 16:34:43 +08:00
groot bd9c14a871 typo
Former-commit-id: 89e00f1b579a2f78737efcafc04507f0f31049b1
2019-04-29 16:20:21 +08:00
groot 16df78caee add attribute for vector
Former-commit-id: e520d4e7aaceb1fedae62cc67326a550666efc6b
2019-04-29 16:14:21 +08:00
groot fe5909a597 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 69eee8018a8a7d7478181c11fef7ef4206ee0784
2019-04-29 16:12:40 +08:00
groot 592dde4dd7 add attribute for vector
Former-commit-id: c2a1a5cd917abe1cf3e8ef327bba5c2ed1cf8008
2019-04-29 16:12:35 +08:00
Xu Peng c26629756a test(db): impl more group test
Former-commit-id: 5de1604a22951a2e96253f994d6af95ccd8bf019
2019-04-29 15:56:07 +08:00
Xu Peng 9ff65dc76c test(db): group test more
Former-commit-id: 31949c0387e3400c63d7387664dc8e142ce1ce17
2019-04-29 15:50:52 +08:00
Xu Peng 4b18d9fec1 test(db): add more meta test
Former-commit-id: b8078e972d1c08b38cd6ff272ec2cd6ab1d895b2
2019-04-29 15:47:09 +08:00
Xu Peng 4a66580f4f test(db): add meta test
Former-commit-id: 9668abe43a31a04c58311c12834fe5b89da23c07
2019-04-29 15:29:28 +08:00
Xu Peng f096e0a109 feat(db): add meta impl factory
Former-commit-id: e9af01dea914b32192efe1c534e174810be5a02a
2019-04-29 15:06:35 +08:00
Xu Peng c1d40bfb3d feat(db): add db factories
Former-commit-id: df8ec1140cc82755e14a739cbb22fb035b3c7d18
2019-04-29 14:06:40 +08:00
Xu Peng 3dfdfef07a test(db): add utils in db test
Former-commit-id: 0e65a0a885cc3ead0fb233bd041bb4f8b8645898
2019-04-29 13:17:19 +08:00
groot cdda6e5769 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: b50f73905441637b4751f55509b74b82cf3329ad
2019-04-29 12:46:01 +08:00
groot bdef129e3a fix unitest load config error
Former-commit-id: e1ff282a7eb4c81ee76efe43751f9d7329e8ddf3
2019-04-29 12:45:53 +08:00
Xu Peng 096c4639b7 refactor(db): remove dummy includes
Former-commit-id: b25398a114a59e79b0e20fca60843aecdbec51b5
2019-04-29 12:38:27 +08:00
groot b8148d8e13 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: bd511cfab2d3813dee05c34dcf068622da2fef94
2019-04-29 12:31:56 +08:00
groot 1aefac8ae0 fix unitest load config error
Former-commit-id: 8bf7417881a421bf5c28a31474743484e8fea155
2019-04-29 12:31:48 +08:00
Xu Peng 5d5bbe842d feat(db): add dates filter for search
Former-commit-id: 04ba53b11c8bb7fbd90877d1be6e82bb80e2247c
2019-04-29 12:05:03 +08:00
groot 688a9992be fix make error
Former-commit-id: 7a5d078a48a92b0595e67bf8fe9891a075044bf4
2019-04-29 12:04:56 +08:00
groot 4cbdb58718 redefine thrift api
Former-commit-id: ed64f6205c2723111f3bc2771836a265b2474817
2019-04-29 11:09:57 +08:00
groot 487ea03461 redefine thrift api
Former-commit-id: 0dc225d0372e6e2260126a301552a37d161ccec8
2019-04-29 11:01:01 +08:00
Xu Peng 2ff4cae2cf test(db): change test
Former-commit-id: e1922a567069b4c058acad186b8186b4cbbe0f4a
2019-04-28 21:01:30 +08:00
Xu Peng 5569f22de2 fix(db): no transaction for update_group_file
Former-commit-id: 22b364f8f07cd009391952ba66478879f6b86b6d
2019-04-28 21:01:30 +08:00
groot d6dc77ced2 fix cmake warning
Former-commit-id: a3c4cb47f43d54e44f8a6b7f887e61f2182d998a
2019-04-28 20:51:21 +08:00
groot 2005f2c1c8 refine test code
Former-commit-id: c44c49b22ad20188bcc2ac339cbb659e29ac661b
2019-04-28 19:28:05 +08:00
Xu Peng 57dfdae3e3 feat(db): fix bug and add exception catch in meta operation
Former-commit-id: 6d33945997e7a528bc729efdad6076d6532f79b3
2019-04-28 18:44:25 +08:00
Xu Peng 486c175b4e feat(db): add serialization mutex
Former-commit-id: f8a3b14c0209a9e36b0510ce48754deefc4ee442
2019-04-28 18:44:25 +08:00
Xu Peng f7cd398c3b test(db): change test case
Former-commit-id: 4d371cf9f3cb591eafff64373aaaabaabd90118c
2019-04-28 18:44:25 +08:00
Xu Peng 32b64ab724 feat(db): add more print
Former-commit-id: 42486eb1e1c804e7b5120dc1f0dd12d2f7bd6a96
2019-04-28 18:44:25 +08:00
Xu Peng 8c01725ff7 test(db): add more friendly timing print for test
Former-commit-id: 2a87319062a6f753881efd898517ac67fd4d3216
2019-04-28 18:44:25 +08:00
groot 66565bd74d refine test code
Former-commit-id: 9b8ccd59cff07cc22a23e156b01beba4ca637c08
2019-04-28 16:53:48 +08:00
groot f773ac9a20 refine test code
Former-commit-id: d137fe1c53e2e05950361f2f376aea1f33a0a228
2019-04-28 16:10:37 +08:00
groot 149c245958 add rocksdb option
Former-commit-id: cebc9569d8dca44c360ac68510427f1447105ddc
2019-04-28 14:48:05 +08:00
groot 0108db9840 add log
Former-commit-id: 0bf2f53f1d9b5c89cceaf6a2e4b11257683d4645
2019-04-28 14:20:29 +08:00
groot 8e23d2eb66 change test_client to unittest
Former-commit-id: 8efbb1314e6cebd5c36643cca0d31668a8be639d
2019-04-28 12:42:04 +08:00
groot 95f3900910 add new api for batch binary search
Former-commit-id: c035ac8fcfe672576c6207fca149c3d4030e7b53
2019-04-28 12:07:59 +08:00
groot 13d7ebb5cf add new api for batch binary search
Former-commit-id: 3729408c50d0ab9a482e3ddea8e1672188a9acd8
2019-04-28 12:07:15 +08:00
groot 167ae9c22c add new api for binary vector
Former-commit-id: e450d463c9bb6473f6da93602bdf306dd48c65f7
2019-04-28 10:43:49 +08:00
groot a5682c301f add new api for binary vector
Former-commit-id: 0c37b1fa7ab1a3da301da0371ae275f0a118931f
2019-04-26 20:57:06 +08:00
groot 9f35b62289 fix cache manager bug
Former-commit-id: d1b7f43865f6e0a059081531e1549a975c86d4aa
2019-04-26 19:45:26 +08:00
groot 541e0d610e Merge branch 'new_orm' into jinhai
Former-commit-id: 3cc778a3f03cd9d71f91e0bb8b12f16f0aea7fbc
2019-04-26 18:35:22 +08:00
Xu Peng 7e00f351e1 test(db): change log format for unittest
Former-commit-id: a364d3800fbefbd9287df906b5e69f4ec89d1aa7
2019-04-26 17:59:51 +08:00
Xu Peng 5fbe3d9641 feat(db): remove limit for id generator
Former-commit-id: a110cfa01b6207cd76fd1ee000945c04c48b0d88
2019-04-26 17:59:14 +08:00
Xu Peng 062c3aad91 feat(db): merge file optimize
Former-commit-id: fea0d7970fab88f995d9d16d7dfea84dd4fbacb7
2019-04-26 17:18:27 +08:00
groot 52234126de fix test bug
Former-commit-id: 1a16c14bf6ce3faf71c4b912c554dab223b86f62
2019-04-26 17:01:46 +08:00
Xu Peng 1d9946ff87 feat(db): change sqlite_orm header dependency
Former-commit-id: d682b364b1b27a2af27f0246460bb9bbb6370fd0
2019-04-26 15:37:54 +08:00
groot a21ad0b743 fix task bug
Former-commit-id: f5debab3ff1c4000596f4cf625f37ba83ec54296
2019-04-26 15:37:10 +08:00
groot 75410aed03 refine scheduler
Former-commit-id: 9b772adf62a9f7f2ae349f3a2420fcecb08af6ce
2019-04-25 16:41:01 +08:00
yhmo 87d0ed293e Merge branch 'scheduler' into 'jinhai'
Scheduler

See merge request jinhai/vecwise_engine!16

Former-commit-id: 1adc4d5f745ac461680ce6f7d7bb14d8044ef87a
2019-04-25 12:18:41 +08:00
groot b03aafdc41 implement scheduler
Former-commit-id: 1be5a738138a626ddb4a7412e798c74debbc4c3a
2019-04-25 12:17:56 +08:00
groot 11cb43ac2e add scheduler
Former-commit-id: aead7396cc627fc680408188d3182fd098b5271d
2019-04-25 09:38:27 +08:00
Xu Peng b9af8670db test(db): update test
Former-commit-id: f3bf72ecd3c482d9a270342009f13be5263f89ca
2019-04-24 20:12:26 +08:00
groot 4864a960b2 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 32f8a5ce257cf776000a93e865bdb7a41f8e31e8
2019-04-24 19:23:45 +08:00
groot 7d2b94f4ae print cache info
Former-commit-id: 056e15ab3715f03b89648c84d5ea6498708971c1
2019-04-24 19:23:37 +08:00
xj.lin ce7bc10f8c fix search
Former-commit-id: 14a6408d66811f1d1a1d5bb1cbbddbecb5dd4d51
2019-04-24 18:19:29 +08:00
groot 3815528396 modify thrift api
Former-commit-id: 9516c969a09e06c073e02b1186503776df2f370a
2019-04-24 17:34:21 +08:00
Xu Peng d402dd9dce fix(db): code fix
Former-commit-id: fbb9040ada2c355dad1e13526f8f16c36e155716
2019-04-24 16:25:50 +08:00
Xu Peng a6369c7a4e feat(db): cache for search
Former-commit-id: 8e13efdaa593b4ebb83b06d33d5127180d756597
2019-04-24 16:20:36 +08:00
Xu Peng 4e59f966c3 feat(db): cache for mem merge
Former-commit-id: bff342710683954dcd4b72b890fff483708ceba0
2019-04-24 16:04:14 +08:00
Xu Peng 22281e8ea5 feat(db): cache for mem serialization
Former-commit-id: 9d3211b9c4bfa6132cd52822e19c1ae5d287d9a2
2019-04-24 15:47:34 +08:00
Xu Peng 7150d3c5aa feat(db): cache for index
Former-commit-id: e33cb100824e8714e539bec4f6622753001a9606
2019-04-24 15:42:08 +08:00
Xu Peng 1fa42f9d61 feat(db): add data api for wrapper
Former-commit-id: baabe91cc364d832e17016c554d66e29e400dfd4
2019-04-24 15:29:45 +08:00
Xu Peng 2e8d45aad3 feat(db): cache merged file
Former-commit-id: d236a8dbfcb01d07b6b544aa98a7e1dd179fc477
2019-04-24 15:16:38 +08:00
groot d6044cfc32 fix build error
Former-commit-id: d06ecbf29ddd4b70bfd056341c6537c66f9dbb55
2019-04-24 15:16:32 +08:00
groot 8185c9fb27 rewrite cache code
Former-commit-id: d4a2336ade2a39d34380dba715290992dcdabc84
2019-04-24 13:57:22 +08:00
groot 41cb7fa0ec Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 3446551c5ae37cb4e54349d98227d5105abcb54e
2019-04-24 12:10:42 +08:00
groot 01c5b43130 rewrite cache code
Former-commit-id: 7dc429b553891f98baa0cef21bee58c545ab9748
2019-04-24 12:10:37 +08:00
Xu Peng 918c113727 fix(db): fix memory leak
Former-commit-id: 1c5b7e0ab18f9508aa5aeecfc7caecf5ac74fd45
2019-04-24 11:53:26 +08:00
groot 97d4738bc6 rewrite cache code
Former-commit-id: 00247bcda3df3d0e29bc4a809f7894ce92470e0e
2019-04-24 11:52:13 +08:00