Commit Graph

698 Commits (9b1128c24a82cb0582337ded94d74f980889cfb9)

Author SHA1 Message Date
groot de1d9fb655 fix some bugs
Former-commit-id: 297b63106e0ed450d92017ca0b079798a43909c5
2019-05-29 11:22:12 +08:00
groot 61fb59d23b merge from remote source
Former-commit-id: fc7be69bc0d039576469f0adb81e027a8f00272c
2019-05-29 09:15:12 +08:00
groot ab90dff7b4 implement sdk interface part2 change log
Former-commit-id: 41f1487f14d2c5e93700b0e521dfcf3410f3802d
2019-05-28 18:46:30 +08:00
yu yunfeng 4116f710f5 merge branch from Xu and add metrics
Former-commit-id: a5d3e97dbd87c6478ece637046a2d9545fbc973f
2019-05-28 18:46:07 +08:00
groot 5c79f1883c implement sdk interface part2
Former-commit-id: e0f031025133d35456f685dfb2f4d3768ee99a56
2019-05-28 18:43:08 +08:00
yu yunfeng 80db8aaf20 Fix compile error
Former-commit-id: 07f4dd06011ef519e29744dcd5b8ac9e407b2505
2019-05-28 17:50:20 +08:00
yu yunfeng 4d8385790a add feature
Former-commit-id: 3534c79716d1dbf9ba12d47c4de75fe19667aae4
2019-05-28 15:39:26 +08:00
yu yunfeng 815bf5550f add metrics_unitest
Former-commit-id: 783161b2f8a70b24b605f2040f9381f4aa0fff07
2019-05-28 15:33:42 +08:00
yu yunfeng a95b29aa27 add metrics without prometheus
Former-commit-id: e158ea586681abb5ec44bdc9025ec27e3aa21567
2019-05-28 15:06:17 +08:00
Xu Peng 13ef8219aa refactor(db): update change log
Former-commit-id: 95c0f52c4f6b1b6723e72e71baed6bc640b7935f
2019-05-28 14:03:09 +08:00
Xu Peng 120a52c184 refactor(db): replace typedef with using
Former-commit-id: 62caeac6fb8a05cabe0622abe73d7b5b548f8472
2019-05-28 14:01:54 +08:00
Xu Peng 9b5791b434 refactor(db): small change
Former-commit-id: 057c7a7b4b9189895d7aac3e253387fe91daee0e
2019-05-28 13:59:16 +08:00
Xu Peng c5501202ad refactor(db): whole db api refactor
Former-commit-id: 3519e8a464bcd66b6da8ef2c579c08eaf13d17bd
2019-05-28 13:49:59 +08:00
yu yunfeng 7839bada77 fix conflict
Former-commit-id: 6d3d137cac5d1b8f826cecaeddbd77ad8a635ce2
2019-05-28 13:48:37 +08:00
yu yunfeng 1521d0aeb3 delete prometheus-cpp
Former-commit-id: d95914cebe38d7f5446cffe28e0d26d0cb82097a
2019-05-28 13:36:14 +08:00
yu yunfeng 1563f81ac2 add metrics
Former-commit-id: 3e811d555cf69eb2c8f515ada44c8df43e460de0
2019-05-28 13:34:47 +08:00
Xu Peng 130b710169 refactor(db): MS-20
Former-commit-id: f34dd2746073c837fa877697e32f1ce3607e35c2
2019-05-28 11:04:37 +08:00
Xu Peng c8bcf53d81 refactor(db): refactor for db impl
Former-commit-id: f7488d5189ed1c34d9b3e8e3da4eaa71766f9c11
2019-05-28 11:04:37 +08:00
Xu Peng 541692c227 refactor(db): include file seq and cpp->inl
Former-commit-id: 970bb6ef009b1806a4f60f6d1f5d62e0aeb1ca5e
2019-05-28 11:04:37 +08:00
Xu Peng 73ffe9f796 refactor(db): include files seq
Former-commit-id: 1236730a49eb3ab3611e001aee95a6a28173f4ca
2019-05-28 11:04:37 +08:00
Xu Peng ce329b4304 refactor(db): Env.cpp Env.h
Former-commit-id: 5d774124457d4136dc8c0e4469ac6950c424de09
2019-05-28 11:04:37 +08:00
Xu Peng fbeddc2ad5 refactor(db): refactor for execution engine
Former-commit-id: 5bf686bae2669ecfe6c4ba722a001c6303bb2f43
2019-05-28 11:04:37 +08:00
Xu Peng 2eff64def1 refactor(db): refactor for DBMetaImpl
Former-commit-id: 9ced33145335090265c53344b4ff46a977eec356
2019-05-28 11:04:37 +08:00
Xu Peng ca33fbbe14 refactor(db): DropAll -Count CleanUp CleanUpFilesWithTTL
Former-commit-id: b718bb89945651de19a1263eaf64eab22d11eb6c
2019-05-28 11:04:37 +08:00
Xu Peng 874eeb8f7a refactor(db): FilesToIndex
Former-commit-id: fe5bd8ca372d0a4d5bf257f3f10853179d2356ce
2019-05-28 11:04:37 +08:00
Xu Peng 7fe5346f14 refactor(db): Archive
Former-commit-id: 21f153c1a57ad4bb706f6b177a10d45faf88ed99
2019-05-28 11:04:37 +08:00
Xu Peng de8811ae9a refactor(db): Size
Former-commit-id: 9dc93505e1378a1e8b14750158c2f8b9b2f840ca
2019-05-28 11:04:37 +08:00
Xu Peng 2789234931 refactor(db): FilesToMerge
Former-commit-id: 9101dcd75943bc241094af92156805090bf8e408
2019-05-28 11:04:37 +08:00
Xu Peng 09fdd0f849 refactor(db): FilesToSearch
Former-commit-id: dcb7f972ee13a0916129dfec5b05dad66025dfbf
2019-05-28 11:04:37 +08:00
Xu Peng edf33115e4 refactor(db): UpdateTableFiles
Former-commit-id: 749cfe1d229a7f2edadd3cd913b96e0087be9cc5
2019-05-28 11:04:37 +08:00
Xu Peng ec4e83db3f refactor(db): UpdateTableFile
Former-commit-id: e5b29fa1396d5a06c26a4917e15fed0082bbc7ae
2019-05-28 11:04:37 +08:00
Xu Peng 3852b830b0 refactor(db): delete get_group_files
Former-commit-id: 0503a8a92ab9687912c516390af1c8fe0e4cd96a
2019-05-28 11:04:37 +08:00
Xu Peng ba8929e9a4 refactor(db): GetTableFile
Former-commit-id: 9b5f8d3a6c3202acc5b16f9b75f4ebe9cb2c6c50
2019-05-28 11:04:37 +08:00
Xu Peng 59fa814af4 refactor(db): delete has_group_file
Former-commit-id: 821b2784c727d30375b7ce5c2bf3e9e9aef16fd8
2019-05-28 11:04:37 +08:00
Xu Peng fbe1278a3a refactor(db): DropPartitionsByDates
Former-commit-id: 2534fa34f690ba60788e3619b6a87a9a7ed8650e
2019-05-28 11:04:37 +08:00
Xu Peng 01e4e605e2 refactor(db): CreateTableFile
Former-commit-id: c29b8ccc97cc327ec9c278f2ea5456369365c4f3
2019-05-28 11:04:37 +08:00
Xu Peng 9d4591612d refactor(db): delete local meta impl and refactor HasTable
Former-commit-id: 4849b994d40cf433797892eb37ceeac46fc65d3d
2019-05-28 11:04:37 +08:00
Xu Peng 624e34f10d refactor(db): refactor DescribeTable
Former-commit-id: 021d731f3be6f338423caabef59bdd4c46ed02d8
2019-05-28 11:04:37 +08:00
Xu Peng 3d330e0aa4 refactor(db): change group_info to table_schema and add_group to CreateTable
Former-commit-id: e8d48ec8e54429bf5d1080997ca329b42ddcab82
2019-05-28 11:04:37 +08:00
Xu Peng f2bb20c90d refactor(db): change group_id to table_id
Former-commit-id: bf0cec2552fcad95bf1b77cdfbdd423984e6f18f
2019-05-28 11:04:37 +08:00
Xu Peng 209d0e4806 refactor(db): change groupfilesschema to table*
Former-commit-id: e786234155eecb9d22ad2b6a8b2c9357675e5de4
2019-05-28 11:03:45 +08:00
Xu Peng e94499cdff refactor(db): change groupschema and groupfileschema to table*
Former-commit-id: fbc69151149faa8ed32547bcdd1a9935dac34070
2019-05-28 11:03:45 +08:00
Xu Peng aa60c62870 refactor(db): remove dummy struct
Former-commit-id: a90c3f127fb84a879956a8383af9def829504208
2019-05-28 11:00:10 +08:00
yu yunfeng 8510104066 fix conflict
Former-commit-id: cffe275e0430a89b99c17574766dff7c972d810d
2019-05-28 10:02:20 +08:00
groot 22e2a2bc3f throw exception for invalid index type
Former-commit-id: b028167c2460be4738af5f092a443749dba89bc0
2019-05-28 09:59:06 +08:00
groot fe5b511596 add search example
Former-commit-id: f38cc87551001449c5930fb719ba038b45af47df
2019-05-27 20:34:20 +08:00
groot 15503d334a Merge remote-tracking branch 'source/branch-1.2' into branch-1.2
Former-commit-id: 772b757f2d486822a261b5f250d7daad3887e806
2019-05-27 19:59:31 +08:00
groot 4b244f9d45 redefine thrift api
Former-commit-id: 8d7d1c47202341521cf06a567e8f7cf3cfc55074
2019-05-27 19:57:09 +08:00
yu yunfeng 1392e0d5c7 c
Former-commit-id: 420c70f051d7cbd2f9a0a5c4d8181ba11bb93f27
2019-05-27 16:31:20 +08:00
yu yunfeng 0df4068cc3 add metrics
Former-commit-id: 357b4f65b49d91c85a83d00513dfea830372341f
2019-05-27 15:59:16 +08:00
Xu Peng c5b931d59e test(db): fix test error after impl exception
Former-commit-id: 71184ffe49ac0130d2002aef4f8f55c825414d0c
2019-05-27 14:59:00 +08:00
Xu Peng 9dcc68b814 feat(db): add exception
Former-commit-id: b2a9deb7df0544a303858fff7f4d6eddf3e6b1f7
2019-05-27 14:58:38 +08:00
Xu Peng d744ef4a33 fix(db): replace locatime with locatime_r for thread safe concern
Former-commit-id: 1b857e297c3b26e2730f86c67e8dc798755493fe
2019-05-27 10:35:41 +08:00
Xu Peng 37fc30e439 env(all): update change log
Former-commit-id: e9124716de75572eab1e027809b2b90a25ae127f
2019-05-26 19:35:30 +08:00
Xu Peng 7337cef31c Merge branch 'release-v1.1' into impl_simple_delete
Former-commit-id: 10d74a865946328366a49fb389d0038858064e83
2019-05-26 17:37:52 +08:00
Xu Peng 1c6a012b46 Merge branch 'branch-1.2' of http://192.168.1.105:6060/megasearch/vecwise_engine into release-v1.1
Former-commit-id: 56c25fba480cf53fed8e03f820a597dfd8138436
2019-05-26 17:34:32 +08:00
Xu Peng 74e6ef4a9c test(db): fix for ARHIVE_DISK_CHECK
Former-commit-id: 1a82a410db91e2b6f9ddc38bafc491a1204c0dd1
2019-05-26 16:51:30 +08:00
Xu Peng ff3a89b997 feat(db): archive after every serliazation
Former-commit-id: bf5191dc707e7336d64534110aa49a2d36da1a1e
2019-05-26 16:50:56 +08:00
jinhai ec579df59c MS-3 Add SDK interface
Former-commit-id: 351fb4356e4318efc85dd7ba9b32873a71faf910
2019-05-26 15:59:05 +08:00
Xu Peng 3958fe5a35 refactor(db): add NextFileId
Former-commit-id: 51a1f75881a8a1f85e3fdc8ac7217218976cc11c
2019-05-26 15:17:46 +08:00
jinhai ad8ef08bf9 MS-4 Refactor the vecwise_engine code structure
Former-commit-id: acade700d7956ad8c4c5ecaaecf23997b0ca5161
2019-05-26 14:48:13 +08:00
jinhai d8bb0ac9af MS-4 Refactor the code structure
Former-commit-id: 369b9f28d1391765b4d4dada2140b261132a0e55
2019-05-26 14:46:38 +08:00
jinhai 8d3ad6aeae MS-4 Refactor the code structure
Former-commit-id: ab2c7af5968b367ca27bac2d991b0dae5ad2dc75
2019-05-26 14:46:38 +08:00
groot cb585e74f0 prepare for gpu index
Former-commit-id: 92a3a851a63c72f98cecd1d0634d1f60c4d810b3
2019-05-26 14:46:38 +08:00
groot 757286e1ba prepare for gpu index
Former-commit-id: ea47029addad06a023919f08a679956de69397f6
2019-05-26 14:46:38 +08:00
groot bf8e7545e1 avoid potential multi-threads risk
Former-commit-id: 6e54134e4249003ce651eaf8ec2642d8898d34f0
2019-05-26 14:46:38 +08:00
groot 224fae759c fix id miss bug
Former-commit-id: 53581de275e862ca9574014a6bd025918077dc59
2019-05-26 14:46:38 +08:00
jinhai 9941416b82 Update license check
Former-commit-id: 1579a302a09ad0c07ceb4b8293a884ad60eab993
2019-05-26 14:46:38 +08:00
groot 65583daaed avoid add vector to invalid group
Former-commit-id: f5d04e510b5d743488be82f492aad2b95929d9e1
2019-05-26 14:46:38 +08:00
Xu Peng 2d08fc415f refactor(db): add NextGroupId in DBMetaImpl
Former-commit-id: 56deb4603db20ac4ef677f1851a1e76e703a234f
2019-05-26 13:24:02 +08:00
Xu Peng 425e4b4b01 feat(db): move tables under tables directories to avoid name conflict with reserved meta files
Former-commit-id: de11db98c00ee071c8578a41c2e9ff673509fe63
2019-05-26 13:11:48 +08:00
Xu Peng 92da0fa4ca refactor(db): for schema changes
Former-commit-id: 3d1aa65da396177ff49e1922ae032cec834f7850
2019-05-26 13:02:22 +08:00
Xu Peng 495c8d4dd6 refactor(db): change rows to size in group file schema
Former-commit-id: 4386308bcfa1bd7136809c7e749e140b53517ca7
2019-05-26 13:02:02 +08:00
Xu Peng e09240e45f test(db): refactor with meta consts
Former-commit-id: a611af0886bdeb51b4a38da2e80b84a4fd13d0cc
2019-05-26 12:26:23 +08:00
Xu Peng b96459cc8b refactor(db): add MetaConsts
Former-commit-id: 5db9dfba91c61274a8334e8daba1488fe5bead3e
2019-05-26 12:26:06 +08:00
Xu Peng 767e63bd00 refactor(db): add MetaTypes.h
Former-commit-id: 2e6e61b9cf0db9728365c904fc2f491962ea5319
2019-05-26 11:51:09 +08:00
Xu Peng f9889598d7 test(db): check size
Former-commit-id: 115707db134408a52f14e95d25c5d434c05d1c9f
2019-05-26 11:27:31 +08:00
Xu Peng b2f079ed67 fix(db): fix size api for db meta
Former-commit-id: 88add7eef97827063e8e87f0d84aec62e66f7ca6
2019-05-26 11:27:31 +08:00
Xu Peng 3f28d33b6e test(db): add test for overall archive
Former-commit-id: 34b7aa89adc45c2505619b902e7701ce7df4e91a
2019-05-26 11:27:31 +08:00
Xu Peng c30a6d4130 feat(db): add size api for db
Former-commit-id: 2fa9614c86fab66267689a06f73c0bef15dcffe8
2019-05-26 11:27:31 +08:00
Xu Peng e15c445fb5 feat(db): add size api for meta
Former-commit-id: 0b240dbf664348f65a70e57a5d545857469ad37b
2019-05-26 11:27:31 +08:00
Xu Peng 0a7f334697 feat(db): add archive post merge and build index
Former-commit-id: 32678939225459bbfb82d491c53b912633fdb395
2019-05-26 11:27:31 +08:00
Xu Peng 3a658e7c56 refactor(db): add some debug print for newly added archive
Former-commit-id: 92b1220200bcbe82cfbf427f5a14d9fe800ec8b5
2019-05-26 11:27:31 +08:00
Xu Peng 80860535a7 test(db): add test for archive days
Former-commit-id: 10dcbdf0d3f32fd90904150c294cbe87a0ebfa7b
2019-05-26 11:27:31 +08:00
Xu Peng cd2afcb2a4 refactor(db): remove dummy print
Former-commit-id: ffc431eeb98d3a4a52708954e2a1e240ad713ebc
2019-05-26 11:27:31 +08:00
Xu Peng 7565a53290 fix(db): update schema and unsigned long type handling
Former-commit-id: 03f17b0f071817350b4137ed31abfb1d5b7066be
2019-05-26 11:27:31 +08:00
Xu Peng 3b83dbf672 refactor(db): add utils
Former-commit-id: 48c9f7818c0260e3191a381879c3e83e0ad7ec9a
2019-05-26 11:27:31 +08:00
Xu Peng 4c44b02b5e test(db): add archive test
Former-commit-id: 7fc4969944759203524c0dbac8fc4421fd528f28
2019-05-26 11:27:31 +08:00
Xu Peng c757be1cb6 fix(db): change type from into to size_t
Former-commit-id: 97f571c02189eb7cf3ade68f1d26aea2e2ce5f1c
2019-05-26 11:27:31 +08:00
Xu Peng a073cf35d6 feat(db): add archive files in meta part 2
Former-commit-id: 76ce47cc2f152d569251b084030c3b747a8f50ff
2019-05-26 11:27:31 +08:00
Xu Peng 73d91135d1 feat(db): add archive files in meta
Former-commit-id: 64a1e267815cc9fb9ccd1b41b6ef8a1f082e3b20
2019-05-26 11:27:31 +08:00
Xu Peng 73fb498ff7 feat(db): add Archive conf in options
Former-commit-id: caa950e7119264fd911f21cd10b4fbb2db896b7d
2019-05-26 11:27:31 +08:00
Xu Peng a7c22f8e53 test(db): test delete group partitions
Former-commit-id: af392c6bf9440a5d29ee152e4d4129153b499f94
2019-05-26 11:27:31 +08:00
Xu Peng 4e1736f3ab feat(db): add get group file api
Former-commit-id: 1c8ed181f4a38203300d48bbca0ed11b7a0185be
2019-05-26 11:27:31 +08:00
Xu Peng 315e532792 fix(db): get group bug fix
Former-commit-id: 0a7cc7e3791bf02ea899a3cafdc5698e52334027
2019-05-26 11:27:31 +08:00
Xu Peng 4eea03af5c feat(db): add simple delete partitions
Former-commit-id: ed39bb26d68f4ea576e824c081e72bfb17d15b8a
2019-05-26 11:27:31 +08:00
groot 9c95423231 prepare for gpu index
Former-commit-id: 764288e406f3a03822bca5e79b8d0ba9a3f4e13e
2019-05-23 11:01:11 +08:00
groot 0c699ac84b prepare for gpu index
Former-commit-id: 048b5c0f4ae84a1afcb57d43c7763c7617d64d26
2019-05-23 10:46:20 +08:00
groot 5f4e16f3d7 avoid potential multi-threads risk
Former-commit-id: c99078422d17cc33ebb4c74e5e85ca0f4203a4b1
2019-05-19 10:59:35 +08:00
jinhai bef742c0a9 Merge branch 'jinhai' of http://192.168.1.105:6060/jinhai/vecwise_engine into jinhai
Former-commit-id: 662de1631e4fe01c940b471f98fce654c52c0495
2019-05-17 20:18:24 +08:00
jinhai 2c42210e8c MS-1 Add Change log
Former-commit-id: 681054dc191d1f4cbdebf215c3fd0905aeb53e94
2019-05-17 20:17:51 +08:00
jinhai af77eb7f89 MS-1 Add Change log
Former-commit-id: 5ab75cc621527fd2e095748728dcfe9731673fd4
2019-05-17 20:16:18 +08:00
yhmo c19b49abc4 Merge branch 'id_bug' into 'release-v1.1'
fix id miss bug

See merge request megasearch/vecwise_engine!27

Former-commit-id: 5505393398813c49a428511d378da6af2f703c1a
2019-05-17 17:50:18 +08:00
groot 833f52c7a1 fix id miss bug
Former-commit-id: ad0d56ad7e1faef38e31c773fcc8fd3f7c1fe664
2019-05-17 17:33:28 +08:00
Xu Peng c04a7c0e78 fix(db): fix create directory bug in release
Former-commit-id: e060ff269f66c02c69978e0a7c77afae59528eb4
2019-05-16 11:24:21 +08:00
Xu Peng 4380016d4a fix(db): fix create directory bug in release
Former-commit-id: 511730da61c4afac4b09e38aafaf77ea9617b822
2019-05-16 11:20:10 +08:00
jinhai 0d0c10df11 Update license check
Former-commit-id: ab88deb5aaeadda3626106a3a4cf3600131f528e
2019-05-15 20:22:04 +08:00
groot c078cc8516 avoid add vector to invalid group
Former-commit-id: 3df82dd670ada8f24b3fb3a2411337e953b7c1b5
2019-05-15 19:57:31 +08:00
jinhai c7f4708fe7 Update README.md and conf
Former-commit-id: 014cd72b6c70e8924758236798ad4d0c12fa099e
2019-05-15 17:28:02 +08:00
groot 7cfd01a2ba build test_client
Former-commit-id: d10961136389a1218dbea8e77a72d5b1b884d2d7
2019-05-15 17:09:43 +08:00
yhmo 011be04411 Merge branch 'jinhai' into 'release-v1'
# Conflicts:
#   cpp/src/utils/Error.h

Former-commit-id: 18470ad3970bec55315d738a006355c1ce2c1f4c
2019-05-15 16:40:00 +08:00
yangwei.yao 74d5802ba4 unit test
Former-commit-id: 3806f1d475b2dd1259fe48a013f01389f8975e5c
2019-05-15 15:01:07 +08:00
yangwei.yao 35eeae6f08 license check is vaild
Former-commit-id: 7381ad310d5b554c99f1f19f7fc460b33c36659f
2019-05-15 15:01:07 +08:00
Xu Peng a6853a5726 fix(db): fix cache error after load file from disk part 2
Former-commit-id: e684913260dee0f4e5c39729f12e29925c1fb118
2019-05-15 13:21:58 +08:00
Xu Peng 59544b0341 fix(db): fix cache error after load file from disk
Former-commit-id: 23dd81d168caa49451634ef7a97c6fa618c92957
2019-05-15 11:47:21 +08:00
yangwei.yao 384b9b8af2 1
Former-commit-id: 3642cd8f4089038eade6857854d1d1b42c5eceb8
2019-05-15 11:26:56 +08:00
jinhai 7c512bf752 Update on license check
Former-commit-id: ef039b5663e0a68c1dfdea7244de4d2e7e16c10e
2019-05-15 11:26:56 +08:00
yangwei.yao 128bc2b420 Refactor
Former-commit-id: 5c57d9054cae1e468a5795b928ecab4d18c1d4af
2019-05-15 11:26:56 +08:00
jinhai 06dd990b18 Refactor code
Former-commit-id: 31caf05ec1b75d9cd1de476104cdc0abf62acedd
2019-05-15 11:26:56 +08:00
yangwei.yao 5eb854b1b6 license_run
Former-commit-id: dbfbeafc516f45c89cf2b693f40ac19abf903df3
2019-05-15 11:24:37 +08:00
yangwei.yao c7ba2112bb 05.11
Former-commit-id: 22e7d5214db47ac228d50989b01e3a5e71a719d4
2019-05-15 11:24:37 +08:00
groot d918a22c33 Merge branch 'release-v1' of 192.168.1.105:jinhai/vecwise_engine into release-v1
Former-commit-id: 48c50673ea7e468d7ec4d9f5c2bc6b92bb4da5d7
2019-05-14 15:29:46 +08:00
groot d14b718862 change api namespace
Former-commit-id: ad513035c3db217c61e0eddcfaa633237564311c
2019-05-14 15:29:37 +08:00
xj.lin 077c36eecb Merge branch 'release-v1' of 192.168.1.105:jinhai/vecwise_engine into release-v1
Former-commit-id: ec5221f0b08674678633ec4415b48399bb52b820
2019-05-14 14:11:09 +08:00
groot cc2edace95 add test infomation
Former-commit-id: a5ac7a483a0f21182069dd2727f1832d0f94ae97
2019-05-14 12:03:50 +08:00
jinhai 7aea1dbccc Update Documents
Former-commit-id: 66643e729c7f190d38e460c903b874e5a1c64aa6
2019-05-14 11:55:18 +08:00
groot 202e4fcbd8 no change config
Former-commit-id: b97f814d0db3052d41eaeb9f7990b271565dbb8f
2019-05-14 11:49:32 +08:00
groot 1a8a97a960 no change config
Former-commit-id: 792765d33c0a448432830a9b3cdfec5272b378cc
2019-05-14 11:37:37 +08:00
groot 678f1010a1 use rocksdb column family
Former-commit-id: dbf59149386a71807ff3ea4498240afd102b5001
2019-05-14 11:16:18 +08:00
xj.lin 70dda63820 fix topk_2
Former-commit-id: 573d80b6d51407cc80e92989c11e3d74f2531d66
2019-05-14 10:26:46 +08:00
groot 70521c45e4 Merge branch 'release-v1' into rocksdb
Former-commit-id: 9efa6d93a63167d98a3e379dc8baa30a2cd18b86
2019-05-13 17:12:37 +08:00
groot a56333b55d throw exception
Former-commit-id: 6a8ae6f0c0b73fc9411b039143a1650e6ab7cc02
2019-05-13 17:05:24 +08:00
groot 56291b218d use rocksdb column family
Former-commit-id: 8cbc5d91e02e6bbc0eff1e329b4c76687d2c1f74
2019-05-13 15:17:05 +08:00
xj.lin 354f68a96f fix TopK bug
Former-commit-id: 76e24617b83d49b2a4808a0cd7406edb849e767e
2019-05-11 18:49:30 +08:00
xj.lin c4244fdc6d fix search stack overflow
Former-commit-id: 39801544686f061a63f4c3f1dec11565164a928d
2019-05-11 16:52:16 +08:00
xj.lin fddf73204a update config
Former-commit-id: 5004449f97f88acac31e01c3d83b7302059091b5
2019-05-11 13:21:19 +08:00
xj.lin 527651bbc6 update conf files
Former-commit-id: 28cf4be27eb0fe9d74046bb609dba103d162e7b2
2019-05-11 12:10:30 +08:00
xj.lin 0f6be5f022 1 update conf files
2 new scripts dir
3 update Readme


Former-commit-id: 0b0c4ca55fc05e459c3e2ed7e8c9c83b3752cbd3
2019-05-11 12:04:47 +08:00
jinhai 1390398cdb Merge branch 'jinhai' of http://191.168.1.105:6060/jinhai/vecwise_engine into jinhai
Former-commit-id: 4d8bb348e42f7d791daf9dc5c59e66d45d395214
2019-05-10 23:44:19 -04:00
zilliz e734d06809 Update CMakeLists.txt
Former-commit-id: 846f7f0401519246676ff1385677da1c4a07a521
2019-05-10 23:43:44 -04:00
xj.lin 364af3b1a8 redefine default index build type
Former-commit-id: 1f10a7774b80b596323882bb74a46484a917344f
2019-05-11 11:27:06 +08:00
xj.lin 876f6a4c66 1 Support Cpu-version
2 Update build.sh support both cpu-build and gpu-build


Former-commit-id: 3c0ddd7fb2f93ab45b6f9878b71b6541617f92c4
2019-05-11 11:27:06 +08:00
Xu Peng 2a8c45d394 test(db): check add vectors result size
Former-commit-id: d72021ae7c0fc69c840780d023d6a7573b618ce5
2019-05-11 11:19:21 +08:00
Xu Peng ac7092f556 fix(db): bug fix for add vectors
Former-commit-id: 84cfcf89843bfd79e226ef3fd8c6d9a273a1f4dc
2019-05-11 11:17:07 +08:00
groot 99b61e3b9b fix bug
Former-commit-id: 4f365862e364a8b6232a9d959354dd609db6a040
2019-05-10 14:33:23 +08:00
groot b2d988b9c6 fix bug
Former-commit-id: 53fa5d480d001cc82145710fa0329604b85bab19
2019-05-10 14:32:43 +08:00
groot 7e6b928ce8 modify thrift api
Former-commit-id: 6a9222b918447562add54efb852bb8716c5ed254
2019-05-10 10:39:59 +08:00
groot f9967cd744 modify thrift api
Former-commit-id: 744dec10d157280d9776a7507aaa428ca76aad66
2019-05-10 10:39:21 +08:00
groot f7a2ac7b00 refine code
Former-commit-id: 9205f1d9bfcd3f4a48688b989cfe52b26dba29de
2019-05-09 21:41:44 +08:00
groot 6a27275486 regen thrift py
Former-commit-id: a199ad849e1a0a6534bd343deaf8e4aa6a1335d5
2019-05-09 19:16:40 +08:00
groot b97b406ce6 regen thrift cpp
Former-commit-id: 2d37cc786425da956db94fc2f3f5de824ad54b94
2019-05-09 19:16:13 +08:00
xj.lin 146bb9e6d4 support install prefix and default install
Former-commit-id: cada287cbf3b4ef2e32e8039aa7836bb76a6adb1
2019-05-09 12:05:35 +08:00
jinhai 77f86fdeee License tests success
Former-commit-id: e10d0146a51286664bb01f5d55f694e547a8f597
2019-05-08 17:38:37 +08:00
yangwei.yao 414cbf860f Update CMakeLists.txt
Former-commit-id: 6007ad4c75ca615d6d21236a2ea5affe347672d1
2019-05-08 17:01:11 +08:00
jinhai 51d9e2c21e Add license check functions
Former-commit-id: d3120c7b805a59bcb736908990d68652008eca8d
2019-05-08 14:55:21 +08:00
Xu Peng 56ffd6bad3 fix(db): db destruction bug fix
Former-commit-id: d77e18e428bc43b2cc1316f0d77b6807192f6662
2019-05-08 13:58:16 +08:00
Xu Peng 4428d56670 refactor(db): trait for engine and dbimpl
Former-commit-id: c42d9f4d7168b4d8e374ddb5ed0499ea1394a306
2019-05-08 12:13:01 +08:00
Xu Peng b36a524739 refactor(db): using traits
Former-commit-id: 6496aa13a3ba40d4bec2e32a1ad6f10377055775
2019-05-08 12:13:01 +08:00
Xu Peng 9e43c45de4 feat(db): support trait for engine
Former-commit-id: cfb90e35386177032fa0c4ac7b8c81f29a536571
2019-05-08 12:13:01 +08:00
Xu Peng 372adf6c80 fix(cache): add pragma once in header
Former-commit-id: cb9b838950c536fa4a582c92cf0df634c0780764
2019-05-08 12:13:01 +08:00
Xu Peng 9adc7bdf82 env(unittest): add missing lib
Former-commit-id: 3d923d0a8588226084f6935b184798f2a402849c
2019-05-08 11:05:09 +08:00
jinhai 15afc4b4bb ./build.sh -t Release will make a release version
Former-commit-id: 7acb08bb5d8d2d64ab1b64ac73ae5373c01d6e80
2019-05-07 16:45:03 +08:00
groot 5897f415ad addd log
Former-commit-id: e950e203afc9c259a4530fd8c9b6ce95da4cb4bc
2019-05-07 12:11:39 +08:00
groot 8e1415ba11 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 97a4429aed85095d23e6dd85e3329df38b47f3d6
2019-05-07 10:10:29 +08:00
groot 00ba6f4783 modify readme
Former-commit-id: f2fa8b895b16184a28ac338f8962b3e6907df953
2019-05-07 10:10:20 +08:00
Xu Peng 0fb7334220 test(db): enhancement for unit test
Former-commit-id: 2fdacaf3f80a70c3319d9dc7b2756f042b5b5106
2019-05-07 09:44:35 +08:00
jinhai 7c0d0179fb Merge branch 'jinhai' of http://192.168.1.105:6060/jinhai/vecwise_engine into jinhai
Former-commit-id: af885c2b110e3f4061c22e593fca973a87673bd5
2019-05-06 22:12:42 +08:00
jinhai 9bf75e809a Add static linking
Former-commit-id: 95e2ccc0112a0cff1f1520c7ec8caee07be442d6
2019-05-06 22:11:02 +08:00
groot e661ba82fe build error
Former-commit-id: 0764940092b64cca42918e542b9d8702cab1c55e
2019-05-06 22:01:28 +08:00
groot f17bac3272 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 8be4107f8aa5d1a6b556d2d249b202e85a7747b7
2019-05-06 21:14:48 +08:00
groot b51a88abfd build error
Former-commit-id: 927fdda8e7b2d7782c800cdff83b9966a26f25f2
2019-05-06 21:14:39 +08:00
Xu Peng b8949ca86f fix(env): fix compile error
Former-commit-id: 63a2957e3c226bdb08658d96738d30dc98a73619
2019-05-06 20:52:02 +08:00
groot 0ce9502a3e fix bug
Former-commit-id: daf197368b50cd764df893949abb5f2956c9c560
2019-05-06 11:24:36 +08:00
groot e472c605d2 modify readme
Former-commit-id: d5fe9fbbe444e2580714ad4fc741b61048dbe01c
2019-05-06 11:10:14 +08:00
groot a34d995195 modify readme
Former-commit-id: 2297c0decb034ceda163a996f6d24604875f6495
2019-05-06 10:47:55 +08:00
xj.lin 2ac87c1e47 1. support IDMap
2. fix some bug
3. background job from IDMap -> IVF


Former-commit-id: ba8f24f09c5481103ad3f4c1c91d4deb70f26dad
2019-05-06 10:24:07 +08:00
xj.lin 56bbe40faf 1. fix operand serialize bug
2. support gpu-build
3. add unittest


Former-commit-id: bb36dcb05220d8f0648f282c7e38fe20f4ab3c16
2019-05-06 09:53:59 +08:00
jinhai 675777d072 Add libzstd-dev to solve the linking error
Former-commit-id: 993f2b5e526a3d073820f80b8ce473842ab937b5
2019-05-05 20:42:33 +08:00
groot faa2c4b4b1 support empty id
Former-commit-id: 1a5303b58f3f3b0154f1609ff1acc0d00007c569
2019-05-05 20:13:34 +08:00
Xu Peng 496989bbe4 refactor(db): add more debug log
Former-commit-id: 7c196e05c60567216938115e081438beeecb0f47
2019-05-05 18:02:11 +08:00
Xu Peng d3cbc1ccad fix(db): db desctruction bug fix
Former-commit-id: e456a0d76c2b1401107d47600c34d4622ca8cd8a
2019-05-05 17:26:50 +08:00
Xu Peng 8a029c9b0d refactor(db): add copyright header
Former-commit-id: 45606fe09972ab741faa4ee8061ef7d307c20c49
2019-05-05 13:10:04 +08:00
Xu Peng 72f096bfca refactor(db): typedef ptr for memvectors
Former-commit-id: 92289614937b7803fc41bf5cb7d50f468192aaa4
2019-05-05 12:55:42 +08:00
Xu Peng c64e8c9621 refactor(db): typdef meta ptr
Former-commit-id: 1fcbd80c65a1ee2815a57127f04807ce7d9f23f3
2019-05-05 10:28:40 +08:00
Xu Peng f5b0ec50cf refactor(db): typedef engine ptr
Former-commit-id: 4629cac435fd484ab949ab112b639a4849e37fca
2019-05-05 10:21:26 +08:00
Xu Peng 85707aa3e9 refactor(db): impl template for engine type part 2
Former-commit-id: 8be264a9ecc7704f63a978fb862b95140a19e1c0
2019-05-05 09:38:37 +08:00
Xu Peng 166289cafa refactor(db): impl template for engine type
Former-commit-id: 2e9a6fa992f58dfe567f7c274b9327454cf3f89e
2019-04-30 21:02:13 +08:00
Xu Peng 0e37089c6a refactor(db): refactor all for crtp replacement
Former-commit-id: 3c5d3ddeec04d573ef3916f673a7504c51a0a3bf
2019-04-30 20:23:11 +08:00
Xu Peng 67960d5a55 refactor(db): dbimpl refactor for ee
Former-commit-id: 5c762120594c4ab76237cc9d713dde3f4a57931a
2019-04-30 20:16:54 +08:00
Xu Peng 8866d36252 refactor(db): refactor execution_engine
Former-commit-id: 90ddd165224135d190108f5d7bce544b5c0f305e
2019-04-30 20:14:38 +08:00
Xu Peng ca195424c5 refactor(db): refactor small part
Former-commit-id: 58fc916c28a94ccecd67c58d5cf3620c51fbe4c4
2019-04-30 18:44:00 +08:00
Xu Peng 62440022d9 refactor(db): remove dummy includes
Former-commit-id: 6cf84f4b81e93c4a02ec7467b14e0ebc9227585d
2019-04-30 18:34:32 +08:00
Xu Peng 94057d9d95 refactor(db): refactor search with execution engine
Former-commit-id: 1625a8aff9582e61e6bb687b4da40f7721610f91
2019-04-30 18:32:40 +08:00
Xu Peng 473d603a89 refactor(db): refactor build_index with execution engine
Former-commit-id: a37b3096ae6883f6633fd3c1f986ca0f45955a0b
2019-04-30 18:11:38 +08:00
Xu Peng 95adef2988 feat(db): add build_index api for ee
Former-commit-id: 75f268e4494d383f7a7b9e32c634a44f7beeba1c
2019-04-30 18:11:38 +08:00
Xu Peng 4cc5b8d523 refactor(db): replace faiss with execution engine
Former-commit-id: 7e7949541e39bc18f30c5aafa7968fdacf709719
2019-04-30 18:11:38 +08:00
groot a724141e73 use multithreads to do id mapping
Former-commit-id: 10b201d3801b146fa6335e4dfd20c877cfb2e948
2019-04-30 17:37:50 +08:00
groot b67c731b90 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 730d1e5d7acd6ff2250ea1a453c2d4127f081356
2019-04-30 17:00:05 +08:00
groot 2e76522151 refine code
Former-commit-id: f81a57c8340d7cfcea9db3d8219612f6108eeda6
2019-04-30 17:00:00 +08:00
Xu Peng 7f000e7979 refactor(db): rename
Former-commit-id: 60c982ed5e500d958182bbc0816731d9423b509a
2019-04-30 16:08:28 +08:00
Xu Peng 204c68879c refactor(db): replace faiss with serializer wrapper
Former-commit-id: 62b5a7d8353c2b0ef4017f43d03d1c6944685400
2019-04-30 16:08:28 +08:00
Xu Peng 713d1ec6b7 feat(db): add cache
Former-commit-id: 2dd8078d8df484ddac54379bc6c84c015c1fc530
2019-04-30 16:08:28 +08:00
Xu Peng 052f7e2f11 feat(db): add more api for serializer
Former-commit-id: d15d7dfecb9964ca2e3ba4e5b469137d1cc85057
2019-04-30 16:08:28 +08:00
Xu Peng cf19e90af3 feat(db): add serializer
Former-commit-id: ab412bbb430e7711ddee0ad26b34f7b3b6c43582
2019-04-30 16:08:28 +08:00
Xu Peng 39be106baa refactor(db): code optimization
Former-commit-id: 320733b50aba32e5bd99853933e7e1eafdbcdbcf
2019-04-30 16:08:28 +08:00
groot 83ed0fa4e6 fix typo
Former-commit-id: 5eb1054016ec8fe6dbf173f1e32c0d37330cd87f
2019-04-30 15:03:06 +08:00
groot 74eee9dc77 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 00d18f20fb408445831a00a5385a244c49786910
2019-04-30 14:47:46 +08:00
groot 905722bd0e add python sample
Former-commit-id: 2c0825ad6ed774eb5ad1999b1439f840dc602bf1
2019-04-30 14:47:36 +08:00
Xu Peng ce54690910 test(db): small change
Former-commit-id: 8cf0fe13bfd7715a491f00cc24e2efa37fd8decd
2019-04-30 14:17:24 +08:00
Xu Peng 3a05719e5a refactor(db): disable some print
Former-commit-id: 09fb8ca768ba06af3407df8d9ec307f259650eae
2019-04-30 14:17:24 +08:00
Xu Peng 9cb81455a1 refactor(db): change print for search
Former-commit-id: c1df662f54ba5132db8d4fbbbd9b1e9998a61e7a
2019-04-30 14:17:24 +08:00
groot ae5e672061 refine test code
Former-commit-id: 25266f1e3574d2ffa42ab8299cc8e5a4ac5b651a
2019-04-30 14:00:22 +08:00
groot dbf9de9a62 refine
Former-commit-id: 46e81a09c49f06c6b80bedfb90c2767bb54ec5f7
2019-04-30 11:44:58 +08:00
groot aa591114c4 time range search
Former-commit-id: 182c5c9db2d3aeaafc4d4878f060435c442b366c
2019-04-30 11:18:08 +08:00
Xu Peng 21a98c0e02 test(db): refactor db test
Former-commit-id: c85ed1e09b51f9c883426f7c77da3261232f0745
2019-04-29 20:22:24 +08:00
Xu Peng 61854a6c23 test(db): refactor SetUp
Former-commit-id: dfbb0f819705c0fca4b5e0a7fb37ce7bc52761d6
2019-04-29 19:05:48 +08:00
Xu Peng ed9dc51f27 test(db): samll change
Former-commit-id: 1bdf8515f7914a43e965334db36d253fea12abb7
2019-04-29 19:01:18 +08:00
Xu Peng 7680d5c731 feat(db): change default options values
Former-commit-id: 8c4aeb5206d7532ac524956e225779ce2e29766e
2019-04-29 18:56:40 +08:00
Xu Peng e78481f5e4 test(db): add meta files test
Former-commit-id: bd7b5371b11ddd769b178fe0e263b5759398e0d3
2019-04-29 18:10:30 +08:00
Xu Peng 0bbae88f3f fix(db): add to index files in files to search list
Former-commit-id: 8174f890208374835a7d0b0c310fdeb7f016bd32
2019-04-29 18:10:30 +08:00
Xu Peng f7853fcd20 test(db): add group file test
Former-commit-id: 8fa440c2be5f525388d45fca7e92244718e8c2fc
2019-04-29 18:10:30 +08:00
groot 363de87bdb gen python api
Former-commit-id: 1c9b4a1fea7c450b55e8d683085d8779460ea3c4
2019-04-29 17:58:08 +08:00
groot 231b216963 add namespace for thrift api
Former-commit-id: 92f9e0a0f7d2e301120573976984f99062b8f44e
2019-04-29 17:55:50 +08:00
groot e1efe942da fix test load config failure
Former-commit-id: 7781b6ff8a4c1d72dfe4f872a7765424af40286e
2019-04-29 16:34:43 +08:00
groot bd9c14a871 typo
Former-commit-id: 89e00f1b579a2f78737efcafc04507f0f31049b1
2019-04-29 16:20:21 +08:00
groot 16df78caee add attribute for vector
Former-commit-id: e520d4e7aaceb1fedae62cc67326a550666efc6b
2019-04-29 16:14:21 +08:00
groot fe5909a597 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 69eee8018a8a7d7478181c11fef7ef4206ee0784
2019-04-29 16:12:40 +08:00
groot 592dde4dd7 add attribute for vector
Former-commit-id: c2a1a5cd917abe1cf3e8ef327bba5c2ed1cf8008
2019-04-29 16:12:35 +08:00
Xu Peng c26629756a test(db): impl more group test
Former-commit-id: 5de1604a22951a2e96253f994d6af95ccd8bf019
2019-04-29 15:56:07 +08:00
Xu Peng 9ff65dc76c test(db): group test more
Former-commit-id: 31949c0387e3400c63d7387664dc8e142ce1ce17
2019-04-29 15:50:52 +08:00
Xu Peng 4b18d9fec1 test(db): add more meta test
Former-commit-id: b8078e972d1c08b38cd6ff272ec2cd6ab1d895b2
2019-04-29 15:47:09 +08:00
Xu Peng 4a66580f4f test(db): add meta test
Former-commit-id: 9668abe43a31a04c58311c12834fe5b89da23c07
2019-04-29 15:29:28 +08:00
Xu Peng f096e0a109 feat(db): add meta impl factory
Former-commit-id: e9af01dea914b32192efe1c534e174810be5a02a
2019-04-29 15:06:35 +08:00
Xu Peng c1d40bfb3d feat(db): add db factories
Former-commit-id: df8ec1140cc82755e14a739cbb22fb035b3c7d18
2019-04-29 14:06:40 +08:00
Xu Peng 3dfdfef07a test(db): add utils in db test
Former-commit-id: 0e65a0a885cc3ead0fb233bd041bb4f8b8645898
2019-04-29 13:17:19 +08:00
groot cdda6e5769 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: b50f73905441637b4751f55509b74b82cf3329ad
2019-04-29 12:46:01 +08:00
groot bdef129e3a fix unitest load config error
Former-commit-id: e1ff282a7eb4c81ee76efe43751f9d7329e8ddf3
2019-04-29 12:45:53 +08:00
Xu Peng 096c4639b7 refactor(db): remove dummy includes
Former-commit-id: b25398a114a59e79b0e20fca60843aecdbec51b5
2019-04-29 12:38:27 +08:00
groot b8148d8e13 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: bd511cfab2d3813dee05c34dcf068622da2fef94
2019-04-29 12:31:56 +08:00
groot 1aefac8ae0 fix unitest load config error
Former-commit-id: 8bf7417881a421bf5c28a31474743484e8fea155
2019-04-29 12:31:48 +08:00
Xu Peng 5d5bbe842d feat(db): add dates filter for search
Former-commit-id: 04ba53b11c8bb7fbd90877d1be6e82bb80e2247c
2019-04-29 12:05:03 +08:00
groot 688a9992be fix make error
Former-commit-id: 7a5d078a48a92b0595e67bf8fe9891a075044bf4
2019-04-29 12:04:56 +08:00
groot 4cbdb58718 redefine thrift api
Former-commit-id: ed64f6205c2723111f3bc2771836a265b2474817
2019-04-29 11:09:57 +08:00
groot 487ea03461 redefine thrift api
Former-commit-id: 0dc225d0372e6e2260126a301552a37d161ccec8
2019-04-29 11:01:01 +08:00
Xu Peng 2ff4cae2cf test(db): change test
Former-commit-id: e1922a567069b4c058acad186b8186b4cbbe0f4a
2019-04-28 21:01:30 +08:00
Xu Peng 5569f22de2 fix(db): no transaction for update_group_file
Former-commit-id: 22b364f8f07cd009391952ba66478879f6b86b6d
2019-04-28 21:01:30 +08:00
groot d6dc77ced2 fix cmake warning
Former-commit-id: a3c4cb47f43d54e44f8a6b7f887e61f2182d998a
2019-04-28 20:51:21 +08:00
groot 2005f2c1c8 refine test code
Former-commit-id: c44c49b22ad20188bcc2ac339cbb659e29ac661b
2019-04-28 19:28:05 +08:00
Xu Peng 57dfdae3e3 feat(db): fix bug and add exception catch in meta operation
Former-commit-id: 6d33945997e7a528bc729efdad6076d6532f79b3
2019-04-28 18:44:25 +08:00
Xu Peng 486c175b4e feat(db): add serialization mutex
Former-commit-id: f8a3b14c0209a9e36b0510ce48754deefc4ee442
2019-04-28 18:44:25 +08:00