Commit Graph

557 Commits (eeeada4e4f94ea1f958058703ee7365850731ec6)

Author SHA1 Message Date
groot 39df2d4d1e fix third-party link error
Former-commit-id: 54782a2d0812e836544ca8667c1ee42a4e934830
2019-05-29 17:30:27 +08:00
groot 845b927783 modify changelog
Former-commit-id: 5988d25b5854c502f2496d0244be5313e5a2969e
2019-05-29 16:59:51 +08:00
groot c9f9991ef3 modify changelog
Former-commit-id: c7448a91938c65c997df94c0929e4dfb53bb19a6
2019-05-29 16:29:08 +08:00
zhiru 9b2d62631d resolve merge conflicts
Former-commit-id: 31d8d0d07a1fb4d8299f694db44787ceacf8c2d3
2019-05-29 16:23:24 +08:00
groot 397457112b refine sdk code
Former-commit-id: 30ab87ccf76dadf9c65489d5a19c1134124faec5
2019-05-29 16:21:22 +08:00
zhiru 31a00449a4 MS-26 cmake. Add thirdparty packages
Former-commit-id: a68611c035820a429ae5ef1ae104a9826838dcca
2019-05-29 16:14:15 +08:00
groot 5386d5e70e refine sample code
Former-commit-id: 18bda8e3585dfd0bcfc699c6788a9af0eb53fc5f
2019-05-29 14:55:22 +08:00
zhiru f119cc39db cmake: add thirparty packages
Former-commit-id: f7efb9acd4c01567f8ed6f26a7aa220aa174bb53
2019-05-29 12:06:37 +08:00
groot 369ce2d76d fix typo
Former-commit-id: b83788e0c11efa77b74a953cfd3b85432c85d5c3
2019-05-29 11:24:30 +08:00
groot de1d9fb655 fix some bugs
Former-commit-id: 297b63106e0ed450d92017ca0b079798a43909c5
2019-05-29 11:22:12 +08:00
groot 61fb59d23b merge from remote source
Former-commit-id: fc7be69bc0d039576469f0adb81e027a8f00272c
2019-05-29 09:15:12 +08:00
groot ab90dff7b4 implement sdk interface part2 change log
Former-commit-id: 41f1487f14d2c5e93700b0e521dfcf3410f3802d
2019-05-28 18:46:30 +08:00
yu yunfeng 4116f710f5 merge branch from Xu and add metrics
Former-commit-id: a5d3e97dbd87c6478ece637046a2d9545fbc973f
2019-05-28 18:46:07 +08:00
groot 5c79f1883c implement sdk interface part2
Former-commit-id: e0f031025133d35456f685dfb2f4d3768ee99a56
2019-05-28 18:43:08 +08:00
yu yunfeng 80db8aaf20 Fix compile error
Former-commit-id: 07f4dd06011ef519e29744dcd5b8ac9e407b2505
2019-05-28 17:50:20 +08:00
yu yunfeng 4d8385790a add feature
Former-commit-id: 3534c79716d1dbf9ba12d47c4de75fe19667aae4
2019-05-28 15:39:26 +08:00
yu yunfeng 815bf5550f add metrics_unitest
Former-commit-id: 783161b2f8a70b24b605f2040f9381f4aa0fff07
2019-05-28 15:33:42 +08:00
yu yunfeng a95b29aa27 add metrics without prometheus
Former-commit-id: e158ea586681abb5ec44bdc9025ec27e3aa21567
2019-05-28 15:06:17 +08:00
Xu Peng 13ef8219aa refactor(db): update change log
Former-commit-id: 95c0f52c4f6b1b6723e72e71baed6bc640b7935f
2019-05-28 14:03:09 +08:00
Xu Peng 120a52c184 refactor(db): replace typedef with using
Former-commit-id: 62caeac6fb8a05cabe0622abe73d7b5b548f8472
2019-05-28 14:01:54 +08:00
Xu Peng 9b5791b434 refactor(db): small change
Former-commit-id: 057c7a7b4b9189895d7aac3e253387fe91daee0e
2019-05-28 13:59:16 +08:00
Xu Peng c5501202ad refactor(db): whole db api refactor
Former-commit-id: 3519e8a464bcd66b6da8ef2c579c08eaf13d17bd
2019-05-28 13:49:59 +08:00
yu yunfeng 7839bada77 fix conflict
Former-commit-id: 6d3d137cac5d1b8f826cecaeddbd77ad8a635ce2
2019-05-28 13:48:37 +08:00
yu yunfeng 1521d0aeb3 delete prometheus-cpp
Former-commit-id: d95914cebe38d7f5446cffe28e0d26d0cb82097a
2019-05-28 13:36:14 +08:00
yu yunfeng 1563f81ac2 add metrics
Former-commit-id: 3e811d555cf69eb2c8f515ada44c8df43e460de0
2019-05-28 13:34:47 +08:00
Xu Peng 130b710169 refactor(db): MS-20
Former-commit-id: f34dd2746073c837fa877697e32f1ce3607e35c2
2019-05-28 11:04:37 +08:00
Xu Peng c8bcf53d81 refactor(db): refactor for db impl
Former-commit-id: f7488d5189ed1c34d9b3e8e3da4eaa71766f9c11
2019-05-28 11:04:37 +08:00
Xu Peng 541692c227 refactor(db): include file seq and cpp->inl
Former-commit-id: 970bb6ef009b1806a4f60f6d1f5d62e0aeb1ca5e
2019-05-28 11:04:37 +08:00
Xu Peng 73ffe9f796 refactor(db): include files seq
Former-commit-id: 1236730a49eb3ab3611e001aee95a6a28173f4ca
2019-05-28 11:04:37 +08:00
Xu Peng ce329b4304 refactor(db): Env.cpp Env.h
Former-commit-id: 5d774124457d4136dc8c0e4469ac6950c424de09
2019-05-28 11:04:37 +08:00
Xu Peng fbeddc2ad5 refactor(db): refactor for execution engine
Former-commit-id: 5bf686bae2669ecfe6c4ba722a001c6303bb2f43
2019-05-28 11:04:37 +08:00
Xu Peng 2eff64def1 refactor(db): refactor for DBMetaImpl
Former-commit-id: 9ced33145335090265c53344b4ff46a977eec356
2019-05-28 11:04:37 +08:00
Xu Peng ca33fbbe14 refactor(db): DropAll -Count CleanUp CleanUpFilesWithTTL
Former-commit-id: b718bb89945651de19a1263eaf64eab22d11eb6c
2019-05-28 11:04:37 +08:00
Xu Peng 874eeb8f7a refactor(db): FilesToIndex
Former-commit-id: fe5bd8ca372d0a4d5bf257f3f10853179d2356ce
2019-05-28 11:04:37 +08:00
Xu Peng 7fe5346f14 refactor(db): Archive
Former-commit-id: 21f153c1a57ad4bb706f6b177a10d45faf88ed99
2019-05-28 11:04:37 +08:00
Xu Peng de8811ae9a refactor(db): Size
Former-commit-id: 9dc93505e1378a1e8b14750158c2f8b9b2f840ca
2019-05-28 11:04:37 +08:00
Xu Peng 2789234931 refactor(db): FilesToMerge
Former-commit-id: 9101dcd75943bc241094af92156805090bf8e408
2019-05-28 11:04:37 +08:00
Xu Peng 09fdd0f849 refactor(db): FilesToSearch
Former-commit-id: dcb7f972ee13a0916129dfec5b05dad66025dfbf
2019-05-28 11:04:37 +08:00
Xu Peng edf33115e4 refactor(db): UpdateTableFiles
Former-commit-id: 749cfe1d229a7f2edadd3cd913b96e0087be9cc5
2019-05-28 11:04:37 +08:00
Xu Peng ec4e83db3f refactor(db): UpdateTableFile
Former-commit-id: e5b29fa1396d5a06c26a4917e15fed0082bbc7ae
2019-05-28 11:04:37 +08:00
Xu Peng 3852b830b0 refactor(db): delete get_group_files
Former-commit-id: 0503a8a92ab9687912c516390af1c8fe0e4cd96a
2019-05-28 11:04:37 +08:00
Xu Peng ba8929e9a4 refactor(db): GetTableFile
Former-commit-id: 9b5f8d3a6c3202acc5b16f9b75f4ebe9cb2c6c50
2019-05-28 11:04:37 +08:00
Xu Peng 59fa814af4 refactor(db): delete has_group_file
Former-commit-id: 821b2784c727d30375b7ce5c2bf3e9e9aef16fd8
2019-05-28 11:04:37 +08:00
Xu Peng fbe1278a3a refactor(db): DropPartitionsByDates
Former-commit-id: 2534fa34f690ba60788e3619b6a87a9a7ed8650e
2019-05-28 11:04:37 +08:00
Xu Peng 01e4e605e2 refactor(db): CreateTableFile
Former-commit-id: c29b8ccc97cc327ec9c278f2ea5456369365c4f3
2019-05-28 11:04:37 +08:00
Xu Peng 9d4591612d refactor(db): delete local meta impl and refactor HasTable
Former-commit-id: 4849b994d40cf433797892eb37ceeac46fc65d3d
2019-05-28 11:04:37 +08:00
Xu Peng 624e34f10d refactor(db): refactor DescribeTable
Former-commit-id: 021d731f3be6f338423caabef59bdd4c46ed02d8
2019-05-28 11:04:37 +08:00
Xu Peng 3d330e0aa4 refactor(db): change group_info to table_schema and add_group to CreateTable
Former-commit-id: e8d48ec8e54429bf5d1080997ca329b42ddcab82
2019-05-28 11:04:37 +08:00
Xu Peng f2bb20c90d refactor(db): change group_id to table_id
Former-commit-id: bf0cec2552fcad95bf1b77cdfbdd423984e6f18f
2019-05-28 11:04:37 +08:00
Xu Peng 209d0e4806 refactor(db): change groupfilesschema to table*
Former-commit-id: e786234155eecb9d22ad2b6a8b2c9357675e5de4
2019-05-28 11:03:45 +08:00
Xu Peng e94499cdff refactor(db): change groupschema and groupfileschema to table*
Former-commit-id: fbc69151149faa8ed32547bcdd1a9935dac34070
2019-05-28 11:03:45 +08:00
Xu Peng aa60c62870 refactor(db): remove dummy struct
Former-commit-id: a90c3f127fb84a879956a8383af9def829504208
2019-05-28 11:00:10 +08:00
yu yunfeng 8510104066 fix conflict
Former-commit-id: cffe275e0430a89b99c17574766dff7c972d810d
2019-05-28 10:02:20 +08:00
groot 22e2a2bc3f throw exception for invalid index type
Former-commit-id: b028167c2460be4738af5f092a443749dba89bc0
2019-05-28 09:59:06 +08:00
groot fe5b511596 add search example
Former-commit-id: f38cc87551001449c5930fb719ba038b45af47df
2019-05-27 20:34:20 +08:00
groot 15503d334a Merge remote-tracking branch 'source/branch-1.2' into branch-1.2
Former-commit-id: 772b757f2d486822a261b5f250d7daad3887e806
2019-05-27 19:59:31 +08:00
groot 4b244f9d45 redefine thrift api
Former-commit-id: 8d7d1c47202341521cf06a567e8f7cf3cfc55074
2019-05-27 19:57:09 +08:00
yu yunfeng 1392e0d5c7 c
Former-commit-id: 420c70f051d7cbd2f9a0a5c4d8181ba11bb93f27
2019-05-27 16:31:20 +08:00
yu yunfeng 0df4068cc3 add metrics
Former-commit-id: 357b4f65b49d91c85a83d00513dfea830372341f
2019-05-27 15:59:16 +08:00
Xu Peng c5b931d59e test(db): fix test error after impl exception
Former-commit-id: 71184ffe49ac0130d2002aef4f8f55c825414d0c
2019-05-27 14:59:00 +08:00
Xu Peng 9dcc68b814 feat(db): add exception
Former-commit-id: b2a9deb7df0544a303858fff7f4d6eddf3e6b1f7
2019-05-27 14:58:38 +08:00
Xu Peng d744ef4a33 fix(db): replace locatime with locatime_r for thread safe concern
Former-commit-id: 1b857e297c3b26e2730f86c67e8dc798755493fe
2019-05-27 10:35:41 +08:00
Xu Peng 37fc30e439 env(all): update change log
Former-commit-id: e9124716de75572eab1e027809b2b90a25ae127f
2019-05-26 19:35:30 +08:00
Xu Peng 7337cef31c Merge branch 'release-v1.1' into impl_simple_delete
Former-commit-id: 10d74a865946328366a49fb389d0038858064e83
2019-05-26 17:37:52 +08:00
Xu Peng 1c6a012b46 Merge branch 'branch-1.2' of http://192.168.1.105:6060/megasearch/vecwise_engine into release-v1.1
Former-commit-id: 56c25fba480cf53fed8e03f820a597dfd8138436
2019-05-26 17:34:32 +08:00
Xu Peng 74e6ef4a9c test(db): fix for ARHIVE_DISK_CHECK
Former-commit-id: 1a82a410db91e2b6f9ddc38bafc491a1204c0dd1
2019-05-26 16:51:30 +08:00
Xu Peng ff3a89b997 feat(db): archive after every serliazation
Former-commit-id: bf5191dc707e7336d64534110aa49a2d36da1a1e
2019-05-26 16:50:56 +08:00
jinhai ec579df59c MS-3 Add SDK interface
Former-commit-id: 351fb4356e4318efc85dd7ba9b32873a71faf910
2019-05-26 15:59:05 +08:00
Xu Peng 3958fe5a35 refactor(db): add NextFileId
Former-commit-id: 51a1f75881a8a1f85e3fdc8ac7217218976cc11c
2019-05-26 15:17:46 +08:00
jinhai ad8ef08bf9 MS-4 Refactor the vecwise_engine code structure
Former-commit-id: acade700d7956ad8c4c5ecaaecf23997b0ca5161
2019-05-26 14:48:13 +08:00
jinhai d8bb0ac9af MS-4 Refactor the code structure
Former-commit-id: 369b9f28d1391765b4d4dada2140b261132a0e55
2019-05-26 14:46:38 +08:00
jinhai 8d3ad6aeae MS-4 Refactor the code structure
Former-commit-id: ab2c7af5968b367ca27bac2d991b0dae5ad2dc75
2019-05-26 14:46:38 +08:00
groot cb585e74f0 prepare for gpu index
Former-commit-id: 92a3a851a63c72f98cecd1d0634d1f60c4d810b3
2019-05-26 14:46:38 +08:00
groot 757286e1ba prepare for gpu index
Former-commit-id: ea47029addad06a023919f08a679956de69397f6
2019-05-26 14:46:38 +08:00
groot bf8e7545e1 avoid potential multi-threads risk
Former-commit-id: 6e54134e4249003ce651eaf8ec2642d8898d34f0
2019-05-26 14:46:38 +08:00
groot 224fae759c fix id miss bug
Former-commit-id: 53581de275e862ca9574014a6bd025918077dc59
2019-05-26 14:46:38 +08:00
jinhai 9941416b82 Update license check
Former-commit-id: 1579a302a09ad0c07ceb4b8293a884ad60eab993
2019-05-26 14:46:38 +08:00
groot 65583daaed avoid add vector to invalid group
Former-commit-id: f5d04e510b5d743488be82f492aad2b95929d9e1
2019-05-26 14:46:38 +08:00
Xu Peng 2d08fc415f refactor(db): add NextGroupId in DBMetaImpl
Former-commit-id: 56deb4603db20ac4ef677f1851a1e76e703a234f
2019-05-26 13:24:02 +08:00
Xu Peng 425e4b4b01 feat(db): move tables under tables directories to avoid name conflict with reserved meta files
Former-commit-id: de11db98c00ee071c8578a41c2e9ff673509fe63
2019-05-26 13:11:48 +08:00
Xu Peng 92da0fa4ca refactor(db): for schema changes
Former-commit-id: 3d1aa65da396177ff49e1922ae032cec834f7850
2019-05-26 13:02:22 +08:00
Xu Peng 495c8d4dd6 refactor(db): change rows to size in group file schema
Former-commit-id: 4386308bcfa1bd7136809c7e749e140b53517ca7
2019-05-26 13:02:02 +08:00
Xu Peng e09240e45f test(db): refactor with meta consts
Former-commit-id: a611af0886bdeb51b4a38da2e80b84a4fd13d0cc
2019-05-26 12:26:23 +08:00
Xu Peng b96459cc8b refactor(db): add MetaConsts
Former-commit-id: 5db9dfba91c61274a8334e8daba1488fe5bead3e
2019-05-26 12:26:06 +08:00
Xu Peng 767e63bd00 refactor(db): add MetaTypes.h
Former-commit-id: 2e6e61b9cf0db9728365c904fc2f491962ea5319
2019-05-26 11:51:09 +08:00
Xu Peng f9889598d7 test(db): check size
Former-commit-id: 115707db134408a52f14e95d25c5d434c05d1c9f
2019-05-26 11:27:31 +08:00
Xu Peng b2f079ed67 fix(db): fix size api for db meta
Former-commit-id: 88add7eef97827063e8e87f0d84aec62e66f7ca6
2019-05-26 11:27:31 +08:00
Xu Peng 3f28d33b6e test(db): add test for overall archive
Former-commit-id: 34b7aa89adc45c2505619b902e7701ce7df4e91a
2019-05-26 11:27:31 +08:00
Xu Peng c30a6d4130 feat(db): add size api for db
Former-commit-id: 2fa9614c86fab66267689a06f73c0bef15dcffe8
2019-05-26 11:27:31 +08:00
Xu Peng e15c445fb5 feat(db): add size api for meta
Former-commit-id: 0b240dbf664348f65a70e57a5d545857469ad37b
2019-05-26 11:27:31 +08:00
Xu Peng 0a7f334697 feat(db): add archive post merge and build index
Former-commit-id: 32678939225459bbfb82d491c53b912633fdb395
2019-05-26 11:27:31 +08:00
Xu Peng 3a658e7c56 refactor(db): add some debug print for newly added archive
Former-commit-id: 92b1220200bcbe82cfbf427f5a14d9fe800ec8b5
2019-05-26 11:27:31 +08:00
Xu Peng 80860535a7 test(db): add test for archive days
Former-commit-id: 10dcbdf0d3f32fd90904150c294cbe87a0ebfa7b
2019-05-26 11:27:31 +08:00
Xu Peng cd2afcb2a4 refactor(db): remove dummy print
Former-commit-id: ffc431eeb98d3a4a52708954e2a1e240ad713ebc
2019-05-26 11:27:31 +08:00
Xu Peng 7565a53290 fix(db): update schema and unsigned long type handling
Former-commit-id: 03f17b0f071817350b4137ed31abfb1d5b7066be
2019-05-26 11:27:31 +08:00
Xu Peng 3b83dbf672 refactor(db): add utils
Former-commit-id: 48c9f7818c0260e3191a381879c3e83e0ad7ec9a
2019-05-26 11:27:31 +08:00
Xu Peng 4c44b02b5e test(db): add archive test
Former-commit-id: 7fc4969944759203524c0dbac8fc4421fd528f28
2019-05-26 11:27:31 +08:00
Xu Peng c757be1cb6 fix(db): change type from into to size_t
Former-commit-id: 97f571c02189eb7cf3ade68f1d26aea2e2ce5f1c
2019-05-26 11:27:31 +08:00
Xu Peng a073cf35d6 feat(db): add archive files in meta part 2
Former-commit-id: 76ce47cc2f152d569251b084030c3b747a8f50ff
2019-05-26 11:27:31 +08:00
Xu Peng 73d91135d1 feat(db): add archive files in meta
Former-commit-id: 64a1e267815cc9fb9ccd1b41b6ef8a1f082e3b20
2019-05-26 11:27:31 +08:00