Commit Graph

2235 Commits (081c208ad3d799ca0a35db4f2b878aadcf760197)

Author SHA1 Message Date
Carol (Nichols || Goulding) ac5ecb01dc fix: Add some more logging for internal server errors 2020-04-02 09:02:52 -04:00
Paul Dix 38ec343b33 Refactor partition_store, database, main, and rpc
Refactored Partition to be a concrete type enum with three different types of partitions: memory, s3, or remote server. Had to move to this rather than a trait because the methods on partition are async.

Refactored database to use the new partition structure and for now only use a memory based database. Persistence will be reintroduced later with the S3 partition implementation.

Refactored main and rpc to use the new database.
2020-04-01 16:46:07 -04:00
Paul Dix 834d5b84a6 Update memdb and partitioned_store
Fix bug in memdb with pulling out a range of data.

Simplify code in partition store to address PR feedback.
2020-03-27 16:24:02 -04:00
Carol (Nichols || Goulding) fa88416dff style: Cargo fmt 2020-03-27 15:53:37 -04:00
Carol (Nichols || Goulding) 2eb09f29ef refactor: Prefer match on the result of cmp to if/else if/else chains 2020-03-27 15:53:19 -04:00
Jake Goulding 1247544deb refactor: remove unneeded explicit types 2020-03-27 14:28:38 -04:00
Jake Goulding 90dbac2df5 doc: Moving details about size estimates to the doc comment 2020-03-27 13:56:05 -04:00
Jake Goulding 2ab44b2603 doc: use doc comments instead of code comments 2020-03-27 13:51:16 -04:00
Jake Goulding 37e1526933 refactor: DRY up the Point -> ReadPoint conversion code 2020-03-27 13:48:46 -04:00
Carol (Nichols || Goulding) ace1060388 refactor: Take the advice of the clippy::explicit_iter_loop lint 2020-03-27 10:45:42 -04:00
Carol (Nichols || Goulding) 533deedbdd fix: Allow if-elses rather than matches 2020-03-27 10:45:42 -04:00
Carol (Nichols || Goulding) 431f4c5633 refactor: Remove unneeded let binding 2020-03-27 09:30:18 -04:00
Carol (Nichols || Goulding) 9411391c4c fix: Remove unused imports 2020-03-27 09:24:02 -04:00
Carol (Nichols || Goulding) fed0a5e8b0 fix: Allow dead code temporarily while partition is being refactored 2020-03-27 09:23:51 -04:00
Carol (Nichols || Goulding) 48954424e1 docs: Add some documentation and TODO comments 2020-03-27 09:14:09 -04:00
Carol (Nichols || Goulding) fa8f04ddb3 style: Cargo fmt 2020-03-27 09:13:48 -04:00
Paul Dix 0ded436d71 Merge branch 'pd-partiton-store' of github.com:influxdata/delorean into pd-partiton-store 2020-03-26 16:26:23 -04:00
Paul Dix aa18015c29 Update partition_store and memdb
Update ReadMergeStream to use a single vec to store stream state.

Update ReadBatch to always assume values in the batch. Update memdb to not put batches with no values in the result set.
2020-03-26 16:23:58 -04:00
Paul Dix 4375afd85c Update partition_store
Updated StreamState to use a single vector to track the streams and the next value.
2020-03-26 13:28:32 -04:00
Carol (Nichols || Goulding) f223fe408b fix: Remove redundant clear 2020-03-26 11:19:05 -04:00
Carol (Nichols || Goulding) 97aedbd167 fix: Remove redundant empty checks 2020-03-26 11:15:10 -04:00
Carol (Nichols || Goulding) 1b4b3fe7ad refactor: Rename a variable to make its purpose clearer
I was reading this as "sortED" which is the opposite of what this means.
2020-03-25 10:03:08 -04:00
Carol (Nichols || Goulding) 23e0b097ca fix: Use sort_by_key on time rather than implementing traits
Needed because the PartialOrd/Ord trait implementations would then
disagree with the PartialEq/Eq trait implementations, which isn't really
what's desired.

Change the method name to make it clearer that this isn't using the Ord
trait's sort.
2020-03-25 10:00:44 -04:00
Paul Dix 215c1138ea Update memdb and partitioned_store
Run fmt and fix test failure for size check on memdb.
2020-03-22 18:08:04 -04:00
Paul Dix 2663d9d756 Update memdb and partition_store
Clean up based on PR feedback.
2020-03-22 17:59:25 -04:00
Paul Dix 8424d49c64 Add Partition Store
This adds the Partition trait along with helper functions and structs to combine the results from multiple partitions.

It also refactors MemDB to have methods that align with the partition trait so that it can be used later by database.rs.

There are obvious places where it is inefficient, but this should be enough to get started with refactoring database.rs to use this rather than rocksdb, series_store, and inverted_index.
2020-03-19 15:30:24 -04:00
Jake Goulding 4fd0c6f210 feat: Error when parsing lines with duplicate tags 2020-03-11 22:43:09 -04:00
Jake Goulding 167750669b refactor: Change the line_parser to return a Result 2020-03-11 22:43:09 -04:00
Jake Goulding 566f0f4c5c refactor: Add a line parser Result alias 2020-03-11 22:43:09 -04:00
Jake Goulding 40614bcf87 refactor: Extract function to convert the parsed line into a value 2020-03-11 22:43:09 -04:00
Jake Goulding f5305fd468 feat: Ensure tags are sorted in the line parser 2020-03-11 22:43:07 -04:00
Carol (Nichols || Goulding) 093e1e960f
Merge pull request #50 from influxdata/line-parser
refactor: Rewrite the line parser with nom
2020-03-06 10:14:01 -05:00
Jake Goulding 78a53aa391 refactor: Replace the hand-written parser with one built with nom 2020-03-06 10:00:29 -05:00
Jake Goulding d5d00071e0 test: Ensure the line protocol parser includes the tag set in the series 2020-03-06 09:51:43 -05:00
Jake Goulding db7bb94450 test: Split tests apart to provide better feedback 2020-03-06 09:51:43 -05:00
Jake Goulding 5972381ad2
Merge pull request #51 from influxdata/remove-failure
refactor: Remove unused failure crate
2020-03-02 08:34:10 -05:00
Jake Goulding 5d3f99da98 refactor: Remove unused failure crate 2020-02-28 16:54:28 -05:00
Jake Goulding 8666edb208
Merge pull request #49 from influxdata/unused-import
style: Remove unused import
2020-02-28 11:35:58 -05:00
Jake Goulding a1cbe4235f style: Remove unused import 2020-02-28 09:41:51 -05:00
Edd Robinson bfe17259f1
Merge pull request #21 from influxdata/er-encoder-bench
test: add encoder/decoder benchmarks
2020-02-28 13:05:00 +00:00
Edd Robinson 17051717e2 chore: remove dependency: 2020-02-28 12:55:28 +00:00
Edd Robinson c2b49a7804 refactor: please clippy 2020-02-27 19:41:55 +00:00
Edd Robinson 01fcff539f chore: kick CI 2020-02-27 15:56:51 +00:00
Edd Robinson 38f23ac07a refactor: merge master in 2020-02-27 14:27:23 +00:00
Carol (Nichols || Goulding) f155e64723
Merge pull request #41 from influxdata/cn-storage-grpc-api
feature: Implementing the storage gRPC API except for read group
2020-02-26 16:33:55 -05:00
Carol (Nichols || Goulding) 54a66c14c8 feature: Implement read filter request 2020-02-26 09:51:02 -05:00
Carol (Nichols || Goulding) 7cac8cc10c feature: Implement tag values request 2020-02-26 09:51:02 -05:00
Carol (Nichols || Goulding) 2a4d2fe52d feature: Implement tag keys request 2020-02-26 09:51:02 -05:00
Carol (Nichols || Goulding) 1cd270fdea feature: Add a trait for common parsing of gRPC inputs 2020-02-26 09:01:57 -05:00
Carol (Nichols || Goulding) a6cb0cd8a9 feature: Hook up Storage gRPC trait with requests unimplemented 2020-02-26 08:55:25 -05:00