Commit Graph

8612 Commits (34ccc9c7f57ea40eee94f17280fa27ddbbd80770)

Author SHA1 Message Date
Paul Dix 779633fd77
Merge pull request #56 from influxdata/pd-partiton-store
feat: Add Partition Store
2020-04-03 13:27:17 -04:00
Carol (Nichols || Goulding) 7bdea751d2 test: Explicitly create the bucket in the end-to-end test 2020-04-03 09:18:15 -04:00
Carol (Nichols || Goulding) 52b2137ab0 fix: Don't create a bucket+org on write 2020-04-03 09:11:31 -04:00
Carol (Nichols || Goulding) db0942c861 feature: Implement the create bucket gRPC request 2020-04-03 09:11:08 -04:00
Carol (Nichols || Goulding) db950b4aee fix: Return None instead of Err if org doesn't exist on bucket lookup 2020-04-02 16:45:21 -04:00
Carol (Nichols || Goulding) 38e660818e style: Cargo fmt 2020-04-02 16:39:57 -04:00
Carol (Nichols || Goulding) 1334dafc0a Revert "fix: Create org if it doesn't exist"
This reverts commit a7d33b803c.
2020-04-02 16:03:05 -04:00
Carol (Nichols || Goulding) 43a2af9a60 Revert "fix: Insert org if it's not found"
This reverts commit cd470908d7.
2020-04-02 16:01:58 -04:00
Paul Dix c83805854d Fix end-to-end test for new rpc.rs behavior 2020-04-02 15:47:43 -04:00
Carol (Nichols || Goulding) cd470908d7 fix: Insert org if it's not found 2020-04-02 11:53:53 -04:00
Carol (Nichols || Goulding) 32ed04c753 style: Cargo fmt 2020-04-02 11:53:07 -04:00
Carol (Nichols || Goulding) d097af781d feature: Implement the get_buckets rpc to get bucket ids in the test 2020-04-02 11:52:39 -04:00
Carol (Nichols || Goulding) ee0afb5e02 fix: Rename field to not start with an underscore 2020-04-02 11:40:45 -04:00
Carol (Nichols || Goulding) a810113364 fix: Return ReadPoint.value instead of time twice 2020-04-02 11:18:46 -04:00
Carol (Nichols || Goulding) df67b9715a Merge remote-tracking branch 'origin/master' into pd-partiton-store 2020-04-02 11:15:26 -04:00
Carol (Nichols || Goulding) 71756da2f4
Merge pull request #48 from influxdata/unique-test-dir
feat: Use a unique test directory for test runs
2020-04-02 11:13:07 -04:00
Jake Goulding 67e9fdf5e7 refactor: Accept a path for the RocksDB location 2020-04-02 11:06:38 -04:00
Jake Goulding 40e7a11303 feature: Use a unique directory per RocksDB test run 2020-04-02 11:06:38 -04:00
Jake Goulding f77d28367d feature: Respect TEST_DELOREAN_DB_DIR in the end-to-end test 2020-04-02 11:06:38 -04:00
Jake Goulding 97d11633b8 feature: Use a unique directory per end-to-end test run 2020-04-02 11:06:36 -04:00
Jake Goulding d66cc552a6 refactor: Use an Error/Result type alias 2020-04-02 11:04:20 -04:00
Carol (Nichols || Goulding) a7d33b803c fix: Create org if it doesn't exist 2020-04-02 11:01:54 -04:00
Paul Dix 8ac21314d6
Merge pull request #55 from influxdata/duplicate-tags
feat: Error when parsing lines with duplicate tags
2020-04-02 10:28:22 -04:00
Paul Dix 6e949433ac
Merge pull request #54 from influxdata/sorted-tags
feat: Ensure tags are sorted in the line parser
2020-04-02 10:26:50 -04:00
Carol (Nichols || Goulding) 6549bebf2c refactor: Make MemDB::new more idiomatic 2020-04-02 10:05:37 -04:00
Carol (Nichols || Goulding) d9cf5c952a fix: Remove RocksDB code 2020-04-02 09:41:30 -04:00
Carol (Nichols || Goulding) 38b39eb095 fix: Keep ParseError's description private; use Display instead
This gives us more flexibility to refactor ParseError in the future.
2020-04-02 09:41:30 -04:00
Carol (Nichols || Goulding) ac5ecb01dc fix: Add some more logging for internal server errors 2020-04-02 09:02:52 -04:00
Paul Dix 38ec343b33 Refactor partition_store, database, main, and rpc
Refactored Partition to be a concrete type enum with three different types of partitions: memory, s3, or remote server. Had to move to this rather than a trait because the methods on partition are async.

Refactored database to use the new partition structure and for now only use a memory based database. Persistence will be reintroduced later with the S3 partition implementation.

Refactored main and rpc to use the new database.
2020-04-01 16:46:07 -04:00
Paul Dix 834d5b84a6 Update memdb and partitioned_store
Fix bug in memdb with pulling out a range of data.

Simplify code in partition store to address PR feedback.
2020-03-27 16:24:02 -04:00
Carol (Nichols || Goulding) fa88416dff style: Cargo fmt 2020-03-27 15:53:37 -04:00
Carol (Nichols || Goulding) 2eb09f29ef refactor: Prefer match on the result of cmp to if/else if/else chains 2020-03-27 15:53:19 -04:00
Jake Goulding 1247544deb refactor: remove unneeded explicit types 2020-03-27 14:28:38 -04:00
Jake Goulding 90dbac2df5 doc: Moving details about size estimates to the doc comment 2020-03-27 13:56:05 -04:00
Jake Goulding 2ab44b2603 doc: use doc comments instead of code comments 2020-03-27 13:51:16 -04:00
Jake Goulding 37e1526933 refactor: DRY up the Point -> ReadPoint conversion code 2020-03-27 13:48:46 -04:00
Carol (Nichols || Goulding) ace1060388 refactor: Take the advice of the clippy::explicit_iter_loop lint 2020-03-27 10:45:42 -04:00
Carol (Nichols || Goulding) 533deedbdd fix: Allow if-elses rather than matches 2020-03-27 10:45:42 -04:00
Carol (Nichols || Goulding) 431f4c5633 refactor: Remove unneeded let binding 2020-03-27 09:30:18 -04:00
Carol (Nichols || Goulding) 9411391c4c fix: Remove unused imports 2020-03-27 09:24:02 -04:00
Carol (Nichols || Goulding) fed0a5e8b0 fix: Allow dead code temporarily while partition is being refactored 2020-03-27 09:23:51 -04:00
Carol (Nichols || Goulding) 48954424e1 docs: Add some documentation and TODO comments 2020-03-27 09:14:09 -04:00
Carol (Nichols || Goulding) fa8f04ddb3 style: Cargo fmt 2020-03-27 09:13:48 -04:00
Paul Dix 0ded436d71 Merge branch 'pd-partiton-store' of github.com:influxdata/delorean into pd-partiton-store 2020-03-26 16:26:23 -04:00
Paul Dix aa18015c29 Update partition_store and memdb
Update ReadMergeStream to use a single vec to store stream state.

Update ReadBatch to always assume values in the batch. Update memdb to not put batches with no values in the result set.
2020-03-26 16:23:58 -04:00
Paul Dix 4375afd85c Update partition_store
Updated StreamState to use a single vector to track the streams and the next value.
2020-03-26 13:28:32 -04:00
Carol (Nichols || Goulding) f223fe408b fix: Remove redundant clear 2020-03-26 11:19:05 -04:00
Carol (Nichols || Goulding) 97aedbd167 fix: Remove redundant empty checks 2020-03-26 11:15:10 -04:00
Carol (Nichols || Goulding) 1b4b3fe7ad refactor: Rename a variable to make its purpose clearer
I was reading this as "sortED" which is the opposite of what this means.
2020-03-25 10:03:08 -04:00
Carol (Nichols || Goulding) 23e0b097ca fix: Use sort_by_key on time rather than implementing traits
Needed because the PartialOrd/Ord trait implementations would then
disagree with the PartialEq/Eq trait implementations, which isn't really
what's desired.

Change the method name to make it clearer that this isn't using the Ord
trait's sort.
2020-03-25 10:00:44 -04:00