Commit Graph

92 Commits (17af5fcbd182cd95604aa9debea423915dc77562)

Author SHA1 Message Date
Carol (Nichols || Goulding) 6da9cf246f feat: Introduce a public DeletedDatabase type 2021-09-02 14:57:27 -04:00
Carol (Nichols || Goulding) 8703aaff63 feat: Introduce a public GenerationId wrapper type 2021-09-02 14:57:27 -04:00
Carol (Nichols || Goulding) f47d7e6d92 feat: Return the time the database was deleted 2021-09-02 14:57:27 -04:00
Carol (Nichols || Goulding) 51b6631d8f feat: Implement a list_all_databases API that returns generation info too 2021-09-02 14:57:27 -04:00
Carol (Nichols || Goulding) 1d50eb9880 test: Add a unit-ish test for list_possible_databases 2021-09-02 14:57:27 -04:00
Marco Neumann 70a5ffeae7 test: allow creation of deterministic chunks and transactions 2021-09-01 11:26:05 +02:00
Carol (Nichols || Goulding) d688678464 feat: Add an iox_object_store API for writing the tombstone file
Connects to #1871.
2021-08-30 10:42:45 -04:00
Carol (Nichols || Goulding) 5566e1926c refactor: Use max_by_key instead of map max 2021-08-26 09:14:23 -04:00
Carol (Nichols || Goulding) 82b566a3bb fix: Warn when a non-generation item is found in a database directory 2021-08-26 09:14:23 -04:00
Carol (Nichols || Goulding) c16b4b1bff refactor: Have GenerationPath save a Generation field 2021-08-26 09:14:23 -04:00
Carol (Nichols || Goulding) 63efda8213 fix: Avoid leaking generation id in an error type 2021-08-26 09:14:23 -04:00
Carol (Nichols || Goulding) 9edffea878 docs: Add and clarify some caveats and intentions 2021-08-26 09:14:23 -04:00
Carol (Nichols || Goulding) 7b6093092a refactor: make the `existing` method private and share more code 2021-08-26 09:14:23 -04:00
Carol (Nichols || Goulding) 2c42a195ea fix: Remove now-unused generation_id method on iox object store 2021-08-26 09:14:23 -04:00
Carol (Nichols || Goulding) 199d212b18 refactor: Move find-or-create IoxObjectStore logic into tests
This is the only place this logic is used; it's not appropriate for
production usage as we only ever want to either find and error or create
and error in real life.
2021-08-26 09:14:23 -04:00
Carol (Nichols || Goulding) c7eceac8a3 refactor: Have server determine database generation from object store 2021-08-26 09:14:23 -04:00
Carol (Nichols || Goulding) 1f0e37c9d1 refactor: Use the parsed_path macro to make path creation shorter 2021-08-26 09:14:22 -04:00
Carol (Nichols || Goulding) 6a79f69bfc refactor: Make methods on paths to produce other paths 2021-08-26 09:14:22 -04:00
Carol (Nichols || Goulding) 5e1b57de9a refactor: Borrow arcs instead of as_ref 2021-08-26 09:14:22 -04:00
Carol (Nichols || Goulding) cee2f21d47 feat: Add a find_or_create object store function for tests 2021-08-26 09:14:22 -04:00
Carol (Nichols || Goulding) d42cbaeef8 feat: Add a method to find one active database in object storage 2021-08-26 09:14:22 -04:00
Carol (Nichols || Goulding) 18ba3b5c59 feat: Create database directories with a generation ID 2021-08-26 09:14:22 -04:00
Carol (Nichols || Goulding) a8ada048dd test: Move success case first so it's easier to see when assumptions are broken 2021-08-26 09:14:22 -04:00
Jake Goulding 375347478a
test: Add basic functional tests for the database rules file methods (#2366)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-24 13:27:58 +00:00
Carol (Nichols || Goulding) cc214fa9b9 fix: The path to db rules.pb shouldn't end in a slash 2021-08-19 21:07:33 -04:00
Carol (Nichols || Goulding) 61263c8774 feat: Add a debugging-suitable way to get the object storage path of a database 2021-08-18 11:32:39 -04:00
Carol (Nichols || Goulding) 997f61c5f6 refactor: Rename Paths to their more specific exported names 2021-08-18 11:32:39 -04:00
Carol (Nichols || Goulding) 10c9acf5c4 refactor: Mark internally-pub items with pub crate to make their privacy status clearer 2021-08-18 11:32:39 -04:00
Carol (Nichols || Goulding) cb05b29917 docs: Explain reasoning behind the crate design more 2021-08-18 11:32:39 -04:00
Carol (Nichols || Goulding) fbf3ceb1e2 refactor: Extract listing of all databases into iox_object_store 2021-08-18 11:32:39 -04:00
Carol (Nichols || Goulding) 557e4498cd refactor: Use the DatabaseName type on IoxObjectStore 2021-08-18 11:32:39 -04:00
Carol (Nichols || Goulding) aba0779162 fix: Update tests to expect new Display format on ObjectStorePaths 2021-08-18 11:32:39 -04:00
Carol (Nichols || Goulding) ef0e1a3f60 refactor: Extract a transaction file path type 2021-08-18 11:32:39 -04:00
Carol (Nichols || Goulding) a5ab6c295a refactor: Move complicated Paths to submodules 2021-08-18 11:32:39 -04:00
Carol (Nichols || Goulding) be5b5139a2 refactor: Move the catalog transaction paths to iox_object_store 2021-08-18 11:32:39 -04:00
Jake Goulding 63111d9d9a refactor: Move the database rules functionality to iox_object_store 2021-08-18 11:32:39 -04:00
Carol (Nichols || Goulding) 6d5cb9c117 refactor: Extract a ParquetFilePath to handle paths to parquet files in a db's object store 2021-08-18 11:32:39 -04:00
Ning Sun c012e996ab
refactor: remove display methods, use fmt::Display instead. (#2272)
* refactor: remove display methods, use fmt::Display instead.

Signed-off-by: Ning Sun <sunng@protonmail.com>

* refactor: update a few calls from .display to .to_string()

* fix: consistently use `Path` rather than occasionally `DirsAndFileName`

* fix: fixup for merge conflicts

* fix: update test

* fix: Catch another case or two

* fix: fmt

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-16 18:00:22 +00:00
Carol (Nichols || Goulding) 927d947005 fix: Ignore failure to send errors over a channel 2021-08-12 15:05:32 -04:00
Carol (Nichols || Goulding) f3b23990c7 refactor: Rename store field to inner 2021-08-12 15:05:32 -04:00
Carol (Nichols || Goulding) 9a40411742 docs: Add more information about this type
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-08-12 15:05:32 -04:00
Carol (Nichols || Goulding) ae6b0e669b refactor: Extract a database persister type that wraps object store
Connects to #2193.
2021-08-12 15:05:32 -04:00