Commit Graph

19 Commits (56d184f80c6baa83b143235172110f251e0bdd48)

Author SHA1 Message Date
Jake Goulding ad1e3d04bb feat: Add a local filesystem implementation of the object store 2020-06-29 08:48:48 -04:00
Jake Goulding bae67cf43a refactor: Use InternalResult on the implementations of `get` streams 2020-06-29 08:48:48 -04:00
Jake Goulding f2003fbf78 refactor: Use std::io to shorten lines 2020-06-29 08:48:48 -04:00
Jake Goulding 00805a0225 refactor: Use enum variants to shorten matches 2020-06-29 08:48:48 -04:00
Carol (Nichols || Goulding) 4df99f1a7c style: Enable the clippy warning to use `Self` when recommended
Fixes #158.
2020-06-25 07:38:58 -04:00
Carol (Nichols || Goulding) afcd1efd1e style: Unify lints everywhere
Then fix the failures, mostly by adding derives and then removing some
unneeded (cheap) clones.

Document places where we purposefully don't use the same lints.

Not unifying missing_docs.

👀 https://github.com/rust-lang/cargo/issues/5034
2020-06-25 07:28:42 -04:00
Jake Goulding 0e9653cd23 docs: Use correct Markdown link syntax 2020-06-19 10:39:58 -04:00
Jake Goulding c778af92f5
Merge pull request #170 from influxdata/reduce-rebuilds
build: Prevent spurious rebuilds due to the object-store
2020-06-19 10:36:51 -04:00
Jake Goulding bfb0213ac3 feat: Update Rusoto to allow streaming data on uploads 2020-06-19 09:18:44 -04:00
Jake Goulding d5c39d931c build: Prevent spurious rebuilds due to the object-store
The file `.env` wasn't precisely specified, which caused Cargo to
re-run the build script each time. Thankfully, `dotenv` returns the
file path that it picked to load, so we can use it directly.
2020-06-19 08:37:09 -04:00
Jake Goulding b00f3ee977 chore: Apply common lints to recently-created crates 2020-06-12 09:26:18 -04:00
Carol (Nichols || Goulding) d507713503 refactor: Switch from HashMap to BTreeMap 2020-06-11 13:44:04 -04:00
Carol (Nichols || Goulding) e3b26c9961 test: Only run GCS and S3 tests if the env vars are set
I don't really like this because the tests will silently not be compiled
if you haven't set the environment variables, so you'd only notice you
weren't running the tests if you looked for those tests' output lines
and saw they weren't there.

Ideally, I'd like to print a warning, but this isn't possible because:

- Anything printed in tests doesn't show up by default
- Cargo's build scripts can't tell whether you're building as a
dependency or building for that crate's tests, so the warning would show
up even if you just depended on delorean_object_store
(https://github.com/rust-lang/cargo/issues/2549)
2020-06-10 17:26:28 -04:00
Carol (Nichols || Goulding) ea1471c503 feat: Add an in-memory object store 2020-06-10 17:23:52 -04:00
Carol (Nichols || Goulding) 4ad805863f feat: Make GCS list return a stream, by wrapping its still-sync API 2020-06-10 17:23:52 -04:00
Carol (Nichols || Goulding) d83c410a5c feat: Update to the released version of cloud-storage
My submitted API improvements got merged in!
2020-06-10 17:23:52 -04:00
Carol (Nichols || Goulding) 8c878cdfd3 docs: Update capabilities 2020-06-10 17:23:52 -04:00
Carol (Nichols || Goulding) fb5d68654d feat: Change AWS list to stream back batches of object names 2020-06-10 17:23:52 -04:00
Carol (Nichols || Goulding) d3283b1096 feat: Object storage in S3 and GCS 2020-06-10 17:23:52 -04:00