Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
influxdb/object_store/Cargo.toml

37 lines
1.2 KiB
TOML
Raw Normal View History

feat: Object storage in S3 and GCS
2020-05-29 15:06:06 +00:00
[package]
refactor: rename delorean_object_store --> object_store (#413)
2020-11-05 13:56:30 +00:00
name = "object_store"
feat: Object storage in S3 and GCS
2020-05-29 15:06:06 +00:00
version = "0.1.0"
authors = ["Paul Dix <paul@pauldix.net>"]
edition = "2018"
chore: Clean up Cargo.tomls (#754) * fix: test_helpers crate should only be a dev-dep * fix: object_store no longer has a build script, so no longer needs a build dep * chore: Alphabetize all Cargo.tomls
2021-02-04 23:56:02 +00:00
[dependencies] # In alphabetical order
refactor: Extract a trait for ObjectStoreApi with associated path This is the promised cleanup. This structure gets rid of a lot of intermediate structures and encodes through associated types how the object stores and path types are related. The enums are still necessary to avoid having generics leak all over the place, but the object store variants and path variants should always match because they'll always come from the object store trait implementations that use the associated types.
2021-01-20 03:36:52 +00:00
async-trait = "0.1.42"
chore: Clean up Cargo.tomls (#754) * fix: test_helpers crate should only be a dev-dep * fix: object_store no longer has a build script, so no longer needs a build dep * chore: Alphabetize all Cargo.tomls
2021-02-04 23:56:02 +00:00
# Microsoft Azure Blob storage integration
# In order to support tokio 1.0 needed to pull in unreleased azure sdk
azure_core = { git = "https://github.com/Azure/azure-sdk-for-rust.git", rev = "5ecad7216e1f04c5ff41e7de4667f006664c8cca" }
azure_storage = { git = "https://github.com/Azure/azure-sdk-for-rust.git", rev = "5ecad7216e1f04c5ff41e7de4667f006664c8cca", default-features = false, features = ["table", "blob"] }
chore: update deps (tokio 1.0 and ecosystem) (#707) * chore: Update arrow + tokio deps * chore: Use bleeding edge azure * chore: Update aws + other deps * fix: fmt * fix: Switch to in-house version of routerify * fix: Upgrade to hyper 0.14 The hyper::error module is now private; hyper::Error is the public re-export * fix: Upgrade cloud storage to get tokio upgrade * fix: Upgrade open_telemetry * fix: Do not call `panic::set_hook` during another panic Doing so leads to a double panic which aborts the process. * fix: new h2 error who dis Co-authored-by: Carol (Nichols || Goulding) <carol.nichols@integer32.com> Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
2021-01-29 21:11:55 +00:00
bytes = "1.0"
feat: Add list_with_delimiter to object store This adds a new function list_with_delimiter to the object store. This commit contains just the implementation for S3, leaving the others to be completed in follow on commits. This has a fixed delimiter to ensure a directory structure is created. This delimiter should be dependent on platform and which object store is used. For any of the cloud object stores or in memory, the delimiter should be /. For the future disk based implementation it should be dependendent on if you're running on Windows or Linux. I didn't use Stream for the return type because I found it difficult to work with and I don't think it actually added anything useful. The return ListResult struct has the next token and I prefer that the caller explicitly makes calls that go over the network so they're more aware of what's going on, where a Stream abstracts that away so it's hidden behind the scenes. We can easilsy add a Stream based version on top of this existing API if we want.
2021-01-03 17:26:20 +00:00
chrono = "0.4"
chore: Clean up Cargo.tomls (#754) * fix: test_helpers crate should only be a dev-dep * fix: object_store no longer has a build script, so no longer needs a build dep * chore: Alphabetize all Cargo.tomls
2021-02-04 23:56:02 +00:00
# Google Cloud Storage integration
cloud-storage = { version = "0.7.0" }
feat: Use ObjectStorePath everywhere to feel out the API needed
2021-01-04 21:58:15 +00:00
futures = "0.3.5"
itertools = "0.9.0"
feat: Add object store path abstraction
2021-01-04 15:16:54 +00:00
percent-encoding = "2.1"
chore: Clean up Cargo.tomls (#754) * fix: test_helpers crate should only be a dev-dep * fix: object_store no longer has a build script, so no longer needs a build dep * chore: Alphabetize all Cargo.tomls
2021-02-04 23:56:02 +00:00
# rusoto crates are for Amazon S3 integration
chore: update deps (tokio 1.0 and ecosystem) (#707) * chore: Update arrow + tokio deps * chore: Use bleeding edge azure * chore: Update aws + other deps * fix: fmt * fix: Switch to in-house version of routerify * fix: Upgrade to hyper 0.14 The hyper::error module is now private; hyper::Error is the public re-export * fix: Upgrade cloud storage to get tokio upgrade * fix: Upgrade open_telemetry * fix: Do not call `panic::set_hook` during another panic Doing so leads to a double panic which aborts the process. * fix: new h2 error who dis Co-authored-by: Carol (Nichols || Goulding) <carol.nichols@integer32.com> Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
2021-01-29 21:11:55 +00:00
rusoto_core = "0.46.0"
rusoto_credential = "0.46.0"
rusoto_s3 = "0.46.0"
chore: Clean up Cargo.tomls (#754) * fix: test_helpers crate should only be a dev-dep * fix: object_store no longer has a build script, so no longer needs a build dep * chore: Alphabetize all Cargo.tomls
2021-02-04 23:56:02 +00:00
snafu = { version = "0.6.10", features = ["futures"] }
fix: enable tokio::fs for object_store crate (#788) Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-02-11 12:12:57 +00:00
tokio = { version = "1.0", features = ["macros", "fs"] }
feat: Add a local filesystem implementation of the object store
2020-06-27 00:54:35 +00:00
# Filesystem integration
feat: Allow to put streams of unknown length to objectstore Addresses the API aspect of #818 Adds a utility module that helps computing the length of a stream while buffering it for later replay (in-memory or spilling it in a temporary file).
2021-02-17 16:48:31 +00:00
tokio-util = { version = "0.6.3", features = [ "io" ] }
chore: Clean up Cargo.tomls (#754) * fix: test_helpers crate should only be a dev-dep * fix: object_store no longer has a build script, so no longer needs a build dep * chore: Alphabetize all Cargo.tomls
2021-02-04 23:56:02 +00:00
reqwest = "0.11"
# Filesystem integration
fix: Make file behave the same as other object stores with paths
2021-01-14 21:05:10 +00:00
walkdir = "2"
feat: Allow to put streams of unknown length to objectstore Addresses the API aspect of #818 Adds a utility module that helps computing the length of a stream while buffering it for later replay (in-memory or spilling it in a temporary file).
2021-02-17 16:48:31 +00:00
tempfile = "3.1.0"
feat: Add a local filesystem implementation of the object store
2020-06-27 00:54:35 +00:00
chore: Clean up Cargo.tomls (#754) * fix: test_helpers crate should only be a dev-dep * fix: object_store no longer has a build script, so no longer needs a build dep * chore: Alphabetize all Cargo.tomls
2021-02-04 23:56:02 +00:00
[dev-dependencies] # In alphabetical order
test: Only run GCS and S3 tests if the env vars are set I don't really like this because the tests will silently not be compiled if you haven't set the environment variables, so you'd only notice you weren't running the tests if you looked for those tests' output lines and saw they weren't there. Ideally, I'd like to print a warning, but this isn't possible because: - Anything printed in tests doesn't show up by default - Cargo's build scripts can't tell whether you're building as a dependency or building for that crate's tests, so the warning would show up even if you just depended on delorean_object_store (https://github.com/rust-lang/cargo/issues/2549)
2020-06-10 21:14:48 +00:00
dotenv = "0.15.0"
chore: Clean up Cargo.tomls (#754) * fix: test_helpers crate should only be a dev-dep * fix: object_store no longer has a build script, so no longer needs a build dep * chore: Alphabetize all Cargo.tomls
2021-02-04 23:56:02 +00:00
tempfile = "3.1.0"
feat: Allow to put streams of unknown length to objectstore Addresses the API aspect of #818 Adds a utility module that helps computing the length of a stream while buffering it for later replay (in-memory or spilling it in a temporary file).
2021-02-17 16:48:31 +00:00
futures-test = "0.3.12"