Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
influxdb/router/Cargo.toml

68 lines
2.2 KiB
TOML
Raw Normal View History

feat: new router2 crate This commit adds an almost-empty router2 crate containing enough of a skeleton to plumb into the IOx CLI/server runner.
2022-01-12 14:13:20 +00:00
[package]
fix: Rename router2 to router
2022-05-06 18:51:52 +00:00
name = "router"
feat: Use workspace package metadata to reduce differences and repetition
2022-09-26 14:43:00 +00:00
version.workspace = true
authors.workspace = true
edition.workspace = true
license.workspace = true
feat: new router2 crate This commit adds an almost-empty router2 crate containing enough of a skeleton to plumb into the IOx CLI/server runner.
2022-01-12 14:13:20 +00:00
[dependencies]
feat: abstract DML handler Defines the DmlHandler trait responsible for processing a request in some abstract way, decoupling the HTTP/gRPC request handlers from the underlying routing logic.
2022-01-14 11:34:42 +00:00
async-trait = "0.1"
chore: use http in router authz deps The router should be using the "http" feature - this prevents crate-specific tests from compiling otherwise.
2023-04-19 12:44:41 +00:00
authz = { path = "../authz", features = ["http"] }
feat(idpe-17265): cst write authorization (#7527) * feat(idpe-17265): authorization should occur as part of the single_tenant specific mod * authz service is accessed only through the single_tenant mod handler * authz service is wrapped in auth mod * move auth integration test into auth mod * push down the authorize() call into the query params parser call, in order to access query params in the extract_token * provide configuration error when authz or single_tenant mode are not co-presented * update authz e2e fixtures * feat(idpe-17265): extract tokens based upon preferred ordering in spec, and write tests to verify behavior. * chore(idpe-17265): update naming conventions for a unifying parser * test: make MockAuthorizer have default, and add a test_delegate_to_authz for CST * chore: record authz duration metric, and include in delegation test. * chore: use authz terminology instead of auth_service * chore: more explicit naming * Revert "chore: record authz duration metric, and include in delegation test." This reverts commit 05c36888ca7247b6953343d759a5185098fae679. * refactor: extract_header_token versus the else condition * refactor: make single_tenant mod and move auth within * chore: make unreachable explicitly panic in the build * test: make token values be const, to be consumed when MockAuthorizer is used * test: use locking for calls_counter in test * fix: add base64 encoding as expected for Basic header * fix: merge conflict resolution. The AuthorizationHeaderExtension is now under the authz::http mod, which is a required feature for router package. * chore: run rustfmt nightly with preferred import handling, on files with modified imports * chore: code cleanup, to have minimal code needed
2023-04-19 15:28:10 +00:00
base64 = "0.21.0"
chore(deps): Bump bytes from 1.3.0 to 1.4.0 Bumps [bytes](https://github.com/tokio-rs/bytes) from 1.3.0 to 1.4.0. - [Release notes](https://github.com/tokio-rs/bytes/releases) - [Changelog](https://github.com/tokio-rs/bytes/blob/master/CHANGELOG.md) - [Commits](https://github.com/tokio-rs/bytes/compare/v1.3.0...v1.4.0) --- updated-dependencies: - dependency-name: bytes dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
2023-02-01 00:30:56 +00:00
bytes = "1.4"
fix: Remove old router
2023-02-10 16:40:24 +00:00
crossbeam-utils = "0.8.15"
fix: Rename data_types2 to data_types
2022-05-05 19:29:24 +00:00
data_types = { path = "../data_types" }
feat: new router2 crate This commit adds an almost-empty router2 crate containing enough of a skeleton to plumb into the IOx CLI/server runner.
2022-01-12 14:13:20 +00:00
dml = { path = "../dml" }
feat: router2 HTTP handlers Implements the HTTP v2 write API endpoint for router2.
2022-01-14 13:34:16 +00:00
flate2 = "1.0"
chore(deps): Bump futures from 0.3.27 to 0.3.28 (#7397) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.27 to 0.3.28. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.27...0.3.28) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-31 10:44:23 +00:00
futures = "0.3.28"
feat: new router2 crate This commit adds an almost-empty router2 crate containing enough of a skeleton to plumb into the IOx CLI/server runner.
2022-01-12 14:13:20 +00:00
generated_types = { path = "../generated_types" }
refactor: use a workspace dependency for hashbrown
2022-11-11 17:12:30 +00:00
hashbrown = { workspace = true }
feat: new router2 crate This commit adds an almost-empty router2 crate containing enough of a skeleton to plumb into the IOx CLI/server runner.
2022-01-12 14:13:20 +00:00
hyper = "0.14"
feat: schema validation Implements a write schema validation DML handler, denying requests that conflict with the schema within the global catalog. Additive schema changes are accepted, incrementally updating the global catalog schema. Deletes are passed through unchanged and unvalidated.
2022-01-28 16:25:20 +00:00
iox_catalog = { path = "../iox_catalog" }
fix: Rename data_types2 to data_types
2022-05-05 19:29:24 +00:00
iox_time = { path = "../iox_time" }
feat: new router2 crate This commit adds an almost-empty router2 crate containing enough of a skeleton to plumb into the IOx CLI/server runner.
2022-01-12 14:13:20 +00:00
metric = { path = "../metric" }
refactor: avoid constructing DmlOperation Instead of converting the set of MutableBatches into a DmlOperation to shard into more DmlOperation instances, the sharder can operate directly on the MutableBatches.
2022-01-14 16:52:03 +00:00
mutable_batch = { path = "../mutable_batch" }
feat: abstract DML handler Defines the DmlHandler trait responsible for processing a request in some abstract way, decoupling the HTTP/gRPC request handlers from the underlying routing logic.
2022-01-14 11:34:42 +00:00
mutable_batch_lp = { path = "../mutable_batch_lp" }
feat: grpc write handler Implements the gRPC write handler endpoint.
2022-02-23 15:41:45 +00:00
mutable_batch_pb = { version = "0.1.0", path = "../mutable_batch_pb" }
chore(deps): Bump object_store from 0.5.5 to 0.5.6 (#7433) Bumps [object_store](https://github.com/apache/arrow-rs) from 0.5.5 to 0.5.6. - [Release notes](https://github.com/apache/arrow-rs/releases) - [Changelog](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md) - [Commits](https://github.com/apache/arrow-rs/commits) --- updated-dependencies: - dependency-name: object_store dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Dom <dom@itsallbroken.com> Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-04 08:43:34 +00:00
object_store = "0.5.6"
feat: abstract DML handler Defines the DmlHandler trait responsible for processing a request in some abstract way, decoupling the HTTP/gRPC request handlers from the underlying routing logic.
2022-01-14 11:34:42 +00:00
observability_deps = { path = "../observability_deps" }
chore: upgrade rskafka and parking_lot (#3592)
2022-02-01 11:50:42 +00:00
parking_lot = "0.12"
feat: grpc write handler Implements the gRPC write handler endpoint.
2022-02-23 15:41:45 +00:00
schema = { version = "0.1.0", path = "../schema" }
feat: router2 HTTP handlers Implements the HTTP v2 write API endpoint for router2.
2022-01-14 13:34:16 +00:00
serde = "1.0"
chore(deps): Bump serde_json from 1.0.95 to 1.0.96 (#7535) Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.95 to 1.0.96. - [Release notes](https://github.com/serde-rs/json/releases) - [Commits](https://github.com/serde-rs/json/compare/v1.0.95...v1.0.96) --- updated-dependencies: - dependency-name: serde_json dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-13 10:07:32 +00:00
serde_json = "1.0.96"
feat: router2 HTTP handlers Implements the HTTP v2 write API endpoint for router2.
2022-01-14 13:34:16 +00:00
serde_urlencoded = "0.7"
chore: Alphabetize some dependencies I can't handle not knowing where to look for a dependency or knowing where to add a new dependency.
2022-10-28 14:34:23 +00:00
service_grpc_catalog = { path = "../service_grpc_catalog"}
chore: router namespace api (#6151) * chore: move ns api from querier to router * chore: add explanatory comment in querier about moved namespace API * fix: add namespace service to router * fix: querier returns unimplemented error for ns retention, not panic * chore: reuse namespace -> proto in router ns api * chore: grpc namespace - consume ns to avoid clone Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-16 15:25:49 +00:00
service_grpc_namespace = { path = "../service_grpc_namespace"}
refactor: rename `iox_object_store_service` to `service_grpc_object_store` for consisntency (#4572) Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-12 14:22:18 +00:00
service_grpc_object_store = { path = "../service_grpc_object_store" }
fix: Remove old router
2023-02-10 16:40:24 +00:00
service_grpc_schema = { path = "../service_grpc_schema" }
feat: Extract sharder to its own crate
2022-06-09 19:10:16 +00:00
sharder = { path = "../sharder" }
fix: Remove old router
2023-02-10 16:40:24 +00:00
smallvec = "1.10.0"
feat: new router2 crate This commit adds an almost-empty router2 crate containing enough of a skeleton to plumb into the IOx CLI/server runner.
2022-01-12 14:13:20 +00:00
thiserror = "1.0"
feat: meaningful RPC write failure errors Whenever an RPC write to an upstream ingester fails, it is retried after an increasing delay, until the RPC_TIMEOUT is hit. Because of this, any RPC write error would be returned as a "timeout", masking the underling reason the write actually failed. This commit pushes down the timeout logic, and retains the most recently observed RPC write error, returning it to the user instead of the timeout error.
2023-03-23 14:46:19 +00:00
tokio = { version = "1", features = ["rt-multi-thread", "macros", "time"] }
refactor: Use workspace dependencies for `tonic`, `tonic-build`, etc (#7515) * refactor: Use workspace dependencies for `tonic`, `tonic-build`, etc * chore: Run cargo hakari tasks --------- Co-authored-by: CircleCI[bot] <circleci@influxdata.com> Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-12 16:07:19 +00:00
tonic = { workspace = true }
feat: new router2 crate This commit adds an almost-empty router2 crate containing enough of a skeleton to plumb into the IOx CLI/server runner.
2022-01-12 14:13:20 +00:00
trace = { path = "../trace/" }
chore: Rerun cargo hakari manage-deps
2023-02-24 18:02:23 +00:00
workspace-hack = { version = "0.1", path = "../workspace-hack" }
feat: abstract DML handler Defines the DmlHandler trait responsible for processing a request in some abstract way, decoupling the HTTP/gRPC request handlers from the underlying routing logic.
2022-01-14 11:34:42 +00:00
[dev-dependencies]
assert_matches = "1.5"
chore: slim down `criterion` (#5611) Criterion comes with some extra cargo tooling called `cargo criterion` which can be used instead of `cargo bench`. The advantage is that we don't need to compile the entire reporting infrastructure into our benchmarks. So let's embrace this separation of concerns. Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-09-12 08:47:35 +00:00
criterion = { version = "0.4", default-features = false, features = ["async_tokio", "rayon"]}
fix: Rename crate `influxdb_line_protocol` to `influxdb-line-protocol` (#7244) * fix: Rename crate `influxdb_line_protocol` to `influxdb-line-protocol` * fix: hakari config --------- Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-03-17 13:19:50 +00:00
influxdb-line-protocol = { path = "../influxdb_line_protocol" }
feat: Enforce table column limits from the schema cache (#5819) * fix: Avoid some allocations by collecting instead of inserting into a vec * refactor: Encode that adding columns is for one table at a time * test: Add another test of column limits * test: Add below/above limit tests for create_or_get_many * fix: Explicitly DO NOT check column limits when inserting many columns * feat: Cache the max_columns_per_table on the NamespaceSchema * feat: Add a function to validate column limits in-memory * fix: Provide more useful information when over column limits * fix: Swap types to remove intermediate allocation * docs: Explain the interactions of the cache and the column limits * test: Actually set up test that showcases column limit race condition * fix: Allow writing to existing columns even if table is over column limit Co-authored-by: Dom <dom@itsallbroken.com>
2022-10-14 11:34:17 +00:00
iox_tests = { path = "../iox_tests" }
refactor: Replace all uses of lazy_static with once_cell Went through and remove all lazy_static uses with once_cell (while waiting for the project to compile). There are still dependencies using lazy_static so it is still in the crate graph but at least there isn't an explicit dependency on it (and it is easier to update to `std::lazy::Lazy` once that is stable).
2022-06-29 11:27:43 +00:00
once_cell = "1"
chore(deps): Bump paste from 1.0.11 to 1.0.12 (#7130) Bumps [paste](https://github.com/dtolnay/paste) from 1.0.11 to 1.0.12. - [Release notes](https://github.com/dtolnay/paste/releases) - [Commits](https://github.com/dtolnay/paste/compare/1.0.11...1.0.12) --- updated-dependencies: - dependency-name: paste dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-06 10:40:41 +00:00
paste = "1.0.12"
chore(deps): Bump pretty_assertions from 1.2.1 to 1.3.0 (#5517) Bumps [pretty_assertions](https://github.com/rust-pretty-assertions/rust-pretty-assertions) from 1.2.1 to 1.3.0. - [Release notes](https://github.com/rust-pretty-assertions/rust-pretty-assertions/releases) - [Changelog](https://github.com/rust-pretty-assertions/rust-pretty-assertions/blob/main/CHANGELOG.md) - [Commits](https://github.com/rust-pretty-assertions/rust-pretty-assertions/compare/v1.2.1...v1.3.0) --- updated-dependencies: - dependency-name: pretty_assertions dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-09-01 10:20:26 +00:00
pretty_assertions = "1.3.0"
test: property test namespace schema merging This commit adds a randomised property test, that compares the results of the new namespace cache schema merging (#7555) with a known-good stdlib HashSet union (the cache implementation is effectively a more specialised set union operation). This property test also validates the "last writer wins" semantics for other, non-schema data within the namespace. Additionally the ChangeSet values returned over a pair of updates are asserted to reflect the actual values added to the cache (but not each call individually) to ensure accurate metrics are reported.
2023-04-26 13:39:20 +00:00
proptest = "1.1.0"
feat: router2 sharder benchmarking (#3558) * feat: benchmarking the router2 sharder * chore: added throughput to sharder benchmarks; vary num buckets
2022-01-27 18:09:16 +00:00
rand = "0.8.3"
feat(router2): simultaneous HTTP request limit This commit adds a service protection limit, allowing the router to restrict the number of simultaneous HTTP requests to a hard-coded limit of 200. By dropping additional requests once the router is serving the configured maximum, the router is prevented from accepting more and more requests that stack up waiting on the catalog / postgres connection pool. Currently buffering all these stalled connections consumes so much memory the router is OOM killed. After this commit, a portion of requests will be satisfied and the rest will be dropped early with a HTTP 503 Service Unavailable response.
2022-04-25 14:06:28 +00:00
test_helpers = { version = "0.1.0", path = "../test_helpers", features = ["future_timeout"] }
feat: meaningful RPC write failure errors Whenever an RPC write to an upstream ingester fails, it is retried after an increasing delay, until the RPC_TIMEOUT is hit. Because of this, any RPC write error would be returned as a "timeout", masking the underling reason the write actually failed. This commit pushes down the timeout logic, and retains the most recently observed RPC write error, returning it to the user instead of the timeout error.
2023-03-23 14:46:19 +00:00
tokio = { version = "1", features = ["test-util"] }
chore(deps): Bump tokio-stream from 0.1.12 to 0.1.13 (#7666) Bumps [tokio-stream](https://github.com/tokio-rs/tokio) from 0.1.12 to 0.1.13. - [Release notes](https://github.com/tokio-rs/tokio/releases) - [Commits](https://github.com/tokio-rs/tokio/compare/tokio-stream-0.1.12...tokio-stream-0.1.13) --- updated-dependencies: - dependency-name: tokio-stream dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Dom <dom@itsallbroken.com> Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-26 09:31:04 +00:00
tokio-stream = { version = "0.1.13", default_features = false, features = [] }
feat: router2 sharder benchmarking (#3558) * feat: benchmarking the router2 sharder * chore: added throughput to sharder benchmarks; vary num buckets
2022-01-27 18:09:16 +00:00
chore: do not build benchmark binary for lib targets (#5400) Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-08-16 08:11:23 +00:00
[lib]
# Allow --save-baseline to work
# https://github.com/bheisler/criterion.rs/issues/275
bench = false
feat: schema validation benchmarks Useful for confirming the scalability of the schema check algorithm.
2022-03-04 00:28:02 +00:00
[[bench]]
name = "schema_validator"
harness = false