29bfb4835f
chore(deps): Bump crossbeam-utils from 0.8.12 to 0.8.14 ( #6204 )
...
Bumps [crossbeam-utils](https://github.com/crossbeam-rs/crossbeam ) from 0.8.12 to 0.8.14.
- [Release notes](https://github.com/crossbeam-rs/crossbeam/releases )
- [Changelog](https://github.com/crossbeam-rs/crossbeam/blob/master/CHANGELOG.md )
- [Commits](https://github.com/crossbeam-rs/crossbeam/compare/crossbeam-utils-0.8.12...crossbeam-utils-0.8.14 )
---
updated-dependencies:
- dependency-name: crossbeam-utils
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-22 09:21:35 +00:00
0c6afd7dbe
refactor: tune circuit breaker config ( #6202 )
...
At the moment it takes way to long to half-open and close circuits ones
they were opened.
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-22 09:03:04 +00:00
63bd302b30
chore(deps): Bump comfy-table from 6.1.2 to 6.1.3 ( #6200 )
...
Bumps [comfy-table](https://github.com/nukesor/comfy-table ) from 6.1.2 to 6.1.3.
- [Release notes](https://github.com/nukesor/comfy-table/releases )
- [Changelog](https://github.com/Nukesor/comfy-table/blob/main/CHANGELOG.md )
- [Commits](https://github.com/nukesor/comfy-table/compare/v6.1.2...v6.1.3 )
---
updated-dependencies:
- dependency-name: comfy-table
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-22 08:55:46 +00:00
04c00bbb62
chore(deps): Bump bytes from 1.2.1 to 1.3.0 ( #6199 )
...
Bumps [bytes](https://github.com/tokio-rs/bytes ) from 1.2.1 to 1.3.0.
- [Release notes](https://github.com/tokio-rs/bytes/releases )
- [Changelog](https://github.com/tokio-rs/bytes/blob/master/CHANGELOG.md )
- [Commits](https://github.com/tokio-rs/bytes/commits )
---
updated-dependencies:
- dependency-name: bytes
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-22 08:23:24 +00:00
846c8c813b
chore: Update crossbeam-utils ( #6201 )
2022-11-22 08:15:32 +00:00
e5f921fccd
Merge pull request #6193 from influxdata/dom/move-sequence-range
...
refactor: move SequenceNumberRange
2022-11-21 16:25:28 +00:00
097f0acb85
refactor: move SequenceNumberRange
...
Moves the SequenceNumberRange type out of "data" and into the root to be
reused outside of the data module. This construct is universally useful
across all the ingester code.
2022-11-21 16:11:55 +01:00
586c3fe8ea
Merge pull request #6189 from influxdata/dom/dml-sink-error
...
refactor: decouple DmlSink error type
2022-11-21 15:05:03 +00:00
1938c18c50
refactor: decouple DmlSink error type
...
Allows different DmlSink implementations to return different error
types. This allows for small, concise errors that are local to the
DmlSink implementation and specific to it. This helps avoid bloated
"kitchen sink" error types.
2022-11-21 15:29:13 +01:00
3000a2c34a
Merge pull request #6188 from influxdata/dom/move-dml-sink
...
refactor: move DmlSink
2022-11-21 14:28:00 +00:00
64c9d87b9b
refactor: move DmlSink
...
Extracts the DmlSink trait into its own module - it is independent of
the Kafka handler and will be reused.
2022-11-21 15:02:24 +01:00
67af105bde
feat: add `process_start_time_seconds` metric ( #6187 )
...
This is helpful to reason about IOx versions and changes/alerts during
deployments.
2022-11-21 12:27:04 +00:00
a9db7581cd
chore(deps): Bump tokio from 1.21.2 to 1.22.0 ( #6183 )
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.21.2 to 1.22.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.21.2...tokio-1.22.0 )
---
updated-dependencies:
- dependency-name: tokio
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-21 10:21:24 +00:00
6991b03329
chore(deps): Bump cc from 1.0.76 to 1.0.77 ( #6182 )
...
Bumps [cc](https://github.com/rust-lang/cc-rs ) from 1.0.76 to 1.0.77.
- [Release notes](https://github.com/rust-lang/cc-rs/releases )
- [Commits](https://github.com/rust-lang/cc-rs/compare/1.0.76...1.0.77 )
---
updated-dependencies:
- dependency-name: cc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-21 10:14:52 +00:00
54c8b0a10a
chore(deps): Bump snap from 1.0.5 to 1.1.0 ( #6185 )
...
Bumps [snap](https://github.com/BurntSushi/rust-snappy ) from 1.0.5 to 1.1.0.
- [Release notes](https://github.com/BurntSushi/rust-snappy/releases )
- [Commits](https://github.com/BurntSushi/rust-snappy/compare/1.0.5...1.1.0 )
---
updated-dependencies:
- dependency-name: snap
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-21 10:08:11 +00:00
9746ec0b00
chore(deps): Bump crossbeam-utils from 0.8.12 to 0.8.13 ( #6184 )
...
Bumps [crossbeam-utils](https://github.com/crossbeam-rs/crossbeam ) from 0.8.12 to 0.8.13.
- [Release notes](https://github.com/crossbeam-rs/crossbeam/releases )
- [Changelog](https://github.com/crossbeam-rs/crossbeam/blob/master/CHANGELOG.md )
- [Commits](https://github.com/crossbeam-rs/crossbeam/compare/crossbeam-utils-0.8.12...crossbeam-utils-0.8.13 )
---
updated-dependencies:
- dependency-name: crossbeam-utils
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-21 10:01:37 +00:00
5ff06060b9
Merge pull request #6186 from influxdata/dependabot/cargo/serde_json-1.0.88
...
chore(deps): Bump serde_json from 1.0.87 to 1.0.88
2022-11-21 09:54:34 +00:00
52c50c16e1
chore(deps): Bump serde_json from 1.0.87 to 1.0.88
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.87 to 1.0.88.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.87...v1.0.88 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-11-21 01:52:18 +00:00
4d55efe655
Merge pull request #6178 from influxdata/dom/ingester-rpc-write
...
feat(ingester): rpc write handler
2022-11-18 16:43:53 +00:00
21ca6bff88
Merge branch 'main' into dom/ingester-rpc-write
2022-11-18 16:37:17 +00:00
d41c1290cf
chore: copy iox images skopeo gar registry ( #6172 )
...
* chore: copy the iox images to the gar registry with skopeo
* chore: add quotes
2022-11-18 16:37:08 +00:00
7103ecd733
Merge branch 'main' into dom/ingester-rpc-write
2022-11-18 16:34:36 +00:00
85c8d16680
refactor: add a message to unreachable!()
...
Adds a message to say an impossible thing is impossible.
2022-11-18 17:33:58 +01:00
9dc32f1c16
refactor: remove names from DML init
...
Fixes conflicts introduced by #6170 .
2022-11-18 17:31:56 +01:00
d2b66ff42c
Merge pull request #6174 from influxdata/dom/write-rpc-client
...
feat(router): handler for direct write to ingester
2022-11-18 16:28:38 +00:00
cc55ab384c
Merge branch 'main' into dom/write-rpc-client
2022-11-18 16:22:19 +00:00
4630bbb956
feat: push down all predicates ( #6042 )
...
* feat: push down all predicates
* fix: fmt
* fix: fmt
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-18 16:22:01 +00:00
59b3c793d3
Merge branch 'main' into dom/ingester-rpc-write
2022-11-18 16:21:07 +00:00
af78f0d5db
refactor: remove names from DML init
...
Fixes conflicts introduced by #6170 .
2022-11-18 17:16:33 +01:00
72939f8bf0
feat(router): handler for direct write to ingester
...
This commit adds the (unused) RpcWrite implementation of the DmlHandler
trait that implements pushing a write over gRPC to a single, arbitrary
ingester. Requests are round-robin'ed across all available ingesters.
This DmlHandler implementation can be swapped out with the
ShardedWriteBuffer to change how writes are propagated to the ingester.
2022-11-18 17:08:20 +01:00
7c813c170a
feat: reintroduce compactor first file in partition exception ( #6176 )
...
* feat: compactor ignores max file count for first file
chore: typo in comment in compactor
* feat: restore special first file in partition compaction logic; add limit
* fix: calculation in compaction max file count
chore: clippy
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-18 15:58:59 +00:00
1a68da02ef
Merge pull request #6170 from influxdata/cn/remove-table-name
...
fix: Remove table names from DmlWrite
2022-11-18 15:48:45 +00:00
9351e01068
refactor: log dml apply errors
...
Ensures DML apply errors are recorded in the ingester logs.
2022-11-18 16:48:31 +01:00
16eed699fd
refactor: avoid needless partition key clone
...
Moves the trace! invocation to before the DmlWrite init to avoid having
to clone the partition key.
2022-11-18 16:46:14 +01:00
9751512d44
fix: Insert columns in schema in ingester tests where we have table names
2022-11-18 10:40:40 -05:00
f27c33d73e
fix: Simplify hashmap insert now that we have Copy keys
2022-11-18 10:40:40 -05:00
02c3083192
fix: Remove table names from Dml operations
2022-11-18 10:40:38 -05:00
a225b81e59
docs: Clarify and make consistent schema validation type comments
2022-11-18 10:39:27 -05:00
90dd9906f6
feat(ingester): rpc write endpoint
...
Adds a handler implementation of the gRPC WriteService to receive direct
RPC writes from a router.
This code is currently unused.
2022-11-18 16:36:19 +01:00
229e2adbb1
refactor: split gRPC services into modules
...
Splits the everything-grpc-in-one-file into smaller, per-service
modules.
2022-11-18 15:51:54 +01:00
49a9565240
feat: gRPC that creates namespace ( #6103 )
...
* feat: create namespace API call in router
Co-authored-by: Nga Tran <nga-tran@live.com>
* chore: treat retention as ns except in CLI
* fix: overflow in nanosecond calc
* fix: retention test after changing it from hours to ns
* chore: comment clarification in cli; better response type for error in ns API
* fix: correct some rebase mistakes
* chore: merge namespace create & create_with_retention; renamed ns create test helper fn & const
* fix: ns autocreation test was wrong after rebase
* fix: mem catalog has default 1hr retention, accidently removed in rebase
* chore: remove mem catalogs default 1hr retention; make it settable in sets & router
Co-authored-by: Luke Bond <luke.n.bond@gmail.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-18 13:02:12 +00:00
84977f63ca
chore(deps): Bump indexmap from 1.9.1 to 1.9.2 ( #6171 )
...
Bumps [indexmap](https://github.com/bluss/indexmap ) from 1.9.1 to 1.9.2.
- [Release notes](https://github.com/bluss/indexmap/releases )
- [Changelog](https://github.com/bluss/indexmap/blob/master/RELEASES.md )
- [Commits](https://github.com/bluss/indexmap/compare/1.9.1...1.9.2 )
---
updated-dependencies:
- dependency-name: indexmap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-18 12:21:01 +00:00
71ffc92559
fix: only push safe select expression through de-dup ( #6156 )
...
* fix: only push safe select expression through de-dup
Fixes #6066 .
* docs: improve
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
* fix: rebase
* test: ensure we do not split ORs
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2022-11-18 09:56:11 +00:00
6f7b1e2e26
feat: reject writes that are outside the retention period ( #6148 )
...
* feat: reject writes that are outside the retention period
* feat: add retention validator into handler stack
* chore: Apply suggestions from code review
Co-authored-by: Dom <dom@itsallbroken.com>
* refactor: address review comments
* test: unit tests fot retention validation
* chore: address review comments
* test: more unit tests and integration tests
* refactor: make time inside retention period for emphemeral_mode test
* fix: 2 hours
Co-authored-by: Dom <dom@itsallbroken.com>
2022-11-17 20:55:58 +00:00
6d3dfa781e
chore: marshal InfluxDbError into status details ( #6161 )
...
* chore: marshal InfluxDbError into status details
* chore: address feedback and CI issues
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-17 19:51:01 +00:00
50b01a2b2b
Merge pull request #6165 from influxdata/cn/test-refactor
...
test: Refactor some ingester tests in preparation for removing table names
2022-11-17 14:07:53 +00:00
1a49fa4864
Merge branch 'main' into cn/test-refactor
2022-11-17 14:01:36 +00:00
15191d11a8
feat: improve error message on `storage` `--format` parse errors ( #6155 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-17 14:01:26 +00:00
9a8b8659e5
Merge pull request #6168 from influxdata/dom/remove-unused-errors
...
refactor: remove unused errors
2022-11-17 13:33:33 +00:00
5afe58d4d2
refactor: remove unused errors
...
These error states are no longer possible after several refactors, but
do not cause a "not used" lint because of macro magic.
2022-11-17 13:53:54 +01:00
dependabot[bot]
Marco Neumann
Stuart Carnie
Dom
kodiakhq[bot]
jaymebrd
Andrew Lamb
Luke Bond
Carol (Nichols || Goulding)
Nga Tran
Christopher M. Wolff