6991b03329
chore(deps): Bump cc from 1.0.76 to 1.0.77 ( #6182 )
...
Bumps [cc](https://github.com/rust-lang/cc-rs ) from 1.0.76 to 1.0.77.
- [Release notes](https://github.com/rust-lang/cc-rs/releases )
- [Commits](https://github.com/rust-lang/cc-rs/compare/1.0.76...1.0.77 )
---
updated-dependencies:
- dependency-name: cc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-21 10:14:52 +00:00
54c8b0a10a
chore(deps): Bump snap from 1.0.5 to 1.1.0 ( #6185 )
...
Bumps [snap](https://github.com/BurntSushi/rust-snappy ) from 1.0.5 to 1.1.0.
- [Release notes](https://github.com/BurntSushi/rust-snappy/releases )
- [Commits](https://github.com/BurntSushi/rust-snappy/compare/1.0.5...1.1.0 )
---
updated-dependencies:
- dependency-name: snap
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-21 10:08:11 +00:00
9746ec0b00
chore(deps): Bump crossbeam-utils from 0.8.12 to 0.8.13 ( #6184 )
...
Bumps [crossbeam-utils](https://github.com/crossbeam-rs/crossbeam ) from 0.8.12 to 0.8.13.
- [Release notes](https://github.com/crossbeam-rs/crossbeam/releases )
- [Changelog](https://github.com/crossbeam-rs/crossbeam/blob/master/CHANGELOG.md )
- [Commits](https://github.com/crossbeam-rs/crossbeam/compare/crossbeam-utils-0.8.12...crossbeam-utils-0.8.13 )
---
updated-dependencies:
- dependency-name: crossbeam-utils
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-21 10:01:37 +00:00
5ff06060b9
Merge pull request #6186 from influxdata/dependabot/cargo/serde_json-1.0.88
...
chore(deps): Bump serde_json from 1.0.87 to 1.0.88
2022-11-21 09:54:34 +00:00
52c50c16e1
chore(deps): Bump serde_json from 1.0.87 to 1.0.88
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.87 to 1.0.88.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.87...v1.0.88 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-11-21 01:52:18 +00:00
4d55efe655
Merge pull request #6178 from influxdata/dom/ingester-rpc-write
...
feat(ingester): rpc write handler
2022-11-18 16:43:53 +00:00
21ca6bff88
Merge branch 'main' into dom/ingester-rpc-write
2022-11-18 16:37:17 +00:00
d41c1290cf
chore: copy iox images skopeo gar registry ( #6172 )
...
* chore: copy the iox images to the gar registry with skopeo
* chore: add quotes
2022-11-18 16:37:08 +00:00
7103ecd733
Merge branch 'main' into dom/ingester-rpc-write
2022-11-18 16:34:36 +00:00
85c8d16680
refactor: add a message to unreachable!()
...
Adds a message to say an impossible thing is impossible.
2022-11-18 17:33:58 +01:00
9dc32f1c16
refactor: remove names from DML init
...
Fixes conflicts introduced by #6170 .
2022-11-18 17:31:56 +01:00
d2b66ff42c
Merge pull request #6174 from influxdata/dom/write-rpc-client
...
feat(router): handler for direct write to ingester
2022-11-18 16:28:38 +00:00
cc55ab384c
Merge branch 'main' into dom/write-rpc-client
2022-11-18 16:22:19 +00:00
4630bbb956
feat: push down all predicates ( #6042 )
...
* feat: push down all predicates
* fix: fmt
* fix: fmt
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-18 16:22:01 +00:00
59b3c793d3
Merge branch 'main' into dom/ingester-rpc-write
2022-11-18 16:21:07 +00:00
af78f0d5db
refactor: remove names from DML init
...
Fixes conflicts introduced by #6170 .
2022-11-18 17:16:33 +01:00
72939f8bf0
feat(router): handler for direct write to ingester
...
This commit adds the (unused) RpcWrite implementation of the DmlHandler
trait that implements pushing a write over gRPC to a single, arbitrary
ingester. Requests are round-robin'ed across all available ingesters.
This DmlHandler implementation can be swapped out with the
ShardedWriteBuffer to change how writes are propagated to the ingester.
2022-11-18 17:08:20 +01:00
7c813c170a
feat: reintroduce compactor first file in partition exception ( #6176 )
...
* feat: compactor ignores max file count for first file
chore: typo in comment in compactor
* feat: restore special first file in partition compaction logic; add limit
* fix: calculation in compaction max file count
chore: clippy
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-18 15:58:59 +00:00
1a68da02ef
Merge pull request #6170 from influxdata/cn/remove-table-name
...
fix: Remove table names from DmlWrite
2022-11-18 15:48:45 +00:00
9351e01068
refactor: log dml apply errors
...
Ensures DML apply errors are recorded in the ingester logs.
2022-11-18 16:48:31 +01:00
16eed699fd
refactor: avoid needless partition key clone
...
Moves the trace! invocation to before the DmlWrite init to avoid having
to clone the partition key.
2022-11-18 16:46:14 +01:00
9751512d44
fix: Insert columns in schema in ingester tests where we have table names
2022-11-18 10:40:40 -05:00
f27c33d73e
fix: Simplify hashmap insert now that we have Copy keys
2022-11-18 10:40:40 -05:00
02c3083192
fix: Remove table names from Dml operations
2022-11-18 10:40:38 -05:00
a225b81e59
docs: Clarify and make consistent schema validation type comments
2022-11-18 10:39:27 -05:00
90dd9906f6
feat(ingester): rpc write endpoint
...
Adds a handler implementation of the gRPC WriteService to receive direct
RPC writes from a router.
This code is currently unused.
2022-11-18 16:36:19 +01:00
229e2adbb1
refactor: split gRPC services into modules
...
Splits the everything-grpc-in-one-file into smaller, per-service
modules.
2022-11-18 15:51:54 +01:00
49a9565240
feat: gRPC that creates namespace ( #6103 )
...
* feat: create namespace API call in router
Co-authored-by: Nga Tran <nga-tran@live.com>
* chore: treat retention as ns except in CLI
* fix: overflow in nanosecond calc
* fix: retention test after changing it from hours to ns
* chore: comment clarification in cli; better response type for error in ns API
* fix: correct some rebase mistakes
* chore: merge namespace create & create_with_retention; renamed ns create test helper fn & const
* fix: ns autocreation test was wrong after rebase
* fix: mem catalog has default 1hr retention, accidently removed in rebase
* chore: remove mem catalogs default 1hr retention; make it settable in sets & router
Co-authored-by: Luke Bond <luke.n.bond@gmail.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-18 13:02:12 +00:00
84977f63ca
chore(deps): Bump indexmap from 1.9.1 to 1.9.2 ( #6171 )
...
Bumps [indexmap](https://github.com/bluss/indexmap ) from 1.9.1 to 1.9.2.
- [Release notes](https://github.com/bluss/indexmap/releases )
- [Changelog](https://github.com/bluss/indexmap/blob/master/RELEASES.md )
- [Commits](https://github.com/bluss/indexmap/compare/1.9.1...1.9.2 )
---
updated-dependencies:
- dependency-name: indexmap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-18 12:21:01 +00:00
71ffc92559
fix: only push safe select expression through de-dup ( #6156 )
...
* fix: only push safe select expression through de-dup
Fixes #6066 .
* docs: improve
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
* fix: rebase
* test: ensure we do not split ORs
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2022-11-18 09:56:11 +00:00
6f7b1e2e26
feat: reject writes that are outside the retention period ( #6148 )
...
* feat: reject writes that are outside the retention period
* feat: add retention validator into handler stack
* chore: Apply suggestions from code review
Co-authored-by: Dom <dom@itsallbroken.com>
* refactor: address review comments
* test: unit tests fot retention validation
* chore: address review comments
* test: more unit tests and integration tests
* refactor: make time inside retention period for emphemeral_mode test
* fix: 2 hours
Co-authored-by: Dom <dom@itsallbroken.com>
2022-11-17 20:55:58 +00:00
6d3dfa781e
chore: marshal InfluxDbError into status details ( #6161 )
...
* chore: marshal InfluxDbError into status details
* chore: address feedback and CI issues
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-17 19:51:01 +00:00
50b01a2b2b
Merge pull request #6165 from influxdata/cn/test-refactor
...
test: Refactor some ingester tests in preparation for removing table names
2022-11-17 14:07:53 +00:00
1a49fa4864
Merge branch 'main' into cn/test-refactor
2022-11-17 14:01:36 +00:00
15191d11a8
feat: improve error message on `storage` `--format` parse errors ( #6155 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-17 14:01:26 +00:00
9a8b8659e5
Merge pull request #6168 from influxdata/dom/remove-unused-errors
...
refactor: remove unused errors
2022-11-17 13:33:33 +00:00
5afe58d4d2
refactor: remove unused errors
...
These error states are no longer possible after several refactors, but
do not cause a "not used" lint because of macro magic.
2022-11-17 13:53:54 +01:00
bea3b987aa
chore(deps): Bump digest from 0.10.5 to 0.10.6 ( #6162 )
...
Bumps [digest](https://github.com/RustCrypto/traits ) from 0.10.5 to 0.10.6.
- [Release notes](https://github.com/RustCrypto/traits/releases )
- [Commits](https://github.com/RustCrypto/traits/compare/digest-v0.10.5...digest-v0.10.6 )
---
updated-dependencies:
- dependency-name: digest
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-17 10:45:03 +00:00
02646e50b5
Merge pull request #6153 from influxdata/dom/round-robin
...
feat(sharder): round robin
2022-11-17 10:31:10 +00:00
d673418b6b
Merge branch 'main' into dom/round-robin
2022-11-17 10:24:50 +00:00
a6929011ea
chore(deps): Bump reqwest from 0.11.12 to 0.11.13 ( #6163 )
...
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.11.12 to 0.11.13.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.12...v0.11.13 )
---
updated-dependencies:
- dependency-name: reqwest
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-17 10:24:38 +00:00
3401c3ea69
Merge pull request #6152 from influxdata/dom/remove-unused-dep
...
build(arrow_util): datafusion is not a release dep
2022-11-17 09:56:37 +00:00
12223c0dfb
Merge branch 'main' into dom/remove-unused-dep
2022-11-17 09:50:23 +00:00
f8ede322f8
Merge pull request #6164 from influxdata/dependabot/cargo/clap-4.0.26
...
chore(deps): Bump clap from 4.0.25 to 4.0.26
2022-11-17 09:50:10 +00:00
9e0c8bb448
Merge branch 'main' into dom/remove-unused-dep
2022-11-17 09:50:00 +00:00
d4715a9fde
fix: Simplify tests by using and creating more test helpers
...
The most important part of this is creating the DmlWrites in one spot.
2022-11-16 21:48:43 -05:00
4e2b68a7c5
fix: Simplify test by not actually creating a catalog namespace
...
This isn't actually needed for what this test is testing.
2022-11-16 21:06:44 -05:00
b6286767b0
fix: Validating the schema in ingester tests isn't necessary
...
The router validates schemas; schema validation shouldn't be tested in
the ingester
2022-11-16 21:05:51 -05:00
c7b9866483
feat: Have make_write_op take the table name as an argument to be more flexible
2022-11-16 21:05:46 -05:00
d0218fb025
refactor: Simplify tests by using make_write_op helper function
2022-11-16 21:00:10 -05:00
dependabot[bot]
Dom
kodiakhq[bot]
jaymebrd
Andrew Lamb
Luke Bond
Carol (Nichols || Goulding)
Nga Tran
Marco Neumann
Christopher M. Wolff