bea3b987aa
chore(deps): Bump digest from 0.10.5 to 0.10.6 ( #6162 )
...
Bumps [digest](https://github.com/RustCrypto/traits ) from 0.10.5 to 0.10.6.
- [Release notes](https://github.com/RustCrypto/traits/releases )
- [Commits](https://github.com/RustCrypto/traits/compare/digest-v0.10.5...digest-v0.10.6 )
---
updated-dependencies:
- dependency-name: digest
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-17 10:45:03 +00:00
02646e50b5
Merge pull request #6153 from influxdata/dom/round-robin
...
feat(sharder): round robin
2022-11-17 10:31:10 +00:00
d673418b6b
Merge branch 'main' into dom/round-robin
2022-11-17 10:24:50 +00:00
a6929011ea
chore(deps): Bump reqwest from 0.11.12 to 0.11.13 ( #6163 )
...
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.11.12 to 0.11.13.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.12...v0.11.13 )
---
updated-dependencies:
- dependency-name: reqwest
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-17 10:24:38 +00:00
3401c3ea69
Merge pull request #6152 from influxdata/dom/remove-unused-dep
...
build(arrow_util): datafusion is not a release dep
2022-11-17 09:56:37 +00:00
12223c0dfb
Merge branch 'main' into dom/remove-unused-dep
2022-11-17 09:50:23 +00:00
f8ede322f8
Merge pull request #6164 from influxdata/dependabot/cargo/clap-4.0.26
...
chore(deps): Bump clap from 4.0.25 to 4.0.26
2022-11-17 09:50:10 +00:00
9e0c8bb448
Merge branch 'main' into dom/remove-unused-dep
2022-11-17 09:50:00 +00:00
d4715a9fde
fix: Simplify tests by using and creating more test helpers
...
The most important part of this is creating the DmlWrites in one spot.
2022-11-16 21:48:43 -05:00
4e2b68a7c5
fix: Simplify test by not actually creating a catalog namespace
...
This isn't actually needed for what this test is testing.
2022-11-16 21:06:44 -05:00
b6286767b0
fix: Validating the schema in ingester tests isn't necessary
...
The router validates schemas; schema validation shouldn't be tested in
the ingester
2022-11-16 21:05:51 -05:00
c7b9866483
feat: Have make_write_op take the table name as an argument to be more flexible
2022-11-16 21:05:46 -05:00
d0218fb025
refactor: Simplify tests by using make_write_op helper function
2022-11-16 21:00:10 -05:00
cac241b7ad
refactor: Extract shared test setup for ingester data tests
2022-11-16 21:00:10 -05:00
256ded7e00
fix: Move a NamespaceData test into its module
2022-11-16 21:00:10 -05:00
1026bd84bc
chore(deps): Bump clap from 4.0.25 to 4.0.26
...
Bumps [clap](https://github.com/clap-rs/clap ) from 4.0.25 to 4.0.26.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v4.0.25...v4.0.26 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-11-17 01:12:21 +00:00
67712b595c
Revert "chore: Update datafusion again ( #6108 )" ( #6159 )
...
This reverts commit fbe9f27f10
2022-11-16 21:14:55 +00:00
80e91a644b
chore: Revert "feat: compactor ignores max file count for first file ( #6144 )" ( #6158 )
...
This reverts commit bf1681f4fe
2022-11-16 19:58:46 +00:00
1b900ba73d
Merge branch 'main' into dom/round-robin
2022-11-16 16:20:55 +00:00
7e1e4aa03c
Merge pull request #6154 from influxdata/dom/correct-comment
...
docs: remove redundant comment
2022-11-16 15:49:17 +00:00
cd33f25d8a
Merge branch 'main' into dom/correct-comment
2022-11-16 15:42:47 +00:00
9365d933f1
chore: router namespace api ( #6151 )
...
* chore: move ns api from querier to router
* chore: add explanatory comment in querier about moved namespace API
* fix: add namespace service to router
* fix: querier returns unimplemented error for ns retention, not panic
* chore: reuse namespace -> proto in router ns api
* chore: grpc namespace - consume ns to avoid clone
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-16 15:25:49 +00:00
fbe9f27f10
chore: Update datafusion again ( #6108 )
...
* chore: Update datafusion pin + api code
* chore: Run cargo hakari tasks
* refactor: combine_sort_key is more idomatic and add rationale comments
* refactor: satisfy borrow checker and updated comments
* fix: Add test case for combine_sort_key
* fix: Apply suggestions from code review
Co-authored-by: Marco Neumann <marco@crepererum.net>
* fix: Add back test for deeply nested expression
* fix: Update output ordering
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: Marco Neumann <marco@crepererum.net>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-16 14:41:52 +00:00
8c38911e8c
docs: remove redundant comment
...
This comment remains by mistake - table_ids is now used.
2022-11-16 14:40:53 +01:00
bc9cccaf76
test(sharder): multi-threaded sharding benchmarks
...
Adds a multithreaded scenario to the Sharder benchmarks.
2022-11-16 14:29:22 +01:00
a4e54f7a0c
feat(sharder): round-robin sharder
...
A "sharder" that simply round-robins requests over the set of T within
it.
This uses thread-local counters to eliminate write contention of the
"index" variable, so that throughput scales linearly with cores. (As
opposed to an atomic which would cause the variable to ping-pong between
core caches with a 6000% reduction in throughput, or slower yet, a
mutex-wrapped counter.)
2022-11-16 14:29:22 +01:00
4435d72594
build(arrow_util): datafusion is not a release dep
...
Moves datafusion to dev-dependencies.
2022-11-16 13:58:17 +01:00
bf1681f4fe
feat: compactor ignores max file count for first file ( #6144 )
...
* feat: compactor ignores max file count for first file
* chore: typo in comment in compactor
2022-11-16 11:21:28 +00:00
62851afc27
feat: add querier->ingester circuit breaker ( #6147 )
...
* feat: add log ingester memory pressure persist
* feat: add querier->ingester circuit breaker
Closes #4608 .
* docs: explain high-level circuit breaker
* docs: improve
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
* test: add additional test assertion
* refactor: upgrade info to warning log
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2022-11-16 10:50:33 +00:00
456314d99f
Merge pull request #6149 from influxdata/dependabot/cargo/clap-4.0.25
...
chore(deps): Bump clap from 4.0.24 to 4.0.25
2022-11-16 10:02:49 +00:00
dbe2744e04
chore(deps): Bump clap from 4.0.24 to 4.0.25
...
Bumps [clap](https://github.com/clap-rs/clap ) from 4.0.24 to 4.0.25.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v4.0.24...v4.0.25 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-11-16 01:07:58 +00:00
448911794c
test: test coverage for sorting and merging in compactor ( #6136 )
...
* test: test coverage for sorting and merging in compactor
* fix: Apply suggestions from code review (comments)
Co-authored-by: Marco Neumann <marco@crepererum.net>
* feat: use itertools to cover all permutations
Co-authored-by: Marco Neumann <marco@crepererum.net>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-15 20:39:45 +00:00
20f1ae1c8f
test: tests in the reorg planner and query tests for merging parquet files ( #6137 )
...
* test: tests in the reorg planner and query tests for merging parquet files
* fix: use 20 files
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-15 20:29:44 +00:00
2a9d330ef3
Merge pull request #6145 from influxdata/dom/rpc-write
...
feat: define router -> ingester write protocol
2022-11-15 14:45:33 +00:00
685a0858dc
Merge branch 'main' into dom/rpc-write
2022-11-15 14:38:15 +00:00
5865f68852
Merge pull request #6138 from influxdata/cn/remove-namespace
...
fix: Remove namespace string from router -> write buffer -> ingester communication
2022-11-15 14:37:52 +00:00
5ed1d8bc79
Merge branch 'main' into cn/remove-namespace
2022-11-15 14:30:44 +00:00
d2e2e0a3cd
Merge pull request #6141 from influxdata/dependabot/cargo/insta-1.21.1
...
chore(deps): Bump insta from 1.21.0 to 1.21.1
2022-11-15 14:28:31 +00:00
dcc7b10bcf
feat: define router -> ingester write protocol
...
Specify a gRPC service and request/response message formats to push
writes directly from a router to an ingester.
2022-11-15 15:00:38 +01:00
fa07a107a1
chore(deps): Bump insta from 1.21.0 to 1.21.1
...
Bumps [insta](https://github.com/mitsuhiko/insta ) from 1.21.0 to 1.21.1.
- [Release notes](https://github.com/mitsuhiko/insta/releases )
- [Changelog](https://github.com/mitsuhiko/insta/blob/master/CHANGELOG.md )
- [Commits](https://github.com/mitsuhiko/insta/commits/1.21.1 )
---
updated-dependencies:
- dependency-name: insta
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-11-15 12:01:26 +00:00
9db808f795
chore(deps): Bump similar from 2.2.0 to 2.2.1 ( #6140 )
...
Bumps [similar](https://github.com/mitsuhiko/similar ) from 2.2.0 to 2.2.1.
- [Release notes](https://github.com/mitsuhiko/similar/releases )
- [Changelog](https://github.com/mitsuhiko/similar/blob/main/CHANGELOG.md )
- [Commits](https://github.com/mitsuhiko/similar/compare/2.2.0...2.2.1 )
---
updated-dependencies:
- dependency-name: similar
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-15 11:59:19 +00:00
1bb19e2137
chore(deps): Bump clap from 4.0.23 to 4.0.24 ( #6139 )
...
Bumps [clap](https://github.com/clap-rs/clap ) from 4.0.23 to 4.0.24.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v4.0.23...v4.0.24 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-15 11:09:39 +00:00
e4de0635ad
chore(deps): Bump uuid from 1.2.1 to 1.2.2 ( #6143 )
...
Bumps [uuid](https://github.com/uuid-rs/uuid ) from 1.2.1 to 1.2.2.
- [Release notes](https://github.com/uuid-rs/uuid/releases )
- [Commits](https://github.com/uuid-rs/uuid/compare/1.2.1...1.2.2 )
---
updated-dependencies:
- dependency-name: uuid
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-15 09:31:59 +00:00
a4b277594c
fix: Remove namespace argument from kafka test helper fn
2022-11-14 16:46:05 -05:00
5854ff28e9
fix: Remove namespace argument from write test helper fn
2022-11-14 16:46:04 -05:00
c27d3a22d2
fix: Remove namespace argument from test helper function
2022-11-14 16:46:04 -05:00
3943faf998
fix: Remove namespace from DmlWrite and DmlDelete constructors
2022-11-14 16:46:04 -05:00
f78195f7c7
fix: Remove namespace name field from DmlWrite and DmlDelete
...
But leave the argument in their constructors for now.
Not all numbers in tests can be 42, Dom.
2022-11-14 16:46:04 -05:00
c203e8295f
test: Keep track of namespaces by ID in ingester TestContext
2022-11-14 16:46:04 -05:00
e2d2e69076
fix: Remove db_name from encode_operation and FileBufferProducer
2022-11-14 16:46:04 -05:00
dependabot[bot]
kodiakhq[bot]
Dom
Carol (Nichols || Goulding)
Andrew Lamb
Nga Tran
Luke Bond
Marco Neumann