Commit Graph

10933 Commits (143cb26e875766cd89bebaa9a74edc97f610c345)

Author SHA1 Message Date
dependabot[bot] 97342fcdc7
chore(deps): Bump futures-io from 0.3.25 to 0.3.26 (#6765)
Bumps [futures-io](https://github.com/rust-lang/futures-rs) from 0.3.25 to 0.3.26.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.25...0.3.26)

---
updated-dependencies:
- dependency-name: futures-io
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-31 11:15:41 +00:00
Dom efe684e8f0
Merge branch 'main' into dom/log-ids 2023-01-31 11:00:22 +00:00
dependabot[bot] 51b0483699
chore(deps): Bump futures-task from 0.3.25 to 0.3.26 (#6768)
Bumps [futures-task](https://github.com/rust-lang/futures-rs) from 0.3.25 to 0.3.26.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.25...0.3.26)

---
updated-dependencies:
- dependency-name: futures-task
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-31 10:58:40 +00:00
Dom Dwyer a029de95f4
refactor: panic with unresolvable table IDs
Include the table ID in the panic message.
2023-01-31 11:47:33 +01:00
Dom Dwyer 6e540bc8d6
refactor: panic with unresolvable namespace IDs
Include the namespace ID in the panic message.
2023-01-31 11:46:40 +01:00
Dom Dwyer 0d9b773693
refactor: panic with unresolvable partition IDs
Include the partition ID in the panic message.
2023-01-31 11:43:32 +01:00
dependabot[bot] 6f032b1d57
chore(deps): Bump async-trait from 0.1.63 to 0.1.64 (#6769)
Bumps [async-trait](https://github.com/dtolnay/async-trait) from 0.1.63 to 0.1.64.
- [Release notes](https://github.com/dtolnay/async-trait/releases)
- [Commits](https://github.com/dtolnay/async-trait/compare/0.1.63...0.1.64)

---
updated-dependencies:
- dependency-name: async-trait
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-31 10:18:27 +00:00
dependabot[bot] 17e118d8c3
chore(deps): Bump futures-channel from 0.3.25 to 0.3.26 (#6770)
Bumps [futures-channel](https://github.com/rust-lang/futures-rs) from 0.3.25 to 0.3.26.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.25...0.3.26)

---
updated-dependencies:
- dependency-name: futures-channel
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-31 10:04:22 +00:00
dependabot[bot] 370a0ef7dd
chore(deps): Bump toml from 0.7.0 to 0.7.1 (#6771)
Bumps [toml](https://github.com/toml-rs/toml) from 0.7.0 to 0.7.1.
- [Release notes](https://github.com/toml-rs/toml/releases)
- [Commits](https://github.com/toml-rs/toml/compare/toml-v0.7.0...toml-v0.7.1)

---
updated-dependencies:
- dependency-name: toml
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-31 09:53:48 +00:00
Marco Neumann 9279570299
fix: PG `flag_for_delete_by_retention` (#6762)
* test: failing test

* fix: PG `flag_for_delete_by_retention`
2023-01-30 21:27:12 +00:00
Andrew Lamb 5b14caa780
chore: Update DataFusion (#6753)
* chore: Update datafusion

* fix: Update for changes

* chore: Run cargo hakari tasks

---------

Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-30 14:48:52 +00:00
Andrew Lamb 51e324378c
chore: Add test for `SHOW TABLES` (#6754)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-30 14:05:26 +00:00
Carol (Nichols || Goulding) 2254ee06b7
test: Port read_group query_tests to end-to-end tests (#6743)
* fix: Delete the read filter *file*; last PR only deleted the *contents*

* test: Port read_group query_tests to end-to-end tests

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-30 12:10:39 +00:00
Marco Neumann b635dda85c
feat: throttle when there are not partitions to compact (#6752)
* test: `MockPartitionsSource::set`

* test: `AssertFutureExt`

* feat: throttle when there are not partitions to compact

Fixes #6727.

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-30 12:00:03 +00:00
Andrew Lamb f133cda00c
docs: Add docstring to Scratchpad (#6742)
* docs: Add docstring to Scratchpad

* fix: put derive macro after docstring

* fix: Update compactor2/src/components/scratchpad/mod.rs

Co-authored-by: Marco Neumann <marco@crepererum.net>

* fix: Update other italic markdown

---------

Co-authored-by: Marco Neumann <marco@crepererum.net>
2023-01-30 11:52:13 +00:00
Dom dc37163a45
Merge pull request #6751 from influxdata/dom/envoy-hax
fix(router): envoy network error translation
2023-01-30 11:35:48 +00:00
Dom 048f7c455a
Merge branch 'main' into dom/envoy-hax 2023-01-30 11:23:32 +00:00
Dom Dwyer 0ddef54b09
fix(router): envoy network error translation
Envoy will connect to an endpoint on demand, and return an
application-level error if it fails with a gRPC status code of
"Unavailable".

It also embeds a metadata entry of {"server": "envoy"} - this commit
uses the two signals (error status code + metadata entry) to drive an
immediate reconnection when observed, assuming the connection is bad.
2023-01-30 12:15:38 +01:00
Marco Neumann d707709cce
fix: invalidate querier->ingester conn on error (#6747)
It seems that tonic is caching DNS results for too long and clings to an
old ingester that no longer exists.

See https://github.com/influxdata/idpe/issues/17022 (not sure though if
this fix is sufficient, let's see).

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-30 11:06:12 +00:00
Marco Neumann 515f0eef64
feat: simple compactor2 self-protection (#6728)
Add some rough "partition is too big" filter for now until we can deal
with them (the framework allows that but we need to set up the proper
divide-and-conquer components).

This will hopefully prevent our prod compactor from dying that often.

Note that this is also duct-tape around two issues:

- DataFusion not accounting in-flight data all the time
- Our wide fan-out query plans (see https://github.com/influxdata/idpe/issues/16768#issuecomment-1387056833 )

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-30 10:57:47 +00:00
Dom 7bf609ce7b
Merge pull request #6730 from influxdata/dom/reduce-write-timeout
feat: configurable RPC write request timeout
2023-01-30 10:12:20 +00:00
Dom a7770f0f7a
Merge branch 'main' into dom/reduce-write-timeout 2023-01-30 09:59:37 +00:00
Dom ca98cb4d0c
Merge pull request #6745 from influxdata/dependabot/cargo/cc-1.0.79
chore(deps): Bump cc from 1.0.78 to 1.0.79
2023-01-30 09:56:14 +00:00
dependabot[bot] 1d46fa1a6f
chore(deps): Bump cc from 1.0.78 to 1.0.79
Bumps [cc](https://github.com/rust-lang/cc-rs) from 1.0.78 to 1.0.79.
- [Release notes](https://github.com/rust-lang/cc-rs/releases)
- [Commits](https://github.com/rust-lang/cc-rs/compare/1.0.78...1.0.79)

---
updated-dependencies:
- dependency-name: cc
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-01-30 09:45:58 +00:00
Dom f1f5144f8b
Merge pull request #6746 from influxdata/dependabot/cargo/tokio-1.25.0
chore(deps): Bump tokio from 1.24.2 to 1.25.0
2023-01-30 09:43:33 +00:00
dependabot[bot] ed7d02a225
chore(deps): Bump tokio from 1.24.2 to 1.25.0
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.24.2 to 1.25.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/commits/tokio-1.25.0)

---
updated-dependencies:
- dependency-name: tokio
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-01-30 01:57:27 +00:00
Christopher M. Wolff 55257b46c9
chore: validate ingester URIs on querier CLI (#6740)
* chore: add validate for ingesters on querier CLI

* chore: fix typo and tests

* chore: clippy

* chore: review feedback

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-27 21:13:52 +00:00
Andrew Lamb 4a6b4f78d2
refactor: Make some nicer methods on the GrpcRequestBuilder (#6741)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-27 21:06:22 +00:00
dependabot[bot] 56825f119e
chore(deps): Bump toml from 0.6.0 to 0.7.0 (#6739)
Bumps [toml](https://github.com/toml-rs/toml) from 0.6.0 to 0.7.0.
- [Release notes](https://github.com/toml-rs/toml/releases)
- [Commits](https://github.com/toml-rs/toml/compare/toml-v0.6.0...toml-v0.7.0)

---
updated-dependencies:
- dependency-name: toml
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-27 20:44:53 +00:00
Carol (Nichols || Goulding) 11233e3b3b
test: Translate the filter_on_value test using field ref (#6734) 2023-01-27 20:03:44 +00:00
Andrew Lamb 0d32662eea
chore: Update datafusion again (#6722)
* chore: Update datafusion

* fix: Update for API

* chore: Run cargo hakari tasks

---------

Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-27 18:59:27 +00:00
Marko Mikulicic 6d5cfba76f
Merge pull request #6737 from influxdata/dry_transition_shard_id
chore: Avoid defining transition shard numbers in multiple crates
2023-01-27 19:09:58 +01:00
Marko Mikulicic 0bc7d90ee3 chore: Avoid defining transition shard numbers in multiple crates 2023-01-27 18:30:34 +01:00
Marko Mikulicic db7e6335ca
feat(ingester2): New objecstore paths will have no shard id (#6735)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-27 17:16:54 +00:00
Marko Mikulicic f6e7724d19
fix(compactor2): Update other locations of the TRANSITION_SHARD_INDEX (#6736) 2023-01-27 16:59:24 +00:00
kodiakhq[bot] ab643ffa8b
Merge pull request #6709 from influxdata/cn/read-filter
test: Port query_tests read_filter tests to end-to-end
2023-01-27 15:47:07 +00:00
Carol (Nichols || Goulding) 4f8dd072b3
fix: Translate a test with a predicate of a literal = literal 2023-01-27 10:28:43 -05:00
Carol (Nichols || Goulding) 94f7f015f4
fix: Port a test with a predicate that tag=tag, which is always true 2023-01-27 10:28:43 -05:00
Carol (Nichols || Goulding) a2b67abe54
fix: Remove test cases that aren't valid to port to end-to-end tests 2023-01-27 10:28:43 -05:00
Carol (Nichols || Goulding) 67c430da63
test: Port read_filter query_tests to end-to-end tests 2023-01-27 10:28:43 -05:00
Carol (Nichols || Goulding) 9d490ceb1a
feat: Add a method to create tag expressions ORed together 2023-01-27 10:28:42 -05:00
Carol (Nichols || Goulding) 7b94e545f1
feat: Change combine_predicate to take a logical operator
To enable building "OR" queries
2023-01-27 10:28:42 -05:00
Carol (Nichols || Goulding) b633b8b7a0
feat: Allow building a predicate that ANDs multiple nodes 2023-01-27 10:28:42 -05:00
Carol (Nichols || Goulding) d6bd6d5178
fix: Make regex_predicate function private; it's only used in this impl 2023-01-27 10:28:42 -05:00
Carol (Nichols || Goulding) 31e7925f47
refactor: Extract a function for making a comparison expression node 2023-01-27 10:28:42 -05:00
Carol (Nichols || Goulding) a400e212ec
refactor: Extract a function for making a string value node 2023-01-27 10:28:42 -05:00
Carol (Nichols || Goulding) 39cd34912b
refactor: Extract a function for making a tag ref node 2023-01-27 10:28:42 -05:00
Carol (Nichols || Goulding) c2c8524dd8
refactor: Extract a shared function for tag predicates 2023-01-27 10:28:42 -05:00
Marko Mikulicic aa9789049a
fix(iox): Use a transition shard id that doesn't overlap with legacy (#6733) 2023-01-27 14:23:40 +00:00
Dom 6ceb42804d
Merge branch 'main' into dom/reduce-write-timeout 2023-01-27 14:07:16 +00:00