Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
11,689 Commits
230 Branches
453 Tags
343 MiB
Commit Graph

11689 Commits (ffe8714956e6839789114f692a7a8ce0261c1b0b)

Author SHA1 Message Date
dependabot[bot] c8f90b1cdc
chore(deps): Bump regex-syntax from 0.6.28 to 0.6.29 (#7300) 
Bumps [regex-syntax](https://github.com/rust-lang/regex) from 0.6.28 to 0.6.29.
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/commits)

---
updated-dependencies:
- dependency-name: regex-syntax
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-22 14:26:10 +00:00
dependabot[bot] 2ba3d13ad8
chore(deps): Bump sqlx-core from 0.6.2 to 0.6.3 (#7295) 
Bumps [sqlx-core](https://github.com/launchbadge/sqlx) from 0.6.2 to 0.6.3.
- [Release notes](https://github.com/launchbadge/sqlx/releases)
- [Changelog](https://github.com/launchbadge/sqlx/blob/v0.6.3/CHANGELOG.md)
- [Commits](https://github.com/launchbadge/sqlx/compare/v0.6.2...v0.6.3)

---
updated-dependencies:
- dependency-name: sqlx-core
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-22 14:18:26 +00:00
dependabot[bot] 187fe85dcd
chore(deps): Bump sqlx from 0.6.2 to 0.6.3 (#7294) 
Bumps [sqlx](https://github.com/launchbadge/sqlx) from 0.6.2 to 0.6.3.
- [Release notes](https://github.com/launchbadge/sqlx/releases)
- [Changelog](https://github.com/launchbadge/sqlx/blob/v0.6.3/CHANGELOG.md)
- [Commits](https://github.com/launchbadge/sqlx/compare/v0.6.2...v0.6.3)

---
updated-dependencies:
- dependency-name: sqlx
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-22 14:06:13 +00:00
Andrew Lamb 7f7d0b8d52
fix(flightsql): Send correct schema in GetFlightInfo for Queries (#7283) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-22 13:58:44 +00:00
Joe-Blount 222d765323
chore(compactor/simulator): add data backfill test cases (#7293) 
* chore(compactor/simulator): add data backfill test cases

* chore: remove extra comment (left from copy & paste)

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-22 13:51:55 +00:00
kodiakhq[bot] 90b52d2332
Merge pull request #7270 from influxdata/cn/shard-tests 
test: Add compactor shard e2e tests
 2023-03-22 13:44:34 +00:00
kodiakhq[bot] 18405a5919
Merge branch 'main' into cn/shard-tests 2023-03-22 13:36:27 +00:00
Fraser Savage 3fbab1a335
feat(persist): Add hot partition persistence counter metric 
This counter tracks how many times each partition has been
enqueued for persistence as a result of hitting the pre-configured
limit.
 2023-03-22 11:41:31 +00:00
Marko Mikulicic 8518ab502b
Merge pull request #7301 from influxdata/auth-header 
fix: Put authorization header in request extension
 2023-03-22 04:27:09 +01:00
Marko Mikulicic 6660b86f6c fix: Put authorization header in request extension 2023-03-22 04:12:07 +01:00
Nga Tran 7ee40acb22
test: set max_l0_created_at appropriately in the core tests (#7292) 
* test: make max_l0_created_at more sense in the core tests

* chore: fix typo

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 20:40:09 +00:00
Andrew Lamb 777128f2b7
feat(flightsql): Avoid planning Flight queries twice (#7281) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 20:15:53 +00:00
Nga Tran f780aba353
test: set max_l0_created_at to reasonable values for the tests and al… (#7286) 
* test: set max_l0_created_at to reasonable values for the tests and also verify it using both test layout and catalog function

* fix: typo

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 18:57:10 +00:00
Joe-Blount dd63b5c52d
chore: expose partition_timeout in the compactor simulator (#7291) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 18:48:43 +00:00
kodiakhq[bot] dd1906a99e
Merge pull request #7284 from influxdata/dom/graceful-shutdown 
test(ingester): graceful shutdown
 2023-03-21 18:41:21 +00:00
Dom 901743b48e
Merge branch 'main' into dom/graceful-shutdown 2023-03-21 18:33:46 +00:00
Andrew Lamb 8ab553180e
chore: Update datafusion again (#7276) 
* chore: Update DataFusion pin

* chore: Update for new Expr type

* fix: deprecated

* chore: Run cargo hakari tasks

* docs: Update predicate/src/lib.rs

* fix: fmt

---------

Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 18:25:04 +00:00
kodiakhq[bot] 4b55e09d09
Merge pull request #7268 from influxdata/savage/router-test-context-builder-pattern 
refactor(router): Utilise builder pattern for construction of `TestContext`s
 2023-03-21 17:02:44 +00:00
Fraser Savage 81a886ecae
Merge branch 'main' into savage/router-test-context-builder-pattern 2023-03-21 15:53:08 +00:00
Andrew Lamb 779234eb20
chore(flightsql): Add tests that schema and data matches (#7280) 
* fix(flightsql): Tests for matching schema in FligthSQL

* fix: Update influxdb_iox/tests/end_to_end_cases/flightsql.rs
 2023-03-21 15:40:21 +00:00
Fraser Savage 8e9d0e8e74
refactor(router): Leverage MissingNamespaceAction directly for TestContext 
This minimises addition of unnecessary types.
 2023-03-21 15:28:00 +00:00
Fraser Savage 22127453da
Merge branch 'main' into savage/router-test-context-builder-pattern 2023-03-21 13:28:06 +00:00
Dom Dwyer eb72fbf3d3
test(ingester): graceful shutdown 
Adds a ingester e2e test asserting the graceful shutdown behaviour;
specifically that:

    * Buffered data is uploaded to object storage
    * WAL files are cleaned up and empty (no replay on startup)
 2023-03-21 14:21:56 +01:00
Dom a385bb2ab2
Merge pull request #7267 from influxdata/dom/rpc-upstream-set-iter 
refactor(router): stateful upstream iter for RPC balancer
 2023-03-21 13:03:33 +00:00
Dom 8272ca56e8
Merge branch 'main' into dom/rpc-upstream-set-iter 2023-03-21 12:35:44 +00:00
Fraser Savage bf35b951ad
refactor(router): Allow test contexts to specify namespace autocreate retention using a Duration 2023-03-21 11:13:55 +00:00
kodiakhq[bot] 37211923e8
Merge branch 'main' into savage/router-test-context-builder-pattern 2023-03-21 10:31:22 +00:00
dependabot[bot] 310dcc23c5
chore(deps): Bump ordered-float from 3.4.0 to 3.6.0 (#7277) 
Bumps [ordered-float](https://github.com/reem/rust-ordered-float) from 3.4.0 to 3.6.0.
- [Release notes](https://github.com/reem/rust-ordered-float/releases)
- [Commits](https://github.com/reem/rust-ordered-float/compare/v3.4.0...v3.6.0)

---
updated-dependencies:
- dependency-name: ordered-float
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-03-21 10:31:06 +00:00
Fraser Savage e773fca7ec
Merge branch 'main' into savage/router-test-context-builder-pattern 2023-03-21 10:31:03 +00:00
Fraser Savage 392972a3ad
refactor(router): Simplify builder code patterns 
Use more fluent method names and leverage defaulting
to remove the need for an option on the namespace autocreate
policy.
 2023-03-21 10:26:23 +00:00
dependabot[bot] 6010405b1b
chore(deps): Bump reqwest from 0.11.14 to 0.11.15 (#7273) 
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.14 to 0.11.15.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.14...v0.11.15)

---
updated-dependencies:
- dependency-name: reqwest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 10:18:13 +00:00
dependabot[bot] 955fab89b1
chore(deps): Bump io-lifetimes from 1.0.8 to 1.0.9 (#7274) 
Bumps [io-lifetimes](https://github.com/sunfishcode/io-lifetimes) from 1.0.8 to 1.0.9.
- [Release notes](https://github.com/sunfishcode/io-lifetimes/releases)
- [Commits](https://github.com/sunfishcode/io-lifetimes/compare/v1.0.8...v1.0.9)

---
updated-dependencies:
- dependency-name: io-lifetimes
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 10:10:36 +00:00
dependabot[bot] 8d3fabf8a1
chore(deps): Bump bitflags from 1.3.2 to 2.0.2 (#7272) 
* chore(deps): Bump bitflags from 1.3.2 to 2.0.2

Bumps [bitflags](https://github.com/bitflags/bitflags) from 1.3.2 to 2.0.2.
- [Release notes](https://github.com/bitflags/bitflags/releases)
- [Changelog](https://github.com/bitflags/bitflags/blob/main/CHANGELOG.md)
- [Commits](https://github.com/bitflags/bitflags/compare/1.3.2...2.0.2)

---
updated-dependencies:
- dependency-name: bitflags
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* chore: Run cargo hakari tasks

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 10:02:40 +00:00
Fraser Savage 2c4908bf51
Merge branch 'main' into savage/router-test-context-builder-pattern 2023-03-21 09:55:47 +00:00
dependabot[bot] 9f0dfac8ad
chore(deps): Bump rustix from 0.36.10 to 0.37.3 (#7271) 
* chore(deps): Bump rustix from 0.36.10 to 0.37.3

Bumps [rustix](https://github.com/bytecodealliance/rustix) from 0.36.10 to 0.37.3.
- [Release notes](https://github.com/bytecodealliance/rustix/releases)
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.36.10...v0.37.3)

---
updated-dependencies:
- dependency-name: rustix
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* chore: Run cargo hakari tasks

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
 2023-03-21 09:55:03 +00:00
Carol (Nichols || Goulding) 12974cf426
fix: Fail if compactor shard args are invalid before contacting the catalog 
Fail fast if we know the shard config is invalid, without possibly
failing while contacting the catalog.

Also, fetching of the transition shard ID is going to go away soon
anyway.
 2023-03-20 16:41:34 -04:00
Carol (Nichols || Goulding) 635b22b5a9
fix: Explicitly use memory catalog for invalid compactor CLI tests 
To avoid the command picking up the catalog from your `.env`.
 2023-03-20 16:40:46 -04:00
Nga Tran efae5246cf
docs: add comments for split/compact (#7269) 
* docs: add comments for split/compact

* chore: Apply suggestions from code review

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-20 19:58:39 +00:00
Carol (Nichols || Goulding) d8bd185fa0
test: Add compactor shard e2e tests 2023-03-20 15:52:47 -04:00
Andrew Lamb 184565b552
feat(flightsql): Implement FlightSQL `GetSqlInfo` endpoint (#7198) 
* feat(flightsql): Implement GetSqlInfo endpoint

* chore: Add some comments to clarify the tests intent
 2023-03-20 19:34:18 +00:00
Andrew Lamb 795a79a7ad
feat(flightsql): Add `GetTables` metadata endpoint without filters (#7238) 
* test: Add getTables jdbc_client example

* feat: add `CommandGetTables` in FlightSqlClient

* feat: add `CommandGetTables` in flightsql cmd and planner

* test: add e2e test for `CommandGetTables`

* chore: clippy

* chore: comment out the test with filters

* test: update jdbc test expected value for tables

---------

Co-authored-by: Chunchun <14298407+appletreeisyellow@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-20 19:20:13 +00:00
kodiakhq[bot] 1d8c85e61c
Merge pull request #7252 from influxdata/cn/compactor2-once 
test: Re-enable running compactor once in step tests
 2023-03-20 17:28:38 +00:00
Carol (Nichols || Goulding) 01a609af45
fix: Actually use the bind addrs when running the compactor once 2023-03-20 13:21:25 -04:00
Carol (Nichols || Goulding) 528d83e989
test: Re-enable running compactor once in step tests 
Putting back the test that I removed in
<https://github.com/influxdata/influxdb_iox/pull/6850>

now that they can use `run compactor2 --compaction-process-once
--compaction-process-all-partitions`

thanks to <https://github.com/influxdata/influxdb_iox/pull/6886>!
 2023-03-20 13:20:43 -04:00
Fraser Savage acdeee62e0
refactor(router): Remove unused catalog field on TestContextBuilder 2023-03-20 17:11:55 +00:00
Fraser Savage 1a2565b45a
refactor(router): Split TestContextBuilder namespace parameters 
Most of the test cases set up a context with or without namespace
autocreation, while few set a retention period. This removes the
requirement to pass a retention period when enabling autocreation
or vice versa.
 2023-03-20 17:04:14 +00:00
Fraser Savage 32a3c81ce9
refactor(router): Use builder pattern to construct TestContext 
Using the builder pattern enables a more ergonomic workflow
for setting optional namespace creation semantics when constructing
the TestContext for the router.
 2023-03-20 17:03:40 +00:00
Dom Dwyer 93ebb42fdd
refactor: stateful upstream iter for RPC balancer 
Changes the router's RPC balancer to return a iterator of elements
starting from the given offset, that can remove elements from the
infinite/cycling iterator to prevent them from being yielded again.
 2023-03-20 17:30:32 +01:00
Dom Dwyer f28ba2381d
test: assert all upstreams are (re)-tried 
Adds a test ensuring requests are sent to all upstream ingesters until a
request succeeds.
 2023-03-20 17:23:02 +01:00
Dom c0a53ae5a9
Merge pull request #7261 from influxdata/dom/seqnumset-range 
fix: full u64 range in SequenceNumberSet
 2023-03-20 14:10:35 +00:00