Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
11,395 Commits
207 Branches
453 Tags
382 MiB
Commit Graph

11395 Commits (d4486bef3e3a6d1cd9d066c0cb0b01a03000165e)

Author SHA1 Message Date
Dom Dwyer d4486bef3e
refactor: access upstream count in UpstreamSnapshot 
Adds a method to return the number of upstreams in an UpstreamSnapshot.
 2023-03-23 11:31:20 +01:00
Stuart Carnie 08ef689d21
feat: Teach InfluxQL how to plan an aggregate query (#7230) 
* feat: Display failed query

Allows a user to immediately identify the failed query.

* feat: API improvements to InfluxQL parser

* feat: Extend `SchemaProvider` trait to query for UDFs

* fix: We don't want the parser to panic on overflows

* fix: ensure `map_type` maps the timestamp data type

* feat: API to map a InfluxQL duration expression to a DataFusion interval

* chore: Copied APIs from DataFusion SQL planner

These APIs are private but useful for InfluxQL planning.

* feat: Initial aggregate query support

* feat: Add an API to fetch a field by name

* chore: Fixes to handling NULLs in aggregates

* chore: Add ability to test expected failures for InfluxQL

* chore: appease rustfmt and clippy 😬

* chore: produce same error as InfluxQL

* chore: appease clippy

* chore: Improve docs

* chore: Simplify aggregate and raw planning

* feat: Add support for GROUP BY TIME(stride, offset)

* chore: Update docs

* chore: remove redundant `is_empty` check

Co-authored-by: Christopher M. Wolff <chris.wolff@influxdata.com>

* chore: PR feedback to clarify purpose of function

* chore: The series_sort can't be empty, as `time` is always added

This was originally intended as an optimisation when executing an
aggregate query that did not group by time or tags, as it will produce
N rows, where N is the number of measurements queried.

* chore: update comment for clarity

---------

Co-authored-by: Christopher M. Wolff <chris.wolff@influxdata.com>
 2023-03-23 01:13:15 +00:00
Joe-Blount 77948e3341
chore(iox/compactor): add test cases tracking max_l0_created_at (#7181) 
* chore(iox/compactor): add test cases tracking max_l0_created_at

* chore(iox/compactor): add invariant check to simulator for misordered max_l0_created_at

* chore(iox/compactor): test updates for max_l0_created_at

This commit updates the newly added tests to comply with the new invariant check.
Several test cases are deleted because the changes to comply with the invariant make the permutations pointless.

* chore(iox/simulator): Add test cases hitting new invariant check for illegal max_l0_created_at

* chore: update previous tests to comply with new invariant

* chore: address comments

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-22 22:14:06 +00:00
Chunchun Ye 87708dc64a
feat(flightsql): Add filters to `GetTables` metadata endpoint (#7289) 
* feat: add optional param to GetTables

* chore: add the third param to query plan

* feat: add table_types param

* chore: clippy

* test: add test cases with filters

* chore: update query to avoid SQL injection

* refactor: update where clause and cleanup

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-22 20:14:01 +00:00
dependabot[bot] 6172e6c513
chore(deps): Bump regex from 1.7.1 to 1.7.2 (#7299) 
Bumps [regex](https://github.com/rust-lang/regex) from 1.7.1 to 1.7.2.
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/compare/1.7.1...1.7.2)

---
updated-dependencies:
- dependency-name: regex
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-03-22 14:45:20 +00:00
dependabot[bot] 9a2fdb7bf6
chore(deps): Bump bitflags from 1.3.2 to 2.0.2 (#7296) 
* chore(deps): Bump bitflags from 1.3.2 to 2.0.2

Bumps [bitflags](https://github.com/bitflags/bitflags) from 1.3.2 to 2.0.2.
- [Release notes](https://github.com/bitflags/bitflags/releases)
- [Changelog](https://github.com/bitflags/bitflags/blob/main/CHANGELOG.md)
- [Commits](https://github.com/bitflags/bitflags/compare/1.3.2...2.0.2)

---
updated-dependencies:
- dependency-name: bitflags
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* chore: Run cargo hakari tasks

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-22 14:44:57 +00:00
dependabot[bot] c35e5973d3
chore(deps): Bump rustix from 0.36.11 to 0.37.3 (#7298) 
* chore(deps): Bump rustix from 0.36.11 to 0.37.3

Bumps [rustix](https://github.com/bytecodealliance/rustix) from 0.36.11 to 0.37.3.
- [Release notes](https://github.com/bytecodealliance/rustix/releases)
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.36.11...v0.37.3)

---
updated-dependencies:
- dependency-name: rustix
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* chore: Run cargo hakari tasks

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-22 14:34:42 +00:00
dependabot[bot] c8f90b1cdc
chore(deps): Bump regex-syntax from 0.6.28 to 0.6.29 (#7300) 
Bumps [regex-syntax](https://github.com/rust-lang/regex) from 0.6.28 to 0.6.29.
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/commits)

---
updated-dependencies:
- dependency-name: regex-syntax
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-22 14:26:10 +00:00
dependabot[bot] 2ba3d13ad8
chore(deps): Bump sqlx-core from 0.6.2 to 0.6.3 (#7295) 
Bumps [sqlx-core](https://github.com/launchbadge/sqlx) from 0.6.2 to 0.6.3.
- [Release notes](https://github.com/launchbadge/sqlx/releases)
- [Changelog](https://github.com/launchbadge/sqlx/blob/v0.6.3/CHANGELOG.md)
- [Commits](https://github.com/launchbadge/sqlx/compare/v0.6.2...v0.6.3)

---
updated-dependencies:
- dependency-name: sqlx-core
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-22 14:18:26 +00:00
dependabot[bot] 187fe85dcd
chore(deps): Bump sqlx from 0.6.2 to 0.6.3 (#7294) 
Bumps [sqlx](https://github.com/launchbadge/sqlx) from 0.6.2 to 0.6.3.
- [Release notes](https://github.com/launchbadge/sqlx/releases)
- [Changelog](https://github.com/launchbadge/sqlx/blob/v0.6.3/CHANGELOG.md)
- [Commits](https://github.com/launchbadge/sqlx/compare/v0.6.2...v0.6.3)

---
updated-dependencies:
- dependency-name: sqlx
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-22 14:06:13 +00:00
Andrew Lamb 7f7d0b8d52
fix(flightsql): Send correct schema in GetFlightInfo for Queries (#7283) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-22 13:58:44 +00:00
Joe-Blount 222d765323
chore(compactor/simulator): add data backfill test cases (#7293) 
* chore(compactor/simulator): add data backfill test cases

* chore: remove extra comment (left from copy & paste)

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-22 13:51:55 +00:00
kodiakhq[bot] 90b52d2332
Merge pull request #7270 from influxdata/cn/shard-tests 
test: Add compactor shard e2e tests
 2023-03-22 13:44:34 +00:00
kodiakhq[bot] 18405a5919
Merge branch 'main' into cn/shard-tests 2023-03-22 13:36:27 +00:00
Marko Mikulicic 8518ab502b
Merge pull request #7301 from influxdata/auth-header 
fix: Put authorization header in request extension
 2023-03-22 04:27:09 +01:00
Marko Mikulicic 6660b86f6c fix: Put authorization header in request extension 2023-03-22 04:12:07 +01:00
Nga Tran 7ee40acb22
test: set max_l0_created_at appropriately in the core tests (#7292) 
* test: make max_l0_created_at more sense in the core tests

* chore: fix typo

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 20:40:09 +00:00
Andrew Lamb 777128f2b7
feat(flightsql): Avoid planning Flight queries twice (#7281) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 20:15:53 +00:00
Nga Tran f780aba353
test: set max_l0_created_at to reasonable values for the tests and al… (#7286) 
* test: set max_l0_created_at to reasonable values for the tests and also verify it using both test layout and catalog function

* fix: typo

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 18:57:10 +00:00
Joe-Blount dd63b5c52d
chore: expose partition_timeout in the compactor simulator (#7291) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 18:48:43 +00:00
kodiakhq[bot] dd1906a99e
Merge pull request #7284 from influxdata/dom/graceful-shutdown 
test(ingester): graceful shutdown
 2023-03-21 18:41:21 +00:00
Dom 901743b48e
Merge branch 'main' into dom/graceful-shutdown 2023-03-21 18:33:46 +00:00
Andrew Lamb 8ab553180e
chore: Update datafusion again (#7276) 
* chore: Update DataFusion pin

* chore: Update for new Expr type

* fix: deprecated

* chore: Run cargo hakari tasks

* docs: Update predicate/src/lib.rs

* fix: fmt

---------

Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 18:25:04 +00:00
kodiakhq[bot] 4b55e09d09
Merge pull request #7268 from influxdata/savage/router-test-context-builder-pattern 
refactor(router): Utilise builder pattern for construction of `TestContext`s
 2023-03-21 17:02:44 +00:00
Fraser Savage 81a886ecae
Merge branch 'main' into savage/router-test-context-builder-pattern 2023-03-21 15:53:08 +00:00
Andrew Lamb 779234eb20
chore(flightsql): Add tests that schema and data matches (#7280) 
* fix(flightsql): Tests for matching schema in FligthSQL

* fix: Update influxdb_iox/tests/end_to_end_cases/flightsql.rs
 2023-03-21 15:40:21 +00:00
Fraser Savage 8e9d0e8e74
refactor(router): Leverage MissingNamespaceAction directly for TestContext 
This minimises addition of unnecessary types.
 2023-03-21 15:28:00 +00:00
Fraser Savage 22127453da
Merge branch 'main' into savage/router-test-context-builder-pattern 2023-03-21 13:28:06 +00:00
Dom Dwyer eb72fbf3d3
test(ingester): graceful shutdown 
Adds a ingester e2e test asserting the graceful shutdown behaviour;
specifically that:

    * Buffered data is uploaded to object storage
    * WAL files are cleaned up and empty (no replay on startup)
 2023-03-21 14:21:56 +01:00
Dom a385bb2ab2
Merge pull request #7267 from influxdata/dom/rpc-upstream-set-iter 
refactor(router): stateful upstream iter for RPC balancer
 2023-03-21 13:03:33 +00:00
Dom 8272ca56e8
Merge branch 'main' into dom/rpc-upstream-set-iter 2023-03-21 12:35:44 +00:00
Fraser Savage bf35b951ad
refactor(router): Allow test contexts to specify namespace autocreate retention using a Duration 2023-03-21 11:13:55 +00:00
kodiakhq[bot] 37211923e8
Merge branch 'main' into savage/router-test-context-builder-pattern 2023-03-21 10:31:22 +00:00
dependabot[bot] 310dcc23c5
chore(deps): Bump ordered-float from 3.4.0 to 3.6.0 (#7277) 
Bumps [ordered-float](https://github.com/reem/rust-ordered-float) from 3.4.0 to 3.6.0.
- [Release notes](https://github.com/reem/rust-ordered-float/releases)
- [Commits](https://github.com/reem/rust-ordered-float/compare/v3.4.0...v3.6.0)

---
updated-dependencies:
- dependency-name: ordered-float
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-03-21 10:31:06 +00:00
Fraser Savage e773fca7ec
Merge branch 'main' into savage/router-test-context-builder-pattern 2023-03-21 10:31:03 +00:00
Fraser Savage 392972a3ad
refactor(router): Simplify builder code patterns 
Use more fluent method names and leverage defaulting
to remove the need for an option on the namespace autocreate
policy.
 2023-03-21 10:26:23 +00:00
dependabot[bot] 6010405b1b
chore(deps): Bump reqwest from 0.11.14 to 0.11.15 (#7273) 
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.14 to 0.11.15.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.14...v0.11.15)

---
updated-dependencies:
- dependency-name: reqwest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 10:18:13 +00:00
dependabot[bot] 955fab89b1
chore(deps): Bump io-lifetimes from 1.0.8 to 1.0.9 (#7274) 
Bumps [io-lifetimes](https://github.com/sunfishcode/io-lifetimes) from 1.0.8 to 1.0.9.
- [Release notes](https://github.com/sunfishcode/io-lifetimes/releases)
- [Commits](https://github.com/sunfishcode/io-lifetimes/compare/v1.0.8...v1.0.9)

---
updated-dependencies:
- dependency-name: io-lifetimes
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 10:10:36 +00:00
dependabot[bot] 8d3fabf8a1
chore(deps): Bump bitflags from 1.3.2 to 2.0.2 (#7272) 
* chore(deps): Bump bitflags from 1.3.2 to 2.0.2

Bumps [bitflags](https://github.com/bitflags/bitflags) from 1.3.2 to 2.0.2.
- [Release notes](https://github.com/bitflags/bitflags/releases)
- [Changelog](https://github.com/bitflags/bitflags/blob/main/CHANGELOG.md)
- [Commits](https://github.com/bitflags/bitflags/compare/1.3.2...2.0.2)

---
updated-dependencies:
- dependency-name: bitflags
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* chore: Run cargo hakari tasks

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-21 10:02:40 +00:00
Fraser Savage 2c4908bf51
Merge branch 'main' into savage/router-test-context-builder-pattern 2023-03-21 09:55:47 +00:00
dependabot[bot] 9f0dfac8ad
chore(deps): Bump rustix from 0.36.10 to 0.37.3 (#7271) 
* chore(deps): Bump rustix from 0.36.10 to 0.37.3

Bumps [rustix](https://github.com/bytecodealliance/rustix) from 0.36.10 to 0.37.3.
- [Release notes](https://github.com/bytecodealliance/rustix/releases)
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.36.10...v0.37.3)

---
updated-dependencies:
- dependency-name: rustix
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* chore: Run cargo hakari tasks

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
 2023-03-21 09:55:03 +00:00
Carol (Nichols || Goulding) 12974cf426
fix: Fail if compactor shard args are invalid before contacting the catalog 
Fail fast if we know the shard config is invalid, without possibly
failing while contacting the catalog.

Also, fetching of the transition shard ID is going to go away soon
anyway.
 2023-03-20 16:41:34 -04:00
Carol (Nichols || Goulding) 635b22b5a9
fix: Explicitly use memory catalog for invalid compactor CLI tests 
To avoid the command picking up the catalog from your `.env`.
 2023-03-20 16:40:46 -04:00
Nga Tran efae5246cf
docs: add comments for split/compact (#7269) 
* docs: add comments for split/compact

* chore: Apply suggestions from code review

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-20 19:58:39 +00:00
Carol (Nichols || Goulding) d8bd185fa0
test: Add compactor shard e2e tests 2023-03-20 15:52:47 -04:00
Andrew Lamb 184565b552
feat(flightsql): Implement FlightSQL `GetSqlInfo` endpoint (#7198) 
* feat(flightsql): Implement GetSqlInfo endpoint

* chore: Add some comments to clarify the tests intent
 2023-03-20 19:34:18 +00:00
Andrew Lamb 795a79a7ad
feat(flightsql): Add `GetTables` metadata endpoint without filters (#7238) 
* test: Add getTables jdbc_client example

* feat: add `CommandGetTables` in FlightSqlClient

* feat: add `CommandGetTables` in flightsql cmd and planner

* test: add e2e test for `CommandGetTables`

* chore: clippy

* chore: comment out the test with filters

* test: update jdbc test expected value for tables

---------

Co-authored-by: Chunchun <14298407+appletreeisyellow@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-03-20 19:20:13 +00:00
kodiakhq[bot] 1d8c85e61c
Merge pull request #7252 from influxdata/cn/compactor2-once 
test: Re-enable running compactor once in step tests
 2023-03-20 17:28:38 +00:00
Carol (Nichols || Goulding) 01a609af45
fix: Actually use the bind addrs when running the compactor once 2023-03-20 13:21:25 -04:00
Carol (Nichols || Goulding) 528d83e989
test: Re-enable running compactor once in step tests 
Putting back the test that I removed in
<https://github.com/influxdata/influxdb_iox/pull/6850>

now that they can use `run compactor2 --compaction-process-once
--compaction-process-all-partitions`

thanks to <https://github.com/influxdata/influxdb_iox/pull/6886>!
 2023-03-20 13:20:43 -04:00