5f43f2a719
refactor: remove old query planning code ( #7449 )
...
Closes #7406 .
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-06 16:05:08 +00:00
612f2451ee
fix: don't panic for unsupported features ( #7472 )
...
This happens rarely but I've spotted this in prod, so let's fix this
because panics are bad and increase monitoring noise.
2023-04-06 14:32:27 +00:00
c03a5c7c14
fix: tracing span hierarchy in querier ( #7469 )
...
The span for the individual chunk creations should be under
"create individual chunks".
2023-04-06 10:01:39 +00:00
30b1878171
test: `ChunkTableProvider::scan` + fix "not dedup" ( #7448 )
...
1. Add loads of tests for `ChunkTableProvider::scan` (= the naive phys.
plan before running any phys. optimizers)
2. Fix interaction of "no de-dup" and predicate pushdown. This might
be used by the ingester at some point and I would like to have this
correct before someone silently introduces a bug by pushing field
predicates into the ingester.
This is mostly prep-work for #7406 so I know that test coverage is
sufficient.
2023-04-06 08:39:53 +00:00
9f5fec42b8
feat: Teach InfluxQL how to plan `LIMIT` and `OFFSET` with `GROUP BY` ( #7447 )
...
* feat: Support LIMIT and OFFSET with GROUP BY
* fix: Compile error
* chore: Improve function name and comment
* chore: rustfmt
* chore: fix clippy warnings
Allowing the too-many-arguments warning for project_select,
as it will require some refactoring after this PR has already
been reviewed. It may be refactored in the future when subqueries are
implemented
2023-04-05 23:01:56 +00:00
e4b4f79c6b
feat: expand 'vertical splitting' to improve compaction efficiency ( #7450 )
...
* feat: expand vertical splitting and coordinate compactions
* chore: insta updates for prior commit
* chore: pr review nits
2023-04-05 21:02:16 +00:00
4dc1f94d6a
chore(deps): Bump rustix from 0.37.6 to 0.37.7 ( #7457 )
...
Bumps [rustix](https://github.com/bytecodealliance/rustix ) from 0.37.6 to 0.37.7.
- [Release notes](https://github.com/bytecodealliance/rustix/releases )
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.37.6...v0.37.7 )
---
updated-dependencies:
- dependency-name: rustix
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-05 19:23:08 +00:00
065422e2ca
chore(deps): Bump libc from 0.2.140 to 0.2.141 ( #7456 )
...
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.140 to 0.2.141.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.140...0.2.141 )
---
updated-dependencies:
- dependency-name: libc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-05 19:15:05 +00:00
4a1f1c0000
chore(deps): Bump zstd-sys from 2.0.7+zstd.1.5.4 to 2.0.8+zstd.1.5.5 ( #7453 )
...
Bumps [zstd-sys](https://github.com/gyscos/zstd-rs ) from 2.0.7+zstd.1.5.4 to 2.0.8+zstd.1.5.5.
- [Release notes](https://github.com/gyscos/zstd-rs/releases )
- [Commits](https://github.com/gyscos/zstd-rs/commits )
---
updated-dependencies:
- dependency-name: zstd-sys
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-05 19:07:26 +00:00
2c001f29bf
chore(deps): Bump zstd-safe from 6.0.4+zstd.1.5.4 to 6.0.5+zstd.1.5.4 ( #7455 )
...
Bumps [zstd-safe](https://github.com/gyscos/zstd-rs ) from 6.0.4+zstd.1.5.4 to 6.0.5+zstd.1.5.4.
- [Release notes](https://github.com/gyscos/zstd-rs/releases )
- [Commits](https://github.com/gyscos/zstd-rs/commits )
---
updated-dependencies:
- dependency-name: zstd-safe
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-05 18:59:51 +00:00
996078123f
chore(deps): Bump filetime from 0.2.20 to 0.2.21 ( #7454 )
...
Bumps [filetime](https://github.com/alexcrichton/filetime ) from 0.2.20 to 0.2.21.
- [Release notes](https://github.com/alexcrichton/filetime/releases )
- [Commits](https://github.com/alexcrichton/filetime/compare/0.2.20...0.2.21 )
---
updated-dependencies:
- dependency-name: filetime
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-05 18:51:54 +00:00
e8b7d69b0f
chore: Update datafusion again ( #7442 )
...
* chore: Update datafusion
* chore: Fix up plans for datafusion API change
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-05 18:21:53 +00:00
3cd8eb56e5
Merge pull request #7415 from influxdata/savage/6824-update-namespace-service-limit-api-call
...
feat(namespace): Update support for namespace service protection limits
2023-04-05 14:34:55 +00:00
44478348c7
refactor(cli): Simplify namespace update-limit command code
2023-04-05 15:25:37 +01:00
9fcaee9ac9
Merge branch 'main' into savage/6824-update-namespace-service-limit-api-call
2023-04-05 14:52:44 +01:00
b53b8c7d76
refactor(namespace): Flatten service protection limits in Namespace proto definition
...
This commit also cleans up the code formatting for the gRPC handler and
simplifies some of the gRPC handler tests for the new update service
limit API.
2023-04-05 14:46:30 +01:00
ba16511c15
chore(deps): Bump io-lifetimes from 1.0.9 to 1.0.10 ( #7446 )
...
Bumps [io-lifetimes](https://github.com/sunfishcode/io-lifetimes ) from 1.0.9 to 1.0.10.
- [Release notes](https://github.com/sunfishcode/io-lifetimes/releases )
- [Commits](https://github.com/sunfishcode/io-lifetimes/compare/v1.0.9...v1.0.10 )
---
updated-dependencies:
- dependency-name: io-lifetimes
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-05 13:03:00 +00:00
94d390f31e
test: Add additional tests for reorg plans ( #7444 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-05 11:15:23 +00:00
e27a8e815d
chore: add tracking of bytes written in simulator ( #7445 )
...
* chore: add tracking of bytes written in simulator; display in final output header
* chore: insta output churn corresponding to tracking bytes written
* chore: address comment
2023-04-04 20:58:50 +00:00
d57a4f8947
refactor: make null-as-missing default behavior for LOCF ( #7443 )
...
* refactor: make null-as-missing default behavior for LOCF
* test: update InfluxQL test
---------
Co-authored-by: Christopher Wolff <cwolff@athena.tail244ec.ts.net>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-04 18:03:09 +00:00
099b33871b
Merge pull request #7430 from influxdata/jrb_24_backlogged_test_case
...
fix: address panic with single L0 overlapping multiple L1s
2023-04-04 11:31:16 -05:00
80a91142b5
Merge branch 'main' into jrb_24_backlogged_test_case
2023-04-04 11:21:54 -05:00
badc8865ef
chore: Update datafusion again ( #7440 )
...
* chore: Update DataFusion
* chore: Update for new API
* chore: Run cargo hakari tasks
* fix: cargo doc
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-04-04 15:45:46 +00:00
4a9317dfdb
chore(deps): Bump libc from 0.2.140 to 0.2.141 ( #7439 )
...
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.140 to 0.2.141.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/commits )
---
updated-dependencies:
- dependency-name: libc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-04 11:51:33 +00:00
66982f988b
chore(deps): Bump object_store from 0.5.5 to 0.5.6 ( #7433 )
...
Bumps [object_store](https://github.com/apache/arrow-rs ) from 0.5.5 to 0.5.6.
- [Release notes](https://github.com/apache/arrow-rs/releases )
- [Changelog](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md )
- [Commits](https://github.com/apache/arrow-rs/commits )
---
updated-dependencies:
- dependency-name: object_store
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Dom <dom@itsallbroken.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-04 08:43:34 +00:00
4429319b8a
chore(deps): Bump rustix from 0.37.6 to 0.37.7 ( #7434 )
...
Bumps [rustix](https://github.com/bytecodealliance/rustix ) from 0.37.6 to 0.37.7.
- [Release notes](https://github.com/bytecodealliance/rustix/releases )
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.37.6...v0.37.7 )
---
updated-dependencies:
- dependency-name: rustix
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Dom <dom@itsallbroken.com>
2023-04-04 08:36:29 +00:00
e9bdf96457
refactor: remove DF-clean-DF phys. optimizer pass hack ( #7428 )
...
As discussed in https://github.com/influxdata/influxdb_iox/pull/7250#discussion_r1155684471
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-04 08:09:35 +00:00
a1b29b3ebb
fix: Incorrect results when planning aggregate expressions ( #7431 )
...
* fix: Incorrect results when mixing non-existent fields in aggregates
* chore: Improve comments around aggregates
2023-04-04 00:19:50 +00:00
cd708183db
chore: update large backfill case to suppress output of runs
2023-04-03 15:02:36 -05:00
48407e78da
chore: add option to simulator to optionally suppress the output of compaction runs
2023-04-03 15:02:04 -05:00
711ccc153e
fix: address panic with single L0 overlapping multiple L1s
2023-04-03 14:09:55 -05:00
839816abf1
Merge pull request #7426 from influxdata/dependabot/cargo/rustix-0.37.6
...
chore(deps): Bump rustix from 0.37.5 to 0.37.6
2023-04-03 12:05:00 +01:00
1002a1d199
chore(deps): Bump rustix from 0.37.5 to 0.37.6
...
Bumps [rustix](https://github.com/bytecodealliance/rustix ) from 0.37.5 to 0.37.6.
- [Release notes](https://github.com/bytecodealliance/rustix/releases )
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.37.5...v0.37.6 )
---
updated-dependencies:
- dependency-name: rustix
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-04-03 10:34:16 +00:00
f04962d630
feat: new query planning ( #7250 )
...
Closes #6098 .
2023-04-03 10:31:03 +00:00
0d2eac2997
Merge pull request #7413 from influxdata/dom/org-bucket-tidy
...
refactor: tidy NamespaceName from org & bucket
2023-04-03 09:41:19 +00:00
8ba073ddb9
Merge branch 'main' into dom/org-bucket-tidy
2023-04-03 10:34:10 +01:00
c4e7337d83
Merge pull request #7427 from influxdata/crepererum/spin_098
...
chore: update spin to version 0.9.8
2023-04-03 10:30:42 +01:00
f7e3d97b15
chore: update spin to version 0.9.8
...
0.9.7 was yanked.
2023-04-03 11:18:51 +02:00
9001c74ff2
chore(deps): Bump mockito from 1.0.1 to 1.0.2 ( #7424 )
...
Bumps [mockito](https://github.com/lipanski/mockito ) from 1.0.1 to 1.0.2.
- [Release notes](https://github.com/lipanski/mockito/releases )
- [Commits](https://github.com/lipanski/mockito/compare/1.0.1...1.0.2 )
---
updated-dependencies:
- dependency-name: mockito
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-03 08:39:33 +00:00
23f892d2e2
Merge pull request #7416 from influxdata/cn/flaky-test
...
test: Use a setup that never persists for a test that expects ingester data
2023-04-03 08:32:32 +00:00
a95b111038
Merge branch 'main' into cn/flaky-test
2023-04-03 08:25:06 +00:00
2dddda7c33
refactor: InfluxQL parser improvements ( #7403 )
...
* chore: Simplify insta snapshots
* chore: Extract struct-like enums to structs
This is in line with DataFusion, which also represents many of its
expression types as struct. The change permits explicit visit
methods for these new types.
These changes will be used by rewriting and visitors to treat the
types, such as Call as an atomic unit that can be replaced.
2023-04-02 21:41:49 +00:00
5efc59d08a
docs: Fix out of date docs for test ChunkStage
2023-03-31 16:00:53 -04:00
89d5cb7fb3
feat: Clarify test setup logging
2023-03-31 16:00:53 -04:00
6335ed24fa
test: Use a setup that never persists for a test that expects ingester data
...
Fixes #7404 .
2023-03-31 16:00:44 -04:00
e091738f19
Merge pull request #7388 from influxdata/cn/hardcoded-refactor
...
refactor: Clarify what's happening in the hardcoded compactor components
2023-03-31 19:58:31 +00:00
90d07412ff
refactor: Extract functions for the different purposes of partition filters
2023-03-31 12:53:41 -04:00
9a27736c65
docs: Fix some typos
2023-03-31 12:44:12 -04:00
a4a79bc640
test: Add a case where a partition's time is included in the max range
2023-03-31 12:42:27 -04:00
a32d536262
refactor: Extract a function to make the post-classification filters
2023-03-31 12:36:26 -04:00
Marco Neumann
Stuart Carnie
Joe-Blount
dependabot[bot]
Andrew Lamb
kodiakhq[bot]
Fraser Savage
Christopher M. Wolff
Joe-Blount
Dom
Carol (Nichols || Goulding)