2519c9c6d2
Merge pull request #8262 from influxdata/jrb_65_move_progress_reporting
...
fix(compactor timeout): chunk up high plan counts in the compactor
2023-07-19 14:16:48 -05:00
ccb950445c
Merge remote-tracking branch 'origin/main' into jrb_65_move_progress_reporting
2023-07-19 14:05:48 -05:00
4c5c2473e6
chore: move scratchpad cleanup earlier
2023-07-19 10:16:28 -05:00
4e88571142
feat: add batch partition getters ( #8268 )
2023-07-19 15:05:41 +00:00
004b401a05
chore: upgrade to sqlx 0.7.1 ( #8266 )
...
There are a bunch of dependencies in `Cargo.lock` that are related to
mysql. These are NOT compiled at all, and are also not part of `cargo
tree`. The reason for the inclusion is a bug in cargo:
https://github.com/rust-lang/cargo/issues/10801
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-19 12:18:57 +00:00
d3b3805e5f
chore(deps): Bump clap from 4.3.15 to 4.3.16 ( #8263 )
...
Bumps [clap](https://github.com/clap-rs/clap ) from 4.3.15 to 4.3.16.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v4.3.15...v4.3.16 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-19 09:26:04 +00:00
fbbaf155ec
feat: ability to batch cache loader requests ( #8259 )
...
Core functionality for #8089 .
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-19 09:20:40 +00:00
69e4f998dd
fix: chunk up high plan counts in the compactor
2023-07-18 15:16:04 -05:00
b79009b128
refactor: refactor `Schemas` type in InfluxQL planner ( #8237 )
...
* refactor: refactor `Schemas` type in InfluxQL planner
* chore: update after merging main
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-18 17:14:39 +00:00
efae0f108a
feat(idpe-17887): enable `/` in db name for v1 write. ( #8235 )
...
* test case for proposed new behavior in v1 write endpoint.
* autogen and default are equivalent reserved words for rp
* have write endpoint match query endpoint, in that db and rp are always concated
2023-07-18 09:36:25 -07:00
1723aa46a6
docs: adjust querier cache docs ( #8260 )
...
`parquet_file` cache has a TTL as of #7975 .
2023-07-18 15:13:15 +00:00
67d1d41b11
chore(deps): Bump scopeguard from 1.1.0 to 1.2.0 ( #8255 )
...
Bumps [scopeguard](https://github.com/bluss/scopeguard ) from 1.1.0 to 1.2.0.
- [Commits](https://github.com/bluss/scopeguard/compare/v1.1.0...v1.2.0 )
---
updated-dependencies:
- dependency-name: scopeguard
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-18 12:49:34 +00:00
4c4c9f731c
chore(deps): Bump uuid from 1.4.0 to 1.4.1 ( #8256 )
...
Bumps [uuid](https://github.com/uuid-rs/uuid ) from 1.4.0 to 1.4.1.
- [Release notes](https://github.com/uuid-rs/uuid/releases )
- [Commits](https://github.com/uuid-rs/uuid/compare/1.4.0...1.4.1 )
---
updated-dependencies:
- dependency-name: uuid
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-18 12:30:42 +00:00
39450c54da
refactor: cache system code moves ( #8258 )
...
* refactor: fix `TestLoader` arg order
* refactor: extract test utils
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-18 12:20:27 +00:00
14f99f219b
chore(deps): Bump clap from 4.3.12 to 4.3.15 ( #8254 )
...
Bumps [clap](https://github.com/clap-rs/clap ) from 4.3.12 to 4.3.15.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v4.3.12...v4.3.15 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-18 09:18:58 +00:00
0bb9e059e5
refactor(influxql): make difference a user-defined window function ( #8257 )
...
Change the implementation of DIFFERENCE, and NON_NEGATIVE_DIFFERENCE,
to use a user-defined window function, rather than a user-defined
aggregator function. This slightly simplifies the implementation.
The window function calculates difference operation on the full
window in one operation rather than a row at a time. Where ther are
no NULL values in the input this function uses arrow compute kernels.
As part of this refactor the window function's implementation is
moved out of the planner module.
2023-07-18 09:03:58 +00:00
d1640bb926
feat(influxql): CUMULATIVE_SUM window function ( #8248 )
...
* feat(influxql): CUMULATIVE_SUM window function
Implement the InfluxQL CUMULATIVE_SUM window function. This is
implemented as described in
https://docs.influxdata.com/influxdb/v1.8/query_language/functions/#cumulative_sum .
* chore: Add a test demonstrating NULL handling of CUMULATIVE_SUM
---------
Co-authored-by: Stuart Carnie <stuart.carnie@gmail.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-18 06:13:58 +00:00
33e41fc5cb
fix: improve error for malformed gap fill query ( #8252 )
...
* fix: improve error for malformed gap fill query
* fix: code review feedback
2023-07-17 21:20:34 +00:00
b916a89159
fix: recurse through SubqueryAlias when finding gap fill time range ( #8249 )
2023-07-17 19:39:30 +00:00
e33a078128
chore(deps): Bump paste from 1.0.13 to 1.0.14 ( #8244 )
...
Bumps [paste](https://github.com/dtolnay/paste ) from 1.0.13 to 1.0.14.
- [Release notes](https://github.com/dtolnay/paste/releases )
- [Commits](https://github.com/dtolnay/paste/compare/1.0.13...1.0.14 )
---
updated-dependencies:
- dependency-name: paste
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 16:10:02 +00:00
2b164c0037
chore: Update DataFusion pin ( #8246 )
2023-07-17 15:53:54 +00:00
9fb689e50d
Merge pull request #8204 from influxdata/jrb_63_compactor_spans
...
chore: add tracing to compactor
2023-07-17 09:58:21 -05:00
85a9e13262
Merge branch 'main' into jrb_63_compactor_spans
2023-07-17 09:52:27 -05:00
7216a40271
Merge pull request #8230 from influxdata/cn/all-over-again
...
feat: Use PartitionHashId, when present, on QueryChunks
2023-07-17 14:52:11 +00:00
ebba032399
Merge branch 'main' into cn/all-over-again
2023-07-17 14:46:48 +00:00
cf046d0b3e
refactor: Extract a from implementation for creating TransitionPartitionId
2023-07-17 10:34:01 -04:00
a9b788b58f
feat: Collate chunks based on their partition hash id if they have it
2023-07-17 10:34:01 -04:00
ae4e7e43c4
Merge pull request #8231 from influxdata/jrb_64_add_test_case
...
fix: compactor loop in highly backlogged case
2023-07-17 09:29:28 -05:00
bba0685c59
Merge remote-tracking branch 'origin/main' into jrb_64_add_test_case
2023-07-17 09:16:13 -05:00
190bc41ca4
chore: comment spelling
2023-07-17 09:14:55 -05:00
70d104b12d
chore(deps): Bump sysinfo from 0.29.4 to 0.29.5 ( #8243 )
...
Bumps [sysinfo](https://github.com/GuillaumeGomez/sysinfo ) from 0.29.4 to 0.29.5.
- [Changelog](https://github.com/GuillaumeGomez/sysinfo/blob/master/CHANGELOG.md )
- [Commits](https://github.com/GuillaumeGomez/sysinfo/commits )
---
updated-dependencies:
- dependency-name: sysinfo
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 14:08:55 +00:00
4c0e5db3a5
chore(deps): Bump insta from 1.30.0 to 1.31.0 ( #8242 )
...
Bumps [insta](https://github.com/mitsuhiko/insta ) from 1.30.0 to 1.31.0.
- [Changelog](https://github.com/mitsuhiko/insta/blob/master/CHANGELOG.md )
- [Commits](https://github.com/mitsuhiko/insta/compare/1.30.0...1.31.0 )
---
updated-dependencies:
- dependency-name: insta
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-17 14:01:21 +00:00
c2606ff3ac
test: Add and use methods creating arbitrary TransitionPartitionId and PartitionHashIds
2023-07-17 09:56:55 -04:00
158c5119d1
fix: Make TransitionPartitionId and PartitionHashId sortable
2023-07-17 09:56:55 -04:00
313baca8b6
fix: Use sort_by rather than sort_by_key to use references
...
These places are sorting by `PartitionId` currently, which implements
`Copy`, but are about to be changed to be sorted on `PartitionHashId`,
which does not implement `Copy`.
2023-07-17 09:56:55 -04:00
745895c643
test: Ensure ingester only sends partition hash id if the partition provider gives it one
...
Also set a partition hash ID on all partitions built in tests with the
`PartitionDataBuilder` by default.
2023-07-17 09:56:55 -04:00
54adecca58
test: Send partition_hash_id to the querier iff PartitionResponse gets a partition hash ID
...
Test to make sure I don't break this behavior before I intend to
2023-07-17 09:54:44 -04:00
9317b36066
refactor: some `cache_system` clean-ups ( #8186 )
...
* refactor: pull out type
* feat: impl `Loader` for `Arc`
* refactor: have a single `TestLoader`
* refactor: simplify code
* refactor: encapsulate `CancellationSafeFutureReceiver`
2023-07-17 12:12:33 +00:00
49d8f829a8
chore(deps): Bump serde from 1.0.168 to 1.0.171 ( #8241 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.168 to 1.0.171.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.168...v1.0.171 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 12:05:54 +00:00
b840ca3f1b
chore(deps): Bump serde_json from 1.0.102 to 1.0.103 ( #8240 )
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.102 to 1.0.103.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.102...v1.0.103 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 11:36:47 +00:00
2fdf4b3ee9
chore(deps): Bump assert_cmd from 2.0.11 to 2.0.12 ( #8239 )
...
Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd ) from 2.0.11 to 2.0.12.
- [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md )
- [Commits](https://github.com/assert-rs/assert_cmd/compare/v2.0.11...v2.0.12 )
---
updated-dependencies:
- dependency-name: assert_cmd
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 10:57:18 +00:00
b6cd3b6e9b
Merge pull request #8157 from influxdata/savage/hook-up-wal-reference-counter-actor
...
feat(ingester): Drop WAL segments once all writes in it are persistent
2023-07-17 10:10:31 +00:00
a2ca5ca17c
Merge branch 'main' into savage/hook-up-wal-reference-counter-actor
2023-07-17 10:49:45 +01:00
283d77ca58
chore(deps): Bump clap from 4.3.11 to 4.3.12 ( #8238 )
...
Bumps [clap](https://github.com/clap-rs/clap ) from 4.3.11 to 4.3.12.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v4.3.11...v4.3.12 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 09:03:39 +00:00
85f03acbdf
fix: correctly catch field/tag discrepancy ( #8234 )
...
Co-authored-by: Marco Neumann <marco@crepererum.net>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-14 18:21:56 +00:00
5c8a61ae23
Merge pull request #8233 from influxdata/cn/rust-1.71
...
chore: Update to Rust 1.71
2023-07-14 15:29:07 +00:00
10a0f8e3bf
fix: Remove ::default() when constructing unit structs
...
As recommended by https://rust-lang.github.io/rust-clippy/master/index.html#default_constructed_unit_structs
2023-07-14 10:50:55 -04:00
d40bc54b71
fix: Remove unneeded double derefs found with new lint suspicious_double_ref_op
2023-07-14 10:25:21 -04:00
0d6a4cc9f6
chore: Update to Rust 1.71
2023-07-14 10:20:51 -04:00
8ff74385bb
Merge pull request #8220 from influxdata/savage/propagate-tracing-spans-from-router-to-ingester
...
feat(router): Propagate tracing spans for RPC write to Ingester
2023-07-14 12:34:06 +00:00
Joe-Blount
Joe-Blount
Marco Neumann
dependabot[bot]
Christopher M. Wolff
wiedld
Martin Hilton
Andrew Lamb
kodiakhq[bot]
Carol (Nichols || Goulding)
Fraser Savage