49d8f829a8
chore(deps): Bump serde from 1.0.168 to 1.0.171 ( #8241 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.168 to 1.0.171.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.168...v1.0.171 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 12:05:54 +00:00
b840ca3f1b
chore(deps): Bump serde_json from 1.0.102 to 1.0.103 ( #8240 )
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.102 to 1.0.103.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.102...v1.0.103 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 11:36:47 +00:00
2fdf4b3ee9
chore(deps): Bump assert_cmd from 2.0.11 to 2.0.12 ( #8239 )
...
Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd ) from 2.0.11 to 2.0.12.
- [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md )
- [Commits](https://github.com/assert-rs/assert_cmd/compare/v2.0.11...v2.0.12 )
---
updated-dependencies:
- dependency-name: assert_cmd
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 10:57:18 +00:00
b6cd3b6e9b
Merge pull request #8157 from influxdata/savage/hook-up-wal-reference-counter-actor
...
feat(ingester): Drop WAL segments once all writes in it are persistent
2023-07-17 10:10:31 +00:00
a2ca5ca17c
Merge branch 'main' into savage/hook-up-wal-reference-counter-actor
2023-07-17 10:49:45 +01:00
283d77ca58
chore(deps): Bump clap from 4.3.11 to 4.3.12 ( #8238 )
...
Bumps [clap](https://github.com/clap-rs/clap ) from 4.3.11 to 4.3.12.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v4.3.11...v4.3.12 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 09:03:39 +00:00
85f03acbdf
fix: correctly catch field/tag discrepancy ( #8234 )
...
Co-authored-by: Marco Neumann <marco@crepererum.net>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-14 18:21:56 +00:00
5c8a61ae23
Merge pull request #8233 from influxdata/cn/rust-1.71
...
chore: Update to Rust 1.71
2023-07-14 15:29:07 +00:00
10a0f8e3bf
fix: Remove ::default() when constructing unit structs
...
As recommended by https://rust-lang.github.io/rust-clippy/master/index.html#default_constructed_unit_structs
2023-07-14 10:50:55 -04:00
d40bc54b71
fix: Remove unneeded double derefs found with new lint suspicious_double_ref_op
2023-07-14 10:25:21 -04:00
0d6a4cc9f6
chore: Update to Rust 1.71
2023-07-14 10:20:51 -04:00
8ff74385bb
Merge pull request #8220 from influxdata/savage/propagate-tracing-spans-from-router-to-ingester
...
feat(router): Propagate tracing spans for RPC write to Ingester
2023-07-14 12:34:06 +00:00
699fb70616
Merge branch 'main' into savage/propagate-tracing-spans-from-router-to-ingester
2023-07-14 12:28:56 +00:00
e1e1d5ab38
fix: compactor loop in highly backlogged case
2023-07-13 16:47:59 -05:00
823a878675
Merge remote-tracking branch 'origin/main' into jrb_63_compactor_spans
2023-07-13 10:37:21 -05:00
181cc0096c
fix(ingester): Prevent WAL segment deletion wait deadlock during shutdown
...
The WAL reference tracker's inactive segment empty notification only fires
when dropping to 0, not if it is already 0 (it may do this multiple times
over the lifetime of the ingester). This makes sure that the graceful
shutdown notifier listener is set up before the WAL is rotated and the
file is enqueued in the tracker for deletion.
2023-07-13 16:26:16 +01:00
885767aa0a
chore(deps): Bump regex-automata from 0.3.2 to 0.3.3 ( #8225 )
...
Bumps [regex-automata](https://github.com/rust-lang/regex ) from 0.3.2 to 0.3.3.
- [Release notes](https://github.com/rust-lang/regex/releases )
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/regex/compare/regex-automata-0.3.2...regex-automata-0.3.3 )
---
updated-dependencies:
- dependency-name: regex-automata
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-13 14:50:35 +00:00
18ef39c5fe
chore: remove env variable control of compactor spans
2023-07-13 09:05:22 -05:00
803122e3b4
Merge remote-tracking branch 'origin/main' into jrb_63_compactor_spans
...
# Conflicts:
# compactor/src/driver.rs
2023-07-13 08:54:22 -05:00
432be864d2
Merge pull request #8228 from influxdata/dom/optional-ts-summary
...
fix(ingester): projection without time column
2023-07-13 14:52:07 +01:00
67343210cd
chore: address comments
2023-07-13 08:51:19 -05:00
4572057a11
Merge branch 'main' into savage/hook-up-wal-reference-counter-actor
2023-07-13 14:37:42 +01:00
787f9a57dc
test: projection with and without "time"
...
Add test cases driving projection logic for BufferTree queries with, and
without the "time" column.
2023-07-13 14:42:52 +02:00
7f7d1f2ee7
fix(ingester): projection without time column
...
The ingester can project arbitrary columns at query time, and has no
special requirement that the "time" column be part of that projection.
Because the timestamp summary generation explicitly requires the time
column to exist, it panics when there's no "time" column in the
projection - this is a bit of a modelling mismatch more than anything.
2023-07-13 14:22:48 +02:00
4c54d10098
refactor(ingester): Simplify test code and reference actor handle passing
...
As pointed out, use of the turbofish for the `MockPersistQueue` default
constructor can be avoided by a specialised `Default` implementation
on the type. The WAL reference actor handle is internally refcounted,
so this commit also stops wrapping it in an `Arc`.
Co-authored-by: Dom <dom@itsallbroken.com>
2023-07-13 12:20:58 +01:00
516880eeb8
docs(ingester): Make it clear that getting op `SequenceNumberSet` is not free
...
The type is not copy and does not use a cached value - it collects a new
owned set.
Co-authored-by: Dom <dom@itsallbroken.com>
2023-07-13 11:42:30 +01:00
9bfec2f77c
fix: ignore flaky test while it is debugged ( #8227 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-13 10:27:13 +00:00
48a5c3e966
chore: Add longer sleep in `end_to_end_cases::debug::build_catalog` and extra logging ( #8224 )
...
* fix: Add longer sleep in end_to_end_cases::debug::build_catalog
* chore: add debug logging when test fails
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-13 10:14:59 +00:00
361f284262
Merge pull request #8222 from influxdata/dom/prune-partition-metadata
...
perf: only send metadata for relevant partitions
2023-07-13 09:55:19 +01:00
04ec49aff5
Merge branch 'main' into dom/prune-partition-metadata
2023-07-13 09:46:57 +01:00
a9e40c1a90
fix(8191): directory path resolve ( #8205 )
2023-07-12 13:50:03 -07:00
c3788ee2b8
chore: Update datafusion pin ( #8223 )
2023-07-12 18:18:41 +00:00
7bd6e90830
perf: only send metadata for relevant partitions
...
When partition pruning is possible, it skips sending the data for
partitions that have no affect on the query outcome.
This commit does the same for the partition metadata - these frames can
form a significant portion of the query response when the row count is
low, and for pruned partitions have no bearing on the query result.
2023-07-12 18:38:43 +02:00
5232cfea1d
Merge pull request #8051 from influxdata/dom/gossip-basic
...
feat: gossip primitive
2023-07-12 17:21:33 +01:00
2bd7af6ca6
Merge branch 'main' into dom/gossip-basic
2023-07-12 17:11:59 +01:00
7e595eca88
test(router): Assert RPC write span contexts can be parsed as encoded
...
This test aims to add some assertion that the span context is correctly
encoded into an RPC write request as long as the [`TraceHeaderParser`]
is responsible for decorating the requests extensions with the added
information.
2023-07-12 16:41:40 +01:00
5f63407f24
Merge pull request #8083 from influxdata/cn/query-catalog-with-either-partition-identifier
...
feat: Query the catalog with PartitionHashId if you have it, otherwise with PartitionId
2023-07-12 14:56:29 +00:00
1fce6d7b86
Merge branch 'main' into dom/gossip-basic
2023-07-12 15:53:49 +01:00
e73116a122
Merge branch 'main' into cn/query-catalog-with-either-partition-identifier
2023-07-12 14:51:02 +00:00
729851be58
test(ingester): Integration test for RPC write trace context inheritrance
2023-07-12 15:48:41 +01:00
61325e2593
Merge pull request #8219 from influxdata/dom/query-tracing
...
refactor(ingester): emit spans for query handler
2023-07-12 14:24:15 +01:00
458b1bf1a6
feat(ingester): Extract SpanContext from RPC write request
...
Ensure that if a `SpanContext` type is present in the request that the
trace ID is used for spans in the RPC write path.
2023-07-12 14:22:58 +01:00
af56985d70
refactor(ingester): emit span for query handler
...
Emit a span that covers the entire flight query handler.
2023-07-12 14:42:43 +02:00
5a37c92c2c
feat(router): Send tracing SpanContext header to ingester during RPC write
2023-07-12 11:30:50 +01:00
ceecd11064
Merge branch 'main' into dom/gossip-basic
2023-07-12 10:50:57 +01:00
b8f1c8f68a
chore(deps): Bump rustix from 0.38.3 to 0.38.4 ( #8217 )
...
Bumps [rustix](https://github.com/bytecodealliance/rustix ) from 0.38.3 to 0.38.4.
- [Release notes](https://github.com/bytecodealliance/rustix/releases )
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.38.3...v0.38.4 )
---
updated-dependencies:
- dependency-name: rustix
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-12 09:28:30 +00:00
c6a4ab0225
Merge pull request #8218 from influxdata/dependabot/cargo/serde_json-1.0.102
...
chore(deps): Bump serde_json from 1.0.100 to 1.0.102
2023-07-12 10:22:37 +01:00
d74f047b06
chore(deps): Bump serde_json from 1.0.100 to 1.0.102
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.100 to 1.0.102.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.100...v1.0.102 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-07-12 02:00:42 +00:00
ebe1f4c91d
fix: Implement influxql ExecutionPlan::children ( #8215 )
2023-07-12 00:01:02 +00:00
f33891b9fe
fix(all-in-one): Run compactor in all-in-one mode ( #8214 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-11 21:14:07 +00:00
dependabot[bot]
kodiakhq[bot]
Fraser Savage
Christopher M. Wolff
Carol (Nichols || Goulding)
Joe-Blount
Dom
Andrew Lamb
wiedld
Marko Mikulicic