9b52bfdeaa
Merge pull request #8371 from influxdata/dependabot/cargo/serde-1.0.179
...
chore(deps): Bump serde from 1.0.177 to 1.0.179
2023-07-31 09:51:07 +01:00
4fa6ead27d
chore(deps): Bump serde from 1.0.177 to 1.0.179
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.177 to 1.0.179.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.177...v1.0.179 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-07-31 08:38:48 +00:00
ec8033a65b
chore(deps): Bump regex-automata from 0.3.3 to 0.3.4 ( #8370 )
...
Bumps [regex-automata](https://github.com/rust-lang/regex ) from 0.3.3 to 0.3.4.
- [Release notes](https://github.com/rust-lang/regex/releases )
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/regex/compare/regex-automata-0.3.3...regex-automata-0.3.4 )
---
updated-dependencies:
- dependency-name: regex-automata
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-31 08:34:24 +00:00
61b65a9cbb
Merge pull request #8357 from influxdata/idpe-17789/rename-internal-variables
...
refactor(idpe-17789): rename internal variables
2023-07-28 14:42:37 -07:00
cfcef35680
Merge branch 'main' into idpe-17789/rename-internal-variables
2023-07-28 14:25:16 -07:00
4f9c901dcf
Merge pull request #8354 from influxdata/savage/router-return-schema-change-diff-values-for-gossip
...
feat(router): Include table/column diff for namespace schema cache update
2023-07-28 14:23:52 +00:00
b3f35b4e7c
Merge branch 'main' into savage/router-return-schema-change-diff-values-for-gossip
2023-07-28 14:16:12 +00:00
a930be45f7
refactor(router): Use map & sum over values instead of fold over iter
...
Also add a nice comment explaining what the string keys are for
[`ChangeStats`].
Co-authored-by: Dom <dom@itsallbroken.com>
2023-07-28 15:11:13 +01:00
940f441259
chore(deps): Bump tikv-jemalloc-ctl from 0.5.0 to 0.5.4 ( #8359 )
...
Bumps [tikv-jemalloc-ctl](https://github.com/tikv/jemallocator ) from 0.5.0 to 0.5.4.
- [Release notes](https://github.com/tikv/jemallocator/releases )
- [Changelog](https://github.com/tikv/jemallocator/blob/main/CHANGELOG.md )
- [Commits](https://github.com/tikv/jemallocator/compare/0.5.0...0.5.4 )
---
updated-dependencies:
- dependency-name: tikv-jemalloc-ctl
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Dom <dom@itsallbroken.com>
2023-07-28 12:45:43 +00:00
aad6608a9a
Merge pull request #8360 from influxdata/dependabot/cargo/serde-1.0.177
...
chore(deps): Bump serde from 1.0.176 to 1.0.177
2023-07-28 13:40:42 +01:00
29d66444e5
chore(deps): Bump serde from 1.0.176 to 1.0.177
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.176 to 1.0.177.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.176...v1.0.177 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-07-28 10:40:15 +00:00
91baa9bab7
chore(deps): Bump tikv-jemalloc-sys ( #8361 )
...
Bumps [tikv-jemalloc-sys](https://github.com/tikv/jemallocator ) from 0.5.3+5.3.0-patched to 0.5.4+5.3.0-patched.
- [Release notes](https://github.com/tikv/jemallocator/releases )
- [Changelog](https://github.com/tikv/jemallocator/blob/main/CHANGELOG.md )
- [Commits](https://github.com/tikv/jemallocator/compare/tikv-jemalloc-sys-0.5.3...0.5.4 )
---
updated-dependencies:
- dependency-name: tikv-jemalloc-sys
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Dom <dom@itsallbroken.com>
2023-07-28 10:38:16 +00:00
783454adb6
Merge pull request #8332 from influxdata/dom/gossip
...
feat(gossip): peer exchange
2023-07-28 11:32:37 +01:00
61348373ff
Merge branch 'main' into dom/gossip
2023-07-28 11:13:06 +01:00
9a7ff9ecfc
chore(idpe-17789): update code comments to reflect both jobs and partitions
2023-07-27 15:39:18 -07:00
d7fee9fdb8
refactor(idpe-17789): rename local variables and private struct properties to jobs (versus partitions).
2023-07-27 15:38:21 -07:00
7ac6c6d80f
Merge pull request #8326 from influxdata/idpe-17789/compaction-job-renaming
...
refactor(idpe-17789): renaming abstractions related to partitions source, to compaction jobs source
2023-07-27 15:30:45 -07:00
78ef536954
Merge branch 'main' into idpe-17789/compaction-job-renaming
2023-07-27 15:05:49 -07:00
e1626c3ba4
Merge pull request #8307 from influxdata/ntran/table_cli
...
feat: create table CLI
2023-07-27 11:03:07 -04:00
091d387e2a
chore: merge main to branch ntran/table_cli
2023-07-27 10:28:45 -04:00
4af45e0cee
Merge pull request #8340 from influxdata/jrb_73_stuck
...
fix: no percent split during ManySmallFiles compaction
2023-07-27 09:03:56 -05:00
f5a41592da
Merge remote-tracking branch 'origin/main' into jrb_73_stuck
...
# Conflicts:
# compactor/tests/layouts/stuck.rs
2023-07-27 08:54:50 -05:00
525f8ec0cb
fix: compactor loop splitting then undoing it ( #8338 )
2023-07-27 13:17:30 +00:00
e00a5cab13
perf(router): Pre-compute `ChangeStats` new column total during schema merge
...
During the schema merge the new tables are iterated over already (to find
which tables and columns are new), so the number needed for the metrics
can be pre-computed to spare two extra loops over the new tables and new
columns returned in `ChangeStats`.
2023-07-27 14:01:50 +01:00
5453ad8ba4
feat(router): Include table/column diff for namespace schema cache update
...
This adds some computational overhead during the merging of new
namespace schema with what's in the router's local cache, but will allow
gossiping of changes.
2023-07-27 13:37:47 +01:00
73339cfc57
fix: remove sqlx "used" metrics ( #8336 )
...
PR #8327 introduced a bunch of metrics for the sqlx connection pool. One
of the metrics was the "used" metrics that was supposed to count
"currently in use" connection. In prod however this metric underflows to
a very large integer. It seems that "acquire" callback is only used by sqlx for
re-used connections (i.e. for the transition from "idle" to "used").
Now we could try to work around it but since there is no "close
connection" callback, I doubt it it possible to do the accurately.
Luckily though we don't really need that counter. sqlx already offers
"active" (defined as idle + used) and "idle", so getting "used" is just
the difference. I removed the "used" metric nevertheless because
"active" and "idle" are read independently from each other (based on atomic
integers) and are NOT guaranteed to be in-sync. Calculating the
difference within IOx however would give the illusion that they are. So
I leave this to the dashboard / alert / whatever, because there it is
usually understood that metrics are samples and may be out of sync for a
very short time.
A nice side effect of this change is that it simplifies the code quite a
bit.
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-27 10:04:56 +00:00
b372e5532f
Merge pull request #8333 from influxdata/dom/cached-fsm-schema
...
perf(ingester): reusable FSM / RecordBatch schemas
2023-07-27 10:36:22 +01:00
a37b85804d
Merge branch 'main' into dom/cached-fsm-schema
2023-07-27 10:31:02 +01:00
854c4c25e9
chore(deps): Bump sysinfo from 0.29.6 to 0.29.7 ( #8341 )
...
Bumps [sysinfo](https://github.com/GuillaumeGomez/sysinfo ) from 0.29.6 to 0.29.7.
- [Changelog](https://github.com/GuillaumeGomez/sysinfo/blob/master/CHANGELOG.md )
- [Commits](https://github.com/GuillaumeGomez/sysinfo/commits )
---
updated-dependencies:
- dependency-name: sysinfo
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-27 09:22:52 +00:00
ac810aab8a
chore(deps): Bump serde from 1.0.175 to 1.0.176 ( #8343 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.175 to 1.0.176.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.175...v1.0.176 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-27 09:17:39 +00:00
700830d7d3
chore(deps): Bump serde_json from 1.0.103 to 1.0.104 ( #8342 )
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.103 to 1.0.104.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.103...v1.0.104 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-27 09:12:35 +00:00
ef158a664b
docs: ref-clone indicators for Schema
...
Cloning a Schema looks expensive, but it's not!
2023-07-27 11:12:11 +02:00
cb3bc1f0fa
Merge pull request #8344 from influxdata/dependabot/cargo/pprof-0.12.1
...
chore(deps): Bump pprof from 0.12.0 to 0.12.1
2023-07-27 10:06:36 +01:00
cdaa3bc720
chore(deps): Bump pprof from 0.12.0 to 0.12.1
...
Bumps [pprof](https://github.com/tikv/pprof-rs ) from 0.12.0 to 0.12.1.
- [Changelog](https://github.com/tikv/pprof-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/tikv/pprof-rs/commits )
---
updated-dependencies:
- dependency-name: pprof
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-07-27 01:54:25 +00:00
6246275c4a
chore: insta churn updates
2023-07-26 15:59:49 -05:00
f1e088aa0e
fix: no percent split during ManySmallFiles compaction
2023-07-26 15:59:20 -05:00
afd5b12324
chore: address review comments and fix tests due to previous commit
2023-07-26 16:40:54 -04:00
8a16703ff8
Merge pull request #8325 from influxdata/idpe-17789/compaction-job-in-compactor
...
feat(idpe-17789): provide CompactionJob throughout compactor
2023-07-26 10:52:44 -07:00
fe3897dd62
Merge branch 'main' into idpe-17789/compaction-job-in-compactor
2023-07-26 10:45:09 -07:00
14815435b8
fix: Use proto::PartitionTemplate's serde_json support directly
...
Rather than defining new types and implementing serialization on them
2023-07-26 13:04:55 -04:00
1ddc64d68d
test: modify and add tests check valid and invalid strftime
2023-07-26 11:44:13 -04:00
1a6aa1a8dc
Merge pull request #8337 from influxdata/savage/tolerate-empty-wal-write-during-replay
...
fix(ingester): Skip empty writes with no data during WAL replay
2023-07-26 10:11:33 +00:00
352bb79fc1
Merge branch 'main' into savage/tolerate-empty-wal-write-during-replay
2023-07-26 10:06:25 +00:00
11aba01385
Merge pull request #8330 from influxdata/savage/expose-router-health-check-configuration-options
...
feat(router): Expose circuit breaker healthcheck `ERROR_WINDOW` for config
2023-07-26 10:06:09 +00:00
c818f90aef
docs(router): Remove code doc ref from router CLI flag text
2023-07-26 11:01:13 +01:00
3133f9c2eb
fix(ingester): Skip empty writes with no data during WAL replay
...
In very rare cases a panic mid-write can result in a partially completed
write to the WAL which contains no table data. This is now not replayed
(as there is nothing to replay) and does not panic when encountered,
but tracks the occurence into the WAL replayed ops metric and logs a
warning.
2023-07-26 10:43:10 +01:00
61e79374e0
feat(router): Expose circuit breaker healthcheck config
...
Exposes the `ERROR_WINDOW` parameter that controls the router's
downstream error-gate health check behaviour as an environment
variable/command line flag. This allows tuning, per-environment, the
period over which the error rate of 80% must be exceeded to cause an
ingester to appear unhealthy.
2023-07-26 09:48:55 +01:00
62c9424cca
chore: Merge branch 'main' into ntran/table_cli
2023-07-25 17:42:01 -04:00
57eed252c7
chore: fix a comment
2023-07-25 17:11:48 -04:00
e6cf9c9d61
fix: rename namespaces of differnet tests to avoid test failures
2023-07-25 17:07:28 -04:00
Dom
dependabot[bot]
wiedld
kodiakhq[bot]
Fraser Savage
wiedld
Nga Tran
Joe-Blount
Joe-Blount
Marco Neumann
Carol (Nichols || Goulding)