Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
49,662 Commits
392 Branches
476 Tags
374 MiB
Commit Graph

49662 Commits (pbarnett/update-script-to-dockerhub)

Author SHA1 Message Date
dependabot[bot] aae478d0f5
chore(deps): Bump base64 from 0.21.2 to 0.21.3 
Bumps [base64](https://github.com/marshallpierce/rust-base64) from 0.21.2 to 0.21.3.
- [Changelog](https://github.com/marshallpierce/rust-base64/blob/master/RELEASE-NOTES.md)
- [Commits](https://github.com/marshallpierce/rust-base64/compare/v0.21.2...v0.21.3)

---
updated-dependencies:
- dependency-name: base64
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-08-28 09:05:14 +00:00
dependabot[bot] 9ae072d3f8
chore(deps): Bump regex from 1.9.3 to 1.9.4 (#8581) 
Bumps [regex](https://github.com/rust-lang/regex) from 1.9.3 to 1.9.4.
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/compare/1.9.3...1.9.4)

---
updated-dependencies:
- dependency-name: regex
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-28 09:00:52 +00:00
dependabot[bot] 57be618413
chore(deps): Bump regex-automata from 0.3.6 to 0.3.7 (#8580) 
Bumps [regex-automata](https://github.com/rust-lang/regex) from 0.3.6 to 0.3.7.
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/compare/regex-automata-0.3.6...regex-syntax-0.3.7)

---
updated-dependencies:
- dependency-name: regex-automata
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-28 08:49:21 +00:00
Joe-Blount 323af3d679
Merge pull request #8578 from influxdata/jrb_88_cap_region_count 
chore: limit compactor region count computations
 2023-08-25 15:56:28 -05:00
Joe-Blount 46179bf164 chore: limit compactor region count computations 2023-08-25 14:41:24 -05:00
Nga Tran 2eb74ddb87
chore: revert teaching compactor to use sort_key_ids (#8574) 2023-08-25 13:21:12 +00:00
Dom d029265696
Merge pull request #8565 from influxdata/dom/gossip-parquet-crate 
feat(gossip): new parquet file gossip crate
 2023-08-25 13:19:19 +01:00
Dom fa738cfec3
Merge branch 'main' into dom/gossip-parquet-crate 2023-08-25 13:07:07 +01:00
Dom ed94b56c6e
docs: copy/paste fix 
Co-authored-by: Fraser Savage <fsavage@influxdata.com>
 2023-08-25 13:06:58 +01:00
Marco Neumann 196c589ef6
refactor: `is_terminal` no longer requires an external crate (#8572) 
* refactor: `is_terminal` no longer requires an external crate

This is now part of the stdlib.

* chore: Run cargo hakari tasks

---------

Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
 2023-08-25 09:01:36 +00:00
dependabot[bot] af8f98e35f
chore(deps): Bump clap from 4.3.24 to 4.4.0 (#8571) 
Bumps [clap](https://github.com/clap-rs/clap) from 4.3.24 to 4.4.0.
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/compare/v4.3.24...clap_complete-v4.4.0)

---
updated-dependencies:
- dependency-name: clap
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-25 07:54:14 +00:00
Andrew Lamb e4505912a1
chore: Update DataFusion pin (#8544) 
* chore: Update DataFusion pin

* refactor: Use upstream check

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-08-24 18:31:33 +00:00
Nga Tran 246918feb6
feat: teach compactor to use sort_key_ids instead of sort_key (#8560) 
* feat: teach compactor to use sort_key_ids instead of sort_key

* test: update the test output after chatting with Joe and know the reason of the chnanges
 2023-08-24 16:16:12 +00:00
Joe-Blount 36e66158a2
chore: add log message before compacting partition (#8569) 2023-08-24 14:13:23 +00:00
Dom c3f402a0f8
Merge branch 'main' into dom/gossip-parquet-crate 2023-08-24 14:11:09 +01:00
Dom 544ff8c3ef
Merge pull request #8567 from influxdata/dom/gossip-docs 
docs(gossip): move crate docs to README
 2023-08-24 13:27:17 +01:00
Dom Dwyer 43bb149ddc
docs(gossip): move crate docs to README 
Move the docs to a README to be linked to.
 2023-08-24 14:15:56 +02:00
Dom Dwyer 180d4affc7
docs: fix diagram padding 
Super important!
 2023-08-24 12:59:55 +02:00
Dom Dwyer b2e93c97f1
docs: clarify tx input type 
The ParquetFileTx type accepts any type that converts into a
ParquetFile, not just a ParquetFile.

This allows applications to use whatever application-level type they
have at hand so long as it's convertible.
 2023-08-24 12:29:01 +02:00
Dom Dwyer 6a0c54758b
feat(gossip): new parquet file gossip crate 
Adds a reusable "gossip_parquet_file" crate that provides a use-case
specific wrapper over the underlying gossip transport.

This crate deals with the encoding and decoding of parquet gossip
messages, handling them off to the application, and decoupling latency
of handlers from the gossip reactor.
 2023-08-24 11:23:17 +02:00
Dom Dwyer 04051aea4c
refactor(gossip): define NewParquetFiles topic 
Separate the parquet file gossiping onto a new topic to allow specific
interest subscriptions and minimise cluster traffic.
 2023-08-24 11:23:17 +02:00
Dom cdd20a2337
Merge pull request #8553 from influxdata/dom/partition-id-proto 
feat: proto serialisation of TransitionPartitionId
 2023-08-24 10:21:49 +01:00
Dom c350873bf6
Merge branch 'main' into dom/partition-id-proto 2023-08-24 10:14:41 +01:00
dependabot[bot] 7b37479cd1
chore(deps): Bump siphasher from 0.3.10 to 1.0.0 (#8561) 
Bumps [siphasher](https://github.com/jedisct1/rust-siphash) from 0.3.10 to 1.0.0.
- [Commits](https://github.com/jedisct1/rust-siphash/compare/0.3.10...1.0.0)

---
updated-dependencies:
- dependency-name: siphasher
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Dom <dom@itsallbroken.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-08-24 09:13:14 +00:00
dependabot[bot] aed214afa8
chore(deps): Bump reqwest from 0.11.19 to 0.11.20 (#8562) 
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.19 to 0.11.20.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.19...v0.11.20)

---
updated-dependencies:
- dependency-name: reqwest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Dom <dom@itsallbroken.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-08-24 09:07:49 +00:00
Dom 0a7b72493d
Merge branch 'main' into dom/partition-id-proto 2023-08-24 10:05:21 +01:00
Dom Dwyer 17b8eaef0f
test: assert error conditions for proto decoding 
Test error cases too.
 2023-08-24 11:04:19 +02:00
dependabot[bot] 7ca074a00a
chore(deps): Bump serde from 1.0.185 to 1.0.186 (#8563) 
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.185 to 1.0.186.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.185...v1.0.186)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Dom <dom@itsallbroken.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-08-24 09:02:20 +00:00
dependabot[bot] 88243d35d3
chore(deps): Bump clap from 4.3.23 to 4.3.24 (#8564) 
Bumps [clap](https://github.com/clap-rs/clap) from 4.3.23 to 4.3.24.
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/compare/v4.3.23...v4.3.24)

---
updated-dependencies:
- dependency-name: clap
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Dom <dom@itsallbroken.com>
 2023-08-24 08:56:54 +00:00
Marco Neumann 92c0e0c806
feat: re-land #8491 (#8543) 
Includes the whole migration set again:

1. **create helper index:** This may or may not exist in prod depending
   on when #8540 landed. This is OK, spend a bit of work here.
2. **actual migration:** The bit that originally failed, but now w/ an
   extra step to migrate empty keys (because the `unnest`+`array_agg`
   logic only works for non-empty keys and is a no-op for empty ones).
   This is idempotent (i.e. a no-op) if we already finished the
   migration.
3. **remove helper index:** Remove the helper index from (1).
4. **enfore `NOT NULL`:** This is a no-op if this was already applied.

Closes #8542.

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2023-08-24 08:14:32 +00:00
kodiakhq[bot] 498cbecd91
Merge pull request #8557 from influxdata/dom/tcp-nodelay 
perf: enable TCP_NODELAY on gRPC servers
 2023-08-23 18:58:07 +00:00
kodiakhq[bot] 1abbbbaf2a
Merge branch 'main' into dom/tcp-nodelay 2023-08-23 18:52:38 +00:00
Dom 6b0c95ed51
Merge branch 'main' into dom/partition-id-proto 2023-08-23 17:40:25 +01:00
Dom 9f94ad542c
Merge pull request #8554 from influxdata/dom/cleanup-impl 
refactor: impl observer where type defined
 2023-08-23 17:40:14 +01:00
Dom Dwyer 6523004008
perf: enable TCP_NODELAY on gRPC servers 
This change forces TCP_NODELAY to be set, which is the default for
tonic, and is enabled by default, but is silently discarded when using
serve_with_incoming_shutdown().
 2023-08-23 18:07:39 +02:00
Dom 4ae1ccbcd5
Merge branch 'main' into dom/partition-id-proto 2023-08-23 17:01:44 +01:00
Dom d2cda56d5e
Merge branch 'main' into dom/cleanup-impl 2023-08-23 17:01:16 +01:00
Dom 6e1d371460
Merge pull request #8551 from influxdata/dom/gossip-parquet-file-proto 
feat(proto): define parquet file gossip type
 2023-08-23 17:00:09 +01:00
Dom b8f5b2661c
Merge branch 'main' into dom/cleanup-impl 2023-08-23 16:59:59 +01:00
Dom 15006044c4
Merge branch 'main' into dom/gossip-parquet-file-proto 2023-08-23 16:49:39 +01:00
Dom 46f288fe02
Merge pull request #8550 from influxdata/dom/completion-observer-full-metadata 
refactor(ingester): full parquet file metadata
 2023-08-23 16:21:35 +01:00
Fraser Savage 8b48e5be95
Merge branch 'main' into savage/disk-full-protection 2023-08-23 15:42:11 +01:00
Dom Dwyer a5df75371b
refactor: impl observer where type defined 
Implement the PersistCompletionObserver for the WalReferenceHandle
alongside the WalReferenceHandle type, instead of the other way around.
 2023-08-23 16:41:00 +02:00
Fraser Savage 19807d7c89
refactor(ingester): Disk guard uses an actor to enqueue persist & clean ops 
This decouples the behaviour of the disk full protection task from the
reporting interval of the disk metrics tracker, ensuring that at least
one extra clean will always be queued if a full disk snapshot is sent
while a previous persist and clean operation is running or finishing.
 2023-08-23 15:34:00 +01:00
Dom Dwyer e932132946
feat: proto serialisation of TransitionPartitionId 
Adds serialisation and deserialisation of TransitionPartitionId to the
protobuf representation, and a randomised round-trip property test.
 2023-08-23 15:52:02 +02:00
Dom Dwyer 6a68b6edf0
test(partition): less proptest discards 
Generate non-empty strings as inputs to proptest tests instead of
generating random strings and filtering.
 2023-08-23 15:52:01 +02:00
Dom Dwyer a1211b0d03
feat(proto): define parquet file gossip type 
Specify the gossip message used to notify peers of new parquet files.

This reuses the existing ParquetFile type in the "catalog" proto
package.

This will probably expand in the future to differentiate between new
files (via ingest) and compacted files (which make other files
obsolete).
 2023-08-23 13:10:08 +02:00
Dom Dwyer 6ccf3324e4
refactor(ingester): full parquet file metadata 
Include the full ParquetFile metadata when invoking
PersistCompletionObserver implementations, instead of the
ParquetFileParams subset.
 2023-08-23 13:06:41 +02:00
Dom e2a61c072d
Merge pull request #8549 from influxdata/dom/use-gossip-schema 
refactor(router): use gossip_schema
 2023-08-23 12:02:25 +01:00
Dom Dwyer ee063057b3
refactor(router): use gossip_schema 
Replace the bespoke schema gossip logic in the router with the reusable
gossip_schema crate.
 2023-08-23 12:42:33 +02:00