Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
6,371 Commits
234 Branches
453 Tags
344 MiB
Commit Graph

6371 Commits (fe0bc2180732cc2189cbfe9a4727294793d25f4d)

Author SHA1 Message Date
Raphael Taylor-Davies 197634ed50
feat: reload chunk back into read buffer (#3209) (#3216) 
* feat: reload chunk back into read buffer (#3209)

* chore: fix logical conflict

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2021-11-29 11:34:55 +00:00
Marco Neumann 4e043ecb55 refactor: remove old routing / sharding config 
This is superseded by the new router subsystem.
 2021-11-29 12:33:48 +01:00
kodiakhq[bot] 6ebec4ff71
Merge pull request #3243 from influxdata/crepererum/improve_kafka_client_usage 
refactor: improve Kafka client usage
 2021-11-29 10:54:22 +00:00
kodiakhq[bot] 8463d941b5
Merge branch 'main' into crepererum/improve_kafka_client_usage 2021-11-29 10:44:11 +00:00
kodiakhq[bot] 7684794e5c
Merge pull request #3222 from influxdata/crepererum/dml_shard_new_types 
refactor: consolidate sharding implementation
 2021-11-29 10:43:53 +00:00
kodiakhq[bot] 068b44334d
Merge branch 'main' into crepererum/dml_shard_new_types 2021-11-29 10:33:49 +00:00
dependabot[bot] d7053cad6b
chore(deps): bump futures-io from 0.3.17 to 0.3.18 (#3241) 
Bumps [futures-io](https://github.com/rust-lang/futures-rs) from 0.3.17 to 0.3.18.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.17...0.3.18)

---
updated-dependencies:
- dependency-name: futures-io
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2021-11-29 10:33:26 +00:00
Raphael Taylor-Davies 0100bfef79
feat: error if persist_age_threshold less than late arrival (#2005) (#3228) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2021-11-29 10:21:12 +00:00
kodiakhq[bot] 24e8c1305c
Merge pull request #3240 from influxdata/dependabot/cargo/futures-channel-0.3.18 
chore(deps): bump futures-channel from 0.3.17 to 0.3.18
 2021-11-29 09:55:32 +00:00
Marco Neumann 459c14035c test: ensure that Kafka producers also generate sane metrics 2021-11-29 10:55:08 +01:00
dependabot[bot] eba6ebd67a
chore(deps): bump futures-channel from 0.3.17 to 0.3.18 
Bumps [futures-channel](https://github.com/rust-lang/futures-rs) from 0.3.17 to 0.3.18.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.17...0.3.18)

---
updated-dependencies:
- dependency-name: futures-channel
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-11-29 09:46:01 +00:00
kodiakhq[bot] ef02846fcc
Merge pull request #3239 from influxdata/dependabot/cargo/serde_json-1.0.72 
chore(deps): bump serde_json from 1.0.71 to 1.0.72
 2021-11-29 09:43:49 +00:00
Marco Neumann b7952c15a6 refactor: improve Kafka client usage 
With the new rust-rdkafka release (merged in #3234) managing multiple
consumer streams becomes a bit easier. Also we can just reuse consumer
clients for multiple metadata requests. In total that provides:

- use only a single client connection for consumers (we had multiple
  connection attempts during startup and one client per stream)
- use only two clients for producers (sadly we need a consumer client to
  probe the partitions during startup)
- consumers no longer need to poll the stream to receive statistics
 2021-11-29 10:39:09 +01:00
dependabot[bot] 5d784ba866
chore(deps): bump serde_json from 1.0.71 to 1.0.72 
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.71 to 1.0.72.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.71...v1.0.72)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-11-29 09:28:07 +00:00
kodiakhq[bot] 0e4afa54bd
Merge pull request #3238 from influxdata/dependabot/cargo/futures-task-0.3.18 
chore(deps): bump futures-task from 0.3.17 to 0.3.18
 2021-11-29 09:21:59 +00:00
dependabot[bot] 0ac4b46ebf
chore(deps): bump futures-task from 0.3.17 to 0.3.18 
Bumps [futures-task](https://github.com/rust-lang/futures-rs) from 0.3.17 to 0.3.18.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.17...0.3.18)

---
updated-dependencies:
- dependency-name: futures-task
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-11-29 09:13:12 +00:00
kodiakhq[bot] b3873c946b
Merge pull request #3237 from influxdata/dependabot/cargo/crc32fast-1.2.2 
chore(deps): bump crc32fast from 1.2.1 to 1.2.2
 2021-11-29 09:09:14 +00:00
dependabot[bot] 3bedf6e62a
chore(deps): bump crc32fast from 1.2.1 to 1.2.2 
Bumps [crc32fast](https://github.com/srijs/rust-crc32fast) from 1.2.1 to 1.2.2.
- [Release notes](https://github.com/srijs/rust-crc32fast/releases)
- [Commits](https://github.com/srijs/rust-crc32fast/compare/v1.2.1...v1.2.2)

---
updated-dependencies:
- dependency-name: crc32fast
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-11-29 09:00:01 +00:00
kodiakhq[bot] 5e2dcad821
Merge pull request #3236 from influxdata/dependabot/cargo/predicates-2.1.0 
chore(deps): bump predicates from 2.0.3 to 2.1.0
 2021-11-29 08:57:52 +00:00
dependabot[bot] b46d07b8a5
chore(deps): bump predicates from 2.0.3 to 2.1.0 
Bumps [predicates](https://github.com/assert-rs/predicates-rs) from 2.0.3 to 2.1.0.
- [Release notes](https://github.com/assert-rs/predicates-rs/releases)
- [Changelog](https://github.com/assert-rs/predicates-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/assert-rs/predicates-rs/compare/v2.0.3...v2.1.0)

---
updated-dependencies:
- dependency-name: predicates
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-11-29 08:40:45 +00:00
kodiakhq[bot] eaff41ac20
Merge pull request #3235 from influxdata/dependabot/cargo/futures-core-0.3.18 
chore(deps): bump futures-core from 0.3.17 to 0.3.18
 2021-11-29 08:38:25 +00:00
dependabot[bot] b9d804c236
chore(deps): bump futures-core from 0.3.17 to 0.3.18 
Bumps [futures-core](https://github.com/rust-lang/futures-rs) from 0.3.17 to 0.3.18.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.17...0.3.18)

---
updated-dependencies:
- dependency-name: futures-core
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-11-29 08:29:32 +00:00
kodiakhq[bot] b74976a8c6
Merge pull request #3234 from influxdata/dependabot/cargo/rdkafka-0.28.0 
chore(deps): bump rdkafka from 0.27.0 to 0.28.0
 2021-11-29 08:27:18 +00:00
dependabot[bot] c729fc6a25
chore(deps): bump rdkafka from 0.27.0 to 0.28.0 
Bumps [rdkafka](https://github.com/fede1024/rust-rdkafka) from 0.27.0 to 0.28.0.
- [Release notes](https://github.com/fede1024/rust-rdkafka/releases)
- [Changelog](https://github.com/fede1024/rust-rdkafka/blob/master/changelog.md)
- [Commits](https://github.com/fede1024/rust-rdkafka/compare/v0.27.0...v0.28.0)

---
updated-dependencies:
- dependency-name: rdkafka
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-11-29 08:18:02 +00:00
kodiakhq[bot] 82539e625e
Merge pull request #3233 from influxdata/dependabot/cargo/cc-1.0.72 
chore(deps): bump cc from 1.0.71 to 1.0.72
 2021-11-29 08:15:26 +00:00
dependabot[bot] c0fe972b20
chore(deps): bump cc from 1.0.71 to 1.0.72 
Bumps [cc](https://github.com/alexcrichton/cc-rs) from 1.0.71 to 1.0.72.
- [Release notes](https://github.com/alexcrichton/cc-rs/releases)
- [Commits](https://github.com/alexcrichton/cc-rs/compare/1.0.71...1.0.72)

---
updated-dependencies:
- dependency-name: cc
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-11-29 01:29:47 +00:00
Andrew Lamb ab4f8cdbf2
test: add end to end tests for Storage/Offsets gRPC call (#3232) 2021-11-27 12:01:33 +00:00
kodiakhq[bot] b5033ce8ef
Merge pull request #3223 from influxdata/offsets-not-implemented 
fix: Implement a dummy Storage.Offsets method
 2021-11-26 16:47:25 +00:00
Marko Mikulicic 8fe2c64f5a
fix: Implement a dummy Storage.Offsets method 
Closes https://github.com/influxdata/conductor/issues/766
 2021-11-26 16:39:07 +01:00
Raphael Taylor-Davies a286960285
refactor: remove delete predicates from read filter interface (#3212) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2021-11-26 12:15:29 +00:00
kodiakhq[bot] f68cbb08ee
Merge pull request #3220 from influxdata/meta-script 
feat: Add a simple script to decode the IOx metadata of a parquet file
 2021-11-26 12:05:42 +00:00
Marco Neumann ad65687cba refactor: consolidate sharding implementation 
Move sharding implementation from router to `dml` (where the types can
be consumed w/o cloning the data) and only support the new sharding
configs.

The old sharding configs will be removed soon.
 2021-11-26 13:00:36 +01:00
kodiakhq[bot] 473ed75253
Merge branch 'main' into meta-script 2021-11-26 11:57:26 +00:00
kodiakhq[bot] f0ace30369
Merge pull request #3221 from influxdata/crepererum/remove_routing_from_database_mode_6 
refactor: remove write buffer direction
 2021-11-26 11:47:46 +00:00
Marco Neumann 7f2e4f4342 refactor: remove write buffer direction 
The direction was required when a database could read or write from/to a
write buffer. Now it is clear from the usage context of a write buffer
context which of the two applications is meant (databases read, routers
write) so the direction flag is no longer required.
 2021-11-26 12:38:40 +01:00
Marko Mikulicic 4b271fe162
feat: Add a simple script to decode the IOx metadata of a parquet file 2021-11-26 12:25:19 +01:00
kodiakhq[bot] 91e5cfd81a
Merge pull request #3219 from influxdata/crepererum/remove_routing_from_database_mode_5 
refactor: remove write buffer producer logic from `Db`
 2021-11-26 11:11:49 +00:00
Marco Neumann ac20fecf6f refactor: remove write buffer producer logic from `Db` 
As a side effect, writing to database no longer requires `async`.

Closes #2243.
 2021-11-26 12:02:27 +01:00
kodiakhq[bot] 00143315ac
Merge pull request #3217 from influxdata/crepererum/disallow_unsequenced_deletes 
feat: disallow unsequenced deletes when reading from write buffer
 2021-11-26 10:51:44 +00:00
kodiakhq[bot] e7a050c573
Merge branch 'main' into crepererum/disallow_unsequenced_deletes 2021-11-26 10:43:24 +00:00
kodiakhq[bot] b3f2de4876
Merge pull request #3215 from influxdata/crepererum/test-bench 
feat: test bench
 2021-11-26 10:43:10 +00:00
Marco Neumann 589b7ad3af fix: typo 
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
 2021-11-26 11:40:41 +01:00
Marco Neumann e5bfa08910 feat: disallow unsequenced deletes when reading from write buffer 
Similar to how writes to a databases that reads from a write buffer are
forbidden deletes should be rejected as well.
 2021-11-26 11:40:08 +01:00
kodiakhq[bot] 262bbd5c47
Merge branch 'main' into crepererum/test-bench 2021-11-26 10:34:21 +00:00
kodiakhq[bot] cfba3651d7
Merge pull request #3218 from influxdata/crepererum/remove_routing_from_database_mode_4 
refactor: remove connection manager and resolver from `Server`
 2021-11-26 10:33:30 +00:00
Marco Neumann 22936abb23 refactor: remove connection manager and resolver from `Server` 2021-11-26 11:00:19 +01:00
kodiakhq[bot] 6d9d84ff29
Merge pull request #3207 from influxdata/crepererum/remove_routing_from_database_mode_3 
refactor: remove write routing logic from `Server`
 2021-11-26 09:45:39 +00:00
Marco Neumann e1b523333c feat: improve glue code 2021-11-26 10:22:15 +01:00
Marco Neumann c5f20769ad feat: improve glue and config handling 2021-11-26 10:09:31 +01:00
Marco Neumann 0e06026fbd refactor: remove write routing logic from `Server` 
API users should use `Database` instead, there's no need any longer to mirror
this API in `Server`. Note that `Database` is better than `Db` in this
case, because the former can also check if we're writing from a write
buffer and can easily reject unsequenced writes. The `pub` modifiers
were adjusted to make it impossible to write through `Db` directly.
 2021-11-26 09:26:43 +01:00