Commit Graph

6313 Commits (35edee6b4f7b205544b06f58976566e54ab4b6a4)

Author SHA1 Message Date
Nga Tran 254d35a6c2 refactor: address review comment 2021-12-01 12:25:42 -05:00
Marco Neumann dbf2642582 fix: `jaeger_debug` -> `jaeger_debug_header` 2021-12-01 18:02:39 +01:00
Marco Neumann 405b2029d7 fix: accept PB batches w/ trimmed repeated tail values
Fixes #3128.
2021-12-01 17:58:55 +01:00
kodiakhq[bot] f9fc38ff41
Merge pull request #3270 from influxdata/crepererum/issue3186
fix: use correct `bytes_read` in `DmlMeta`
2021-12-01 16:55:51 +00:00
kodiakhq[bot] 5143af0401
Merge branch 'main' into crepererum/issue3186 2021-12-01 16:47:32 +00:00
kodiakhq[bot] b2365daad8
Merge pull request #3257 from influxdata/crepererum/remove_test_bench
refactor: remove test bench
2021-12-01 16:47:14 +00:00
kodiakhq[bot] d5f94b0012
Merge branch 'main' into crepererum/remove_test_bench 2021-12-01 16:38:42 +00:00
Raphael Taylor-Davies 94883cd33b
feat: decode error details payloads (#3251) (#3271) 2021-12-01 15:30:59 +00:00
Nga Tran 878c59c0d2 chore: cleanup 2021-12-01 10:25:35 -05:00
Nga Tran 1ac32f1d90 refactor: avoid lock gap while updating in-memory catalog 2021-12-01 10:24:58 -05:00
Marco Neumann 332485d2c9 fix: use correct `bytes_read` in `DmlMeta`
- for file-based write buffers: Use headers + payload
- for Kafka-based write buffers: Use the estimation that we also use for
  other metrics
- as a side effect we can now just use `PartialEq` for more types

Fixes #3186.
2021-12-01 15:57:21 +01:00
Marco Neumann 4bbe756b52 feat: make jaeger-debug-id configurable 2021-12-01 15:02:15 +01:00
Raphael Taylor-Davies 9e45ce4121
feat: cleanup gRPC server errors (#3251) (#3265)
* feat: add precondition violation enumeration (#3251)

* chore: review feedback
2021-12-01 13:33:17 +00:00
Marco Neumann c961454dcd feat: `jaeger-debug-id` from data generator 2021-12-01 14:33:09 +01:00
Raphael Taylor-Davies f1936f0b08
refactor: add resource type enumeration (#3251) (#3260)
* refactor: add resource type enumeration (#3251)

* chore: more error details
2021-12-01 10:26:12 +00:00
Raphael Taylor-Davies 05064eba62
fix: don't error on delete to non-existent table (#3259) (#3263)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-01 00:40:05 +00:00
Nga Tran f53cdca010 feat: handling empty compacted stream 2021-11-30 18:13:36 -05:00
Nga Tran 6bb7a796e7 chore: Merge branch 'main' into ntran/compact_os_preserved_catalog 2021-11-30 16:55:38 -05:00
Nga Tran e8034cdc53 refactor: handle delete predicates for compacting os 2021-11-30 16:45:04 -05:00
kodiakhq[bot] 42b1436220
Merge pull request #3262 from influxdata/crepererum/fix_git_version
fix: GIT version in `--version`
2021-11-30 17:19:36 +00:00
Marco Neumann 7a02830bf7 fix: GIT version in `--version`
The GIT version was always "UNKNOWN", a regression introduced by #2965.
Also adds a regression test.
2021-11-30 16:06:27 +01:00
Raphael Taylor-Davies c161d1176a
refactor: cleanup Db write path error handling (#3258) 2021-11-30 15:05:02 +00:00
kodiakhq[bot] 82b4f8811c
Merge pull request #3261 from influxdata/crepererum/RUSTSEC-2021-0127
chore: ignore `RUSTSEC-2021-0127`
2021-11-30 14:54:51 +00:00
Marco Neumann 1eab81f47e chore: ignore `RUSTSEC-2021-0127` 2021-11-30 15:46:34 +01:00
Raphael Taylor-Davies 1e515a1dec
feat: load RUB from object store (#3224) (#3250) 2021-11-30 14:39:52 +00:00
Andrew Lamb 20da62eb87
chore: Update `arrow`, `arrow-flight`, and `parquet` to 6.3.0 (#3254)
* chore: Update `arrow`,  `arrow-flight`, and `parquet` to 6.3.0

* fix: update metadata size
2021-11-30 12:30:17 +00:00
Raphael Taylor-Davies 88acf3788e
feat: rebuild catalog (#3225) (#3253)
* feat: rebuild catalog (#3225)

* chore: fix doc

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-30 12:17:27 +00:00
Marco Neumann 46ff3a0351 refactor: remove test bench 2021-11-30 13:05:57 +01:00
Raphael Taylor-Davies 6f8d513798
chore: remove temporary logging (#2297) (#3256) 2021-11-30 11:11:17 +00:00
Nga Tran 7afc20142b test: add tests that do actual compacting chunks 2021-11-29 22:59:34 -05:00
Raphael Taylor-Davies f165faf5bc
feat: support forcing persistence of partition irrespective of arrival time (#3249)
* feat: force persistence of partition irrespective of arrival time

* feat: expose to CLI

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-29 22:07:35 +00:00
Nga Tran 37c4bb402b feat: update os compacted chunk in both in memory and preserved catalog 2021-11-29 15:17:00 -05:00
Raphael Taylor-Davies 837e029ed8
refactor: cleanup database recovery (#3225) (#3245)
* refactor: cleanup database recovery (#3225)

* chore: fix errors

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-29 18:49:46 +00:00
kodiakhq[bot] fb9d21cf64
Merge pull request #3248 from influxdata/crepererum/extend_ci_lints
ci: run shellcheck and yamllint
2021-11-29 15:59:26 +00:00
kodiakhq[bot] 5ffb03b83c
Merge branch 'main' into crepererum/extend_ci_lints 2021-11-29 15:51:06 +00:00
Raphael Taylor-Davies 0517adf752
feat: test interaction of write buffer and lifecycle (#2811) (#3211)
* feat: test interaction of write buffer and lifecycle (#2811)

* chore: more docs
2021-11-29 14:16:43 +00:00
Marco Neumann f1e9ac9ef2 ci: run shellcheck 2021-11-29 15:11:15 +01:00
Marco Neumann 86772a6d20 ci: run yamllint 2021-11-29 15:11:15 +01:00
kodiakhq[bot] a5261d4cca
Merge pull request #3246 from influxdata/crepererum/extend_ci_image
ci: add `yamllint` and `shellcheck` to CI image
2021-11-29 13:38:04 +00:00
Marco Neumann 24be4784fb ci: add `yamllint` and `shellcheck` to CI image
This prepares a PR to run these two tools as linters.
2021-11-29 14:10:05 +01:00
kodiakhq[bot] c5472973ee
Merge pull request #3244 from influxdata/crepererum/remove_routing_from_database_mode_7
refactor: remove old routing / sharding config
2021-11-29 11:46:57 +00:00
kodiakhq[bot] 23dffefcf8
Merge branch 'main' into crepererum/remove_routing_from_database_mode_7 2021-11-29 11:38:12 +00:00
Raphael Taylor-Davies 197634ed50
feat: reload chunk back into read buffer (#3209) (#3216)
* feat: reload chunk back into read buffer (#3209)

* chore: fix logical conflict

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-29 11:34:55 +00:00
Marco Neumann 4e043ecb55 refactor: remove old routing / sharding config
This is superseded by the new router subsystem.
2021-11-29 12:33:48 +01:00
kodiakhq[bot] 6ebec4ff71
Merge pull request #3243 from influxdata/crepererum/improve_kafka_client_usage
refactor: improve Kafka client usage
2021-11-29 10:54:22 +00:00
kodiakhq[bot] 8463d941b5
Merge branch 'main' into crepererum/improve_kafka_client_usage 2021-11-29 10:44:11 +00:00
kodiakhq[bot] 7684794e5c
Merge pull request #3222 from influxdata/crepererum/dml_shard_new_types
refactor: consolidate sharding implementation
2021-11-29 10:43:53 +00:00
kodiakhq[bot] 068b44334d
Merge branch 'main' into crepererum/dml_shard_new_types 2021-11-29 10:33:49 +00:00
dependabot[bot] d7053cad6b
chore(deps): bump futures-io from 0.3.17 to 0.3.18 (#3241)
Bumps [futures-io](https://github.com/rust-lang/futures-rs) from 0.3.17 to 0.3.18.
- [Release notes](https://github.com/rust-lang/futures-rs/releases)
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.17...0.3.18)

---
updated-dependencies:
- dependency-name: futures-io
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-29 10:33:26 +00:00
Raphael Taylor-Davies 0100bfef79
feat: error if persist_age_threshold less than late arrival (#2005) (#3228)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-29 10:21:12 +00:00