Commit Graph

6367 Commits (e3d9454f8ade71a879bb9dd5fa925f1eaf2c6bd6)

Author SHA1 Message Date
kodiakhq[bot] 7ad60c3941
Merge pull request #3252 from influxdata/ntran/compact_os_preserved_catalog
feat: update os compacted chunk in both in-memory and preserved catalogs
2021-12-01 18:35:00 +00:00
kodiakhq[bot] e8edab0b43
Merge branch 'main' into ntran/compact_os_preserved_catalog 2021-12-01 18:26:33 +00:00
Nga Tran de54d2843c chore: remove unused error 2021-12-01 13:24:12 -05:00
Nga Tran 60807c2d95 refactor: address review comments 2021-12-01 13:11:17 -05:00
Nga Tran 254d35a6c2 refactor: address review comment 2021-12-01 12:25:42 -05:00
Marco Neumann dbf2642582 fix: `jaeger_debug` -> `jaeger_debug_header` 2021-12-01 18:02:39 +01:00
Marco Neumann 405b2029d7 fix: accept PB batches w/ trimmed repeated tail values
Fixes #3128.
2021-12-01 17:58:55 +01:00
kodiakhq[bot] f9fc38ff41
Merge pull request #3270 from influxdata/crepererum/issue3186
fix: use correct `bytes_read` in `DmlMeta`
2021-12-01 16:55:51 +00:00
kodiakhq[bot] 5143af0401
Merge branch 'main' into crepererum/issue3186 2021-12-01 16:47:32 +00:00
kodiakhq[bot] b2365daad8
Merge pull request #3257 from influxdata/crepererum/remove_test_bench
refactor: remove test bench
2021-12-01 16:47:14 +00:00
kodiakhq[bot] d5f94b0012
Merge branch 'main' into crepererum/remove_test_bench 2021-12-01 16:38:42 +00:00
Raphael Taylor-Davies 94883cd33b
feat: decode error details payloads (#3251) (#3271) 2021-12-01 15:30:59 +00:00
Nga Tran 878c59c0d2 chore: cleanup 2021-12-01 10:25:35 -05:00
Nga Tran 1ac32f1d90 refactor: avoid lock gap while updating in-memory catalog 2021-12-01 10:24:58 -05:00
Marco Neumann 332485d2c9 fix: use correct `bytes_read` in `DmlMeta`
- for file-based write buffers: Use headers + payload
- for Kafka-based write buffers: Use the estimation that we also use for
  other metrics
- as a side effect we can now just use `PartialEq` for more types

Fixes #3186.
2021-12-01 15:57:21 +01:00
Marco Neumann 4bbe756b52 feat: make jaeger-debug-id configurable 2021-12-01 15:02:15 +01:00
Raphael Taylor-Davies 9e45ce4121
feat: cleanup gRPC server errors (#3251) (#3265)
* feat: add precondition violation enumeration (#3251)

* chore: review feedback
2021-12-01 13:33:17 +00:00
Marco Neumann c961454dcd feat: `jaeger-debug-id` from data generator 2021-12-01 14:33:09 +01:00
Raphael Taylor-Davies f1936f0b08
refactor: add resource type enumeration (#3251) (#3260)
* refactor: add resource type enumeration (#3251)

* chore: more error details
2021-12-01 10:26:12 +00:00
Raphael Taylor-Davies 05064eba62
fix: don't error on delete to non-existent table (#3259) (#3263)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-01 00:40:05 +00:00
Nga Tran f53cdca010 feat: handling empty compacted stream 2021-11-30 18:13:36 -05:00
Nga Tran 6bb7a796e7 chore: Merge branch 'main' into ntran/compact_os_preserved_catalog 2021-11-30 16:55:38 -05:00
Nga Tran e8034cdc53 refactor: handle delete predicates for compacting os 2021-11-30 16:45:04 -05:00
kodiakhq[bot] 42b1436220
Merge pull request #3262 from influxdata/crepererum/fix_git_version
fix: GIT version in `--version`
2021-11-30 17:19:36 +00:00
Marco Neumann 7a02830bf7 fix: GIT version in `--version`
The GIT version was always "UNKNOWN", a regression introduced by #2965.
Also adds a regression test.
2021-11-30 16:06:27 +01:00
Raphael Taylor-Davies c161d1176a
refactor: cleanup Db write path error handling (#3258) 2021-11-30 15:05:02 +00:00
kodiakhq[bot] 82b4f8811c
Merge pull request #3261 from influxdata/crepererum/RUSTSEC-2021-0127
chore: ignore `RUSTSEC-2021-0127`
2021-11-30 14:54:51 +00:00
Marco Neumann 1eab81f47e chore: ignore `RUSTSEC-2021-0127` 2021-11-30 15:46:34 +01:00
Raphael Taylor-Davies 1e515a1dec
feat: load RUB from object store (#3224) (#3250) 2021-11-30 14:39:52 +00:00
Andrew Lamb 20da62eb87
chore: Update `arrow`, `arrow-flight`, and `parquet` to 6.3.0 (#3254)
* chore: Update `arrow`,  `arrow-flight`, and `parquet` to 6.3.0

* fix: update metadata size
2021-11-30 12:30:17 +00:00
Raphael Taylor-Davies 88acf3788e
feat: rebuild catalog (#3225) (#3253)
* feat: rebuild catalog (#3225)

* chore: fix doc

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-30 12:17:27 +00:00
Marco Neumann 46ff3a0351 refactor: remove test bench 2021-11-30 13:05:57 +01:00
Raphael Taylor-Davies 6f8d513798
chore: remove temporary logging (#2297) (#3256) 2021-11-30 11:11:17 +00:00
Nga Tran 7afc20142b test: add tests that do actual compacting chunks 2021-11-29 22:59:34 -05:00
Raphael Taylor-Davies f165faf5bc
feat: support forcing persistence of partition irrespective of arrival time (#3249)
* feat: force persistence of partition irrespective of arrival time

* feat: expose to CLI

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-29 22:07:35 +00:00
Nga Tran 37c4bb402b feat: update os compacted chunk in both in memory and preserved catalog 2021-11-29 15:17:00 -05:00
Raphael Taylor-Davies 837e029ed8
refactor: cleanup database recovery (#3225) (#3245)
* refactor: cleanup database recovery (#3225)

* chore: fix errors

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-29 18:49:46 +00:00
kodiakhq[bot] fb9d21cf64
Merge pull request #3248 from influxdata/crepererum/extend_ci_lints
ci: run shellcheck and yamllint
2021-11-29 15:59:26 +00:00
kodiakhq[bot] 5ffb03b83c
Merge branch 'main' into crepererum/extend_ci_lints 2021-11-29 15:51:06 +00:00
Raphael Taylor-Davies 0517adf752
feat: test interaction of write buffer and lifecycle (#2811) (#3211)
* feat: test interaction of write buffer and lifecycle (#2811)

* chore: more docs
2021-11-29 14:16:43 +00:00
Marco Neumann f1e9ac9ef2 ci: run shellcheck 2021-11-29 15:11:15 +01:00
Marco Neumann 86772a6d20 ci: run yamllint 2021-11-29 15:11:15 +01:00
kodiakhq[bot] a5261d4cca
Merge pull request #3246 from influxdata/crepererum/extend_ci_image
ci: add `yamllint` and `shellcheck` to CI image
2021-11-29 13:38:04 +00:00
Marco Neumann 24be4784fb ci: add `yamllint` and `shellcheck` to CI image
This prepares a PR to run these two tools as linters.
2021-11-29 14:10:05 +01:00
kodiakhq[bot] c5472973ee
Merge pull request #3244 from influxdata/crepererum/remove_routing_from_database_mode_7
refactor: remove old routing / sharding config
2021-11-29 11:46:57 +00:00
kodiakhq[bot] 23dffefcf8
Merge branch 'main' into crepererum/remove_routing_from_database_mode_7 2021-11-29 11:38:12 +00:00
Raphael Taylor-Davies 197634ed50
feat: reload chunk back into read buffer (#3209) (#3216)
* feat: reload chunk back into read buffer (#3209)

* chore: fix logical conflict

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-29 11:34:55 +00:00
Marco Neumann 4e043ecb55 refactor: remove old routing / sharding config
This is superseded by the new router subsystem.
2021-11-29 12:33:48 +01:00
kodiakhq[bot] 6ebec4ff71
Merge pull request #3243 from influxdata/crepererum/improve_kafka_client_usage
refactor: improve Kafka client usage
2021-11-29 10:54:22 +00:00
kodiakhq[bot] 8463d941b5
Merge branch 'main' into crepererum/improve_kafka_client_usage 2021-11-29 10:44:11 +00:00