Commit Graph

3731 Commits (dac1e6f5eae952d0fd91c96dcfe0097bbca04eda)

Author SHA1 Message Date
kodiakhq[bot] 6aa5cfa937
Merge pull request #1796 from influxdata/layered-tracing
fix: Use layered tracing
2021-06-28 16:45:55 +00:00
Edd Robinson 12ae9b012a refactor: clarify intent of 2021-06-28 17:39:48 +01:00
Marko Mikulicic f2c7454274
fix: Use layered tracing 2021-06-28 18:37:12 +02:00
Raphael Taylor-Davies 32c683ddc1
fix: remove shared dictionary concept from ChunkSnapshot (#1570) (#1820) (#1825)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-28 15:26:49 +00:00
kodiakhq[bot] 9456ae5d39
Merge pull request #1798 from influxdata/cn/fix-loop-problem
fix: Try all partition_writes even if one in the middle fails
2021-06-28 13:53:39 +00:00
Carol (Nichols || Goulding) 0f7c47d10e fix: Limit the number of errors per sequenced entry we'll collect 2021-06-28 09:29:17 -04:00
Carol (Nichols || Goulding) 1e171e2e9a refactor: Organize `use` statements and let rustfmt manage order 2021-06-28 09:29:15 -04:00
Carol (Nichols || Goulding) f3a3a9b267 fix: Try to write all partition_writes even if one fails, collect all errors and report at the end 2021-06-28 09:24:23 -04:00
Carol (Nichols || Goulding) 4d2954ec1d test: Write a failing tests for partition_writes being ignored after a failure 2021-06-28 09:24:23 -04:00
Marco Neumann 6ec24353bf refactor: only rebuild a single txn for pres. catalogs
Stop relying on in-parquet transaction information during catalog
rebuilds. This has some downsides (no fork detection, only a single
transaction hence no time travel) but will allow that we remove
transaction information from parquet files, so that we can finally move
the actual parquet file storage out of the transaction lock.

This will help with #1821.
2021-06-28 15:10:44 +02:00
kodiakhq[bot] 4588c282e1
Merge pull request #1813 from influxdata/fixnewline
fix: Fix trailing newline emission in case of truncated log line
2021-06-28 11:20:33 +00:00
kodiakhq[bot] b69711d5ab
Merge branch 'main' into fixnewline 2021-06-28 11:13:41 +00:00
kodiakhq[bot] 4053dcaa2e
Merge pull request #1816 from influxdata/crepererum/move_catalog_loading_code
refactor: move catalog loading code into its own module
2021-06-28 11:12:38 +00:00
kodiakhq[bot] 8927491f04
Merge branch 'main' into crepererum/move_catalog_loading_code 2021-06-28 11:05:59 +00:00
kodiakhq[bot] dacc68f8d6
Merge pull request #1819 from influxdata/crepererum/editorconfig_indent
chore: add indent to editorconfig
2021-06-28 11:05:05 +00:00
Marco Neumann 9690d5d3f8 chore: add indent to editorconfig 2021-06-28 12:52:03 +02:00
Marco Neumann 65e65412cc refactor: move catalog loading code into its own module 2021-06-28 12:46:25 +02:00
Marko Mikulicic 1ff0e8d8d4
fix: Fix trailing newline emission in case of truncated log line 2021-06-28 12:23:53 +02:00
Marco Neumann 7b12426602 feat: implement persistence window checkpointing 2021-06-28 11:34:41 +02:00
Marco Neumann 25a912d4eb docs: fix mutable buffer intro docs 2021-06-28 11:34:41 +02:00
kodiakhq[bot] f69d61c7d1
Merge pull request #1801 from influxdata/pd-write-persistence-windows
feat: add persistence windows to partition and update on write
2021-06-25 19:52:15 +00:00
Paul Dix af93bb6573 chore: PR cleanup 2021-06-25 15:45:00 -04:00
Paul Dix de236c5a6f feat: update persistence windows to support late arrival less than 30 seconds 2021-06-25 15:34:11 -04:00
Paul Dix 435b4b6a94 feat: add persistence windows to partition and update on write
This brings the persistence windows into the catalog partition. It adds a helper method on TableBatch to get the min and max times for a given write. Finally, it adds this logic to the db to update persistence windows on every write while the partition write lock is being held.
2021-06-25 15:34:11 -04:00
kodiakhq[bot] 9cfabfd1b7
Merge pull request #1810 from influxdata/er/refactor/logging
refactor: logging
2021-06-25 16:46:27 +00:00
kodiakhq[bot] e033b52bcd
Merge branch 'main' into er/refactor/logging 2021-06-25 16:39:11 +00:00
Edd Robinson ed98812c2a refactor: logging 2021-06-25 17:37:04 +01:00
kodiakhq[bot] 0568f9c84a
Merge pull request #1808 from influxdata/fixlogs
fix: Increase line buffer to avoid frequent interleaved logs
2021-06-25 16:12:50 +00:00
kodiakhq[bot] d6451f3fde
Merge branch 'main' into fixlogs 2021-06-25 15:51:23 +00:00
Marko Mikulicic 15b709f89c
fix: Increase line buffer to avoid frequent interleaved logs 2021-06-25 17:41:28 +02:00
Raphael Taylor-Davies 3046b1692c
chore: include table name in compaction log (#1805)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-25 15:20:44 +00:00
Raphael Taylor-Davies 84e63bb1b9
feat: temporary log information on record batch data (#1807)
* feat: temporary log information on record batch data

* chore: add buffer size
2021-06-25 14:46:51 +00:00
Andrew Lamb 2e5f10f6b1
feat: Sort the output of split_plans as well (#1800)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-25 13:02:30 +00:00
kodiakhq[bot] 88b83746e6
Merge pull request #1804 from influxdata/disabled-logs
test: Ensure disabled logs don't eval args
2021-06-25 09:13:43 +00:00
Marko Mikulicic 22aa80969d
test: Ensure disabled logs don't eval args 2021-06-25 10:16:43 +02:00
kodiakhq[bot] a605263660
Merge pull request #1803 from influxdata/pd-update-contributing
chore: update CONTRIBUTING with instructions for running and debugging end-to-end tests
2021-06-24 22:18:26 +00:00
Paul Dix 2d2768bf33 chore: update CONTRIBUTING with instructions for running and debugging end-to-end tests 2021-06-24 18:01:19 -04:00
Andrew Lamb 4e7cf39b23
chore: Reduce debug logging in query crate (#1802) 2021-06-24 21:01:11 +00:00
Andrew Lamb 79446d45be
feat: Implement split_plans (#1794)
* feat: implement split plan / planner

* fix: Apply suggestions from code review

Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>

* fix: resolve merge conflicts

* fix: add values to panic

Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2021-06-24 18:38:00 +00:00
Raphael Taylor-Davies 297fc12db8
feat: compact chunks (#1776)
* feat: compact chunks

* chore: review feedback

* chore: clippy lints

* chore: document sort key algorithm

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-24 16:49:10 +00:00
kodiakhq[bot] 83777c6f53
Merge pull request #1748 from influxdata/cn/ci-improvements
chore: small CI improvements
2021-06-24 12:58:32 +00:00
kodiakhq[bot] 6d713439c9
Merge branch 'main' into cn/ci-improvements 2021-06-24 12:51:32 +00:00
kodiakhq[bot] 6e9a735999
Merge pull request #1743 from influxdata/cn/kafka-write
feat: Write entries to Kafka
2021-06-24 12:50:48 +00:00
kodiakhq[bot] 1bde983d66
Merge branch 'main' into cn/kafka-write 2021-06-24 12:42:44 +00:00
Andrew Lamb 0a03605bbc
refactor: pull Channel --> Stream adapater into its own module (#1793)
* refactor: pull Channel --> Stream adapater into its own module

* docs: Update query/src/exec/stream.rs

Co-authored-by: Marko Mikulicic <mkm@influxdata.com>

Co-authored-by: Marko Mikulicic <mkm@influxdata.com>
2021-06-24 10:35:45 +00:00
Carol (Nichols || Goulding) c0c1c3fd8e refactor: Extract a struct to hold all the arguments needed to make a Db 2021-06-23 16:31:38 -04:00
Carol (Nichols || Goulding) 3abb4ca12d chore: Add RUST_BACKTRACE=1 to tests in CI
Fixes #1736.
2021-06-23 16:16:47 -04:00
Carol (Nichols || Goulding) 4612afe65d chore: Instead of installing rustup components, print all their versions 2021-06-23 15:28:58 -04:00
Carol (Nichols || Goulding) f0efd20259 chore: Switch to rust-toolchain.toml to specify Rust components we need as well 2021-06-23 15:28:58 -04:00
Carol (Nichols || Goulding) f903b6eca8 fix: Create WriteBuffer outside of commit_db so committing can't fail 2021-06-23 13:56:50 -04:00