dd93b2cdec
feat: add db-level compaction limiter
2021-07-19 14:00:10 +01:00
4ca19ad13f
refactor: add max_active_compaction config option
2021-07-19 14:00:10 +01:00
4da8a16c18
chore: update to arrow 5.0 and master datafusion ( #2049 )
...
* chore: update to arrow 5.0 and master datafusion
* fix: Update test for change in object size
2021-07-19 12:49:51 +00:00
e2a23c7ac3
fix: persist deadlock ( #2045 ) ( #2046 )
2021-07-19 11:52:48 +00:00
ee6a14b7dc
Merge pull request #2042 from DCjanus/main
...
refactor: explicitly specify the type, more friendly to IDE
2021-07-19 10:06:57 +00:00
eb00a72782
Merge branch 'main' into main
2021-07-19 10:00:23 +00:00
f5f8e507bb
Merge pull request #2043 from influxdata/crepererum/simplify_testdb_lifecycle_rules
...
test: make TestDb lifecycle better for testing
2021-07-19 09:59:55 +00:00
a1d47a8a7a
Merge branch 'main' into crepererum/simplify_testdb_lifecycle_rules
2021-07-19 09:53:35 +00:00
5fc98c7c56
feat: add failure reporting to TaskTracker ( #2031 )
...
* feat: add failure reporting to TaskTracker
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-19 09:17:20 +00:00
2263189e09
test: make TestDb lifecycle better for testing
...
This is a leftover from #1972 .
2021-07-19 09:50:44 +02:00
cdb81cbc60
refactor: explicitly specify the type, more friendly to IDE
2021-07-17 22:45:54 +08:00
0c17080e40
Merge pull request #2034 from influxdata/jg/snafu-driveby
...
refactor: clean up some SNAFU usage
2021-07-16 18:05:58 +00:00
c896f0e100
Merge branch 'main' into jg/snafu-driveby
2021-07-16 17:58:58 +00:00
d00d56027b
docs: add comment to trigger build ( #2039 )
2021-07-16 17:53:55 +00:00
77633315f3
Merge pull request #2037 from influxdata/acks
...
fix: Set acks=all for kafka writes
2021-07-16 16:03:22 +00:00
1676c33113
refactor: update write_buffer/src/kafka.rs
2021-07-16 16:56:03 +01:00
de0dce79f6
docs: Update write_buffer/src/kafka.rs
...
Co-authored-by: Edd Robinson <me@edd.io>
2021-07-16 17:53:02 +02:00
92623b5f32
fix: Set acks=all for kafka writes
2021-07-16 17:49:04 +02:00
98a0bdf31d
Merge pull request #2009 from influxdata/cn/meta-data-size-bug
...
fix: use correct row group size when updating table meta data
2021-07-16 15:03:03 +00:00
54ad69ed86
fix: ensure correct table meta size used
2021-07-16 10:48:45 -04:00
42b56ad657
refactor: Use SNAFU's context instead of `ok_or_else`
2021-07-16 09:59:54 -04:00
939d15a21f
perf: Avoid clone when an error doesn't occur
2021-07-16 09:59:54 -04:00
f3175ed291
test: use of different size values
2021-07-16 09:47:56 -04:00
abe2fe7262
test: MetaData new with a row group vs default then update_with should have the same size
2021-07-16 09:47:56 -04:00
f57ba6afdb
fix: use fixed-size timestamps for parquet metadata ( #2032 )
...
This fixes flaky tests that rely on predictable files sizes.
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-16 13:14:02 +00:00
3d5c07a5d8
Merge pull request #1890 from influxdata/fbroot
...
feat: Flatbuffers root_type and file_identifier
2021-07-16 12:38:23 +00:00
256aaa21e5
Merge branch 'main' into fbroot
2021-07-16 11:48:58 +00:00
0319d7d4d2
Merge pull request #1972 from influxdata/crepererum/persist_real_checkpoints
...
feat: persist real (non-fake) part.+DB checkpoints
2021-07-16 10:53:28 +00:00
2498642c00
fix: `persist_partition` docstring
2021-07-16 12:46:07 +02:00
1ef2bc1887
refactor: `Db::{write_chunk_to_object_store => Db::persist_partition}`
...
The previous method allowed to persist any chunk -- even ones that
should not be persisted yet and w/o any order of peristence. That will
break our persistence windows. So instead offer a sane higher-level
interface that can trigger persistence of a partition within the
boundaries of the lifecycle rules. This needs some adjustments for our
test suite.
2021-07-16 12:07:58 +02:00
9683d91f32
refactor: adjust to upstream changes
2021-07-16 11:45:34 +02:00
2b0a4bbe0a
feat: persist real (non-fake) part.+DB checkpoints
2021-07-16 11:45:34 +02:00
8276511bd3
feat: allow to construct partition checkpoint from partition
2021-07-16 11:45:34 +02:00
a9ea8e9ced
docs: add docstring to some `Partition` methods
2021-07-16 11:45:34 +02:00
81c90868be
docs: note that `MinMaxSequence` are inclusive start/end
2021-07-16 11:45:34 +02:00
71b5030fc0
refactor: remove unused `LockableChunk::write_to_object_store`
2021-07-16 11:45:34 +02:00
00b89cd751
fix: freeze chunks in write path ( #2021 ) ( #2022 )
...
* fix: freeze chunks in write path (#2021 )
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-16 08:51:37 +00:00
3613b18e32
Merge pull request #2026 from influxdata/ntran/refactor_use_sort_key
...
refactor: address review comments and add useful log info to catch resort
2021-07-15 21:25:00 +00:00
50aa1f857d
Merge branch 'main' into ntran/refactor_use_sort_key
2021-07-15 21:17:26 +00:00
12121ad1c4
Merge pull request #2028 from influxdata/debugkafka
...
chore: Add some debug logs to write buffer
2021-07-15 21:14:57 +00:00
76d9b8f7cc
Merge branch 'main' into debugkafka
2021-07-15 21:07:35 +00:00
6218957bd8
fix: flaky lifecycle test ( #1994 ) ( #2020 )
...
* fix: flaky lifecycle test (#1994 )
* chore: fix lint
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-15 21:07:09 +00:00
cbadd65cfe
fix: Update write_buffer/src/kafka.rs
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-07-15 23:00:45 +02:00
d5dcb40438
refactor: track future execution ( #2014 )
...
* refactor: track future execution
* refactor: update server/src/db/lifecycle/compact.rs
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-15 20:58:52 +00:00
06399e88e0
chore: Add some debug logs to write buffer
2021-07-15 22:18:03 +02:00
f3b44d81f2
refactor: remove empty lines
2021-07-15 15:43:45 -04:00
cfe0bfa88b
refactor: address review comments and add useful log info to catch resort
2021-07-15 15:39:12 -04:00
74b8bb76e6
chore: Update to correct pre-release version of DF ( #2023 )
...
Co-authored-by: Edd Robinson <me@edd.io>
2021-07-15 18:13:42 +00:00
5027131bb2
Merge pull request #2019 from influxdata/cn/kafka-queue-settings
...
fix: Kafka queueing
2021-07-15 17:47:42 +00:00
0db38a84db
Merge branch 'main' into cn/kafka-queue-settings
2021-07-15 17:40:18 +00:00
Edd Robinson
Andrew Lamb
Raphael Taylor-Davies
kodiakhq[bot]
Marco Neumann
DCjanus
Marko Mikulicic
Jake Goulding
Carol (Nichols || Goulding)
Nga Tran