552e3fb691
fix: Padd stats compute deterministic order of sort key and update tests that got changed by the use of sort key
2021-07-14 14:06:41 -04:00
d156998b46
fix: remove unused parameter `mutable_linger_seconds` from dbrules ( #2003 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-14 18:06:20 +00:00
2bcf6d280b
Merge pull request #1999 from influxdata/cn/exploration
...
fix: Change RUB chunk table_summaries to table_summary
2021-07-14 17:38:22 +00:00
833debd5b5
Merge branch 'main' into cn/exploration
2021-07-14 17:30:55 +00:00
cbeeb97cff
feat: flush open window on persist ( #1985 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-14 16:58:20 +00:00
83f72c465d
Merge pull request #2002 from influxdata/er/refactor/batch
...
refactor: increase compaction batch size
2021-07-14 16:39:13 +00:00
2ef6671eca
Merge branch 'main' into er/refactor/batch
2021-07-14 17:31:42 +01:00
1d00fa2fd8
refactor: track memory metrics in catalog ( #1995 )
...
* refactor: track memory metrics in catalog
* chore: update comment
2021-07-14 16:23:00 +00:00
46ac15a77e
refactor: increase compaction batch size
2021-07-14 17:19:11 +01:00
8070065e2f
fix: Change RUB chunk table_summaries to table_summary
...
Because chunks now have only one table.
Connects to #1718 , #1613 , #1295
2021-07-14 11:18:02 -04:00
cedd6269c7
Merge pull request #1997 from influxdata/cn/alt-table-summary
...
feat: Make a TableSummaryAndTimes type for incremental replacement of TableSummary
2021-07-14 14:56:54 +00:00
9bc7ea2ace
Merge branch 'main' into cn/alt-table-summary
2021-07-14 14:49:59 +00:00
89b15fd3d2
Merge pull request #1998 from influxdata/crepererum/fix_entry_clone
...
fix: fix `Entry::clone`
2021-07-14 14:49:37 +00:00
2c01bcffba
Merge branch 'main' into crepererum/fix_entry_clone
2021-07-14 14:42:06 +00:00
243cee530a
test: Fix flaky test by specifying ORDER BY in query ( #1996 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-14 14:41:24 +00:00
649b467adb
fix: CatalogChunk no longer needs to record a write when created from a MUB chunk
2021-07-14 10:28:12 -04:00
7ccbab8c90
feat: Make a TableSummaryAndTimes to use to slowly replace TableSummary
...
And use TableSummaryAndTimes with the mutable buffer chunks when turning
them into catalog chunks.
It's proving too big to switch over everything using TableSummary at
once, so this will let us switch over more incrementally.
2021-07-14 10:28:12 -04:00
c176a4ee09
fix: fix `Entry::clone`
2021-07-14 16:26:59 +02:00
b79d9eb0ab
chore: add end-to-end test for PB write service ( #1894 )
...
* chore: add end-to-end test for PB write service
* chore: lint
* chore: fix test
2021-07-14 14:20:37 +00:00
0417cc3c0f
Merge pull request #1992 from influxdata/er/chore/e2elogs
...
chore: emit server logs
2021-07-14 13:20:11 +00:00
bf9a054961
Merge branch 'main' into er/chore/e2elogs
2021-07-14 13:12:52 +00:00
fa10201025
Merge pull request #1986 from influxdata/alamb/go_go_go_go
...
chore: Update IOx to a pre-release version of arrow and datafusion to test out performance improvement
2021-07-14 13:12:24 +00:00
4dedb657f2
Merge branch 'main' into alamb/go_go_go_go
2021-07-14 14:04:13 +01:00
795b730368
Merge branch 'main' into er/chore/e2elogs
2021-07-14 13:03:48 +00:00
f1c1620c84
feat: make persistence windows interface harder to use incorrectly ( #1977 )
...
* feat: make persistence windows interface harder to use incorrectly
* chore: review feedback
* chore: update comment
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-14 13:03:18 +00:00
0e5276ed20
Merge branch 'main' into alamb/go_go_go_go
2021-07-14 13:56:35 +01:00
157141c9eb
Merge branch 'main' into er/chore/e2elogs
2021-07-14 13:56:17 +01:00
8ac22dda4c
Merge pull request #1993 from influxdata/er/refactor/kafka-size
...
refactor: set kafka max message size
2021-07-14 12:55:26 +00:00
8d23dd6d6d
fix: Set kafka max message size in client
2021-07-14 14:46:49 +02:00
52704af776
Merge pull request #1987 from influxdata/crepererum/write_buffer_crate
...
chore: move write buffer into its own crate
2021-07-14 12:26:25 +00:00
feb2a356ee
Merge branch 'main' into crepererum/write_buffer_crate
2021-07-14 12:19:24 +00:00
84826699c2
Merge pull request #1988 from influxdata/crepererum/peristence_windows_lint
...
chore: enable more aggressive linting for `persistence_windows` crate
2021-07-14 12:18:32 +00:00
886a87f011
chore: enable linting for `persistence_windows` crate
2021-07-14 14:11:51 +02:00
9b413c6bd7
Merge branch 'main' into er/chore/e2elogs
2021-07-14 13:10:39 +01:00
9cb9ae0874
chore: move write buffer into its own crate
2021-07-14 14:09:18 +02:00
d6885760d8
Merge pull request #1991 from influxdata/noreqsize
...
fix: Remove bad max.request.size config param
2021-07-14 12:07:54 +00:00
44f9689093
chore: emit server logs
2021-07-14 12:56:17 +01:00
d427fed9dc
fix: Remove bad max.request.size config param
2021-07-14 13:54:18 +02:00
8fd0df04f2
feat: continue buidling and using sort_key if available
2021-07-13 16:25:58 -04:00
781c4fa666
fix: update server tests
2021-07-13 15:44:57 -04:00
97c727a2c2
fix: update read_buffer tests
2021-07-13 15:44:57 -04:00
4800b36949
chore: Update IOx to a pre-release version of arrow and datafusion to test out performance improvement
2021-07-13 15:44:57 -04:00
ef3269ee1d
chore: Update datafusion deps ( #1984 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-13 17:29:29 +00:00
0164cabbf3
refactor: do not use DataFrame DataFusion API / stop optimizing twice ( #1982 )
...
* refactor: do not use DataFrame DataFusion API
* fix: update output to reflect not running optimizer twice
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-13 16:29:43 +00:00
09a744fce3
Merge pull request #1981 from influxdata/writebuffergotcha
...
fix: Raise kafka max request size to 10M
2021-07-13 15:55:51 +00:00
239c931f26
fix: Raise max message to 10M
...
And log message size on kafka write error.
Turns out the kafka partition message size limit default is 1MB, but also the
client side "max request size" default is also 1MB.
The error message we get from our kafka client is misleading: it says
```
KafkaError (Message production error: MessageSizeTooLarge (Broker: Message size too large)) }
```
which to my mind it seemed like if ("Broker:") the broker said "Message size too large".
That was a lie; I killed the broker and the client kept saying the same error message which means
it didn't even try to send the message out.
TODO: make this a proper parameter. (but let's unblock)
2021-07-13 17:47:36 +02:00
c272933627
Merge pull request #1980 from influxdata/crepererum/update_deps
...
chore: update some dependencies
2021-07-13 14:26:23 +00:00
6a09678f34
Merge branch 'main' into crepererum/update_deps
2021-07-13 14:18:57 +00:00
cc4c7cfad7
Merge pull request #1978 from influxdata/genscript
...
feat: Add small genlp.py script
2021-07-13 14:18:19 +00:00
c5f97211ba
Merge branch 'main' into genscript
2021-07-13 14:11:37 +00:00
Nga Tran
Andrew Lamb
kodiakhq[bot]
Raphael Taylor-Davies
Edd Robinson
Carol (Nichols || Goulding)
Marco Neumann
Jacob Marble
Marko Mikulicic
Andrew Lamb