Marco Neumann
956086fa6d
feat: add "drop chunk" job type
2021-07-15 12:07:56 +02:00
Marco Neumann
e570c66697
feat: add "dropping" chunk lifecycle action
2021-07-15 12:07:56 +02:00
Marco Neumann
68e20779a2
test: add test for clearing lifecycle actions from chunks
2021-07-15 12:07:56 +02:00
Marco Neumann
d89fca00be
feat: persist "drop chunk"
2021-07-15 12:07:56 +02:00
Marco Neumann
40047a76bc
refactor: `remove_parquet` cannot fail
2021-07-15 12:07:56 +02:00
Raphael Taylor-Davies
3e0d1eb560
refactor: introduce PartitionAddr ( #2010 )
2021-07-15 10:01:33 +00:00
kodiakhq[bot]
6182c0974b
Merge pull request #1970 from influxdata/ntran/use_sort_key
...
feat: Using sort_key to avoid resorts
2021-07-14 21:43:41 +00:00
Nga Tran
0b1f2b1fd0
chore: merge main to branch
2021-07-14 16:17:14 -04:00
Nga Tran
ef271d1e1c
test: make the tests clearer
2021-07-14 15:42:30 -04:00
Nga Tran
b4d86dcb7d
fix: make the order of sort key deterministic
2021-07-14 14:50:19 -04:00
Nga Tran
9ffaf863fa
refactor: cleanup
2021-07-14 14:30:04 -04:00
Nga Tran
552e3fb691
fix: Padd stats compute deterministic order of sort key and update tests that got changed by the use of sort key
2021-07-14 14:06:41 -04:00
Andrew Lamb
d156998b46
fix: remove unused parameter `mutable_linger_seconds` from dbrules ( #2003 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-14 18:06:20 +00:00
kodiakhq[bot]
2bcf6d280b
Merge pull request #1999 from influxdata/cn/exploration
...
fix: Change RUB chunk table_summaries to table_summary
2021-07-14 17:38:22 +00:00
kodiakhq[bot]
833debd5b5
Merge branch 'main' into cn/exploration
2021-07-14 17:30:55 +00:00
Raphael Taylor-Davies
cbeeb97cff
feat: flush open window on persist ( #1985 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-14 16:58:20 +00:00
kodiakhq[bot]
83f72c465d
Merge pull request #2002 from influxdata/er/refactor/batch
...
refactor: increase compaction batch size
2021-07-14 16:39:13 +00:00
Edd Robinson
2ef6671eca
Merge branch 'main' into er/refactor/batch
2021-07-14 17:31:42 +01:00
Raphael Taylor-Davies
1d00fa2fd8
refactor: track memory metrics in catalog ( #1995 )
...
* refactor: track memory metrics in catalog
* chore: update comment
2021-07-14 16:23:00 +00:00
Edd Robinson
46ac15a77e
refactor: increase compaction batch size
2021-07-14 17:19:11 +01:00
Carol (Nichols || Goulding)
8070065e2f
fix: Change RUB chunk table_summaries to table_summary
...
Because chunks now have only one table.
Connects to #1718 , #1613 , #1295
2021-07-14 11:18:02 -04:00
kodiakhq[bot]
cedd6269c7
Merge pull request #1997 from influxdata/cn/alt-table-summary
...
feat: Make a TableSummaryAndTimes type for incremental replacement of TableSummary
2021-07-14 14:56:54 +00:00
kodiakhq[bot]
9bc7ea2ace
Merge branch 'main' into cn/alt-table-summary
2021-07-14 14:49:59 +00:00
kodiakhq[bot]
89b15fd3d2
Merge pull request #1998 from influxdata/crepererum/fix_entry_clone
...
fix: fix `Entry::clone`
2021-07-14 14:49:37 +00:00
kodiakhq[bot]
2c01bcffba
Merge branch 'main' into crepererum/fix_entry_clone
2021-07-14 14:42:06 +00:00
Andrew Lamb
243cee530a
test: Fix flaky test by specifying ORDER BY in query ( #1996 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-14 14:41:24 +00:00
Carol (Nichols || Goulding)
649b467adb
fix: CatalogChunk no longer needs to record a write when created from a MUB chunk
2021-07-14 10:28:12 -04:00
Carol (Nichols || Goulding)
7ccbab8c90
feat: Make a TableSummaryAndTimes to use to slowly replace TableSummary
...
And use TableSummaryAndTimes with the mutable buffer chunks when turning
them into catalog chunks.
It's proving too big to switch over everything using TableSummary at
once, so this will let us switch over more incrementally.
2021-07-14 10:28:12 -04:00
Marco Neumann
c176a4ee09
fix: fix `Entry::clone`
2021-07-14 16:26:59 +02:00
Jacob Marble
b79d9eb0ab
chore: add end-to-end test for PB write service ( #1894 )
...
* chore: add end-to-end test for PB write service
* chore: lint
* chore: fix test
2021-07-14 14:20:37 +00:00
kodiakhq[bot]
0417cc3c0f
Merge pull request #1992 from influxdata/er/chore/e2elogs
...
chore: emit server logs
2021-07-14 13:20:11 +00:00
kodiakhq[bot]
bf9a054961
Merge branch 'main' into er/chore/e2elogs
2021-07-14 13:12:52 +00:00
kodiakhq[bot]
fa10201025
Merge pull request #1986 from influxdata/alamb/go_go_go_go
...
chore: Update IOx to a pre-release version of arrow and datafusion to test out performance improvement
2021-07-14 13:12:24 +00:00
Edd Robinson
4dedb657f2
Merge branch 'main' into alamb/go_go_go_go
2021-07-14 14:04:13 +01:00
kodiakhq[bot]
795b730368
Merge branch 'main' into er/chore/e2elogs
2021-07-14 13:03:48 +00:00
Raphael Taylor-Davies
f1c1620c84
feat: make persistence windows interface harder to use incorrectly ( #1977 )
...
* feat: make persistence windows interface harder to use incorrectly
* chore: review feedback
* chore: update comment
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-14 13:03:18 +00:00
Edd Robinson
0e5276ed20
Merge branch 'main' into alamb/go_go_go_go
2021-07-14 13:56:35 +01:00
Edd Robinson
157141c9eb
Merge branch 'main' into er/chore/e2elogs
2021-07-14 13:56:17 +01:00
kodiakhq[bot]
8ac22dda4c
Merge pull request #1993 from influxdata/er/refactor/kafka-size
...
refactor: set kafka max message size
2021-07-14 12:55:26 +00:00
Marko Mikulicic
8d23dd6d6d
fix: Set kafka max message size in client
2021-07-14 14:46:49 +02:00
kodiakhq[bot]
52704af776
Merge pull request #1987 from influxdata/crepererum/write_buffer_crate
...
chore: move write buffer into its own crate
2021-07-14 12:26:25 +00:00
kodiakhq[bot]
feb2a356ee
Merge branch 'main' into crepererum/write_buffer_crate
2021-07-14 12:19:24 +00:00
kodiakhq[bot]
84826699c2
Merge pull request #1988 from influxdata/crepererum/peristence_windows_lint
...
chore: enable more aggressive linting for `persistence_windows` crate
2021-07-14 12:18:32 +00:00
Marco Neumann
886a87f011
chore: enable linting for `persistence_windows` crate
2021-07-14 14:11:51 +02:00
Edd Robinson
9b413c6bd7
Merge branch 'main' into er/chore/e2elogs
2021-07-14 13:10:39 +01:00
Marco Neumann
9cb9ae0874
chore: move write buffer into its own crate
2021-07-14 14:09:18 +02:00
kodiakhq[bot]
d6885760d8
Merge pull request #1991 from influxdata/noreqsize
...
fix: Remove bad max.request.size config param
2021-07-14 12:07:54 +00:00
Edd Robinson
44f9689093
chore: emit server logs
2021-07-14 12:56:17 +01:00
Marko Mikulicic
d427fed9dc
fix: Remove bad max.request.size config param
2021-07-14 13:54:18 +02:00
Nga Tran
8fd0df04f2
feat: continue buidling and using sort_key if available
2021-07-13 16:25:58 -04:00