Commit Graph

3851 Commits (956086fa6db3a8607c6db4cd6cbad71f1af3182a)

Author SHA1 Message Date
Marco Neumann 956086fa6d feat: add "drop chunk" job type 2021-07-15 12:07:56 +02:00
Marco Neumann e570c66697 feat: add "dropping" chunk lifecycle action 2021-07-15 12:07:56 +02:00
Marco Neumann 68e20779a2 test: add test for clearing lifecycle actions from chunks 2021-07-15 12:07:56 +02:00
Marco Neumann d89fca00be feat: persist "drop chunk" 2021-07-15 12:07:56 +02:00
Marco Neumann 40047a76bc refactor: `remove_parquet` cannot fail 2021-07-15 12:07:56 +02:00
Raphael Taylor-Davies 3e0d1eb560
refactor: introduce PartitionAddr (#2010) 2021-07-15 10:01:33 +00:00
kodiakhq[bot] 6182c0974b
Merge pull request #1970 from influxdata/ntran/use_sort_key
feat: Using sort_key to avoid resorts
2021-07-14 21:43:41 +00:00
Nga Tran 0b1f2b1fd0 chore: merge main to branch 2021-07-14 16:17:14 -04:00
Nga Tran ef271d1e1c test: make the tests clearer 2021-07-14 15:42:30 -04:00
Nga Tran b4d86dcb7d fix: make the order of sort key deterministic 2021-07-14 14:50:19 -04:00
Nga Tran 9ffaf863fa refactor: cleanup 2021-07-14 14:30:04 -04:00
Nga Tran 552e3fb691 fix: Padd stats compute deterministic order of sort key and update tests that got changed by the use of sort key 2021-07-14 14:06:41 -04:00
Andrew Lamb d156998b46
fix: remove unused parameter `mutable_linger_seconds` from dbrules (#2003)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-14 18:06:20 +00:00
kodiakhq[bot] 2bcf6d280b
Merge pull request #1999 from influxdata/cn/exploration
fix: Change RUB chunk table_summaries to table_summary
2021-07-14 17:38:22 +00:00
kodiakhq[bot] 833debd5b5
Merge branch 'main' into cn/exploration 2021-07-14 17:30:55 +00:00
Raphael Taylor-Davies cbeeb97cff
feat: flush open window on persist (#1985)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-14 16:58:20 +00:00
kodiakhq[bot] 83f72c465d
Merge pull request #2002 from influxdata/er/refactor/batch
refactor: increase compaction batch size
2021-07-14 16:39:13 +00:00
Edd Robinson 2ef6671eca
Merge branch 'main' into er/refactor/batch 2021-07-14 17:31:42 +01:00
Raphael Taylor-Davies 1d00fa2fd8
refactor: track memory metrics in catalog (#1995)
* refactor: track memory metrics in catalog

* chore: update comment
2021-07-14 16:23:00 +00:00
Edd Robinson 46ac15a77e refactor: increase compaction batch size 2021-07-14 17:19:11 +01:00
Carol (Nichols || Goulding) 8070065e2f fix: Change RUB chunk table_summaries to table_summary
Because chunks now have only one table.

Connects to #1718, #1613, #1295
2021-07-14 11:18:02 -04:00
kodiakhq[bot] cedd6269c7
Merge pull request #1997 from influxdata/cn/alt-table-summary
feat: Make a TableSummaryAndTimes type for incremental replacement of TableSummary
2021-07-14 14:56:54 +00:00
kodiakhq[bot] 9bc7ea2ace
Merge branch 'main' into cn/alt-table-summary 2021-07-14 14:49:59 +00:00
kodiakhq[bot] 89b15fd3d2
Merge pull request #1998 from influxdata/crepererum/fix_entry_clone
fix: fix `Entry::clone`
2021-07-14 14:49:37 +00:00
kodiakhq[bot] 2c01bcffba
Merge branch 'main' into crepererum/fix_entry_clone 2021-07-14 14:42:06 +00:00
Andrew Lamb 243cee530a
test: Fix flaky test by specifying ORDER BY in query (#1996)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-14 14:41:24 +00:00
Carol (Nichols || Goulding) 649b467adb fix: CatalogChunk no longer needs to record a write when created from a MUB chunk 2021-07-14 10:28:12 -04:00
Carol (Nichols || Goulding) 7ccbab8c90 feat: Make a TableSummaryAndTimes to use to slowly replace TableSummary
And use TableSummaryAndTimes with the mutable buffer chunks when turning
them into catalog chunks.

It's proving too big to switch over everything using TableSummary at
once, so this will let us switch over more incrementally.
2021-07-14 10:28:12 -04:00
Marco Neumann c176a4ee09 fix: fix `Entry::clone` 2021-07-14 16:26:59 +02:00
Jacob Marble b79d9eb0ab
chore: add end-to-end test for PB write service (#1894)
* chore: add end-to-end test for PB write service

* chore: lint

* chore: fix test
2021-07-14 14:20:37 +00:00
kodiakhq[bot] 0417cc3c0f
Merge pull request #1992 from influxdata/er/chore/e2elogs
chore: emit server logs
2021-07-14 13:20:11 +00:00
kodiakhq[bot] bf9a054961
Merge branch 'main' into er/chore/e2elogs 2021-07-14 13:12:52 +00:00
kodiakhq[bot] fa10201025
Merge pull request #1986 from influxdata/alamb/go_go_go_go
chore: Update IOx to a pre-release version of arrow and datafusion to test out performance improvement
2021-07-14 13:12:24 +00:00
Edd Robinson 4dedb657f2
Merge branch 'main' into alamb/go_go_go_go 2021-07-14 14:04:13 +01:00
kodiakhq[bot] 795b730368
Merge branch 'main' into er/chore/e2elogs 2021-07-14 13:03:48 +00:00
Raphael Taylor-Davies f1c1620c84
feat: make persistence windows interface harder to use incorrectly (#1977)
* feat: make persistence windows interface harder to use incorrectly

* chore: review feedback

* chore: update comment

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-14 13:03:18 +00:00
Edd Robinson 0e5276ed20
Merge branch 'main' into alamb/go_go_go_go 2021-07-14 13:56:35 +01:00
Edd Robinson 157141c9eb
Merge branch 'main' into er/chore/e2elogs 2021-07-14 13:56:17 +01:00
kodiakhq[bot] 8ac22dda4c
Merge pull request #1993 from influxdata/er/refactor/kafka-size
refactor: set kafka max message size
2021-07-14 12:55:26 +00:00
Marko Mikulicic 8d23dd6d6d
fix: Set kafka max message size in client 2021-07-14 14:46:49 +02:00
kodiakhq[bot] 52704af776
Merge pull request #1987 from influxdata/crepererum/write_buffer_crate
chore: move write buffer into its own crate
2021-07-14 12:26:25 +00:00
kodiakhq[bot] feb2a356ee
Merge branch 'main' into crepererum/write_buffer_crate 2021-07-14 12:19:24 +00:00
kodiakhq[bot] 84826699c2
Merge pull request #1988 from influxdata/crepererum/peristence_windows_lint
chore: enable more aggressive linting for `persistence_windows` crate
2021-07-14 12:18:32 +00:00
Marco Neumann 886a87f011 chore: enable linting for `persistence_windows` crate 2021-07-14 14:11:51 +02:00
Edd Robinson 9b413c6bd7
Merge branch 'main' into er/chore/e2elogs 2021-07-14 13:10:39 +01:00
Marco Neumann 9cb9ae0874 chore: move write buffer into its own crate 2021-07-14 14:09:18 +02:00
kodiakhq[bot] d6885760d8
Merge pull request #1991 from influxdata/noreqsize
fix: Remove bad max.request.size config param
2021-07-14 12:07:54 +00:00
Edd Robinson 44f9689093 chore: emit server logs 2021-07-14 12:56:17 +01:00
Marko Mikulicic d427fed9dc
fix: Remove bad max.request.size config param 2021-07-14 13:54:18 +02:00
Nga Tran 8fd0df04f2 feat: continue buidling and using sort_key if available 2021-07-13 16:25:58 -04:00