Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
4,161 Commits
211 Branches
453 Tags
355 MiB
Commit Graph

4161 Commits (0fe8eda89e66c849e20c04f0fb90e4d3e4879663)

Author SHA1 Message Date
Raphael Taylor-Davies 6a4c08ec28
refactor: extract DatabaseBuilder for end-to-end test cases (#2004) 
* refactor: extract DatabaseBuilder for end-to-end test cases

* chore: fix kafka tests

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2021-07-15 12:25:21 +00:00
Raphael Taylor-Davies d71f38f27c
feat: compute PartitionCheckpoint from PersistenceWindows (#2011) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2021-07-15 12:17:23 +00:00
Andrew Lamb 0c86d1dccf
feat: Record parquet bytes size in catalog / parquet_file (#2006) 
* feat: Store object store size in parquet_file

* fix: update TRANSACTION_VERSION to 8

* refactor: rename os_bytes --> file_size_bytes
 2021-07-15 12:07:11 +00:00
kodiakhq[bot] 86f677cba2
Merge pull request #1959 from influxdata/crepererum/persist_drop 
feat: persist "drop chunk"
 2021-07-15 10:15:11 +00:00
Marco Neumann 4741483f72 docs: explain why we update memory metrics when lifecycle action is cleared 2021-07-15 12:07:56 +02:00
Marco Neumann 924b0db542 fix: account for memory size in drop lifecycle action 2021-07-15 12:07:56 +02:00
Marco Neumann cccdd8a43f fix: correct code comment 2021-07-15 12:07:56 +02:00
Marco Neumann 77a9191a11 fix: chunk dropping over lifecycle policy should also respect the preserved catalog 2021-07-15 12:07:56 +02:00
Marco Neumann 71cb15f017 refactor: use lifecycle action to drop chunks 
This avoids holding partition locks while the preserved catalog IO is
done.
 2021-07-15 12:07:56 +02:00
Marco Neumann 956086fa6d feat: add "drop chunk" job type 2021-07-15 12:07:56 +02:00
Marco Neumann e570c66697 feat: add "dropping" chunk lifecycle action 2021-07-15 12:07:56 +02:00
Marco Neumann 68e20779a2 test: add test for clearing lifecycle actions from chunks 2021-07-15 12:07:56 +02:00
Marco Neumann d89fca00be feat: persist "drop chunk" 2021-07-15 12:07:56 +02:00
Marco Neumann 40047a76bc refactor: `remove_parquet` cannot fail 2021-07-15 12:07:56 +02:00
Raphael Taylor-Davies 3e0d1eb560
refactor: introduce PartitionAddr (#2010) 2021-07-15 10:01:33 +00:00
kodiakhq[bot] 6182c0974b
Merge pull request #1970 from influxdata/ntran/use_sort_key 
feat: Using sort_key to avoid resorts
 2021-07-14 21:43:41 +00:00
Nga Tran 0b1f2b1fd0 chore: merge main to branch 2021-07-14 16:17:14 -04:00
Nga Tran ef271d1e1c test: make the tests clearer 2021-07-14 15:42:30 -04:00
Nga Tran b4d86dcb7d fix: make the order of sort key deterministic 2021-07-14 14:50:19 -04:00
Nga Tran 9ffaf863fa refactor: cleanup 2021-07-14 14:30:04 -04:00
Nga Tran 552e3fb691 fix: Padd stats compute deterministic order of sort key and update tests that got changed by the use of sort key 2021-07-14 14:06:41 -04:00
Andrew Lamb d156998b46
fix: remove unused parameter `mutable_linger_seconds` from dbrules (#2003) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2021-07-14 18:06:20 +00:00
kodiakhq[bot] 2bcf6d280b
Merge pull request #1999 from influxdata/cn/exploration 
fix: Change RUB chunk table_summaries to table_summary
 2021-07-14 17:38:22 +00:00
kodiakhq[bot] 833debd5b5
Merge branch 'main' into cn/exploration 2021-07-14 17:30:55 +00:00
Raphael Taylor-Davies cbeeb97cff
feat: flush open window on persist (#1985) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2021-07-14 16:58:20 +00:00
kodiakhq[bot] 83f72c465d
Merge pull request #2002 from influxdata/er/refactor/batch 
refactor: increase compaction batch size
 2021-07-14 16:39:13 +00:00
Edd Robinson 2ef6671eca
Merge branch 'main' into er/refactor/batch 2021-07-14 17:31:42 +01:00
Raphael Taylor-Davies 1d00fa2fd8
refactor: track memory metrics in catalog (#1995) 
* refactor: track memory metrics in catalog

* chore: update comment
 2021-07-14 16:23:00 +00:00
Edd Robinson 46ac15a77e refactor: increase compaction batch size 2021-07-14 17:19:11 +01:00
Carol (Nichols || Goulding) 8070065e2f fix: Change RUB chunk table_summaries to table_summary 
Because chunks now have only one table.

Connects to #1718, #1613, #1295
 2021-07-14 11:18:02 -04:00
kodiakhq[bot] cedd6269c7
Merge pull request #1997 from influxdata/cn/alt-table-summary 
feat: Make a TableSummaryAndTimes type for incremental replacement of TableSummary
 2021-07-14 14:56:54 +00:00
kodiakhq[bot] 9bc7ea2ace
Merge branch 'main' into cn/alt-table-summary 2021-07-14 14:49:59 +00:00
kodiakhq[bot] 89b15fd3d2
Merge pull request #1998 from influxdata/crepererum/fix_entry_clone 
fix: fix `Entry::clone`
 2021-07-14 14:49:37 +00:00
kodiakhq[bot] 2c01bcffba
Merge branch 'main' into crepererum/fix_entry_clone 2021-07-14 14:42:06 +00:00
Andrew Lamb 243cee530a
test: Fix flaky test by specifying ORDER BY in query (#1996) 
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2021-07-14 14:41:24 +00:00
Carol (Nichols || Goulding) 649b467adb fix: CatalogChunk no longer needs to record a write when created from a MUB chunk 2021-07-14 10:28:12 -04:00
Carol (Nichols || Goulding) 7ccbab8c90 feat: Make a TableSummaryAndTimes to use to slowly replace TableSummary 
And use TableSummaryAndTimes with the mutable buffer chunks when turning
them into catalog chunks.

It's proving too big to switch over everything using TableSummary at
once, so this will let us switch over more incrementally.
 2021-07-14 10:28:12 -04:00
Marco Neumann c176a4ee09 fix: fix `Entry::clone` 2021-07-14 16:26:59 +02:00
Jacob Marble b79d9eb0ab
chore: add end-to-end test for PB write service (#1894) 
* chore: add end-to-end test for PB write service

* chore: lint

* chore: fix test
 2021-07-14 14:20:37 +00:00
kodiakhq[bot] 0417cc3c0f
Merge pull request #1992 from influxdata/er/chore/e2elogs 
chore: emit server logs
 2021-07-14 13:20:11 +00:00
kodiakhq[bot] bf9a054961
Merge branch 'main' into er/chore/e2elogs 2021-07-14 13:12:52 +00:00
kodiakhq[bot] fa10201025
Merge pull request #1986 from influxdata/alamb/go_go_go_go 
chore: Update IOx to a pre-release version of arrow and datafusion to test out performance improvement
 2021-07-14 13:12:24 +00:00
Edd Robinson 4dedb657f2
Merge branch 'main' into alamb/go_go_go_go 2021-07-14 14:04:13 +01:00
kodiakhq[bot] 795b730368
Merge branch 'main' into er/chore/e2elogs 2021-07-14 13:03:48 +00:00
Raphael Taylor-Davies f1c1620c84
feat: make persistence windows interface harder to use incorrectly (#1977) 
* feat: make persistence windows interface harder to use incorrectly

* chore: review feedback

* chore: update comment

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 2021-07-14 13:03:18 +00:00
Edd Robinson 0e5276ed20
Merge branch 'main' into alamb/go_go_go_go 2021-07-14 13:56:35 +01:00
Edd Robinson 157141c9eb
Merge branch 'main' into er/chore/e2elogs 2021-07-14 13:56:17 +01:00
kodiakhq[bot] 8ac22dda4c
Merge pull request #1993 from influxdata/er/refactor/kafka-size 
refactor: set kafka max message size
 2021-07-14 12:55:26 +00:00
Marko Mikulicic 8d23dd6d6d
fix: Set kafka max message size in client 2021-07-14 14:46:49 +02:00
kodiakhq[bot] 52704af776
Merge pull request #1987 from influxdata/crepererum/write_buffer_crate 
chore: move write buffer into its own crate
 2021-07-14 12:26:25 +00:00