c986ce2c19
feat: Add pruning module to query crate ( #1611 )
...
* feat: Add pruning module
* fix: clippy
* fix: Apply suggestions from code review
* fix: remove erronious claims of DF bugs
* fix: update comments with DF bug reference
2021-06-03 11:07:26 +00:00
30f7bdf724
Merge pull request #1610 from influxdata/ntran/deduplicate
...
test: prepare tests for deduplicate work
2021-06-02 17:47:02 +00:00
1c764c47a2
Merge branch 'main' into ntran/deduplicate
2021-06-02 17:42:36 +00:00
40bd932fff
refactor: address Andrew's comment
2021-06-02 13:41:46 -04:00
32c6ed1f34
refactor: More cleanup related to multi-table chunks ( #1604 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-02 17:00:23 +00:00
e7a97f3ac1
test: merge main and add more tests for deduplicate work
2021-06-02 12:00:40 -04:00
6f8e771033
Merge pull request #1606 from influxdata/crepererum/refactor_db_loading
...
refactor: isolate DB loading and streamline error handling
2021-06-02 15:41:20 +00:00
80f4d84ce8
refactor: isolate DB loading and streamline error handling
...
There are not functional changes here (except that errors look slightly
different) but it should allow for an easier move of the DB loading into
a delayed task.
2021-06-02 13:42:24 +02:00
69509f3b89
Merge pull request #1596 from influxdata/er/feat/read_buffer/int_rle
...
feat: add RLE support for integer columns
2021-06-02 10:26:20 +00:00
fa729fd6b0
refactor: address PR feedback
2021-06-02 11:21:10 +01:00
a5b554d2c3
feat: add RLE support to integer encodings
2021-06-02 10:57:17 +01:00
71598d9b3e
refactor: move rle heuristics to rle module
2021-06-02 10:57:17 +01:00
f58a045d99
Merge pull request #1589 from influxdata/crepererum/catalog_transaction_ts
...
feat: preserve and read timestamps to/from preserved catalog
2021-06-02 08:20:23 +00:00
e5b65e10ac
test: ensure that `find_last_transaction_timestamp` indeed returns the last timestamp
2021-06-02 10:15:06 +02:00
98e413d5a9
fix: do not unwrap broken timestamps in serialized catalog
2021-06-02 10:15:06 +02:00
fc0a74920f
fix: use clearer error text
2021-06-02 09:41:19 +02:00
2a0b2698c6
fix: use structured logging
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-06-02 09:41:19 +02:00
64bf8c5182
docs: add code comment explaining why we parse transaction timestamps
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-06-02 09:41:19 +02:00
77aeb5ca5d
refactor: use protobuf-native Timestamp instead of string
2021-06-02 09:41:19 +02:00
9b9400803b
refactor!: bump transaction version to 2
2021-06-02 09:41:19 +02:00
5f77b7b92b
feat: add `parquet_file::catalog::find_last_transaction_timestamp`
2021-06-02 09:41:19 +02:00
9aee961e2a
test: test loading catalogs from broken protobufs
2021-06-02 09:41:19 +02:00
0a625b50e6
feat: store transaction timestamp in preserved catalog
2021-06-02 09:41:19 +02:00
399d5f1ad0
Merge pull request #1598 from influxdata/crepererum/issue1513-b
...
refactor: clean-up chunk structure + add tests
2021-06-02 07:14:47 +00:00
0e09b20ca8
Merge branch 'main' into crepererum/issue1513-b
2021-06-02 07:08:29 +00:00
fdb6c98c8e
Merge pull request #1602 from influxdata/ntran/pushdown_explain
...
refactor: macro and tests for explains
2021-06-01 22:29:12 +00:00
40df7def0e
test: ttests for the deduplicate work
2021-06-01 18:06:35 -04:00
a02f693b68
chore: Merge branch 'main' into ntran/deduplicate
2021-06-01 16:48:42 -04:00
60ad929721
refactor: add macro tto compare output of explains
2021-06-01 16:39:14 -04:00
aa867601e5
chore: merge main with DF plan display fix
2021-06-01 16:17:41 -04:00
83b2eacea6
chore: update deps for datafusion ( #1601 )
2021-06-01 20:00:39 +00:00
0ad258bab3
refactor: remove comments since the time function predicates are pushed down after the recent constant folding fix in DF
2021-06-01 16:00:09 -04:00
29032c0094
Merge pull request #1600 from influxdata/logheaders
...
fix: Log more details on http errors
2021-06-01 17:14:45 +00:00
055c6b665a
Merge branch 'main' into logheaders
2021-06-01 17:10:13 +00:00
c240086707
Merge pull request #1599 from influxdata/moredetailstolog
...
feat: Add more details to WritePoints error log
2021-06-01 16:32:33 +00:00
5b9cd4033e
fix: Log more details on http errors
2021-06-01 18:31:53 +02:00
92fd88e607
Merge branch 'main' into moredetailstolog
2021-06-01 16:27:25 +00:00
293433a73e
feat: Add more details to WritePoints error log
2021-06-01 18:24:06 +02:00
d8fbb7b410
refactor: Remove last vestiges of multi-table chunks from PartitionChunk API ( #1588 )
...
* refactor: Remove last vestiges of multi-table chunks from PartitionChunk API
* fix: remove test that can no longer fail
* fix: update tests + code review comments
* fix: clippy
* fix: clippy
* fix: restore test_measurement_fields_error test
2021-06-01 16:12:33 +00:00
dbfb56b6c1
Merge pull request #1597 from influxdata/crepererum/fix_catalog_replay_logging
...
fix: fix confusing log message during catalog replay
2021-06-01 16:05:13 +00:00
714a082f3a
refactor: remove chunk state struct nesting
...
Inline structs that are only used for enum variants.
2021-06-01 18:00:16 +02:00
5a4562f1c9
test: test `Chunk::new_open`
2021-06-01 18:00:16 +02:00
f45e61f9ef
test: test chunk lifecycle action handling
2021-06-01 18:00:16 +02:00
50636ca011
refactor: rename `Chunk::{set_closed => freeze}` and add tests
...
This make it clearer what is actually happening. Furthermore, freezing
frozen chunks is now a no-op.
2021-06-01 18:00:16 +02:00
aafc8c4746
Merge branch 'main' into crepererum/fix_catalog_replay_logging
2021-06-01 15:59:42 +00:00
98c2963c28
fix: fix confusing log message during catalog replay
2021-06-01 17:58:38 +02:00
c0e4e6951a
chore: update datafusion ( #1594 )
2021-06-01 15:55:07 +00:00
d3711a5591
refactor: Use ParquetExec from DataFusion to read parquet files ( #1580 )
...
* refactor: use ParquetExec to read parquet files
* fix: test
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-01 14:44:07 +00:00
a1c832f27b
Merge pull request #1591 from influxdata/dom/cow-encoding-names
...
refactor: avoid copying encoding name for stats
2021-06-01 14:11:19 +00:00
37d2a139f9
Merge branch 'main' into dom/cow-encoding-names
2021-06-01 14:06:48 +00:00
Andrew Lamb
kodiakhq[bot]
Nga Tran
Marco Neumann
Edd Robinson
Marko Mikulicic