3e2b4bf7ea
Merge branch 'main' into debuginfo2
2021-06-03 15:59:19 +02:00
c6b4f5a765
Merge pull request #1617 from influxdata/er/feat/read_buffer/float_int
...
feat: Compress Floats columns containg natural numbers
2021-06-03 13:54:23 +00:00
c77e57b7dc
feat: Preserve full debug infos in release builds
...
The `Cargo.toml` file already says:
```toml
[profile.release]
debug = true
```
but we were overriding it in the circleci release script to include only line number info,
probably to shave off some time from the total build time.
The ability to debug a production binary outweighs the few seconds or even a minute overhead it takes to
add the debug infos. If building with full debug infos take much much longer, next time we disable them
it would be nice to include such a dramatic fact in the comments next to where we disable debug infos :-)
2021-06-03 15:50:01 +02:00
e583e1fbda
Merge branch 'main' into er/feat/read_buffer/float_int
2021-06-03 14:48:36 +01:00
eaa5b75437
refactor: Make it clear only partition_key and table name pruning happens in catalog ( #1608 )
...
* refactor: Make it clear only partition_key and table name pruning is happening in catalog
* fix: clippy
* fix: Update server/src/db/catalog.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* refactor: use TableNameFilter enum rather than Option
* docs: Add docstring to the `From` implementation
* fix: Update server/src/db/catalog/partition.rs
Co-authored-by: Edd Robinson <me@edd.io>
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
Co-authored-by: Edd Robinson <me@edd.io>
2021-06-03 13:09:09 +00:00
418cc4cf0e
refactor: update read_buffer/src/column/encoding/scalar/transcoders.rs
...
Co-authored-by: Dom <dom@itsallbroken.com>
2021-06-03 14:02:16 +01:00
336b25c029
Merge pull request #1616 from influxdata/crepererum/fix_os_del_listing
...
fix: do not error on `list_with_delimiter` w/ non-existing prefix
2021-06-03 12:19:17 +00:00
75fe592758
Merge branch 'main' into crepererum/fix_os_del_listing
2021-06-03 12:14:15 +00:00
c379e99fe2
Merge pull request #1605 from influxdata/crepererum/improve_cleanup
...
feat: jitter background clean-up job + wait on first job
2021-06-03 12:13:39 +00:00
c9cfab5c50
Merge branch 'main' into crepererum/improve_cleanup
2021-06-03 12:06:07 +00:00
22c7592e3b
refactor: DRY RLE check
2021-06-03 12:32:40 +01:00
65bfa4dd10
test: fix tests
2021-06-03 12:32:40 +01:00
9a45c0d05b
feat: implement float byte trimming for arrow array
2021-06-03 12:32:40 +01:00
5d02a71e6f
feat: implement byte trimming on float slice
2021-06-03 12:32:40 +01:00
32e5f8c715
feat: add float byte trimmer encoding
2021-06-03 12:32:40 +01:00
728476f2e1
refactor: add encoding name to float encodings
2021-06-03 12:32:40 +01:00
c986ce2c19
feat: Add pruning module to query crate ( #1611 )
...
* feat: Add pruning module
* fix: clippy
* fix: Apply suggestions from code review
* fix: remove erronious claims of DF bugs
* fix: update comments with DF bug reference
2021-06-03 11:07:26 +00:00
27b9477aa4
test: fix flaky test
2021-06-03 11:23:29 +02:00
7b2663a38a
test: make tests faster
2021-06-03 11:23:29 +02:00
3c9fd81697
refactor: split overlong line
2021-06-03 11:23:29 +02:00
2afa8fa89a
docs: fix typo and mention default
2021-06-03 11:23:29 +02:00
85139abbbb
fix: use structured logging for cleanup logs
2021-06-03 11:23:29 +02:00
bbd73e59be
feat: jitter background clean-up job + wait on first job
2021-06-03 11:23:29 +02:00
ce412dbce2
fix: use structured error for background cleanup task reporting
2021-06-03 11:23:29 +02:00
bd39954d73
fix: do not error on `list_with_delimiter` w/ non-existing prefix
...
Disk-driven object stores were reporting `UnableToProcessEntry` when
calling `list_with_delimiter` and a non-existing prefix.
To prevent regressions add a test to the test suite shared by all
store implementations.
2021-06-03 10:25:20 +02:00
30f7bdf724
Merge pull request #1610 from influxdata/ntran/deduplicate
...
test: prepare tests for deduplicate work
2021-06-02 17:47:02 +00:00
1c764c47a2
Merge branch 'main' into ntran/deduplicate
2021-06-02 17:42:36 +00:00
40bd932fff
refactor: address Andrew's comment
2021-06-02 13:41:46 -04:00
32c6ed1f34
refactor: More cleanup related to multi-table chunks ( #1604 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-02 17:00:23 +00:00
e7a97f3ac1
test: merge main and add more tests for deduplicate work
2021-06-02 12:00:40 -04:00
6f8e771033
Merge pull request #1606 from influxdata/crepererum/refactor_db_loading
...
refactor: isolate DB loading and streamline error handling
2021-06-02 15:41:20 +00:00
80f4d84ce8
refactor: isolate DB loading and streamline error handling
...
There are not functional changes here (except that errors look slightly
different) but it should allow for an easier move of the DB loading into
a delayed task.
2021-06-02 13:42:24 +02:00
69509f3b89
Merge pull request #1596 from influxdata/er/feat/read_buffer/int_rle
...
feat: add RLE support for integer columns
2021-06-02 10:26:20 +00:00
fa729fd6b0
refactor: address PR feedback
2021-06-02 11:21:10 +01:00
a5b554d2c3
feat: add RLE support to integer encodings
2021-06-02 10:57:17 +01:00
71598d9b3e
refactor: move rle heuristics to rle module
2021-06-02 10:57:17 +01:00
f58a045d99
Merge pull request #1589 from influxdata/crepererum/catalog_transaction_ts
...
feat: preserve and read timestamps to/from preserved catalog
2021-06-02 08:20:23 +00:00
e5b65e10ac
test: ensure that `find_last_transaction_timestamp` indeed returns the last timestamp
2021-06-02 10:15:06 +02:00
98e413d5a9
fix: do not unwrap broken timestamps in serialized catalog
2021-06-02 10:15:06 +02:00
fc0a74920f
fix: use clearer error text
2021-06-02 09:41:19 +02:00
2a0b2698c6
fix: use structured logging
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-06-02 09:41:19 +02:00
64bf8c5182
docs: add code comment explaining why we parse transaction timestamps
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-06-02 09:41:19 +02:00
77aeb5ca5d
refactor: use protobuf-native Timestamp instead of string
2021-06-02 09:41:19 +02:00
9b9400803b
refactor!: bump transaction version to 2
2021-06-02 09:41:19 +02:00
5f77b7b92b
feat: add `parquet_file::catalog::find_last_transaction_timestamp`
2021-06-02 09:41:19 +02:00
9aee961e2a
test: test loading catalogs from broken protobufs
2021-06-02 09:41:19 +02:00
0a625b50e6
feat: store transaction timestamp in preserved catalog
2021-06-02 09:41:19 +02:00
399d5f1ad0
Merge pull request #1598 from influxdata/crepererum/issue1513-b
...
refactor: clean-up chunk structure + add tests
2021-06-02 07:14:47 +00:00
0e09b20ca8
Merge branch 'main' into crepererum/issue1513-b
2021-06-02 07:08:29 +00:00
fdb6c98c8e
Merge pull request #1602 from influxdata/ntran/pushdown_explain
...
refactor: macro and tests for explains
2021-06-01 22:29:12 +00:00
Marko Mikulicic
kodiakhq[bot]
Edd Robinson
Andrew Lamb
Marco Neumann
Nga Tran