Edd Robinson
418cc4cf0e
refactor: update read_buffer/src/column/encoding/scalar/transcoders.rs
...
Co-authored-by: Dom <dom@itsallbroken.com>
2021-06-03 14:02:16 +01:00
Edd Robinson
22c7592e3b
refactor: DRY RLE check
2021-06-03 12:32:40 +01:00
Edd Robinson
9a45c0d05b
feat: implement float byte trimming for arrow array
2021-06-03 12:32:40 +01:00
Edd Robinson
5d02a71e6f
feat: implement byte trimming on float slice
2021-06-03 12:32:40 +01:00
Edd Robinson
32e5f8c715
feat: add float byte trimmer encoding
2021-06-03 12:32:40 +01:00
Edd Robinson
728476f2e1
refactor: add encoding name to float encodings
2021-06-03 12:32:40 +01:00
Edd Robinson
fa729fd6b0
refactor: address PR feedback
2021-06-02 11:21:10 +01:00
Edd Robinson
a5b554d2c3
feat: add RLE support to integer encodings
2021-06-02 10:57:17 +01:00
Edd Robinson
71598d9b3e
refactor: move rle heuristics to rle module
2021-06-02 10:57:17 +01:00
Dom
aca00a505f
refactor: avoid copying encoding name for stats
...
Swaps the encoding name String type for a Cow in the column Statistics,
avoiding having to copy the encoding name where it is a static string
already.
2021-06-01 11:08:07 +01:00
Andrew Lamb
00e735ef0d
chore: remove unused dependencies ( #1583 )
2021-05-29 10:31:57 +00:00
Raphael Taylor-Davies
db432de137
feat: add distinct count to StatValues ( #1568 )
2021-05-28 17:41:34 +00:00
Edd Robinson
e94be15296
refactor: update read_buffer/src/column/encoding/scalar/fixed.rs
2021-05-27 21:18:10 +01:00
Edd Robinson
26fe4167f7
refactor: erase some types
2021-05-27 14:57:40 +01:00
Edd Robinson
bba387d6ff
refactor: fix benchmarks
2021-05-27 14:35:34 +01:00
Edd Robinson
7ab27c4468
refactor: get build
2021-05-27 14:35:34 +01:00
Edd Robinson
04513e737d
refactor: define encodings wrt to scalar encoding trait
2021-05-27 14:35:34 +01:00
Edd Robinson
22f8a8a4a1
refactor: define scalar encoding in terms of trait
2021-05-27 14:35:34 +01:00
Edd Robinson
c84d50447c
feat: define a Transcoder trait
2021-05-27 14:35:34 +01:00
Edd Robinson
a81ada6140
feat: add transcoder trait
2021-05-27 14:35:34 +01:00
Raphael Taylor-Davies
4fcc04e6c9
chore: enable arrow prettyprint feature ( #1566 )
2021-05-27 10:28:14 +00:00
kodiakhq[bot]
db96286ed7
Merge branch 'main' into er/refactor/scalar_comp
2021-05-24 17:02:14 +00:00
Andrew Lamb
14ba25f86d
chore: Update datafusion and use released version of arrow crates ( #1546 )
...
* chore: Update datafusion and use released version of arrow crate
* fix: Update for change in API
2021-05-24 15:37:22 +00:00
Edd Robinson
eace6c9201
fix: ensure scalars compare correctly
2021-05-24 16:19:28 +01:00
Nga Tran
784ef88fcd
chore: merge main to branch and add more tests that expose a wrong result bug on unsigned int
2021-05-21 12:38:06 -04:00
Edd Robinson
a65c729b01
fix: support converse binary expressions
2021-05-21 15:41:52 +01:00
Edd Robinson
d5f02cb6c5
refactor: address PR feedback
2021-05-21 09:40:26 +01:00
Edd Robinson
d57e3ae73e
refactor: move scalar encodings
2021-05-20 22:58:30 +01:00
Edd Robinson
0ec2499f60
refactor: teach scalar RLE to return different type
2021-05-20 22:50:44 +01:00
Nga Tran
e44a3a87db
feat: fnow predicate is actuallu pushed down to RUB but there are bugs and not working yet
2021-05-20 16:56:15 -04:00
Edd Robinson
4cb76e367b
refactor: fix change to Chunk API
2021-05-20 11:11:18 +01:00
Edd Robinson
663a38862d
refactor: address PR feedback
2021-05-20 10:49:49 +01:00
Edd Robinson
76caef89b1
refactor: apply suggestions from code review
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-05-20 10:49:49 +01:00
Edd Robinson
c901fe1023
perf: improve values_as_dictionary with predicates
2021-05-20 10:49:49 +01:00
Edd Robinson
723ff2553b
feat: teach read_filter to return dictionaries
2021-05-20 10:49:49 +01:00
Edd Robinson
3de6f3f8bd
feat: teach string encoding to production Dictionary values
2021-05-20 10:49:49 +01:00
Edd Robinson
634ceb886b
feat: add Dictionary Values type
2021-05-20 10:49:49 +01:00
Edd Robinson
b7b87c1c96
test: add read_filter benchmark
2021-05-20 10:49:49 +01:00
Edd Robinson
4e766d7085
refactor: reorganise benchmarks
2021-05-20 10:49:49 +01:00
Edd Robinson
c8e2c9224e
chore: rename benchmark
2021-05-20 10:49:49 +01:00
Raphael Taylor-Davies
37880ee89a
refactor: store chunk IDs only in catalog ( #1521 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-20 04:07:14 +00:00
Edd Robinson
2963d63b5e
feat: implement byte trimming on nullable encodings
2021-05-17 14:32:55 +01:00
Edd Robinson
6a72274517
feat: extend implementations to more Arrow arrays
2021-05-17 14:32:55 +01:00
Edd Robinson
2b98bca9ca
test: allow from slice to be testable
2021-05-17 14:32:55 +01:00
Edd Robinson
b7ea53f5db
refactor: remove unnecessary from imps
2021-05-17 14:32:55 +01:00
Andrew Lamb
07db4932ee
refactor: rename data_types/src/chunk.rs -> data_types/src/chunk_metadata.rs ( #1500 )
2021-05-15 10:18:01 +00:00
Raphael Taylor-Davies
f9178dbb5f
feat: push metrics into catalog ( #1488 )
...
* feat: push metrics into catalog
* chore: minor cleanup
* fix: include db labels in chunk metric domains
* chore: fmt
* fix: don't allow dropping moving chunks
* chore: further tweaks
* chore: review feedback
* feat: use new_unregistered() for metric instruments instead of default
* chore: use &[KeyValue] instead of &Vec<KeyValue>
* refactor: make GauageValue non default constructible
2021-05-14 17:37:39 +00:00
Dom
db6c7728c7
refactor: use 10% target reduction for RLE
...
Comments say 10% but const was 30% - a 10% computed size reduction
sounds sensible!
2021-05-14 15:08:54 +01:00
Dom
874d7a1118
test: run rle_rows test
...
The rle_rows test was missing a #[test] annotation preventing it from
running.
2021-05-14 14:41:17 +01:00
Edd Robinson
0d21d9e2e0
refactor: implement from_iter, reduce code!
2021-05-14 13:32:02 +01:00