Commit Graph

301 Commits (418cc4cf0eafffcd56dcf35de07ce0892dc05557)

Author SHA1 Message Date
Edd Robinson 418cc4cf0e
refactor: update read_buffer/src/column/encoding/scalar/transcoders.rs
Co-authored-by: Dom <dom@itsallbroken.com>
2021-06-03 14:02:16 +01:00
Edd Robinson 22c7592e3b refactor: DRY RLE check 2021-06-03 12:32:40 +01:00
Edd Robinson 9a45c0d05b feat: implement float byte trimming for arrow array 2021-06-03 12:32:40 +01:00
Edd Robinson 5d02a71e6f feat: implement byte trimming on float slice 2021-06-03 12:32:40 +01:00
Edd Robinson 32e5f8c715 feat: add float byte trimmer encoding 2021-06-03 12:32:40 +01:00
Edd Robinson 728476f2e1 refactor: add encoding name to float encodings 2021-06-03 12:32:40 +01:00
Edd Robinson fa729fd6b0 refactor: address PR feedback 2021-06-02 11:21:10 +01:00
Edd Robinson a5b554d2c3 feat: add RLE support to integer encodings 2021-06-02 10:57:17 +01:00
Edd Robinson 71598d9b3e refactor: move rle heuristics to rle module 2021-06-02 10:57:17 +01:00
Dom aca00a505f refactor: avoid copying encoding name for stats
Swaps the encoding name String type for a Cow in the column Statistics,
avoiding having to copy the encoding name where it is a static string
already.
2021-06-01 11:08:07 +01:00
Andrew Lamb 00e735ef0d
chore: remove unused dependencies (#1583) 2021-05-29 10:31:57 +00:00
Raphael Taylor-Davies db432de137
feat: add distinct count to StatValues (#1568) 2021-05-28 17:41:34 +00:00
Edd Robinson e94be15296
refactor: update read_buffer/src/column/encoding/scalar/fixed.rs 2021-05-27 21:18:10 +01:00
Edd Robinson 26fe4167f7 refactor: erase some types 2021-05-27 14:57:40 +01:00
Edd Robinson bba387d6ff refactor: fix benchmarks 2021-05-27 14:35:34 +01:00
Edd Robinson 7ab27c4468 refactor: get build 2021-05-27 14:35:34 +01:00
Edd Robinson 04513e737d refactor: define encodings wrt to scalar encoding trait 2021-05-27 14:35:34 +01:00
Edd Robinson 22f8a8a4a1 refactor: define scalar encoding in terms of trait 2021-05-27 14:35:34 +01:00
Edd Robinson c84d50447c feat: define a Transcoder trait 2021-05-27 14:35:34 +01:00
Edd Robinson a81ada6140 feat: add transcoder trait 2021-05-27 14:35:34 +01:00
Raphael Taylor-Davies 4fcc04e6c9
chore: enable arrow prettyprint feature (#1566) 2021-05-27 10:28:14 +00:00
kodiakhq[bot] db96286ed7
Merge branch 'main' into er/refactor/scalar_comp 2021-05-24 17:02:14 +00:00
Andrew Lamb 14ba25f86d
chore: Update datafusion and use released version of arrow crates (#1546)
* chore: Update datafusion and use released version of arrow crate

* fix: Update for change in API
2021-05-24 15:37:22 +00:00
Edd Robinson eace6c9201 fix: ensure scalars compare correctly 2021-05-24 16:19:28 +01:00
Nga Tran 784ef88fcd chore: merge main to branch and add more tests that expose a wrong result bug on unsigned int 2021-05-21 12:38:06 -04:00
Edd Robinson a65c729b01 fix: support converse binary expressions 2021-05-21 15:41:52 +01:00
Edd Robinson d5f02cb6c5 refactor: address PR feedback 2021-05-21 09:40:26 +01:00
Edd Robinson d57e3ae73e refactor: move scalar encodings 2021-05-20 22:58:30 +01:00
Edd Robinson 0ec2499f60 refactor: teach scalar RLE to return different type 2021-05-20 22:50:44 +01:00
Nga Tran e44a3a87db feat: fnow predicate is actuallu pushed down to RUB but there are bugs and not working yet 2021-05-20 16:56:15 -04:00
Edd Robinson 4cb76e367b refactor: fix change to Chunk API 2021-05-20 11:11:18 +01:00
Edd Robinson 663a38862d refactor: address PR feedback 2021-05-20 10:49:49 +01:00
Edd Robinson 76caef89b1 refactor: apply suggestions from code review
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-05-20 10:49:49 +01:00
Edd Robinson c901fe1023 perf: improve values_as_dictionary with predicates 2021-05-20 10:49:49 +01:00
Edd Robinson 723ff2553b feat: teach read_filter to return dictionaries 2021-05-20 10:49:49 +01:00
Edd Robinson 3de6f3f8bd feat: teach string encoding to production Dictionary values 2021-05-20 10:49:49 +01:00
Edd Robinson 634ceb886b feat: add Dictionary Values type 2021-05-20 10:49:49 +01:00
Edd Robinson b7b87c1c96 test: add read_filter benchmark 2021-05-20 10:49:49 +01:00
Edd Robinson 4e766d7085 refactor: reorganise benchmarks 2021-05-20 10:49:49 +01:00
Edd Robinson c8e2c9224e chore: rename benchmark 2021-05-20 10:49:49 +01:00
Raphael Taylor-Davies 37880ee89a
refactor: store chunk IDs only in catalog (#1521)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-20 04:07:14 +00:00
Edd Robinson 2963d63b5e feat: implement byte trimming on nullable encodings 2021-05-17 14:32:55 +01:00
Edd Robinson 6a72274517 feat: extend implementations to more Arrow arrays 2021-05-17 14:32:55 +01:00
Edd Robinson 2b98bca9ca test: allow from slice to be testable 2021-05-17 14:32:55 +01:00
Edd Robinson b7ea53f5db refactor: remove unnecessary from imps 2021-05-17 14:32:55 +01:00
Andrew Lamb 07db4932ee
refactor: rename data_types/src/chunk.rs -> data_types/src/chunk_metadata.rs (#1500) 2021-05-15 10:18:01 +00:00
Raphael Taylor-Davies f9178dbb5f
feat: push metrics into catalog (#1488)
* feat: push metrics into catalog

* chore: minor cleanup

* fix: include db labels in chunk metric domains

* chore: fmt

* fix: don't allow dropping moving chunks

* chore: further tweaks

* chore: review feedback

* feat: use new_unregistered() for metric instruments instead of default

* chore: use &[KeyValue] instead of &Vec<KeyValue>

* refactor: make GauageValue non default constructible
2021-05-14 17:37:39 +00:00
Dom db6c7728c7 refactor: use 10% target reduction for RLE
Comments say 10% but const was 30% - a 10% computed size reduction
sounds sensible!
2021-05-14 15:08:54 +01:00
Dom 874d7a1118 test: run rle_rows test
The rle_rows test was missing a #[test] annotation preventing it from
running.
2021-05-14 14:41:17 +01:00
Edd Robinson 0d21d9e2e0 refactor: implement from_iter, reduce code! 2021-05-14 13:32:02 +01:00