Commit Graph

98 Commits (36d9541cbc69f6d889996eeb0be3f60d69801080)

Author SHA1 Message Date
Edd Robinson 36d9541cbc feat: an arrow-backed boolean encoding 2021-02-01 12:02:14 +00:00
Edd Robinson 679e04fdb3 refactor: remove redundant From implementations 2021-02-01 10:52:27 +00:00
Edd Robinson 42e2178110 refactor: simpify arrow -> read buffer column 2021-01-31 21:19:18 +00:00
Edd Robinson 28b596b883 refactor: wire up fixed null encoding 2021-01-31 21:12:47 +00:00
Edd Robinson 0195dfc03a test: add coverage for NULL values in queries 2021-01-31 21:12:06 +00:00
Edd Robinson 4d107334dd test: adjust number of rows 2021-01-31 12:01:26 +00:00
Edd Robinson 0bed5e2290
refactor: update read_buffer/src/row_group.rs
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-01-31 11:55:04 +00:00
Edd Robinson 02c154c746 refactor: min/max support 2021-01-30 22:58:39 +00:00
Edd Robinson 9cc9c714ed refactor: wire up sum 2021-01-30 22:42:58 +00:00
Edd Robinson fd25b6a9e2 refactor: wire up aggregate count 2021-01-30 21:01:25 +00:00
Edd Robinson 75a2e1caff refactor: results can just contain aggregates 2021-01-30 10:02:03 +00:00
Edd Robinson a71d3eea86 refactor: address PR feedback 2021-01-29 22:01:51 +00:00
Edd Robinson 3bb58fe971 refactor: tidy up commented code 2021-01-29 22:01:51 +00:00
Edd Robinson 46f20df089 refactor: change Rc -> Arc 2021-01-29 22:01:51 +00:00
Edd Robinson ec10c81041 refactor: simplify chunk locking implementation 2021-01-29 22:01:51 +00:00
Edd Robinson 6b6c1476f6 refactor: implement table meta-data rebuilding 2021-01-29 22:01:51 +00:00
Edd Robinson 13cbc12298 feat: make database support concurrent access 2021-01-29 22:01:51 +00:00
Edd Robinson bc08c6b404 feat: support concurrent access to Chunk 2021-01-29 22:01:51 +00:00
Edd Robinson 30b90943bc feat: make Table concurrent-safe 2021-01-29 22:01:51 +00:00
Edd Robinson 050185ad92 refactor: ensure meta updated when rowgroup add/removed 2021-01-29 22:01:51 +00:00
Edd Robinson 338bbb9b55 refactor: materialise rb for read_aggregate at table 2021-01-29 22:01:51 +00:00
Edd Robinson e3afab12a7 refactor: rb from table read_filter 2021-01-29 22:01:51 +00:00
Edd Robinson 9d3c623a14 refactor: baseline Rc 2021-01-29 22:01:51 +00:00
Andrew Lamb 2282a68e65
refactor: Move selection to the data_types crate and remove redundant implemenation (#704) 2021-01-29 13:35:07 -05:00
Edd Robinson c8ce27ce5e perf: add benchmark for table_names
This commit adds some benchmarks for `table_names` against the read
buffer's Database implementation. On my laptop these look like:

database_table_names_all_tables
                        time:   [2.2104 us 2.2242 us 2.2381 us]
Found 2 outliers among 100 measurements (2.00%)
  1 (1.00%) high mild
  1 (1.00%) high severe

database_table_names_meta_pred_no_match
                        time:   [1.8389 us 1.8488 us 1.8593 us]
Found 3 outliers among 100 measurements (3.00%)
  1 (1.00%) high mild
  2 (2.00%) high severe

database_table_names_single_pred_match
                        time:   [5.5457 us 5.5694 us 5.5919 us]
Found 5 outliers among 100 measurements (5.00%)
  3 (3.00%) high mild
  2 (2.00%) high severe

database_table_names_multi_pred_match
                        time:   [478.85 us 480.32 us 481.83 us]
Found 4 outliers among 100 measurements (4.00%)
  2 (2.00%) high mild
  2 (2.00%) high severe

database_table_names_multi_pred_match_multi_tables
                        time:   [476.47 us 478.93 us 482.25 us]
Found 11 outliers among 100 measurements (11.00%)
  4 (4.00%) high mild
  7 (7.00%) high severe
2021-01-26 17:00:53 +00:00
Edd Robinson 42d629ac32 feat: wire up predicate support to external API 2021-01-26 17:00:53 +00:00
Edd Robinson c89a569e03 feat: add per-chunk pred support in table_names 2021-01-26 17:00:53 +00:00
Edd Robinson 8a23e22957 feat: determine if row group satisfies predicate 2021-01-26 17:00:53 +00:00
Andrew Lamb c3b0371c84
feat: Initial RPC Query Frontend (#692)
* feat: Initial RPC Query Frontend

* docs: s/immutable buffer/mutable buffer

* docs: Correct type in docstring
2021-01-25 08:33:39 -05:00
Edd Robinson 3da9b73464 refactor: add assertion 2021-01-25 11:26:15 +00:00
Edd Robinson 5fe5ed0569 test: more aggregate coverage 2021-01-25 11:21:20 +00:00
Edd Robinson c60cfbd2bb refactor: update read_buffer/src/lib.rs
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-01-25 11:21:20 +00:00
Edd Robinson a4bde5c252 refactor: error on unsupported aggregates 2021-01-25 11:21:20 +00:00
Edd Robinson d848526124 refactor: tidy up 2021-01-25 11:21:20 +00:00
Edd Robinson 9270874760 feat: wire up read_aggregate to external API 2021-01-25 11:21:20 +00:00
Edd Robinson e6b8d0e072 feat: add support for converting to record batch: 2021-01-25 11:21:20 +00:00
Edd Robinson 09ec6b78d3 feat: add ability to merge ReadAggregateResults 2021-01-25 11:21:20 +00:00
Andrew Lamb 7969808f09
feat: Chunk Migration APIs and query data in the read buffer via SQL (#668)
* feat: Chunk Migration APIs and query data in the read buffer via SQL

* fix: Make code more consistent

* fix: fmt / clippy

* chore: Apply suggestions from code review

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* refactor: Remove unecessary Result and make chunks() infallable

* chore: Apply more suggestions from code review

Co-authored-by: Edd Robinson <me@edd.io>
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
Co-authored-by: Edd Robinson <me@edd.io>
2021-01-19 13:28:26 -05:00
Edd Robinson 221ed86853 refactor: apply suggestions from code review
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-01-19 15:33:44 +00:00
Edd Robinson 57365b082c refactor: clean up filter_map 2021-01-19 15:33:44 +00:00
Edd Robinson dbdd885e58 refactor: follow snafu style guide 2021-01-19 15:33:44 +00:00
Edd Robinson 5f6335573b fix: ensure table missing handled 2021-01-19 15:33:44 +00:00
Edd Robinson 9f65c4b6ef refactor: encapsulate column meta data 2021-01-19 15:33:44 +00:00
Edd Robinson 0c7424465d refactor: use schema type for read_filter 2021-01-19 15:33:44 +00:00
Edd Robinson 93f4f8aa41 feat: teach read_buffer schema -> data_types schema 2021-01-19 15:33:44 +00:00
Edd Robinson 864e9e4dac refactor: tidy up columns in row group 2021-01-19 15:33:44 +00:00
Edd Robinson 71fce96b3b feat: encapsulate semantic column type in result schema 2021-01-19 15:33:44 +00:00
Edd Robinson 17358589ed refactor: move AggregateType to schema 2021-01-19 15:33:44 +00:00
Edd Robinson d805ce6189 refactor: move LogicalDataType into Schema 2021-01-19 15:33:44 +00:00
Edd Robinson e34979532d refactor: fix Display implementation 2021-01-18 12:05:11 +00:00