Commit Graph

198 Commits (78aa66d6997cb6b7dd565b47b1d8ea24bac91c49)

Author SHA1 Message Date
Marco Neumann fd0da7e74a chore: upgrade arrow and Rust
See https://github.com/apache/arrow/pull/10082 for upstream PR.
2021-04-19 14:00:04 +02:00
Edd Robinson 4b706141de refactor: log new row groups added to RB 2021-04-19 10:25:57 +00:00
Edd Robinson 2b53f55fd5 refactor: implement Display on row group 2021-04-19 10:25:57 +00:00
Edd Robinson 98aa2a3543 refactor: implemenent Display on encodings 2021-04-19 10:25:57 +00:00
Edd Robinson a9d2ffcc6f refactor: impl Display on OwnedValue 2021-04-19 10:25:57 +00:00
Edd Robinson 22fbec194e refactor: impl Display on LogicalDataType 2021-04-19 10:25:57 +00:00
Edd Robinson d11a322e0c refactor: import Display 2021-04-19 10:25:57 +00:00
Andrew Lamb e226b5a820
feat: Use TimestampNanosecondArray for timestamps in IOx (#1230)
* refactor: Create Arrow arrays using iterators

* feat: use Timestamp64(TimeUnit::Nanosecond) for timestamps

* feat: add support for timestamp array

* fix: update more tests

* fix: remove unecessary code

Co-authored-by: Edd Robinson <me@edd.io>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-16 15:55:33 +00:00
Edd Robinson 025f760479 refactor: change sync::RwLock to parking_lot 2021-04-14 19:18:03 +00:00
Edd Robinson a3fc5e2474 refactor: change sync::RwLock to parking_lot 2021-04-14 19:18:03 +00:00
Edd Robinson 5bb34e9a97 refactor: use read_buffer column range for time range 2021-04-14 16:10:24 +00:00
Nga Tran 05bf28ce85 feat: Add 2 main functions table_schema and table_names for Parquet Chunk ato pay a foundation for querying it 2021-04-13 18:23:55 -04:00
Edd Robinson be369689f2 refactor: fix benchmarks 2021-04-08 18:20:37 +00:00
Edd Robinson a34de76c49 refactor: wire read buffer tracker in 2021-04-08 18:20:37 +00:00
Edd Robinson d429cf9aeb refactor: tighten up Read Buffer API 2021-04-08 10:24:19 +00:00
Edd Robinson dae9f12593 refactor: remove deprecated API 2021-04-08 10:24:19 +00:00
Edd Robinson 721a784ce0 refactor: concrete type to keep streams happy 2021-04-08 10:19:11 +00:00
Edd Robinson 17853266ce refactor: add helper method for all names 2021-04-08 10:19:11 +00:00
Edd Robinson 9e1068b7de refactor: db to return usize 2021-04-07 13:27:41 +00:00
Edd Robinson cab7d1d1fe refactor: chunk size to return usize 2021-04-07 13:27:41 +00:00
Edd Robinson 7dd5924059 refactor: table size to return usize 2021-04-07 13:27:41 +00:00
Edd Robinson b867599fce refactor: row group size to return usize 2021-04-07 13:27:41 +00:00
Edd Robinson 40abe24123 refactor: encoding size to return usize 2021-04-07 13:27:41 +00:00
Edd Robinson ea2c882635 refactor: tidy up 2021-04-07 10:46:08 +00:00
Edd Robinson b524b4411e test: move test for table_summaries into chunk 2021-04-07 10:46:08 +00:00
Edd Robinson a662d5e180 refactor: expose column_values at chunk level 2021-04-07 10:46:08 +00:00
Edd Robinson 7bee168752 refactor: chunk upsert does not need &mut 2021-04-07 10:46:08 +00:00
Edd Robinson e8ff86279f refactor: move column_names to chunk level 2021-04-07 10:46:08 +00:00
Edd Robinson 03b72cc80d feat: add chunk predicate check 2021-04-07 10:46:08 +00:00
Edd Robinson c2e0c80f8c refactor: expose read_filter at chunk level 2021-04-07 10:46:08 +00:00
Edd Robinson bc3560af8c test: add coverage for has_table 2021-04-07 10:46:08 +00:00
Edd Robinson 0c32cb48c7 feat: add read_filter schema method 2021-04-07 10:46:08 +00:00
Edd Robinson d39fe8abf8 refactor: add ability to upsert table 2021-04-07 10:46:08 +00:00
Edd Robinson 2129c2a725 refactor: make some methods crate-visible 2021-04-07 10:46:08 +00:00
Edd Robinson 5eea06c9b3 refactor: allow empty chunks 2021-04-07 10:46:08 +00:00
Andrew Lamb b61875e0b2
feat: Add TableSummary calculation to ReadBuffer (#1092) 2021-03-31 16:26:37 +00:00
Andrew Lamb 6a48001d13
refactor: Manage storage directly in the Catalog (#1057)
* refactor: Manage mutable buffer chunks directly

* fix: do not use mutable_buffer for listing table names
2021-03-29 17:55:07 +00:00
Andrew Lamb 895e808754
chore: Upgrade arrow deps (#1046)
* chore: Upgrade dependencies

* chore: upgrade query for new interfaces

* chore: update read_buffer
2021-03-25 13:35:08 +00:00
Edd Robinson 585213e51f refactor: return error for wrong group columns 2021-03-23 14:41:06 +00:00
Edd Robinson cadc92dac9 refactor: remove dead code 2021-03-22 20:47:48 +00:00
Edd Robinson 300ac2e411 refactor: simplify aggregate_columns 2021-03-22 20:47:48 +00:00
Edd Robinson dd0ab422d2 refactor: remove redundant type 2021-03-22 20:47:48 +00:00
Edd Robinson dea4f1c451 refactor: remove type from row_group 2021-03-22 20:47:48 +00:00
Edd Robinson dfd39cfce6 refactor: apply suggestions from code review
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-03-22 16:15:49 +00:00
Edd Robinson 3e9b2fff5c refactor: Update read_buffer/src/row_group.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-03-22 16:15:49 +00:00
Edd Robinson ce55dd7ce3 refactor: update read_buffer/src/row_group.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-03-22 16:15:49 +00:00
Edd Robinson b44dc7d9a1 refactor: update read_buffer/src/value.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-03-22 16:15:49 +00:00
Edd Robinson 326016966f refactor: update read_buffer/src/row_group.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-03-22 16:15:49 +00:00
Edd Robinson ffa06e4f0e test: more test coverage 2021-03-22 16:15:49 +00:00
Edd Robinson e5f7cc143a refactor: use AggregateVec for results 2021-03-22 16:15:49 +00:00