Commit Graph

215 Commits (e25dd1836f7fa4fcfb32c822b851bb1f555f64fc)

Author SHA1 Message Date
Edd Robinson 96e1289c94 refactor: log time to create row group 2021-04-28 15:08:19 +00:00
Edd Robinson c3b41649ee refactor: use space saving compression 2021-04-28 15:08:19 +00:00
Edd Robinson 5e3d43d62f fix: report row group rows correctly 2021-04-28 15:08:19 +00:00
Marco Neumann eddc9319ff docs: deny broken intradoc links 2021-04-27 13:22:28 +02:00
Raphael Taylor-Davies 20117de078
feat: string dictionary encoding (#1220) (#1262)
* feat: string dictionary encoding (#1220)

* chore: review comments

* chore: fix lint

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-27 09:36:58 +00:00
Dom 1826d86938 chore: fix observability dependency key
The observability_deps crate name was erroneously wrapped in double
quotes.
2021-04-26 12:22:21 +01:00
Edd Robinson faec98eab9 refactor: remove time column from row group 2021-04-26 09:51:06 +00:00
Edd Robinson 15bde2f8fa refactor: remove time field from Table meta 2021-04-26 09:51:06 +00:00
Edd Robinson 1f0e760f2f refactor: use bool::then 2021-04-22 21:59:41 +00:00
Edd Robinson 2784f89e6e refactor: sigh 2021-04-20 17:30:50 +00:00
Edd Robinson d55bf73860 refactor: satisfy new clippy lints 2021-04-20 17:30:50 +00:00
Edd Robinson 0114afcdfa refactor: quieten logs for new row group 2021-04-19 16:08:49 +00:00
Carol (Nichols || Goulding) 82c1d94ce1 refactor: Use Option.map where possible 2021-04-19 08:48:11 -04:00
Carol (Nichols || Goulding) 83250a93e6 refactor: Use vec macro 2021-04-19 08:48:11 -04:00
Carol (Nichols || Goulding) c9772db01b fix: Allow this upper case acronym; it could be confusing otherwise 2021-04-19 08:48:11 -04:00
Carol (Nichols || Goulding) 757933afc4 fix: use Self when possible 2021-04-19 08:48:11 -04:00
Carol (Nichols || Goulding) 716c3d41ab refactor: Use flatten rather than if let Some 2021-04-19 08:44:52 -04:00
Marco Neumann fd0da7e74a chore: upgrade arrow and Rust
See https://github.com/apache/arrow/pull/10082 for upstream PR.
2021-04-19 14:00:04 +02:00
Edd Robinson 4b706141de refactor: log new row groups added to RB 2021-04-19 10:25:57 +00:00
Edd Robinson 2b53f55fd5 refactor: implement Display on row group 2021-04-19 10:25:57 +00:00
Edd Robinson 98aa2a3543 refactor: implemenent Display on encodings 2021-04-19 10:25:57 +00:00
Edd Robinson a9d2ffcc6f refactor: impl Display on OwnedValue 2021-04-19 10:25:57 +00:00
Edd Robinson 22fbec194e refactor: impl Display on LogicalDataType 2021-04-19 10:25:57 +00:00
Edd Robinson d11a322e0c refactor: import Display 2021-04-19 10:25:57 +00:00
Andrew Lamb e226b5a820
feat: Use TimestampNanosecondArray for timestamps in IOx (#1230)
* refactor: Create Arrow arrays using iterators

* feat: use Timestamp64(TimeUnit::Nanosecond) for timestamps

* feat: add support for timestamp array

* fix: update more tests

* fix: remove unecessary code

Co-authored-by: Edd Robinson <me@edd.io>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-16 15:55:33 +00:00
Edd Robinson 025f760479 refactor: change sync::RwLock to parking_lot 2021-04-14 19:18:03 +00:00
Edd Robinson a3fc5e2474 refactor: change sync::RwLock to parking_lot 2021-04-14 19:18:03 +00:00
Edd Robinson 5bb34e9a97 refactor: use read_buffer column range for time range 2021-04-14 16:10:24 +00:00
Nga Tran 05bf28ce85 feat: Add 2 main functions table_schema and table_names for Parquet Chunk ato pay a foundation for querying it 2021-04-13 18:23:55 -04:00
Edd Robinson be369689f2 refactor: fix benchmarks 2021-04-08 18:20:37 +00:00
Edd Robinson a34de76c49 refactor: wire read buffer tracker in 2021-04-08 18:20:37 +00:00
Edd Robinson d429cf9aeb refactor: tighten up Read Buffer API 2021-04-08 10:24:19 +00:00
Edd Robinson dae9f12593 refactor: remove deprecated API 2021-04-08 10:24:19 +00:00
Edd Robinson 721a784ce0 refactor: concrete type to keep streams happy 2021-04-08 10:19:11 +00:00
Edd Robinson 17853266ce refactor: add helper method for all names 2021-04-08 10:19:11 +00:00
Edd Robinson 9e1068b7de refactor: db to return usize 2021-04-07 13:27:41 +00:00
Edd Robinson cab7d1d1fe refactor: chunk size to return usize 2021-04-07 13:27:41 +00:00
Edd Robinson 7dd5924059 refactor: table size to return usize 2021-04-07 13:27:41 +00:00
Edd Robinson b867599fce refactor: row group size to return usize 2021-04-07 13:27:41 +00:00
Edd Robinson 40abe24123 refactor: encoding size to return usize 2021-04-07 13:27:41 +00:00
Edd Robinson ea2c882635 refactor: tidy up 2021-04-07 10:46:08 +00:00
Edd Robinson b524b4411e test: move test for table_summaries into chunk 2021-04-07 10:46:08 +00:00
Edd Robinson a662d5e180 refactor: expose column_values at chunk level 2021-04-07 10:46:08 +00:00
Edd Robinson 7bee168752 refactor: chunk upsert does not need &mut 2021-04-07 10:46:08 +00:00
Edd Robinson e8ff86279f refactor: move column_names to chunk level 2021-04-07 10:46:08 +00:00
Edd Robinson 03b72cc80d feat: add chunk predicate check 2021-04-07 10:46:08 +00:00
Edd Robinson c2e0c80f8c refactor: expose read_filter at chunk level 2021-04-07 10:46:08 +00:00
Edd Robinson bc3560af8c test: add coverage for has_table 2021-04-07 10:46:08 +00:00
Edd Robinson 0c32cb48c7 feat: add read_filter schema method 2021-04-07 10:46:08 +00:00
Edd Robinson d39fe8abf8 refactor: add ability to upsert table 2021-04-07 10:46:08 +00:00