Commit Graph

301 Commits (418cc4cf0eafffcd56dcf35de07ce0892dc05557)

Author SHA1 Message Date
Edd Robinson 17358589ed refactor: move AggregateType to schema 2021-01-19 15:33:44 +00:00
Edd Robinson d805ce6189 refactor: move LogicalDataType into Schema 2021-01-19 15:33:44 +00:00
Edd Robinson e34979532d refactor: fix Display implementation 2021-01-18 12:05:11 +00:00
Edd Robinson bdeacdcf37 docs: define merging 2021-01-18 12:05:11 +00:00
Edd Robinson e2a16d7d4c refactor: fix error handling 2021-01-18 12:05:11 +00:00
Edd Robinson 3c61fdb773 refactor: update read_buffer/src/row_group.rs
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-01-18 12:05:11 +00:00
Edd Robinson a82bf8de78 refactor: Update read_buffer/src/chunk.rs
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-01-18 12:05:11 +00:00
Edd Robinson 26d11be09c refactor: wire up read_aggregate to chunk 2021-01-18 12:05:11 +00:00
Edd Robinson eaabb82404 refactor: wire up read_aggregate in table 2021-01-18 12:05:11 +00:00
Edd Robinson 0a4d890f31 refactor: move schema information for results into type 2021-01-18 12:05:11 +00:00
Edd Robinson 6dbb00715e refactor: rename method 2021-01-18 12:05:11 +00:00
Edd Robinson 42c0ccf274 refactor: rename method to 2021-01-18 12:05:11 +00:00
Andrew Lamb 71627120b9
refactor: consolidate line protocol schema creation into data_types and port code to use it (#663)
* refactor: consolidate line protocol schema creation into data_types, and port code to use it

refactor: Port mutable buffer to use SchemaBuilder

* fix: doctest

* refactor: remove unecessary clippyisms

* docs: Improve comments via suggestions from code review

Co-authored-by: Edd Robinson <me@edd.io>

* refactor: use more idomatic try_ naming and TryInto trait

* docs: Change from line protocol data model to InfluxDB data model

* refactor: rename LP --> Influx in code

* feat: add support for UInteger type

Co-authored-by: Edd Robinson <me@edd.io>
2021-01-15 17:29:30 -05:00
Edd Robinson 7f4f44211f test: fix broken test 2021-01-15 12:54:24 +00:00
Edd Robinson c6ff633afd test: expose internals for benchmarking
This commit is a bit of a hack. The first thing I could think of. The
problem is that I want to be able to benchmark various modules in the
read buffer but I don't want to expose those internals via the external
API.

Becuase criterion only lets you exercise the exported API I needed to
expose some internals. I did this by creating a documented module
`benchmarks` in the `read_buffer` crate, which re-exports identifiers
that can be used by a criterion crate.

The idea is that it will be clear that this module is not part of the
public API.
2021-01-14 22:46:27 +00:00
Edd Robinson d55bc4835a refactor: rename method 2021-01-14 21:45:54 +00:00
Edd Robinson d82293ba23 refactor: add API method 2021-01-14 21:26:50 +00:00
Edd Robinson 1d5bc6f345 refactor: expose column_names for getting tag keys 2021-01-14 21:26:50 +00:00
Edd Robinson 676b58dc2c fix: ensure correct chunks used 2021-01-14 21:26:50 +00:00
Edd Robinson 4c4d2e8e67 refactor: add API method for read_aggregate_window 2021-01-14 21:26:50 +00:00
Edd Robinson 3026668878 refactor: add API method for read_aggregate 2021-01-14 21:26:50 +00:00
Edd Robinson bdb8a78569 refactor: reduce expose API 2021-01-14 21:26:50 +00:00
Edd Robinson d536f82879 fix: get benchmarks compiling 2021-01-14 14:06:17 +00:00
Edd Robinson 6c5fdc0fae refactor: clean up comment 2021-01-14 13:46:20 +00:00
Edd Robinson 2ba438cf4f refactor: update read_buffer/src/row_group.rs
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-01-14 13:46:20 +00:00
Edd Robinson 05e083d0e2 feat: support converting from DF types 2021-01-14 13:14:08 +00:00
Edd Robinson 728d556b7d refactor: encapsulate read buffer predicats in type 2021-01-14 13:14:08 +00:00
Andrew Lamb a5240af080
docs: Document desired crate dependencies in comments (#638)
* docs: Document the desire for read buffer and mutable buffer to be independent of query layer

* docs: Document desire for the query layer to not depend on storage systems

* fix: Apply suggestions from code review

Co-authored-by: Edd Robinson <me@edd.io>

Co-authored-by: Edd Robinson <me@edd.io>
2021-01-12 17:49:03 -05:00
Edd Robinson 9ec0ae26e1 refactor: implement From<ArrayRef> 2021-01-11 16:11:21 +00:00
Edd Robinson 9eef7b4d7f feat: add enum for selecting 'all' columns 2021-01-11 16:11:21 +00:00
Edd Robinson 61466fed44 refactor: add outline for read_aggregate 2021-01-11 16:11:21 +00:00
Edd Robinson 5a15a11a5c feat: lazily return record batches for read_filter 2021-01-11 16:11:21 +00:00
Edd Robinson c3019a91bd feat: add support for determining logical column types 2021-01-11 16:11:20 +00:00
Edd Robinson 1d972e01c8 refactor: Update read_buffer/src/lib.rs
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-01-08 21:03:38 +00:00
Edd Robinson 23f27e10fa feat: add partition concept to ReadBuffer 2021-01-08 21:03:38 +00:00
Edd Robinson 46f85bb6a6 refactor: adrress PR comments
Co-authored-by: Andrew Lamb <alamb@influxdata.com>

Co-authored-by: Dom <dom@itsallbroken.com>
2021-01-08 16:19:19 +00:00
Edd Robinson 4ce6821d90 feat: implement table_names on 2021-01-08 16:19:19 +00:00
Edd Robinson 590b74e386 refactor: add test for adding chunk to database 2021-01-08 16:19:19 +00:00
Edd Robinson 6df2de62bb refactor: provide an API for table row groups 2021-01-08 16:19:19 +00:00
Edd Robinson 954da31e83 test: fix tests 2021-01-08 16:19:19 +00:00
Edd Robinson 2178a6eae4 feat: hook up record batch -> chunk to store 2021-01-08 16:19:19 +00:00
Edd Robinson b1ab6a189d feat: record batch -> read buffer column 2021-01-08 16:19:19 +00:00
Edd Robinson 8382501440 refactor: validate column types 2021-01-08 16:19:19 +00:00
Andrew Lamb 8219403fab
feat: Instantiate ReadBuffer as part of server creation (#620)
* feat: Instantiate ReadBuffer as part of server creation

* refactor: remove Store from read_buffer
2021-01-07 13:25:42 -05:00
Edd Robinson 937442cfa0 refactor: update partition refs to chunk 2020-12-28 21:08:56 +00:00
Edd Robinson c46cf6fdcf refactor: rename partition to chunk 2020-12-28 21:08:56 +00:00
Edd Robinson c0dc93a8cb refactor: change partition to chunk 2020-12-28 21:08:56 +00:00
Edd Robinson fa8afe845d refactor: fix benchmarks 2020-12-22 21:26:05 +00:00
Edd Robinson b1aabc14b2 refactor: rename Segment to RowGroup 2020-12-22 21:26:04 +00:00
Edd Robinson 0af935d123 refactor: rename segment module to row_group 2020-12-22 21:26:04 +00:00
Edd Robinson 199ba68769 refactor: rename segment_store crate to read_buffer 2020-12-22 21:26:04 +00:00