Commit Graph

1090 Commits (c5dc48db04c6ceb3adb2fed77ffa95faf7277b75)

Author SHA1 Message Date
Edd Robinson c5dc48db04 feat: implement range based predicate on column 2020-11-02 11:47:14 +00:00
Edd Robinson 952959cd5f fix: fix bug with range predicate method 2020-11-02 11:47:14 +00:00
Edd Robinson 34ba183a3e feat: implement getting row ids from predicate 2020-11-02 11:47:14 +00:00
Edd Robinson 93dde00d04 refactor: change filter API 2020-11-02 11:47:07 +00:00
Edd Robinson c4176a3f46 refactor: better API for row ids 2020-10-29 12:25:54 +00:00
Edd Robinson 5dd4af1286
Merge pull request #398 from influxdata/er/feat/column-encoded
feat: implementation of encoded value methods
2020-10-28 21:40:23 +00:00
Edd Robinson 56c56f73d6 feat: add support for all encoded values 2020-10-28 18:41:08 +00:00
Edd Robinson e82913a186 feat: add support for encoded values 2020-10-28 17:19:01 +00:00
Edd Robinson 4a07ea8d9d
Merge pull request #397 from influxdata/er/feat/column-values
feat: implement methods for returning materialised values
2020-10-28 09:30:42 +00:00
Paul Dix 1d866b448d
Merge pull request #393 from influxdata/pd-database_rules_persistence
feat: implement summary statistics for write buffer
2020-10-27 17:21:00 -04:00
Paul Dix 41bc351106 chore: pr feedback fixes 2020-10-27 15:10:50 -06:00
Edd Robinson 48af64d2cb feat: add distinct_values implementation on column 2020-10-27 18:46:41 +00:00
Edd Robinson fef30a7cc4 feat: add values implementation on column 2020-10-27 18:46:38 +00:00
Edd Robinson 5861d6d030 refactor: make RLE values API simpler 2020-10-27 18:39:38 +00:00
Edd Robinson ef8441054d feat: complete signed slice conversion 2020-10-27 18:39:38 +00:00
Edd Robinson b3d543d000 feat: extend support for converting from unsigned slices 2020-10-27 18:39:38 +00:00
Edd Robinson d8130a6000 feat: add implementation 2020-10-27 18:39:38 +00:00
Edd Robinson 60a4e8428c refactor: represent row ids as u32 2020-10-27 18:39:38 +00:00
Andrew Lamb 6623ce9f65
feat: Add more logging for rpc, reduce low level hyper logging (#396) 2020-10-27 11:24:44 -04:00
Andrew Lamb cf90ebe82d
fix: Use Read instead of BufRead as no BufRead method is actually used (#394) 2020-10-27 07:40:27 -04:00
Paul Dix 5105810488 feat: implement summary statistics for write buffer
Adds partition metadata to data types crate which also contains the summary statistics. Updates the write buffer to keep summary stats.
2020-10-26 20:03:19 -06:00
Andrew Lamb 2083b41a24
refactor: rename write_buffer* to take its rightful place (#392) 2020-10-26 16:31:34 -04:00
Paul Dix 1fe8f517cc
Merge pull request #389 from influxdata/pd-database_rules_persistence
feat: implement API for storing the server configuration
2020-10-26 15:47:48 -04:00
Paul Dix 1e966b5153 feat: implement API for storing the server configuration in object storage
This adds basic API calls for persisting and loading the server configuratioon of database rules and host groups to and from object storage. It stores all the data in a single JSON file.
2020-10-26 13:43:43 -06:00
Andrew Lamb ef501871bb
feat: remove partition_store (#387) 2020-10-26 14:39:38 -04:00
Andrew Lamb 4e1e8dbf79
chore: Upgrade version of Arrow/DataFusion (2 of 3) (#391)
* chore: Upgrade version of Arrow/DataFusion (2 of 3)

* fix: Fixup error type usage and use async stream interface

* fix: post merge fixups
2020-10-26 13:49:16 -04:00
Andrew Lamb 880958d9c7
feat: switch end-to-end test to use write_buffer implementation rather than partitioned store (#386)
* feat: switch end-to-end test to use write_buffer implementation rather than partitioned store

* fix: Apply PR suggestions
2020-10-26 13:42:38 -04:00
Andrew Lamb 88b9f43110
chore: Upgrade version of Arrow/DataFusion (1 of 3) (#390)
* chore: Upgrade version of Arrow/DataFusion

* fix: update code for deps
2020-10-26 11:46:02 -04:00
Edd Robinson ac2b81e5a8
Merge pull request #385 from influxdata/er/feat/column
feat: initial Column stubs
2020-10-26 15:39:27 +00:00
Edd Robinson 004704c5eb refactor: address PR feedback 2020-10-26 15:29:49 +00:00
Andrew Lamb 1004854403
refactor: remove uneeded dependencies, switch to tracing from log (#388) 2020-10-26 06:15:47 -04:00
Paul Dix bee92fb33b
Merge pull request #383 from influxdata/pd-handle_replicated_write
feat: implement subscriptions that for subscribers to all data
2020-10-25 13:04:05 -04:00
Andrew Lamb a66bd4a738
feat: Implement measurement_fields gRPC route (#384)
* feat: Implement measurement_fields gRPC route

* fix: Apply suggestions from code review in github

Co-authored-by: Jake Goulding <jake.goulding@integer32.com>

* fix: apply code review comments locally

* fix: fix based on code review

Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
2020-10-23 14:01:46 -04:00
Edd Robinson ad7b177c26 feat: add column method stubs 2020-10-23 18:43:28 +01:00
Edd Robinson d53a5b95a9 feat: add nullable int column 2020-10-23 15:03:02 +01:00
Edd Robinson 0e21541ba2 feat: add support for consuming arrow array 2020-10-23 15:02:38 +01:00
Edd Robinson 53dfaf6f5e feat: create RLE columns from arrays 2020-10-23 13:41:59 +01:00
Edd Robinson 4a86f4c389 fix: ensure first rl added to column 2020-10-23 13:41:59 +01:00
Edd Robinson 2675593b35 fix: ensure dictionary only returns non-null values: 2020-10-23 13:41:59 +01:00
Edd Robinson 502773c940 feat: basic conversion of [i64] into column 2020-10-23 13:41:59 +01:00
Edd Robinson a03f536bb7
Merge pull request #382 from influxdata/er/refactor/dict-encoding
feat: improve NULL support in RLE encoding
2020-10-23 13:37:45 +01:00
Paul Dix 19911b4432 feat: implement subscriptions that for subscribers to all data
This implements only the most basic subscription mechanism, which basically makes it the same as replication at this point. It also simplifies subscriptions to not consider pull type. This will come back later, but will have to happen after the wal buffering is implemented.
2020-10-22 17:16:11 -04:00
Paul Dix 45c37b22b4
Merge pull request #379 from influxdata/pd-cluster_sequence_number
feat: add sequence number to replicated writes
2020-10-22 14:15:02 -04:00
Edd Robinson 3914db5935 feat: add support for null/non-null rows 2020-10-22 15:30:47 +01:00
Edd Robinson 806211ed1a refactor: re-work NULL support in RLE 2020-10-22 14:52:08 +01:00
Andrew Lamb c646f29794
feat: Add source checkout and initial build to docker CI image, don't use build cache (#381)
* feat: Add source checkout and initial build to docker CI image

* fix: remove tidbits
2020-10-22 05:50:36 -04:00
Andrew Lamb 0b443fdb12
feat: add --num-threads CLI argument, allow single threaded operation (#378) 2020-10-21 17:12:32 -04:00
Paul Dix 7a82fb1829 feat: add sequence number to replicated writes
This adds a sequence number to replicated writes. Sequence numbers are per databasea and kept only in memory, which means they'll reset whenever the process is restarted. It is up to the receivers of replicated writes to determine if they need to request any missed sequence numbers.
2020-10-21 16:11:49 -04:00
Edd Robinson 7ef17ccdaa feat: initialise RLE with dictionary 2020-10-21 14:01:01 +01:00
Edd Robinson daf89c7d22
Merge pull request #371 from influxdata/er/feat/dict-encoding
feat: add dictionary RLE encoding to Segment Store
2020-10-21 14:00:32 +01:00