Commit Graph

1062 Commits (ac2b81e5a8960827dee494b694189aa938c37ace)

Author SHA1 Message Date
Edd Robinson ac2b81e5a8
Merge pull request #385 from influxdata/er/feat/column
feat: initial Column stubs
2020-10-26 15:39:27 +00:00
Edd Robinson 004704c5eb refactor: address PR feedback 2020-10-26 15:29:49 +00:00
Andrew Lamb 1004854403
refactor: remove uneeded dependencies, switch to tracing from log (#388) 2020-10-26 06:15:47 -04:00
Paul Dix bee92fb33b
Merge pull request #383 from influxdata/pd-handle_replicated_write
feat: implement subscriptions that for subscribers to all data
2020-10-25 13:04:05 -04:00
Andrew Lamb a66bd4a738
feat: Implement measurement_fields gRPC route (#384)
* feat: Implement measurement_fields gRPC route

* fix: Apply suggestions from code review in github

Co-authored-by: Jake Goulding <jake.goulding@integer32.com>

* fix: apply code review comments locally

* fix: fix based on code review

Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
2020-10-23 14:01:46 -04:00
Edd Robinson ad7b177c26 feat: add column method stubs 2020-10-23 18:43:28 +01:00
Edd Robinson d53a5b95a9 feat: add nullable int column 2020-10-23 15:03:02 +01:00
Edd Robinson 0e21541ba2 feat: add support for consuming arrow array 2020-10-23 15:02:38 +01:00
Edd Robinson 53dfaf6f5e feat: create RLE columns from arrays 2020-10-23 13:41:59 +01:00
Edd Robinson 4a86f4c389 fix: ensure first rl added to column 2020-10-23 13:41:59 +01:00
Edd Robinson 2675593b35 fix: ensure dictionary only returns non-null values: 2020-10-23 13:41:59 +01:00
Edd Robinson 502773c940 feat: basic conversion of [i64] into column 2020-10-23 13:41:59 +01:00
Edd Robinson a03f536bb7
Merge pull request #382 from influxdata/er/refactor/dict-encoding
feat: improve NULL support in RLE encoding
2020-10-23 13:37:45 +01:00
Paul Dix 19911b4432 feat: implement subscriptions that for subscribers to all data
This implements only the most basic subscription mechanism, which basically makes it the same as replication at this point. It also simplifies subscriptions to not consider pull type. This will come back later, but will have to happen after the wal buffering is implemented.
2020-10-22 17:16:11 -04:00
Paul Dix 45c37b22b4
Merge pull request #379 from influxdata/pd-cluster_sequence_number
feat: add sequence number to replicated writes
2020-10-22 14:15:02 -04:00
Edd Robinson 3914db5935 feat: add support for null/non-null rows 2020-10-22 15:30:47 +01:00
Edd Robinson 806211ed1a refactor: re-work NULL support in RLE 2020-10-22 14:52:08 +01:00
Andrew Lamb c646f29794
feat: Add source checkout and initial build to docker CI image, don't use build cache (#381)
* feat: Add source checkout and initial build to docker CI image

* fix: remove tidbits
2020-10-22 05:50:36 -04:00
Andrew Lamb 0b443fdb12
feat: add --num-threads CLI argument, allow single threaded operation (#378) 2020-10-21 17:12:32 -04:00
Paul Dix 7a82fb1829 feat: add sequence number to replicated writes
This adds a sequence number to replicated writes. Sequence numbers are per databasea and kept only in memory, which means they'll reset whenever the process is restarted. It is up to the receivers of replicated writes to determine if they need to request any missed sequence numbers.
2020-10-21 16:11:49 -04:00
Edd Robinson 7ef17ccdaa feat: initialise RLE with dictionary 2020-10-21 14:01:01 +01:00
Edd Robinson daf89c7d22
Merge pull request #371 from influxdata/er/feat/dict-encoding
feat: add dictionary RLE encoding to Segment Store
2020-10-21 14:00:32 +01:00
Paul Dix c0f09901dd
Merge pull request #364 from influxdata/pd-cluster_replicate
feat: Add server id to replicated writes
2020-10-21 08:41:02 -04:00
Paul Dix d95e728e1f chore: fix merge conflicts with writer id 2020-10-21 08:33:41 -04:00
Paul Dix 57bb63717d chore: convert writer id to u32 2020-10-21 08:30:19 -04:00
Paul Dix a7bde81d8c feat: Add server id to replicated writes
Adds the server id to replicated writes. Changes type from u8 to u16 for more potential write servers. Also updates the server struct in Delorean to no longer have locks. Locking will happen higher up, likely with the server being arc_swap'd out on any configuration update.
2020-10-21 08:30:19 -04:00
Edd Robinson a663964193 refactor: add doc comment 2020-10-21 12:16:42 +01:00
Andrew Lamb 53b529fe19
refactor: Remove some uses of pub use (#377)
* refactor: Remove some uses of pub use

* fix: remove bad comment
2020-10-21 06:38:38 -04:00
Andrew Lamb b0f0f2743b
feat: Convert GroupedSeriesSetItems to GroupFrame (#368) 2020-10-21 06:13:37 -04:00
Andrew Lamb afa59f9086
fix: do not run plans in write buffer when predicates refer to columns that do not exist (#372)
* fix: do not run plans for tables in write buffer when predicates refer to columns that do not exist

* fix: Apply suggestions from code review
2020-10-20 16:40:52 -04:00
Andrew Lamb 8b1f04c79e
fix: pin the version of flatbuffers used in the dockerci image to latest release (1.12.0) rather than HEAD (#375) 2020-10-20 15:48:35 -04:00
Andrew Lamb 87f58b45cd
feat: Implement GroupedSeriesSet conversions (#367) 2020-10-20 09:42:40 -04:00
Edd Robinson 09c34567c3 feat: methods for encoded values 2020-10-20 10:54:28 +01:00
Edd Robinson ffeff09c4c feat: add methods for schema exploration 2020-10-20 10:54:28 +01:00
Edd Robinson 984ce7959d feat: add distinct_values 2020-10-20 10:54:28 +01:00
Edd Robinson a489aa1998 feat: add support materialising values 2020-10-20 10:54:28 +01:00
Edd Robinson d9e5fb36d7 refactor: support vector and bitmap row ids 2020-10-20 10:54:28 +01:00
Edd Robinson cf5d14d6ee feat: add support for filtering 2020-10-20 10:54:28 +01:00
Edd Robinson fa183371b7 test: reinstate benchmark changes 2020-10-20 10:54:28 +01:00
Edd Robinson 9e1f8d8fe4 feat: dictionary-rle shell 2020-10-20 10:54:28 +01:00
Edd Robinson fe7fc4cd54 feat: fixed encoding for non-null numerics 2020-10-20 10:54:28 +01:00
Andrew Lamb ee344c3d51
feat: Plan for computing groups (#366) 2020-10-19 14:14:43 -04:00
Andrew Lamb bfb966b1f1
feat: basic read_group plumbing (#365)
* feat: basic read_group plumbing

* fix: Update delorean_storage/src/exec.rs
2020-10-19 11:45:46 -04:00
Carol (Nichols || Goulding) 999d638b79 refactor: Extract a method to check that server ID is set 2020-10-19 10:55:18 -04:00
Paul Dix 1d56334b6b feat: Add server id to replicated writes
Adds the server id to replicated writes. Changes type from u8 to u16 for more potential write servers. Also updates the server struct in Delorean to no longer have locks. Locking will happen higher up, likely with the server being arc_swap'd out on any configuration update.
2020-10-16 16:09:14 -04:00
Carol (Nichols || Goulding) ce76513048
Merge pull request #358 from influxdata/cn/improvements 2020-10-16 14:22:37 -04:00
Carol (Nichols || Goulding) 5aa79d5aac refactor: Derive Default rather than implementing by hand 2020-10-16 14:00:53 -04:00
Carol (Nichols || Goulding) ffa8cea9d9 fix: Only compile tests modules in test mode 2020-10-16 14:00:53 -04:00
Carol (Nichols || Goulding) 7853d56780 refactor: Use impl Into<String> 2020-10-16 13:59:41 -04:00
Carol (Nichols || Goulding) 192dbd6442 fix: Remove an unneeded string allocation 2020-10-16 13:58:58 -04:00