Commit Graph

1366 Commits (595d13956d98d40883415b02d6e6ce47321877f1)

Author SHA1 Message Date
Edd Robinson a088f33c35
Merge pull request #519 from influxdata/er/refactor/time-predicate
refactor: avoid requiring time predicate in Segment
2020-12-03 10:06:29 +00:00
Edd Robinson 05c420cc9e
Merge branch 'main' into er/refactor/time-predicate 2020-12-02 19:13:12 +00:00
Edd Robinson 381c3038aa
refactor: update segment_store/src/segment.rs
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2020-12-02 19:13:00 +00:00
Andrew Lamb 8cb8276819
fix: Update gRPC definitions so tag_key=_field requests work in IOx (#517)
* fix: Update gRPC definitions so tag_key=_field requests work in IOx

* docs: Update src/server/rpc.rs

* fix: fixup test

* fix: Apply suggestions from code review

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* fix: consistent type annotations

* fix: refactor redundant test code into test_helpers

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2020-12-02 13:58:48 -05:00
Edd Robinson 4dc5cc46a9 refactor: DRY up the predicate logic 2020-12-02 17:59:45 +00:00
Edd Robinson ab83288067 refactor: segment doesn't require time range 2020-12-02 17:56:59 +00:00
Andrew Lamb ecc4eee8e1
refactor: Move SQL functions into is own trait (#511)
* refactor: remove uneeded function table_to_arrow from Trait

* refactor: Move SQL functions into is own trait
2020-12-02 08:23:37 -05:00
Andrew Lamb c99d389a70
refactor: Remove vestigial gRPC IOX API (#508)
* refactor: remove unused IOx gRPC interface

* refactor: rename file

* refactor: rename gRPC service IOx to IOxTesting
2020-12-02 06:55:15 -05:00
Dom 321fa0aa28
Merge pull request #496 from influxdata/dom/separate-ci
ci: use GitHub for CI
2020-12-02 10:36:27 +00:00
Andrew Lamb 5ef499bb63
refactor: rename Database --> TSDatabase to better reflect its purpose (#510)
* refactor: rename Database --> TSDatabase to better reflect its purpose

* refactor: rename field_columns to field_column_names

* fix: clippy?
2020-12-01 12:37:11 -05:00
Andrew Lamb a2e5af1508
feat: Log gRPC predicates in a human readable form (#507)
* feat: log predicate passed to storage system

* fix: clippy
2020-12-01 09:31:39 -05:00
Dom 60f933c3f7
Merge pull request #509 from influxdata/dom/gz-flate2
chore: use flate2 everywhere
2020-12-01 11:29:19 +00:00
Dom c3a0e893ae test: use flate2 2020-12-01 11:01:10 +00:00
Dom e7fa6ab20a perf(ingest): use flate2 2020-12-01 11:01:09 +00:00
Dom 62eb6eb43e perf(influx_tsm): use flate2 2020-12-01 11:01:09 +00:00
Andrew Lamb 1646397891
refactor: consolidate GroupedSeriesSet and SeriesSet (#502) 2020-11-30 14:23:58 -05:00
Dom e7d88d7383
Merge pull request #505 from influxdata/dom/gz-flate2
perf(gzip): switch to flate2
2020-11-30 16:51:31 +00:00
Edd Robinson 7383c5aa7b
Merge pull request #504 from influxdata/er/refactor/logical_types
refactor: restrict logical scalar type
2020-11-30 16:08:22 +00:00
Dom 19b0ff284d chore(server): restrict gzip deflated body size
Restricts the size of the decompressed request body when using gzip.
2020-11-30 15:20:20 +00:00
Dom 867aba847a perf(convert): use flate2 for gzip decompression
Switches from `libflate` to `flate2` for the top-level commands (specifically
TSM conversion).
2020-11-30 15:18:25 +00:00
Edd Robinson 9dc9e505ff refactor: add From<&str> implementation for Value 2020-11-30 13:33:56 +00:00
Edd Robinson 681b0f0660 refactor: implement From trait for Value
This commit adds a set of helper `From` trait implementations for
numerical scalar types.
2020-11-30 13:28:34 +00:00
Edd Robinson dfdf7082d9 refactor: remove non-64-bit Scalar types
Supports: #501

This commit removes scalar types that are not 64-bit, since we don't
plan to expose these datatypes outside of a column.
2020-11-30 13:14:25 +00:00
Dom b17b6be0a3
Merge pull request #499 from influxdata/dom/db-name-validation
chore: validate database names
2020-11-30 13:03:53 +00:00
Edd Robinson ccc84de894 refactor: remove logical f32 type
Supports: #501

This commit removes the logical `f32` type.
2020-11-30 12:52:36 +00:00
Edd Robinson 8d1d653193 refactor: reduce set of supported logical types
Supports: #501

This commit removes logical integer types other than `i64` and `u64`.
2020-11-30 12:52:31 +00:00
Dom 37fea83ca9 test: add newline test case 2020-11-30 11:57:48 +00:00
Dom b9f933763e
Merge pull request #500 from influxdata/dom/fix-line-proto-bench
test(bench): fix bad line_parser prometheus assert
2020-11-30 11:55:55 +00:00
Dom 9fbe3e1767 test(bench): fix bad line_parser prometheus assert 2020-11-30 11:47:27 +00:00
Dom f08846ca50 chore: validate database names
Ensure database names contain only {alphanumeric, -, _} characters.

Fixes #278.
2020-11-30 11:27:33 +00:00
Andrew Lamb 20f421e9c6
fix: Do not send GroupFrames in response to read_window_aggregate (#497)
* fix: Do not send GroupFrames in response to read_window_aggregate

* fix: clippy and test
2020-11-30 05:59:05 -05:00
Dom 3cbabf0f80
docs(README): document clang requirement (#498)
Found while investigating #465 - clang is needed to build the croaring
dependency.
2020-11-27 15:32:29 -05:00
Andrew Lamb 46d58dfec5
fix: allow empty `offset` widows for read_window_aggregate offset (#493)
* fix: allow empty `offset` widows for read_window_aggregate offset

* refactor: Use an enum for clarity
2020-11-27 09:31:22 -05:00
Dom 7e1e24ca21 ci: only run CircleCI for /perf branches
Filters the triggered CircleCI workflow to only run against branches with /perf
in their name.

No changes to the scheduled build image generation.
2020-11-27 11:34:56 +00:00
Dom 9c785a3b0f ci: add GitHub actions
Adds a GitHub CI action:

    * Uses the rust-toolchain file to install the requested version.
    * Performs a build with default cargo target
    * Runs workspace tests
    * Checks cargo fmt is happy
    * Runs clippy for lints, denying warnings

All commands taken from the existing CircleCI pipeline.

Currently no caching / reuse of build container.
2020-11-27 11:34:56 +00:00
Dom da3b616368
Merge pull request #494 from influxdata/dom/extra-ci-docs
docs(ci): extra CI documentation
2020-11-26 13:49:57 +00:00
Dom e93941e487 docs(ci): extra CI documentation
Adds some extra quick-glance docs for the CI flow.
2020-11-26 13:46:07 +00:00
Edd Robinson 559df0e37c
Merge pull request #485 from influxdata/er/refactor/segment-lifetimes
refactor: remove some lifetimes
2020-11-26 11:47:42 +00:00
Andrew Lamb 129aa208ba
refactor: More use of datafusion expr building functions (#488) 2020-11-26 06:40:57 -05:00
Dom aca65414c7
Merge pull request #492 from influxdata/alamb/moar-logging
feat: Log error message returned to gRPC in IOx logs
2020-11-26 11:25:18 +00:00
Dom 9c726530ed
Merge pull request #489 from influxdata/dom/storage-fixture-random-port
test: random ports for storage fixture server
2020-11-26 10:04:11 +00:00
Andrew Lamb f825e01699 feat: log gRPC errors 2020-11-25 17:11:38 -05:00
Andrew Lamb 8908f43b43
refactor: clean up `use` statements (#487) 2020-11-25 16:14:29 -05:00
Andrew Lamb 3a9ee88f00
chore: update to latest version of arrow + update code (#486)
* chore: update to latest version of arrow + update code

* chore: Update rust toolchain to match arrow

* fix: clippy
2020-11-25 14:46:35 -05:00
Andrew Lamb 8c8af66d4d
refactor: use datafusion expression building code in write_buffer (#484) 2020-11-25 14:41:39 -05:00
Dom 49fe88fced test: random ports for storage fixture server
Rather than having to specify unique ports for test server instances, have the
kernel randomly assign ports and configure the storage gRPC client to use them.
2020-11-25 17:41:36 +00:00
Andrew Lamb 0eaa90e89d
feat: Hook up read_window_aggregate into the write_buffer, end-to-end tests (#483)
* feat: read_window_aggregate_plans

* fix: clippy sacrifice

* fix: clippy

* fix: clippy
2020-11-25 10:20:49 -05:00
Edd Robinson a260dc37b1 refactor: remove some lifetimes 2020-11-25 14:27:18 +00:00
Andrew Lamb c08744603b
refactor: Remove uneeded unwrap (#482) 2020-11-25 06:44:15 -05:00
Andrew Lamb 9f6427c94f
refactor: query/src/groupby.rs -> query/src/group_by.rs (#477)
* refactor: query/src/groupby.rs -> query/src/group_by.rs

* refactor: update references
2020-11-25 06:43:11 -05:00