485a59b2f8
feat: Implement logfmt (Heroku) formatted log output ( #716 )
...
* feat: add option to output logs formatted via logfmt
* refactor: Apply suggestions from code review
Co-authored-by: Edd Robinson <me@edd.io>
* fix: add tests for span inclusion
* feat: Also log spans
* fix: bug in normalizer
Co-authored-by: Edd Robinson <me@edd.io>
2021-02-01 16:43:01 -05:00
5d1c7dfe82
docs: Improve descriptive code comments as suggested in review
2021-02-01 14:56:49 -05:00
5c8b351f57
fix: Address clippy suggestions
2021-02-01 14:56:49 -05:00
f9539f2b74
fix: Remove blanket trait impl now causing a stack overflow
2021-02-01 14:56:49 -05:00
ff6955a433
refactor: Extract a trait for ObjectStoreApi with associated path
...
This is the promised cleanup. This structure gets rid of a lot of
intermediate structures and encodes through associated types how the
object stores and path types are related.
The enums are still necessary to avoid having generics leak all over
the place, but the object store variants and path variants should always
match because they'll always come from the object store trait
implementations that use the associated types.
2021-02-01 14:56:47 -05:00
c40205b37e
test: Move DirsAndFileName functionality tests with the definition
2021-02-01 14:39:18 -05:00
596a73f56a
refactor: Extract a FilePath type for use in file storage
...
Enforces that on-disk storage will only ever use file paths.
More cleanup coming!
2021-02-01 14:39:18 -05:00
d39131ab49
refactor: Extract a CloudPath type for use in cloud storage
...
This is the start of using the type system to enforce that only
CloudPaths will be used with S3, GCS, and Azure.
Still some mess in here, cleanup coming.
2021-02-01 14:39:16 -05:00
7d3b4db234
fix: InMemory doesn't need pagination
2021-02-01 14:35:47 -05:00
fdbe602e57
refactor: Always get a path to build from the object store
2021-02-01 14:30:21 -05:00
5e74ae2ee7
refactor: Segments should know how to persist themselves to object storage
2021-02-01 14:30:20 -05:00
288861e646
feat: implement table_schema in partition chunk, mutable buffer, read buffer ( #705 )
...
fix: sort output schema by name
fix: Update data_types/src/schema.rs
Co-authored-by: Edd Robinson <me@edd.io>
refactor: Update read_buffer/src/lib.rs
Co-authored-by: Edd Robinson <me@edd.io>
Co-authored-by: Edd Robinson <me@edd.io>
2021-02-01 13:54:58 -05:00
9560e33c5d
Merge pull request #715 from influxdata/er/feat/read-buffer/bool
...
feat: add Boolean column support
2021-02-01 17:13:32 +00:00
2885b0528b
refactor: address PR comments
2021-02-01 16:56:56 +00:00
d44099d242
refactor: update read_buffer/src/column/bool.rs
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-02-01 15:17:51 +00:00
7e1ac34906
refactor: recordbatch boolean -> Bool
2021-02-01 12:29:04 +00:00
172c8d146c
refactor: wire up bool encoding to read buffer column
2021-02-01 12:02:14 +00:00
36d9541cbc
feat: an arrow-backed boolean encoding
2021-02-01 12:02:14 +00:00
0dae29f9ea
Merge pull request #714 from influxdata/er/fix/read_buffer/arrow_fixed_null
...
refactor: wire up nullable column encodings
2021-02-01 12:01:38 +00:00
679e04fdb3
refactor: remove redundant From implementations
2021-02-01 10:52:27 +00:00
42e2178110
refactor: simpify arrow -> read buffer column
2021-01-31 21:19:18 +00:00
28b596b883
refactor: wire up fixed null encoding
2021-01-31 21:12:47 +00:00
0195dfc03a
test: add coverage for NULL values in queries
2021-01-31 21:12:06 +00:00
172d95a5b2
Merge pull request #713 from influxdata/er/refactor/read_buffer/enable-simple-aggs
...
feat: aggregates without group keys
2021-01-31 20:36:20 +00:00
4d107334dd
test: adjust number of rows
2021-01-31 12:01:26 +00:00
0bed5e2290
refactor: update read_buffer/src/row_group.rs
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-01-31 11:55:04 +00:00
02c154c746
refactor: min/max support
2021-01-30 22:58:39 +00:00
9cc9c714ed
refactor: wire up sum
2021-01-30 22:42:58 +00:00
fd25b6a9e2
refactor: wire up aggregate count
2021-01-30 21:01:25 +00:00
75a2e1caff
refactor: results can just contain aggregates
2021-01-30 10:02:03 +00:00
07ac73a9d6
Merge pull request #710 from influxdata/er/feat/read_buffer/concurrent
...
feat: Read Buffer safe for concurrent access
2021-01-29 22:19:17 +00:00
a71d3eea86
refactor: address PR feedback
2021-01-29 22:01:51 +00:00
3bb58fe971
refactor: tidy up commented code
2021-01-29 22:01:51 +00:00
46f20df089
refactor: change Rc -> Arc
2021-01-29 22:01:51 +00:00
ec10c81041
refactor: simplify chunk locking implementation
2021-01-29 22:01:51 +00:00
6b6c1476f6
refactor: implement table meta-data rebuilding
2021-01-29 22:01:51 +00:00
13cbc12298
feat: make database support concurrent access
2021-01-29 22:01:51 +00:00
bc08c6b404
feat: support concurrent access to Chunk
2021-01-29 22:01:51 +00:00
30b90943bc
feat: make Table concurrent-safe
2021-01-29 22:01:51 +00:00
050185ad92
refactor: ensure meta updated when rowgroup add/removed
2021-01-29 22:01:51 +00:00
338bbb9b55
refactor: materialise rb for read_aggregate at table
2021-01-29 22:01:51 +00:00
e3afab12a7
refactor: rb from table read_filter
2021-01-29 22:01:51 +00:00
9d3c623a14
refactor: baseline Rc
2021-01-29 22:01:51 +00:00
f3bd8bd0e3
chore: update deps (tokio 1.0 and ecosystem) ( #707 )
...
* chore: Update arrow + tokio deps
* chore: Use bleeding edge azure
* chore: Update aws + other deps
* fix: fmt
* fix: Switch to in-house version of routerify
* fix: Upgrade to hyper 0.14
The hyper::error module is now private; hyper::Error is the public
re-export
* fix: Upgrade cloud storage to get tokio upgrade
* fix: Upgrade open_telemetry
* fix: Do not call `panic::set_hook` during another panic
Doing so leads to a double panic which aborts the process.
* fix: new h2 error who dis
Co-authored-by: Carol (Nichols || Goulding) <carol.nichols@integer32.com>
Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
2021-01-29 16:11:55 -05:00
2282a68e65
refactor: Move selection to the data_types crate and remove redundant implemenation ( #704 )
2021-01-29 13:35:07 -05:00
81494e351e
Merge pull request #706 from influxdata/cn/end-to-end-refactor
2021-01-29 08:50:36 -05:00
deaeff0173
refactor: Extract smaller functions for grpc tests
...
This makes it easier to see what's being tested and zero in on what
you're interested in rather than needing to scroll and scan through a
lot of code in the main test.
2021-01-29 08:34:28 -05:00
8ade506a0c
refactor: Extract independent test helper functions to separate files
2021-01-29 08:34:28 -05:00
41e0fff039
refactor: Extract gRPC read group and read window agg tests because they manage their own data
2021-01-29 08:34:28 -05:00
cfe18e3e61
refactor: Extract a method to create gRPC ReadSource to the Scenario
2021-01-29 08:34:28 -05:00
Andrew Lamb
Carol (Nichols || Goulding)
Edd Robinson
Carol (Nichols || Goulding)