f8fb24b88c
refactor: Extract In-memory memory::Error
2021-02-04 13:04:52 -05:00
8e6a06ebb2
refactor: Extract Azure azure::Error
2021-02-04 13:04:52 -05:00
841f4ee314
refactor: Extract AWS S3 aws::Error
2021-02-04 13:04:52 -05:00
1492e52e57
refactor: Extract Google Cloud Storage gcp::Error
2021-02-04 13:04:52 -05:00
f795c56c8d
refactor: Start splitting up the object store error type; extract disk::Error
...
It's starting to get out of control. Time to fix that.
2021-02-04 13:04:52 -05:00
f9454fb57f
feat: Implement list_with_delimiter for File object store
...
Fixes #688 .
2021-02-04 13:04:52 -05:00
5b18f7dbea
feat: Hook DirsAndFileName push_part_as_dir to FilePath
2021-02-04 13:04:52 -05:00
a7cd8a2796
feat: Add a way to unset a file name in an object store path
2021-02-04 13:04:52 -05:00
c722188c5a
feat: Connect parts_after_prefix from DirsAndFileName to FilePath
...
This will be useful in the File object store's list_with_delimiter.
2021-02-04 13:04:52 -05:00
c66efa80d1
feat: Implement PartialOrd and Ord for FilePath
...
This allows storing FilePaths in a BTreeSet and ordering FilePaths.
2021-02-04 13:04:52 -05:00
fd39315388
refactor: Improve error name
...
I thought this only had to do with the InMemory Put request, but it's a
bit more general than that. Hopefully clarifying the purpose of this
error.
2021-02-04 13:04:52 -05:00
678044e08a
fix: test isn't a special extension recognized by object storage
...
This test was invalid because there are cases in which we use the
assumption that all file names in object storage should end with
`.json`, `.parquet`, or `.segment`.
2021-02-04 13:04:52 -05:00
13b097728f
fix: Improve code, comments and error messages for consistency ( #737 )
...
* fix: Improve code, comments and error messages for consistency
* fix: update error message
2021-02-04 12:05:24 -05:00
1ff9a3ab87
Merge pull request #741 from influxdata/listdb
...
feat: Implement list databases API
2021-02-04 17:06:47 +01:00
202a4187a1
feat: Implement list databases API
...
Ref #722
2021-02-04 16:50:40 +01:00
42de58497e
Merge pull request #742 from influxdata/routerify-error-handling
...
feat: consistent global error handling and logging
2021-02-04 15:04:25 +00:00
29314a6118
feat: consistent global error handling and logging
2021-02-04 13:15:17 +00:00
d5ebf9c3da
chore: Update deps again ( #738 )
2021-02-04 06:02:05 -05:00
6906e6bdd3
refactor: standardize erorr handling in rpc service ( #728 )
2021-02-03 14:50:00 -05:00
d66eae1a44
feat: Implement TableProvider for Trait for `Db` ( #730 )
...
* feat: Implement TableProvider for Db
Gets us selection pushdown in plans, sets us up for predicate pushdown
Includes: SendableRecordBatchStreams for mutable buffer and read buffer results
fixup snapshots
* docs: comments
2021-02-03 14:18:47 -05:00
4b524dbb35
Merge pull request #712 from influxdata/jg/flight-server
2021-02-03 10:25:51 -05:00
1f1ebefd7a
fix: Switch to database name instead of org/bucket for the Flight API
2021-02-03 10:02:06 -05:00
fc091041c5
fix: Propagate query planning error instead of unwrapping
2021-02-03 09:56:56 -05:00
b0a3ac1a65
docs: Leave a TODO note
2021-02-03 09:56:56 -05:00
19673657c2
refactor: Extract the Flight server into its own module
2021-02-03 09:56:56 -05:00
51d18e6ac7
refactor: Move GrpcService definition up a module
2021-02-03 09:56:56 -05:00
9ff2ee99d8
refactor: Move gRPC make_server up a module
2021-02-03 09:56:56 -05:00
8975b1cbf5
fix: into_iter in the assert_table_eq macro
...
This makes it so the macro can take `&[String]` or `&[&str]`.
2021-02-03 09:56:56 -05:00
39338b195b
feat: Basic scaffolding of a flight server do_get
2021-02-03 09:56:56 -05:00
95d5f759df
chore: Organize use imports
2021-02-03 09:56:56 -05:00
a5e09366b0
feat: Export arrow-flight from arrow-deps
2021-02-03 09:56:56 -05:00
4954cef08d
Merge pull request #675 from influxdata/cn+jg/osp-types
2021-02-03 09:56:30 -05:00
0f8ef9c7d5
Merge branch 'main' into cn+jg/osp-types
2021-02-03 09:09:04 -05:00
abc26a33c1
chore: Update dependencies (again) ( #718 )
...
* chore: Update dependencies (again)
* refactor: update for changes in DataFusion API
* fix: fmt
* fix: clippy
2021-02-02 18:33:01 -05:00
47101896c8
Merge pull request #719 from mkmik/editorconfig
...
style: Add editor config
2021-02-02 17:34:59 +00:00
941eb60b43
style: Add editor config
...
hopefully with some uncontroversial rules.
2021-02-02 13:28:02 +01:00
485a59b2f8
feat: Implement logfmt (Heroku) formatted log output ( #716 )
...
* feat: add option to output logs formatted via logfmt
* refactor: Apply suggestions from code review
Co-authored-by: Edd Robinson <me@edd.io>
* fix: add tests for span inclusion
* feat: Also log spans
* fix: bug in normalizer
Co-authored-by: Edd Robinson <me@edd.io>
2021-02-01 16:43:01 -05:00
5d1c7dfe82
docs: Improve descriptive code comments as suggested in review
2021-02-01 14:56:49 -05:00
5c8b351f57
fix: Address clippy suggestions
2021-02-01 14:56:49 -05:00
f9539f2b74
fix: Remove blanket trait impl now causing a stack overflow
2021-02-01 14:56:49 -05:00
ff6955a433
refactor: Extract a trait for ObjectStoreApi with associated path
...
This is the promised cleanup. This structure gets rid of a lot of
intermediate structures and encodes through associated types how the
object stores and path types are related.
The enums are still necessary to avoid having generics leak all over
the place, but the object store variants and path variants should always
match because they'll always come from the object store trait
implementations that use the associated types.
2021-02-01 14:56:47 -05:00
c40205b37e
test: Move DirsAndFileName functionality tests with the definition
2021-02-01 14:39:18 -05:00
596a73f56a
refactor: Extract a FilePath type for use in file storage
...
Enforces that on-disk storage will only ever use file paths.
More cleanup coming!
2021-02-01 14:39:18 -05:00
d39131ab49
refactor: Extract a CloudPath type for use in cloud storage
...
This is the start of using the type system to enforce that only
CloudPaths will be used with S3, GCS, and Azure.
Still some mess in here, cleanup coming.
2021-02-01 14:39:16 -05:00
7d3b4db234
fix: InMemory doesn't need pagination
2021-02-01 14:35:47 -05:00
fdbe602e57
refactor: Always get a path to build from the object store
2021-02-01 14:30:21 -05:00
5e74ae2ee7
refactor: Segments should know how to persist themselves to object storage
2021-02-01 14:30:20 -05:00
288861e646
feat: implement table_schema in partition chunk, mutable buffer, read buffer ( #705 )
...
fix: sort output schema by name
fix: Update data_types/src/schema.rs
Co-authored-by: Edd Robinson <me@edd.io>
refactor: Update read_buffer/src/lib.rs
Co-authored-by: Edd Robinson <me@edd.io>
Co-authored-by: Edd Robinson <me@edd.io>
2021-02-01 13:54:58 -05:00
9560e33c5d
Merge pull request #715 from influxdata/er/feat/read-buffer/bool
...
feat: add Boolean column support
2021-02-01 17:13:32 +00:00
2885b0528b
refactor: address PR comments
2021-02-01 16:56:56 +00:00
Carol (Nichols || Goulding)
Jake Goulding
Andrew Lamb
Marko Mikulicic
Raphael Taylor-Davies
Raphael Taylor-Davies
Carol (Nichols || Goulding)
Dom
Edd Robinson