71daaffce6
docs: update README config section
2021-01-12 11:35:41 +00:00
f8e74126c9
fix: source .env to display values in help text
...
Sources the .env (ignoring errors) before constructing the top-level Clap
config. This ensures any values from the .env file are loaded and displayed.
2021-01-12 11:32:43 +00:00
bdc832d040
refactor: replace config system with structopt
...
Replaces the hand-rolled config system with a StructOpt managed config struct.
I've got most of it ported across, but the interaction between all the logging
config bits is complex! I've left what is there and hooked in the value from
the config struct (which directly replaces the env var in usage, as it also
sources from the env).
2021-01-11 18:43:14 +00:00
de6c385d85
fix: Run CI checks only once on PRs, not twice ( #546 )
...
* fix: Run CI tests only once on PRs, not twice
* fix: run on pull_request rather than push
2021-01-11 12:01:07 -05:00
00bea0a388
Merge pull request #631 from influxdata/er/feat/read_buffer/select_database
...
feat: read filter API for lazily streaming out of Read Buffer
2021-01-11 16:24:31 +00:00
9ec0ae26e1
refactor: implement From<ArrayRef>
2021-01-11 16:11:21 +00:00
9eef7b4d7f
feat: add enum for selecting 'all' columns
2021-01-11 16:11:21 +00:00
61466fed44
refactor: add outline for read_aggregate
2021-01-11 16:11:21 +00:00
5a15a11a5c
feat: lazily return record batches for read_filter
2021-01-11 16:11:21 +00:00
c3019a91bd
feat: add support for determining logical column types
2021-01-11 16:11:20 +00:00
4dff270c34
Merge pull request #633 from influxdata/dom/fix-api-panic
...
fix: invalid API request body causes panic
2021-01-11 13:42:14 +00:00
f98a33bbe9
fix: invalid API request body causes panic
...
Removes a stray unwrap() that was causing a request with invalid JSON / empty
body to panic the handler thread.
Fixes #632
2021-01-11 13:25:22 +00:00
3ccb36a9ca
Merge pull request #628 from influxdata/er/feat/read_buffer/partition-map
...
feat: add partition concept to ReadBuffer
2021-01-08 21:20:12 +00:00
1d972e01c8
refactor: Update read_buffer/src/lib.rs
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-01-08 21:03:38 +00:00
23f27e10fa
feat: add partition concept to ReadBuffer
2021-01-08 21:03:38 +00:00
0ef604ad17
Merge pull request #627 from influxdata/cn/fewer-servers
2021-01-08 14:25:34 -05:00
2be992b2f6
Merge branch 'main' into cn/fewer-servers
2021-01-08 12:41:48 -05:00
b66ad643d5
refactor: Extract panic logging to its own crate for ease of reuse
2021-01-08 12:36:56 -05:00
6d0c538eca
refactor: pull DBChunk into its own module ( #623 )
...
* refactor: pull DBChunk into its own module
* refactor: consolidate impl blocks
2021-01-08 12:27:21 -05:00
6f3b5a6a9e
refactor: Alphabetize workspace members to match dir listing
2021-01-08 12:20:31 -05:00
cd03f39280
refactor: Move code in the server::server module to the root
...
This gets rid of the redundant server::server imports.
2021-01-08 12:19:58 -05:00
155485a752
refactor: Rename commands/server to commands/influxdb_ioxd
2021-01-08 12:19:16 -05:00
d2717e97c1
Merge pull request #616 from influxdata/er/feat/record-batch-read-buffer
...
feat: add support for writing chunks to ReadBuffer
2021-01-08 16:41:06 +00:00
46f85bb6a6
refactor: adrress PR comments
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: Dom <dom@itsallbroken.com>
2021-01-08 16:19:19 +00:00
4ce6821d90
feat: implement table_names on
2021-01-08 16:19:19 +00:00
590b74e386
refactor: add test for adding chunk to database
2021-01-08 16:19:19 +00:00
6df2de62bb
refactor: provide an API for table row groups
2021-01-08 16:19:19 +00:00
954da31e83
test: fix tests
2021-01-08 16:19:19 +00:00
2178a6eae4
feat: hook up record batch -> chunk to store
2021-01-08 16:19:19 +00:00
b1ab6a189d
feat: record batch -> read buffer column
2021-01-08 16:19:19 +00:00
8382501440
refactor: validate column types
2021-01-08 16:19:19 +00:00
bd226172f5
Merge pull request #547 from jeschkies/karsten/support-azure-blob-storage
...
feat: Azure support for object store
2021-01-08 16:09:43 +00:00
2cd383af6f
feat: Azure support for object store
...
Closes #528
This patch adds support for Microsfot Azure Blob storage. The
implementations requires an account, a key and container name. They can
be configured via the environment variables `AZURE_STORAGE_ACCOUNT`,
`AZURE_STORAGE_MASTER_KEY` and `AZURE_STORAGE_CONTAINER`.
2021-01-08 16:27:17 +01:00
6c626e8279
Merge pull request #624 from influxdata/cn/osp
2021-01-08 09:12:07 -05:00
93064e5fab
Merge branch 'main' into cn/osp
2021-01-08 09:00:09 -05:00
a4be6f74c7
refactor: Remove partition key from the Chunk trait ( #622 )
2021-01-08 06:11:07 -05:00
cef0bb7c98
feat: Implement starts_with on ObjectStorePath
2021-01-07 16:51:32 -05:00
535e65c02a
refactor: Use itertools' extend with the iter instead of collecting
2021-01-07 16:02:23 -05:00
91c4e26628
feat: Disallow parts of paths to be only one or two dots
2021-01-07 16:02:20 -05:00
23782dc9b7
test: Add some tests around path building and encoding
2021-01-07 16:02:10 -05:00
164c0e7357
fix: Use DELIMITER to create DELIMITER_BYTE
2021-01-07 15:23:51 -05:00
37056a1753
feat: Decode PathPart's values when Displaying
2021-01-07 15:23:32 -05:00
b421de77c4
feat: Encode characters GCS recommends avoiding
2021-01-07 14:58:58 -05:00
8219403fab
feat: Instantiate ReadBuffer as part of server creation ( #620 )
...
* feat: Instantiate ReadBuffer as part of server creation
* refactor: remove Store from read_buffer
2021-01-07 13:25:42 -05:00
c672bb341d
feat: Extract SQL planning out of databases ( #618 )
2021-01-07 13:13:30 -05:00
d17ef800c5
feat: add create and get database to API ( #619 )
...
* feat: add create and get database to API
This commit is start of the IOx specific API. It puts everything under /iox/api/v1 as this is the beginning of the IOx API. Creating a database is done with a PUT and a GET request can retrieve the DatabaseRules details.
* feat: add defaults for DatabaseRules for create_database
* feat: add create and get database to API
This commit is start of the IOx specific API. It puts everything under /iox/api/v1 as this is the beginning of the IOx API. Creating a database is done with a PUT and a GET request can retrieve the DatabaseRules details.
2021-01-07 12:25:37 -05:00
6f6631fad4
Merge pull request #611 from influxdata/pd-object-store
2021-01-07 10:56:53 -05:00
18ee1b561b
feat: Use ObjectStorePath everywhere to feel out the API needed
2021-01-07 10:48:22 -05:00
e58607f015
fix: Add more info to a test failure message
...
I had stuff in my Google storage from when I was manually testing out
how paths are handled; it was hard to see that was the problem without
this extra failure text.
2021-01-07 09:21:00 -05:00
44fb5b2b72
fix: Un-nest test modules
...
Now that the code is separated into modules, we don't need the modules
inside the test modules. So before this commit, the test names looked
like this:
```
test aws::tests::amazon_s3::s3_test_put_nonexistent_bucket ... ok
test gcp::test::google_cloud_storage::gcs_test ... ok
test disk::tests::file::length_mismatch_is_an_error ... ok
test memory::tests::in_memory::length_mismatch_is_an_error ... ok
```
and after this commit, the test names look like this:
```
test aws::tests::s3_test_put_nonexistent_bucket ... ok
test gcp::test::gcs_test ... ok
test disk::tests::length_mismatch_is_an_error ... ok
test memory::tests::length_mismatch_is_an_error ... ok
```
2021-01-07 09:20:57 -05:00
Dom
Andrew Lamb
Edd Robinson
Carol (Nichols || Goulding)
Carol (Nichols || Goulding)
Karsten Jeschkies
Paul Dix