Commit Graph

81 Commits (8e9dd227534f57e607c7d6b89fad055bde6e02fe)

Author SHA1 Message Date
Carol (Nichols || Goulding) c7ef18337c feat: Consolidate all bucket config into one option/env var
Fixes #869.
2021-02-25 15:53:20 -05:00
Marko Mikulicic 9e521a2ea1 feat: Plug GCS list_with_delimiter impl
And fix env.example. Now GCS can be used to persist snapshots.
2021-02-23 21:06:53 +00:00
Marko Mikulicic 9860def4b2 feat: Add S3 plumbing to iodx config 2021-02-23 14:55:55 +00:00
Andrew Lamb dd0810c18d
docs: Refer to the example env file and clarify comments (#851)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-02-22 19:42:30 +00:00
Carol (Nichols || Goulding) 54ecaaa7a6 docs: Restore the example .env file and add Azure variables 2021-02-18 16:53:06 -05:00
Andrew Lamb 16f2fbcb6d
docs: Improve style guide about using Snafu (#695) 2021-01-27 14:57:59 -05:00
Andrew Lamb 8c0ce0b2ce
docs: Add query README file and explain some rationale (#648)
* docs: Add query README file

* fix: Apply suggestions from code review

Co-authored-by: Edd Robinson <me@edd.io>

Co-authored-by: Edd Robinson <me@edd.io>
2021-01-12 18:26:32 -05:00
Andrew Lamb 9f0ff678f1
feat: Formalizes the config system for IOx, including tests (#608)
* feat: Create configuration system, port IOx to use it

* docs: Apply suggestions from code review

Co-authored-by: Paul Dix <paul@influxdata.com>

* fix: fix test for setting values

Co-authored-by: Paul Dix <paul@influxdata.com>
2020-12-31 07:02:31 -05:00
Andrew Lamb 47c6763f24
docs: Add documentation about data life cycle (#578) 2020-12-18 13:33:35 -05:00
Andrew Lamb 463a20202e
docs: Add reference to docs directory and a table of contents (#577) 2020-12-18 12:39:38 -05:00
Paul Dix 70ff4267ce
chore: Connect server crate to http routes and server command (#569)
* chore: Connect server crate to http routes and server command

This updates the http_routes and main server to use the Server crate. This is the first step in a larger effort to start hooking up the initial IOx API and get things running end to end with in-memory database, WAL buffer, and object storage.

For the time being, this disables the previous disk based WAL. Or rather, it uses the WriteBufferDb without it. That means that this IOx server has no persistence until later. Because of this, the restart in the end-to-end was removed.

Later PRs will add the WAL buffer and restart logic that loads from object store. We can opt to bring the local disk based WAL back later, but it will likely require some refactoring to work with how the WAL Buffer will operate.
2020-12-17 18:48:41 -05:00
Dom 41f5099691 refactor: compile out trace! level for release builds
Configures the IOx tracing to compile out trace!() level events in the release
binary. This effectively gives contributors three levels of output:

* Important to the user (info & friends)
* Not important for regular running, but needed to debug
* Only useful to devs in a specific part of the system, never seen by user

Documents this behaviour (and general usage guidelines) for contributors.
2020-12-14 12:06:53 +00:00
Dom 80da024212 docs(tracing): add IOx tracing usage doc
Describes the components involved in, and usage of the tracing system in IOx.
2020-12-14 12:06:53 +00:00
Brandon Sov 989d0ecad8 refactor: set valid format for default s3 bucket name example 2020-12-08 23:42:27 -08:00
Andrew Lamb a03eb6e8f7
docs: Add mentions of `unsafe` and platform dependent compilation in style guide (#472) 2020-11-23 11:14:33 -05:00
Carol (Nichols || Goulding) 572ff1947a
Merge pull request #428 from influxdata/back-to-the-future 2020-11-10 12:00:27 -05:00
Carol (Nichols || Goulding) c096682ab8 fix: Improve docs based on feedback from @rbetts 2020-11-10 11:53:44 -05:00
Carol (Nichols || Goulding) 05b60b8fd0 fix: Remove remaining mentions of Delorean 2020-11-10 11:47:42 -05:00
Carol (Nichols || Goulding) 920fd6df3f docs: Improve env example
- Remove `-` so you can use your editor's uncomment feature
- Add the env vars to customize the server addresses
- Document a bit more
2020-11-10 11:23:37 -05:00
Andrew Lamb 0532821ed9
chore: Make the project root neat and tidy (#416)
* chore: move example env file into docs

* chore: move dockerfiles out of root

* chore: move storectl-bench.sh into benches
2020-11-10 10:00:22 -05:00
alamb e3a3a4add3 docs: add note about using synchronous I/O and notes from @stuartcarnie on backpressure 2020-07-13 10:35:28 -04:00
alamb 2dca85069f fix: clarify some points 2020-07-13 10:35:28 -04:00
Andrew Lamb 97cbcac370 fix: Update docs/multi_core_tasks.md
Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
2020-07-13 10:35:28 -04:00
Andrew Lamb 5e256f3722 fix: Apply suggestions from code review
Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
2020-07-13 10:35:28 -04:00
alamb 2ecfcbaae0 docs: Add worked example and caveats about priority scheduling 2020-07-13 10:35:28 -04:00
Andrew Lamb 646a244c08 fix: Apply suggestions from code review
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2020-07-13 10:35:28 -04:00
alamb 6a5854bbc3 docs: writeup multi core tasks architecture 2020-07-13 10:35:28 -04:00
alamb eee1e9fe77 fix: Setup parquet column encoding correctly 2020-06-23 09:54:16 -04:00
Andrew Lamb 2a42df278a
docs: Initial style guide with idomatic error handling (#174)
* docs: Initial style guide with idomatic error handling

* fix: Apply suggestions from code review

Co-authored-by: Paul Dix <paul@influxdata.com>

* fix: Apply suggestions from code review

Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* fix: clean up example 

To not to use different field name

Co-authored-by: Paul Dix <paul@influxdata.com>
Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2020-06-22 16:41:36 -04:00
Andrew Lamb 7190b07b83
fix: Add additional encoding thoughts to doc (#151) 2020-06-15 10:33:02 -04:00
Andrew Lamb 4a0b2cd671
doc: Initial file encoding thoughts (#88) 2020-05-22 17:28:24 -04:00