Commit Graph

2235 Commits (081c208ad3d799ca0a35db4f2b878aadcf760197)

Author SHA1 Message Date
Carol (Nichols || Goulding) 7c6f543d35 fix: wb::ColumnValue is now a set of associated consts, not a real Rust enum 2021-03-22 09:38:58 -04:00
Carol (Nichols || Goulding) 24af745b23 chore: Upgrade to flatbuffers 0.8 2021-03-22 09:38:58 -04:00
Carol (Nichols || Goulding) aa6c21141b docs: Necessary to build flatc from source now 2021-03-22 09:38:58 -04:00
Raphael Taylor-Davies 13b97cc31d
chore: use lld on linux (#1022)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-22 10:13:43 +00:00
Raphael Taylor-Davies a19c1cd3d6
chore: install lld in CI image and remove musl (#1024)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-19 17:38:45 +00:00
Marko Mikulicic 7f9bb1dbc2 chore: Add debuginfo=0 to CI builds 2021-03-19 17:12:26 +00:00
Andrew Lamb 6e1795fda0
refactor: Move some types (not yet exposed to clients) into internal_types (#1015)
* refactor: Move some types (not yet exposed to clients) into internal_types

* docs: Add README.md explaining the rationale

* refactor: remove some stragglers

* fix: fix benches

* fix: Apply suggestions from code review

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* fix: add clippy lints

* fix: fmt

* docs: Apply suggestions from code review

fix typos

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-19 16:27:57 +00:00
Raphael Taylor-Davies 7e6c6d67b4
feat: graceful shutdown (#827) (#1018)
* feat: graceful shutdown (#827)

* chore: additional docs

* chore: further docs

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-19 15:36:49 +00:00
kodiakhq[bot] 33468698c9
Merge pull request #1021 from influxdata/alamb/fix_compiler_arm64
fix: remove unneeded cpu feature check
2021-03-19 14:50:35 +00:00
Andrew Lamb eca9ef7bdd fix: remove unneded cpu feature check 2021-03-19 09:40:39 -04:00
Andrew Lamb 0c383b27ac
chore: Improve use of logging macros in storage service (#1011) 2021-03-18 12:47:57 +00:00
Raphael Taylor-Davies dd94a33bc7
feat: retain limited tracker history (#1005) 2021-03-17 16:32:34 +00:00
Andrew Lamb 3a53923684
feat: Management API + CLI command to close a chunk and move to read buffer (#1002)
* feat: Management API + CLI command to close a  chunk and move to read buffer

* refactor: Less copy-pasta

* fix: track only once, use `let _` instead of `.ok()`

* docs: Apply suggestions from code review

fix comments ( 🤦‍♀️  for copy/pasta)

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* docs: Update server/src/lib.rs

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* refactor: Use DatabaseName rather than impl Into<String>

* fix: Fixup logical merge conflicts

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-03-17 15:25:27 +00:00
Raphael Taylor-Davies 1fee56274b
fix: prevent observing inconsistent tracker states (#994)
* fix: prevent observing inconsistent tracker states

* feat: further tracker docs

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-17 14:28:54 +00:00
Raphael Taylor-Davies 4b98d19d70
refactor: remove interior mutability from TrackerRegistry (#1004)
* refactor: remove interior mutability from TrackerRegistry

* fix: don't hold mutex across await point

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-17 12:58:27 +00:00
Aakash Hemadri 0a5257deea
refactor: Fix `setup` model and `setup` test
Signed-off-by: Aakash Hemadri <aakashhemadri123@gmail.com>
2021-03-17 10:12:16 +05:30
Aakash Hemadri 6134915f27
refactor: Fix `setup` tests for influxdb_client
Signed-off-by: Aakash Hemadri <aakashhemadri123@gmail.com>
2021-03-17 10:12:16 +05:30
Aakash Hemadri c876c18961
feat: Add support for setup API to influxdb_client
- Check if database has default user, org, bucket
- Set up initial user, org and bucket
- Set up a new user, org and bucket

- Add examples and test
- Add necessary models

Signed-off-by: Aakash Hemadri <aakashhemadri123@gmail.com>
2021-03-17 10:12:09 +05:30
kodiakhq[bot] 580298e0b2
Merge pull request #1003 from influxdata/alamb/update_arrow
chore: update deps (including arrow)
2021-03-16 22:40:30 +00:00
Andrew Lamb 2f77090ecf fix: clippy/fmt 2021-03-16 18:16:48 -04:00
Andrew Lamb 72eff5eed5 chore: update deps (including arrow) 2021-03-16 18:15:44 -04:00
Andrew Lamb ef9c3f3d8f
feat: Management API + CLI command to list chunks in a partition (#995)
* feat: Management API + CLI command to list chunks in a partition

For ease of use

* refactor: remove unecessary Result
2021-03-16 20:10:55 +00:00
Raphael Taylor-Davies 3fe1b8c5b7
feat: add longrunning operations client (#981)
refactor: add separate format feature influxdb_iox_client

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-16 13:19:44 +00:00
Aakash Hemadri 9c112b9872
feat: Add support for ready API to influxdb_client (#999)
Get the readiness of an instance at startup

Signed-off-by: Aakash Hemadri <aakashhemadri123@gmail.com>

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-16 13:06:20 +00:00
Andrew Lamb 51304fd138
docs: Add README for influxdb_client (#996)
* docs: Add README for influxdb_client

* docs: Update influxdb2_client/README.md

Co-authored-by: Paul Dix <paul@influxdata.com>

* docs: Apply suggestions from code review

Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>

Co-authored-by: Paul Dix <paul@influxdata.com>
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-16 12:53:01 +00:00
Andrew Lamb a3c146a38e
docs: Update README.md to refer to the command and CLI help (#982)
* docs: Update README.md to refer to the command and CLI help

* docs: Apply suggestions from code review

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-03-16 12:40:40 +00:00
Andrew Mitchell 275075fd72 fix: Send a 404 for db not found write requests 2021-03-15 19:30:46 -04:00
Marko Mikulicic 58b01b4ad3 fix: Add ca-certificates to iox docker image 2021-03-15 16:53:42 +00:00
Andrew Lamb 4781317647
feat: Management API + CLI command to create a new chunk (rollover partition) (#990)
* feat: Management API + CLI command to create a new chunk (rollover partition)

* fix: Update tests/end_to_end_cases/management_api.rs

fix typo

* fix: logical merge conflict

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-15 16:41:18 +00:00
Raphael Taylor-Davies 65f7a1ac5b
fix: use consistent crate versions (#989)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-15 15:42:19 +00:00
Marko Mikulicic 8bd7a39607 fix: Use InstanceMetadataProvider directly
Rusoto's ChainProvider swallows the error message produced by the underlying InstanceMetadataProvider
(see d59d716f09/rusoto/credential/src/lib.rs (L397)) making it hard for us to know why it's not working in our staging cluster.
2021-03-15 13:55:43 +00:00
Andrew Lamb 91a92e668a
refactor: complete migration of end-to-end.rs test to use #[tokio::test] (#987)
* refactor: pull Scenario code out of main module

* refactor: break out http into tests

* refactor: use random org_id and bucket_id

* refactor: port read_api to be indepndent

* refactor: port last test

* refactor: convenience methods to create different clients in end-to-end tests

* fix: improve comments

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-15 13:13:55 +00:00
kodiakhq[bot] 566f21e569
Merge pull request #980 from influxdata/fixauth
feat: Make S3 auth parameters optional
2021-03-15 09:27:43 +00:00
Marko Mikulicic 3c8a58266a
feat: Make S3 auth parameters optional
so that if not present, the aws client library can use builtin auth providers,
such as the InstanceMetadataProvider, which is commonly used to get the credentials
granted to the AWS VM via cloud native mechanism.
2021-03-15 10:11:01 +01:00
Andrew Lamb facd02a0ec
feat: configure databases created with CLI with reasonable defaults (#971)
* feat: configure databases created with `database create ...` with reasonable defaults

* fix: remove truncated comments

* fix: Apply suggestions from code review

Improve comments

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* fix:  creates a database without a mutable buffer

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-03-12 21:47:43 +00:00
Carol (Nichols || Goulding) cc8390f763 refactor: Use prost's enum helper functions for converting from ints 2021-03-12 21:10:10 +00:00
Andrew Lamb 1b36d6b0cd fix: Return Partition rather than strings 2021-03-12 20:33:39 +00:00
Andrew Lamb cd66814c3d feat: Add management API and CLI for listing partitions 2021-03-12 20:33:39 +00:00
kodiakhq[bot] b81300b36c
Merge pull request #972 from influxdata/pd-routing-rules
feat: add configuration for routing rules
2021-03-12 20:16:08 +00:00
kodiakhq[bot] fcd4419702
Merge branch 'main' into pd-routing-rules 2021-03-12 20:02:53 +00:00
Andrew Lamb f542d6216e fix: Update docs/README.md
Co-authored-by: Paul Dix <paul@influxdata.com>
2021-03-12 20:02:34 +00:00
Andrew Lamb a5a7e21840 fix: space 2021-03-12 20:02:34 +00:00
Andrew Lamb 2530be6111 docs: Add links to tech talks 2021-03-12 20:02:34 +00:00
Paul Dix 2604280476 refactor: simplify to focus on only sharding writes. routes can come later 2021-03-12 14:36:39 -05:00
kodiakhq[bot] 83e90a70ab
Merge pull request #978 from influxdata/runrun
feat: Rename server run command to just run
2021-03-12 18:49:29 +00:00
Marko Mikulicic 334fb149b1
feat: Rename server run command to just run
Closes #976
2021-03-12 18:36:04 +01:00
Raphael Taylor-Davies 7e25c4e896
feat: add fanout task tracking (#956)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-12 15:01:27 +00:00
Andrew Lamb 6fecf68bd4
feat: make CLI to listing database consistent with other commands (#974)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-12 14:43:49 +00:00
Andrew Lamb 2456bc1b28
refactor: impl Error for FieldViolation (#975) 2021-03-12 14:30:45 +00:00
Andrew Lamb 6ac7e2c1a7
feat: Add management API and CLI to list chunks (#968)
* feat: Add management API and CLI to list chunks

* fix: Apply suggestions from code review

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* fix: add comment to protobuf

* fix: fix comment

* fix: fmt, fixup merge errors

* fix: fascinating type dance with prost generated types

* fix: clippy

* fix: move command to influxdb_iox database chunk list

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-03-12 13:56:14 +00:00