Commit Graph

2052 Commits (566f21e569a53679c386babc5db513e971a0d00a)

Author SHA1 Message Date
kodiakhq[bot] 566f21e569
Merge pull request #980 from influxdata/fixauth
feat: Make S3 auth parameters optional
2021-03-15 09:27:43 +00:00
Marko Mikulicic 3c8a58266a
feat: Make S3 auth parameters optional
so that if not present, the aws client library can use builtin auth providers,
such as the InstanceMetadataProvider, which is commonly used to get the credentials
granted to the AWS VM via cloud native mechanism.
2021-03-15 10:11:01 +01:00
Andrew Lamb facd02a0ec
feat: configure databases created with CLI with reasonable defaults (#971)
* feat: configure databases created with `database create ...` with reasonable defaults

* fix: remove truncated comments

* fix: Apply suggestions from code review

Improve comments

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* fix:  creates a database without a mutable buffer

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-03-12 21:47:43 +00:00
Carol (Nichols || Goulding) cc8390f763 refactor: Use prost's enum helper functions for converting from ints 2021-03-12 21:10:10 +00:00
Andrew Lamb 1b36d6b0cd fix: Return Partition rather than strings 2021-03-12 20:33:39 +00:00
Andrew Lamb cd66814c3d feat: Add management API and CLI for listing partitions 2021-03-12 20:33:39 +00:00
kodiakhq[bot] b81300b36c
Merge pull request #972 from influxdata/pd-routing-rules
feat: add configuration for routing rules
2021-03-12 20:16:08 +00:00
kodiakhq[bot] fcd4419702
Merge branch 'main' into pd-routing-rules 2021-03-12 20:02:53 +00:00
Andrew Lamb f542d6216e fix: Update docs/README.md
Co-authored-by: Paul Dix <paul@influxdata.com>
2021-03-12 20:02:34 +00:00
Andrew Lamb a5a7e21840 fix: space 2021-03-12 20:02:34 +00:00
Andrew Lamb 2530be6111 docs: Add links to tech talks 2021-03-12 20:02:34 +00:00
Paul Dix 2604280476 refactor: simplify to focus on only sharding writes. routes can come later 2021-03-12 14:36:39 -05:00
kodiakhq[bot] 83e90a70ab
Merge pull request #978 from influxdata/runrun
feat: Rename server run command to just run
2021-03-12 18:49:29 +00:00
Marko Mikulicic 334fb149b1
feat: Rename server run command to just run
Closes #976
2021-03-12 18:36:04 +01:00
Raphael Taylor-Davies 7e25c4e896
feat: add fanout task tracking (#956)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-12 15:01:27 +00:00
Andrew Lamb 6fecf68bd4
feat: make CLI to listing database consistent with other commands (#974)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-12 14:43:49 +00:00
Andrew Lamb 2456bc1b28
refactor: impl Error for FieldViolation (#975) 2021-03-12 14:30:45 +00:00
Andrew Lamb 6ac7e2c1a7
feat: Add management API and CLI to list chunks (#968)
* feat: Add management API and CLI to list chunks

* fix: Apply suggestions from code review

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* fix: add comment to protobuf

* fix: fix comment

* fix: fmt, fixup merge errors

* fix: fascinating type dance with prost generated types

* fix: clippy

* fix: move command to influxdb_iox database chunk list

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-03-12 13:56:14 +00:00
Marko Mikulicic 9df4131e60 feat: Add server remote [set|remove|list] commands 2021-03-12 10:41:18 +00:00
Paul Dix 0606203b40 feat: add configuration for routing rules
This is a strawman for what routing rules might look like in DatabaseRules. Once there's a chance for discussion, I'd move next to looking at how the Server would split up an incoming write into separate FB blobs to be sent to remote IOx servers. That might change what the API/configuration looks like as that's how it would be used (at least for writes).

After that it would make sense to move to adding the proto definitions with conversions and gRPC and CLI CRUD to configure routing rules.
2021-03-11 15:25:57 -05:00
Marko Mikulicic 8029aa887d feat: Add subcommands to server 2021-03-11 16:07:42 +00:00
Raphael Taylor-Davies 0ff527285c
refactor: remove unnecessary async from DatabaseStore trait (#965)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-11 11:33:53 +00:00
Andrew Lamb af553f3b38
refactor: run some more end to end tests as tokio tests (#964)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-11 11:14:49 +00:00
Marko Mikulicic d1a8872de6 refactor: Turn server in a proper command
Turn `server` into proper command, with a `command` function in its own module, its own
error type, etc, in preparation of adding subcommands to it.
2021-03-11 09:22:12 +00:00
Raphael Taylor-Davies b8942dce0d
fix: remove unused proto files (#963)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-10 18:47:56 +00:00
Raphael Taylor-Davies 65972ccdfc
feat: remove now redundant parts of the HTTP API (#931)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-10 18:05:39 +00:00
kodiakhq[bot] 040f056fc6
Merge pull request #960 from influxdata/simplify
chore: Simplify server command
2021-03-10 17:50:38 +00:00
kodiakhq[bot] 6631e91830
Merge branch 'main' into simplify 2021-03-10 17:34:32 +00:00
Raphael Taylor-Davies d2859a99d0
feat: add google longrunning operations stubs (#959)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-10 17:34:07 +00:00
Marko Mikulicic ce3a36dd8b
chore: Simplify server command 2021-03-10 17:49:41 +01:00
kodiakhq[bot] 702c675c94
Merge pull request #940 from influxdata/servernodefault
feat: Make server no longer the default command
2021-03-10 16:06:33 +00:00
Marko Mikulicic 79105b2c50
feat: Make server no longer the default command 2021-03-10 16:49:49 +01:00
Marko Mikulicic aedd559094
Merge pull request #953 from influxdata/detectstray
test: Detect if talking to the wrong test server
2021-03-10 16:45:53 +01:00
Marko Mikulicic 5434846250
test: Detect if talking to the wrong test server
Closes #952

A pragmatic fix for #952: since we already set the server id in `wait_until_ready`,
let's start a test server without an ID (by not passing `INFLUXDB_IOX_ID`)
and use the property of already having an ID as an indication that we're talking
to a server instance that we didn't just start.

It doesn't necessarily mean we're talking to the right server, but the main point
of #952 was to avoid confusing error messages like "DatabaseAlreadyExists";
with this PR, the only way for that error to confuse developers is if we "unset" the
writer ID of a server fixture and leave it there hanging, with in-memory side effects
but no ID. Possible but unlikely, I think.
2021-03-10 16:03:02 +01:00
kodiakhq[bot] d33ddcbe9e
Merge pull request #957 from influxdata/alamb/remove_the_kill
fix: Revert "fix: Shutdown stest fixture on test harness exit"
2021-03-10 14:41:51 +00:00
Andrew Lamb 2b72890028 fix: Revert "fix: Shutdown stest fixture on test harness exit"
This reverts commit 28fe808d7e.

Not needed after https://github.com/influxdata/influxdb_iox/pull/955 is merged
2021-03-10 09:28:03 -05:00
Andrew Lamb f568c083a4
fix: Do not leave child processes around after the end-to-end test (#955) 2021-03-10 14:25:27 +00:00
Andrew Lamb 1c6d25e7d8
refactor: Port end-to-end tests that modify global state to their own fixture (#949)
* refactor: Use autogenerated ports in end-to-end.rs

* refactor: Use different fixture for tests that change writer id

* fix: clippy
2021-03-10 14:05:35 +00:00
Marko Mikulicic 1b40ca7ab5 feat: Implement CRUD for remote addresses 2021-03-10 13:39:59 +00:00
Andrew Lamb 9ebedf744f
feat: Add CLI to query the database using SQL (#943)
* feat: Add CLI to query the database using SQL

* fix: merge conflicts
2021-03-10 13:21:12 +00:00
Marko Mikulicic 28fe808d7e fix: Shutdown stest fixture on test harness exit 2021-03-10 11:31:26 +00:00
kodiakhq[bot] 9654f85cd1
Merge pull request #906 from influxdata/jgm-line-protocol-uinteger
fix(line-protocol): add unsigned integer field type
2021-03-09 21:33:20 +00:00
kodiakhq[bot] fd4af4b532
Merge branch 'main' into jgm-line-protocol-uinteger 2021-03-09 21:17:40 +00:00
Andrew Lamb 8163a31552
refactor: rework all end-to-end.rs tests to use the server fixture rather than const connection strings (#948) 2021-03-09 20:47:29 +00:00
Andrew Lamb 1af5cf8b7c
refactor: Move end-to-end test server fixture into its own module (#945)
* refactor: Move test server fixture into its own module

* fix: Update tests/end-to-end.rs

* fix: better error handling and display

* fix: tweak startup message
2021-03-09 19:08:55 +00:00
Jacob Marble 488252d9f1 fix: test 2021-03-09 07:52:52 -08:00
Jacob Marble 09c4f88758 fix: cargo fmt 2021-03-09 07:45:05 -08:00
Jacob Marble 255589cfcb fix: test error type 2021-03-09 07:29:01 -08:00
Paul Dix 706115178b
chore: remove cruft from config/database rules (#935)
The replication, query, and subscription concepts here are going to be signficiantly different. Thought it would be best to just remove this cruft for now to avoid confusion.

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-03-09 13:48:59 +00:00
Jacob Marble abb991ffca fix: add tests to unsigned integer parsing in LP and MUB 2021-03-08 15:29:05 -08:00