db46ac04d0
feat: support line protocol precision parameter ( #3522 ) ( #3526 )
...
* feat: support line protocol precision parameter (#3522 )
* chore: format imports
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-25 14:12:22 +00:00
bb893510a0
feat: Add scaffolding for ingester server
...
* Adds a new ingester command to start an ingester server
* Moves previous ingester server over to handler
* Skeleton for gRPC and HTTP handlers
2022-01-21 18:02:19 -05:00
9c19cd6cc4
fix: clamp start/end of TimestampRange to min/max valid timestamp values ( #3487 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-20 16:08:00 +00:00
9751301374
refactor: rename `storage_api.rs` end to end test to `influxrpc.rs` for consistency ( #3497 )
...
* refactor: rename `storage_api` end to end test to `influxrpc` for consistency
* fix: fmt
2022-01-20 14:25:13 +00:00
168afb63ad
feat: add `size` methods to DML-related types
...
This will be helpful when we want to batch DML operations in memory
(e.g. when using RSKafka).
This also ensures that `MBChunk` accounts for the column names that
are stored within `MutableBatch`.
2022-01-18 13:52:31 +01:00
40a290f6f7
feat: router2 HTTP handlers
...
Implements the HTTP v2 write API endpoint for router2.
2022-01-17 11:57:28 +00:00
c399e676ca
chore: upgrade clap to v3
2022-01-17 12:12:46 +01:00
89db894df4
fix: serde_json `arbitrary_precision` ( #3458 ) ( #3469 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-17 09:50:54 +00:00
b036db293f
fix: Format `ParenExpression` RPC storage Expression `Node`s ( #3463 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-14 16:02:51 +00:00
36ec6019f9
feat: wire up token to query frontends
2022-01-14 10:26:11 +00:00
dd23056efd
chore: update datafusion, arrow, prost, tonic, pbjson, etc ( #3455 )
...
* chore: update datafusion, arrow, prost, tonic, etc
* fix: update pprof as well
* chore: update hakari
* fix: update pbjson
* chore: update heappy
* fix: hakari
* fix: workaround https://github.com/influxdata/influxdb_iox/issues/3458
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-13 17:07:15 +00:00
430823c148
docs: fix typo
...
Co-authored-by: Marko Mikulicic <mkm@influxdata.com>
2022-01-13 15:42:30 +00:00
3d32901877
fix: undected gzip HTTP body truncation
...
When reading the gzip-encoded body of a HTTP request, the stream is read
up until the configured maximum number of allowable bytes, at which
point the body was silently trucated. This could allow fields in
submitted line protocol to be silently lost (amongst other bad things).
This change ensures that truncation results in a RequestSizeExceeded
error.
2022-01-13 14:38:37 +00:00
7fc17203e2
refactor: add router2 server mode
...
Plumbs the router2 crate into IOx's CLI & server-runner framework.
2022-01-12 14:52:47 +00:00
a8cb8755de
feat: new router2 crate
...
This commit adds an almost-empty router2 crate containing enough of a
skeleton to plumb into the IOx CLI/server runner.
2022-01-12 14:43:10 +00:00
f3f6f335a9
chore: upgrade to snafu 0.7 ( #3440 )
2022-01-11 19:22:36 +00:00
b76921d26e
fix(influxrpc): Support _field references in front end conversion ( #3426 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-10 21:54:56 +00:00
6d20ce1f9e
feat: Allow wipe catalog in `ReplayError` and `WriteBufferCreationError` states ( #3425 )
...
* feat: feat: Allow wipe catalog in ReplayError
* fix: comments
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-07 17:07:44 +00:00
336ffd1966
refactor: Remove `Result` in QueryDatabase trait (none of the functions can fail) ( #3422 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-06 22:03:08 +00:00
a93ae739a9
feat: Add table_name to Partition API ( #3421 )
2022-01-06 16:38:39 +00:00
f9174c483b
refactor: Extract server::db into its own crate ( #3417 )
...
* refactor: Extract JobRegistry from the server crate
Both the server crate and a db crate that I'm about to extract depend on
JobRegistry, so to avoid making circular dependencies, extract the
JobRegistry to its own crate.
* refactor: Move db out of server into its own crate
Fixes #2821 .
2021-12-23 22:01:17 +00:00
2c3ca0c77c
docs: Add doc comments to all CLI subcommands ( #3414 )
...
* docs: Add doc comments to all CLI subcommands
* docs: Update influxdb_iox/src/commands/database/recover.rs
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-23 12:17:39 +00:00
5aaee1bcf4
fix: Remove some straggling references to writer ID that should be server ID ( #3415 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-22 21:05:38 +00:00
c631dd4267
refactor: address PR feedback
2021-12-21 10:23:12 +00:00
200c32cb32
feat: support all tag key predicates
2021-12-21 10:23:12 +00:00
5b277c8754
test: exercise show tag values
2021-12-17 17:59:30 +00:00
119e579fa3
feat: add support for tag values grouped by measurement and tag key
2021-12-17 17:59:30 +00:00
a68d71ef06
feat: add ability to materialise measurements
2021-12-17 17:59:30 +00:00
ebbf86dc1d
refactor: impl stub
2021-12-17 17:59:30 +00:00
3fde298a99
refactor: handle rpc
2021-12-17 17:59:30 +00:00
9f2694bf1b
test: `objest_store` azure support via Azurite
2021-12-17 09:30:21 +01:00
64f915d860
fix: flaky end to end system_tables test ( #3397 )
2021-12-17 08:13:09 +00:00
5d58b06e64
test: fix some environment variables influencing our tests
2021-12-16 11:17:36 +01:00
d8810074e8
refactor: better test action CLI
2021-12-16 09:29:25 +01:00
f4fde15810
refactor: nicer code
...
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-12-16 09:29:25 +01:00
ed775431b6
fix: treat early server worker exit as proper error
...
Instead of just logging the issue, also make sure the error gets
propagated all the way up to the exit code.
Fixes #3375 .
2021-12-16 09:29:25 +01:00
da0330fc5f
fix: print newline at end of `database list --detailed` ( #3382 )
2021-12-15 19:33:24 +00:00
758b65dd29
feat: Add database initialization state and errors to CLI and remove list_databases_detailed gRPC ( #3377 )
...
* feat: Add database initialization state and errors to CLI:
* fix: do not use optional in protobuf
* fix: clippy
* fix: correct check I broke appeasing clippy
2021-12-15 12:18:41 +00:00
7fe6897c59
refactor: add support for handling `TagValuesGroupedByMeasurementAndTagKeyRequest` ( #3373 )
...
* chore: update Storage service
* refactor: handle rpc
* refactor: log request fields
* refactor: add new RPC to client
* test: basic test of RPC
* refactor: fmt
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-14 18:42:12 +00:00
ec6d945cbe
feat: wire up general predicates to measurement_names
2021-12-13 14:01:09 +00:00
c0ba69f09e
chore: marge main to branch and resolve conflict
2021-12-09 15:40:33 -05:00
35370922f3
refactor: make a setup for 2 persisted chunks that can be used in for different places
2021-12-09 15:21:56 -05:00
3cda6b6c0f
refactor: Remove collect_query and replication ( #3348 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-09 19:58:19 +00:00
099e2d4056
chore: Apply suggestions from code review
...
Co-authored-by: Marco Neumann <marco@crepererum.net>
2021-12-09 13:52:42 -05:00
e46708354e
test: add management cli tests
2021-12-09 12:53:45 -05:00
365917c2aa
fix: Organize imports
2021-12-09 08:49:34 -05:00
471c3181bb
feat: Make a top-level influxdb_iox feature for kafka functionality
...
Thread the feature through router and server to the write buffer crate.
Move an end-to-end test that uses Kafka behind the feature flag.
2021-12-09 08:49:34 -05:00
38ce54c1be
Merge branch 'main' into crepererum/issue3336
2021-12-09 09:44:55 +00:00
efbfbb1a0b
feat: compact all object store chunks of a given partition
2021-12-08 16:06:03 -05:00
876a9af35a
fix: limit number of S3 connections
...
Otherwise the whole thing blows up when starting a server that has many
DBs registerd, because we potentially create 1 connection per DB (e.g.
to read out the preserved catalog).
Fixes #3336 .
2021-12-08 19:06:02 +01:00
Raphael Taylor-Davies
Paul Dix
Andrew Lamb
Marco Neumann
Dom
Edd Robinson
Carol (Nichols || Goulding)
Nga Tran
Carol (Nichols || Goulding)
kodiakhq[bot]