Paul Dix
4764e71c54
feat: Add initial iox_catalog skeleton
2022-01-17 09:56:20 -05:00
kodiakhq[bot]
c59c17b2f2
Merge pull request #3468 from influxdata/dom/http-handlers
...
feat(router2): http write handler
2022-01-17 12:08:23 +00:00
Dom
1b7369e743
docs: fix broken doc link
2022-01-17 11:57:32 +00:00
Dom
7badf37250
refactor: db_name -> namespace
...
Renames all "database name" references to "namespace".
2022-01-17 11:57:32 +00:00
Dom
885c831aff
refactor: avoid constructing DmlOperation
...
Instead of converting the set of MutableBatches into a DmlOperation to
shard into more DmlOperation instances, the sharder can operate directly
on the MutableBatches.
2022-01-17 11:57:32 +00:00
Dom
7f99d18dd1
refactor: clippy
2022-01-17 11:57:31 +00:00
Dom
40a290f6f7
feat: router2 HTTP handlers
...
Implements the HTTP v2 write API endpoint for router2.
2022-01-17 11:57:28 +00:00
Dom
80b12d417c
feat: abstract DML handler
...
Defines the DmlHandler trait responsible for processing a request in
some abstract way, decoupling the HTTP/gRPC request handlers from the
underlying routing logic.
2022-01-17 11:56:04 +00:00
kodiakhq[bot]
da35abfc8a
Merge pull request #3470 from influxdata/crepererum/clap_v3
...
chore: upgrade clap to v3
2022-01-17 11:21:11 +00:00
Marco Neumann
c399e676ca
chore: upgrade clap to v3
2022-01-17 12:12:46 +01:00
Raphael Taylor-Davies
89db894df4
fix: serde_json `arbitrary_precision` ( #3458 ) ( #3469 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-17 09:50:54 +00:00
Andrew Lamb
b036db293f
fix: Format `ParenExpression` RPC storage Expression `Node`s ( #3463 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-14 16:02:51 +00:00
kodiakhq[bot]
8e2e9b9082
Merge pull request #3464 from influxdata/dom/empty-org-bucket
...
fix: reject empty org & bucket
2022-01-14 14:17:45 +00:00
Dom
5cce69b481
fix: reject empty org & bucket
...
Previously a request that specified an empty org & bucket value would be
mapped to a database named "_".
This commit changes the org/bucket mapping fn to return an error if
either org or bucket is empty.
2022-01-14 12:17:26 +00:00
kodiakhq[bot]
e1d7b71d6a
Merge pull request #3460 from influxdata/er/feat/query_duration
...
feat: add query completion duration to queries system table
2022-01-14 10:49:36 +00:00
Edd Robinson
cdb4f43d62
refactor: address feedback
2022-01-14 10:41:27 +00:00
Edd Robinson
9283432a0f
refactor: display as ns
2022-01-14 10:26:11 +00:00
Edd Robinson
36ec6019f9
feat: wire up token to query frontends
2022-01-14 10:26:11 +00:00
Edd Robinson
0b343bcf19
feat: add RAII token to time query completion
2022-01-14 10:26:11 +00:00
Edd Robinson
6a842fc105
feat: add completed duration to system table
2022-01-14 10:26:11 +00:00
Edd Robinson
211bee5886
feat: add support for setting complete time
2022-01-14 10:26:11 +00:00
Edd Robinson
d1816b662f
chore: update rust to 1.58 ( #3461 )
...
* chore: update rust to 1.58
* fix: clippy
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
2022-01-13 21:12:46 +00:00
Andrew Lamb
957276faa1
fix: reduce "nothing to do" lifecycle messages from from debug to trace ( #3449 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-13 19:04:47 +00:00
Andrew Lamb
dd23056efd
chore: update datafusion, arrow, prost, tonic, pbjson, etc ( #3455 )
...
* chore: update datafusion, arrow, prost, tonic, etc
* fix: update pprof as well
* chore: update hakari
* fix: update pbjson
* chore: update heappy
* fix: hakari
* fix: workaround https://github.com/influxdata/influxdb_iox/issues/3458
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-13 17:07:15 +00:00
Andrew Lamb
cdf5c21cd4
fix: Fix max timestamp value comparison in chunk metadata ( #3453 )
...
* fix: Fix max timestamp value comparison in chunk metadata
* refactor: rename contains to overlaps
Co-authored-by: Edd Robinson <me@edd.io>
2022-01-13 16:58:30 +00:00
kodiakhq[bot]
576552cc36
Merge pull request #3456 from influxdata/dom/truncated-lp
...
fix: undetected gzip HTTP body truncation
2022-01-13 15:50:27 +00:00
Dom
430823c148
docs: fix typo
...
Co-authored-by: Marko Mikulicic <mkm@influxdata.com>
2022-01-13 15:42:30 +00:00
Dom
3d32901877
fix: undected gzip HTTP body truncation
...
When reading the gzip-encoded body of a HTTP request, the stream is read
up until the configured maximum number of allowable bytes, at which
point the body was silently trucated. This could allow fields in
submitted line protocol to be silently lost (amongst other bad things).
This change ensures that truncation results in a RequestSizeExceeded
error.
2022-01-13 14:38:37 +00:00
Andrew Lamb
a750da43f1
test: Reproducer for #3428 ( #3429 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-13 11:44:39 +00:00
kodiakhq[bot]
ecdb0165d1
Merge pull request #3446 from influxdata/dom/router2
...
feat: router2 skeleton
2022-01-12 17:00:25 +00:00
Dom
b9bee7f735
build: update workspace-hack
2022-01-12 15:09:06 +00:00
Dom
7fc17203e2
refactor: add router2 server mode
...
Plumbs the router2 crate into IOx's CLI & server-runner framework.
2022-01-12 14:52:47 +00:00
Dom
a8cb8755de
feat: new router2 crate
...
This commit adds an almost-empty router2 crate containing enough of a
skeleton to plumb into the IOx CLI/server runner.
2022-01-12 14:43:10 +00:00
Raphael Taylor-Davies
c5cf03511c
fix: parquet column count statistics ( #2124 ) ( #3444 )
...
* fix: parquet metadata total_count (#2124 )
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-11 21:56:24 +00:00
Andrew Lamb
530240cb5a
chore: Update datafusion dependency ( #3443 )
2022-01-11 20:08:25 +00:00
Marco Neumann
f3f6f335a9
chore: upgrade to snafu 0.7 ( #3440 )
2022-01-11 19:22:36 +00:00
kodiakhq[bot]
0c5664fada
Merge pull request #3432 from influxdata/crepererum/cargo_update
...
chore: `cargo update`
2022-01-11 14:06:14 +00:00
Marco Neumann
37bb7f2120
chore: `cargo update`
...
dependabot currently doesn't work due to
https://github.com/dependabot/dependabot-core/issues/4574
Excluded `quote` due to
https://github.com/dtolnay/quote/issues/204
2022-01-11 14:57:51 +01:00
kodiakhq[bot]
d894b3b991
Merge pull request #3435 from influxdata/crepererum/fix_ci
...
ci: use CLI-driven SSH for cargo
2022-01-11 10:48:01 +00:00
Marco Neumann
328286029f
ci: use CLI-driven SSH for cargo
...
Workaround for <https://github.com/rust-lang/cargo/issues/10280 >.
2022-01-11 11:38:02 +01:00
Andrew Lamb
b76921d26e
fix(influxrpc): Support _field references in front end conversion ( #3426 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-10 21:54:56 +00:00
Raphael Taylor-Davies
479276b8cd
docs: document ingest flow ( #3418 )
...
* docs: document ingest flow
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-07 17:37:30 +00:00
Andrew Lamb
80c048528c
refactor: Clean up code by using `lit` and `lit_timestamp_nano` rather than `Expr::Literal(ScalarValue(Some(...)))` ( #3427 )
2022-01-07 17:23:14 +00:00
Andrew Lamb
6d20ce1f9e
feat: Allow wipe catalog in `ReplayError` and `WriteBufferCreationError` states ( #3425 )
...
* feat: feat: Allow wipe catalog in ReplayError
* fix: comments
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-07 17:07:44 +00:00
Andrew Lamb
336ffd1966
refactor: Remove `Result` in QueryDatabase trait (none of the functions can fail) ( #3422 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-06 22:03:08 +00:00
Andrew Lamb
8d732ad78c
refactor: Split database.rs into smaller modules ( #3424 )
...
* refactor: Split database.rs into smaller modules
* fix: clippy
2022-01-06 21:42:36 +00:00
Andrew Lamb
a93ae739a9
feat: Add table_name to Partition API ( #3421 )
2022-01-06 16:38:39 +00:00
Raphael Taylor-Davies
5b71306423
chore: lint markdown docs and use relative code references in docs ( #3420 )
...
* chore: lint markdown docs
docs: relative source file references in markdown docs
* chore: review feedback
2022-01-04 09:50:13 +00:00
Carol (Nichols || Goulding)
f9174c483b
refactor: Extract server::db into its own crate ( #3417 )
...
* refactor: Extract JobRegistry from the server crate
Both the server crate and a db crate that I'm about to extract depend on
JobRegistry, so to avoid making circular dependencies, extract the
JobRegistry to its own crate.
* refactor: Move db out of server into its own crate
Fixes #2821 .
2021-12-23 22:01:17 +00:00
Andrew Lamb
527885f7f8
chore: Update datafusion ( #3413 )
...
* chore: Update datafusion and update code to handle timezone aware timestamps
* fix: cargo hakari
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-23 14:52:12 +00:00