Commit Graph

6519 Commits (4764e71c547a30aee5cd8c179d625624c1b5cfa4)

Author SHA1 Message Date
Paul Dix 4764e71c54 feat: Add initial iox_catalog skeleton 2022-01-17 09:56:20 -05:00
kodiakhq[bot] c59c17b2f2
Merge pull request #3468 from influxdata/dom/http-handlers
feat(router2): http write handler
2022-01-17 12:08:23 +00:00
Dom 1b7369e743 docs: fix broken doc link 2022-01-17 11:57:32 +00:00
Dom 7badf37250 refactor: db_name -> namespace
Renames all "database name" references to "namespace".
2022-01-17 11:57:32 +00:00
Dom 885c831aff refactor: avoid constructing DmlOperation
Instead of converting the set of MutableBatches into a DmlOperation to
shard into more DmlOperation instances, the sharder can operate directly
on the MutableBatches.
2022-01-17 11:57:32 +00:00
Dom 7f99d18dd1 refactor: clippy 2022-01-17 11:57:31 +00:00
Dom 40a290f6f7 feat: router2 HTTP handlers
Implements the HTTP v2 write API endpoint for router2.
2022-01-17 11:57:28 +00:00
Dom 80b12d417c feat: abstract DML handler
Defines the DmlHandler trait responsible for processing a request in
some abstract way, decoupling the HTTP/gRPC request handlers from the
underlying routing logic.
2022-01-17 11:56:04 +00:00
kodiakhq[bot] da35abfc8a
Merge pull request #3470 from influxdata/crepererum/clap_v3
chore: upgrade clap to v3
2022-01-17 11:21:11 +00:00
Marco Neumann c399e676ca chore: upgrade clap to v3 2022-01-17 12:12:46 +01:00
Raphael Taylor-Davies 89db894df4
fix: serde_json `arbitrary_precision` (#3458) (#3469)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-17 09:50:54 +00:00
Andrew Lamb b036db293f
fix: Format `ParenExpression` RPC storage Expression `Node`s (#3463)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-14 16:02:51 +00:00
kodiakhq[bot] 8e2e9b9082
Merge pull request #3464 from influxdata/dom/empty-org-bucket
fix: reject empty org & bucket
2022-01-14 14:17:45 +00:00
Dom 5cce69b481 fix: reject empty org & bucket
Previously a request that specified an empty org & bucket value would be
mapped to a database named "_".

This commit changes the org/bucket mapping fn to return an error if
either org or bucket is empty.
2022-01-14 12:17:26 +00:00
kodiakhq[bot] e1d7b71d6a
Merge pull request #3460 from influxdata/er/feat/query_duration
feat: add query completion duration to queries system table
2022-01-14 10:49:36 +00:00
Edd Robinson cdb4f43d62 refactor: address feedback 2022-01-14 10:41:27 +00:00
Edd Robinson 9283432a0f refactor: display as ns 2022-01-14 10:26:11 +00:00
Edd Robinson 36ec6019f9 feat: wire up token to query frontends 2022-01-14 10:26:11 +00:00
Edd Robinson 0b343bcf19 feat: add RAII token to time query completion 2022-01-14 10:26:11 +00:00
Edd Robinson 6a842fc105 feat: add completed duration to system table 2022-01-14 10:26:11 +00:00
Edd Robinson 211bee5886 feat: add support for setting complete time 2022-01-14 10:26:11 +00:00
Edd Robinson d1816b662f
chore: update rust to 1.58 (#3461)
* chore: update rust to 1.58

* fix: clippy

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
2022-01-13 21:12:46 +00:00
Andrew Lamb 957276faa1
fix: reduce "nothing to do" lifecycle messages from from debug to trace (#3449)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-13 19:04:47 +00:00
Andrew Lamb dd23056efd
chore: update datafusion, arrow, prost, tonic, pbjson, etc (#3455)
* chore: update datafusion, arrow, prost, tonic, etc

* fix: update pprof as well

* chore: update hakari

* fix: update pbjson

* chore: update heappy

* fix: hakari

* fix: workaround https://github.com/influxdata/influxdb_iox/issues/3458

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-13 17:07:15 +00:00
Andrew Lamb cdf5c21cd4
fix: Fix max timestamp value comparison in chunk metadata (#3453)
* fix: Fix max timestamp value comparison in chunk metadata

* refactor: rename contains to overlaps

Co-authored-by: Edd Robinson <me@edd.io>
2022-01-13 16:58:30 +00:00
kodiakhq[bot] 576552cc36
Merge pull request #3456 from influxdata/dom/truncated-lp
fix: undetected gzip HTTP body truncation
2022-01-13 15:50:27 +00:00
Dom 430823c148
docs: fix typo
Co-authored-by: Marko Mikulicic <mkm@influxdata.com>
2022-01-13 15:42:30 +00:00
Dom 3d32901877 fix: undected gzip HTTP body truncation
When reading the gzip-encoded body of a HTTP request, the stream is read
up until the configured maximum number of allowable bytes, at which
point the body was silently trucated. This could allow fields in
submitted line protocol to be silently lost (amongst other bad things).

This change ensures that truncation results in a RequestSizeExceeded
error.
2022-01-13 14:38:37 +00:00
Andrew Lamb a750da43f1
test: Reproducer for #3428 (#3429)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-13 11:44:39 +00:00
kodiakhq[bot] ecdb0165d1
Merge pull request #3446 from influxdata/dom/router2
feat: router2 skeleton
2022-01-12 17:00:25 +00:00
Dom b9bee7f735 build: update workspace-hack 2022-01-12 15:09:06 +00:00
Dom 7fc17203e2 refactor: add router2 server mode
Plumbs the router2 crate into IOx's CLI & server-runner framework.
2022-01-12 14:52:47 +00:00
Dom a8cb8755de feat: new router2 crate
This commit adds an almost-empty router2 crate containing enough of a
skeleton to plumb into the IOx CLI/server runner.
2022-01-12 14:43:10 +00:00
Raphael Taylor-Davies c5cf03511c
fix: parquet column count statistics (#2124) (#3444)
* fix: parquet metadata total_count (#2124)

* chore: review feedback

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-11 21:56:24 +00:00
Andrew Lamb 530240cb5a
chore: Update datafusion dependency (#3443) 2022-01-11 20:08:25 +00:00
Marco Neumann f3f6f335a9
chore: upgrade to snafu 0.7 (#3440) 2022-01-11 19:22:36 +00:00
kodiakhq[bot] 0c5664fada
Merge pull request #3432 from influxdata/crepererum/cargo_update
chore: `cargo update`
2022-01-11 14:06:14 +00:00
Marco Neumann 37bb7f2120 chore: `cargo update`
dependabot currently doesn't work due to
https://github.com/dependabot/dependabot-core/issues/4574

Excluded `quote` due to
https://github.com/dtolnay/quote/issues/204
2022-01-11 14:57:51 +01:00
kodiakhq[bot] d894b3b991
Merge pull request #3435 from influxdata/crepererum/fix_ci
ci: use CLI-driven SSH for cargo
2022-01-11 10:48:01 +00:00
Marco Neumann 328286029f ci: use CLI-driven SSH for cargo
Workaround for <https://github.com/rust-lang/cargo/issues/10280>.
2022-01-11 11:38:02 +01:00
Andrew Lamb b76921d26e
fix(influxrpc): Support _field references in front end conversion (#3426)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-10 21:54:56 +00:00
Raphael Taylor-Davies 479276b8cd
docs: document ingest flow (#3418)
* docs: document ingest flow

* chore: review feedback

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-07 17:37:30 +00:00
Andrew Lamb 80c048528c
refactor: Clean up code by using `lit` and `lit_timestamp_nano` rather than `Expr::Literal(ScalarValue(Some(...)))` (#3427) 2022-01-07 17:23:14 +00:00
Andrew Lamb 6d20ce1f9e
feat: Allow wipe catalog in `ReplayError` and `WriteBufferCreationError` states (#3425)
* feat: feat: Allow wipe catalog in ReplayError

* fix: comments

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-07 17:07:44 +00:00
Andrew Lamb 336ffd1966
refactor: Remove `Result` in QueryDatabase trait (none of the functions can fail) (#3422)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-06 22:03:08 +00:00
Andrew Lamb 8d732ad78c
refactor: Split database.rs into smaller modules (#3424)
* refactor: Split database.rs into smaller modules

* fix: clippy
2022-01-06 21:42:36 +00:00
Andrew Lamb a93ae739a9
feat: Add table_name to Partition API (#3421) 2022-01-06 16:38:39 +00:00
Raphael Taylor-Davies 5b71306423
chore: lint markdown docs and use relative code references in docs (#3420)
* chore: lint markdown docs

docs: relative source file references in markdown docs

* chore: review feedback
2022-01-04 09:50:13 +00:00
Carol (Nichols || Goulding) f9174c483b
refactor: Extract server::db into its own crate (#3417)
* refactor: Extract JobRegistry from the server crate

Both the server crate and a db crate that I'm about to extract depend on
JobRegistry, so to avoid making circular dependencies, extract the
JobRegistry to its own crate.

* refactor: Move db out of server into its own crate

Fixes #2821.
2021-12-23 22:01:17 +00:00
Andrew Lamb 527885f7f8
chore: Update datafusion (#3413)
* chore: Update datafusion and update code to handle timezone aware timestamps

* fix: cargo hakari

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-23 14:52:12 +00:00