aa6f118487
feat: iox_catalog sequencers ( #3465 )
...
* refactor: ensure sequencers are unique
Adds a unique constraint to ensure only one sequencer record exists for
each Kafka (topic, partition).
* test: use DSN from env for integration tests
Removes the hard-coded DSN, instead sourcing it from the DATABASE_URL
environment variable.
* docs: integration testing for iox_catalog
Documents the required steps in order to run the Postgres integration
tests for the iox_catalog crate.
* feat(iox_catalog): create & list sequencers
Adds support for interacting with the "sequencer" table.
* chore: update lockfile
Running cargo in iox_catalog generates a lockfile diff.
2022-01-17 10:00:31 -05:00
6f2e10cab6
feat(router2): implement delete API handler
...
Adds support for the HTTP v2 delete API endpoint.
2022-01-17 14:57:36 +00:00
4f908021e4
chore: Update iox_catalog Postgres test to only run on integration
2022-01-17 09:56:20 -05:00
3215928d2f
chore: fix CI sqlx migrate command
2022-01-17 09:56:20 -05:00
5877374d0d
chore: fix ci postgres env
2022-01-17 09:56:20 -05:00
c373e7a397
chore: update circle CI for postgres
2022-01-17 09:56:20 -05:00
4e48aea55c
chore: add Postgres and migrations to CI
2022-01-17 09:56:20 -05:00
8d6d9e679f
refactor: update iox_catalog
...
Changed to use the iox_catalog schema in Postgres rather than public.
Updated talbe names to be singular.
Removed the connection_string from query_pool
2022-01-17 09:56:20 -05:00
4e5bca93fb
chore: update iox_catalog to Snafu 0.7
2022-01-17 09:56:20 -05:00
4764e71c54
feat: Add initial iox_catalog skeleton
2022-01-17 09:56:20 -05:00
c59c17b2f2
Merge pull request #3468 from influxdata/dom/http-handlers
...
feat(router2): http write handler
2022-01-17 12:08:23 +00:00
1b7369e743
docs: fix broken doc link
2022-01-17 11:57:32 +00:00
7badf37250
refactor: db_name -> namespace
...
Renames all "database name" references to "namespace".
2022-01-17 11:57:32 +00:00
885c831aff
refactor: avoid constructing DmlOperation
...
Instead of converting the set of MutableBatches into a DmlOperation to
shard into more DmlOperation instances, the sharder can operate directly
on the MutableBatches.
2022-01-17 11:57:32 +00:00
7f99d18dd1
refactor: clippy
2022-01-17 11:57:31 +00:00
40a290f6f7
feat: router2 HTTP handlers
...
Implements the HTTP v2 write API endpoint for router2.
2022-01-17 11:57:28 +00:00
80b12d417c
feat: abstract DML handler
...
Defines the DmlHandler trait responsible for processing a request in
some abstract way, decoupling the HTTP/gRPC request handlers from the
underlying routing logic.
2022-01-17 11:56:04 +00:00
da35abfc8a
Merge pull request #3470 from influxdata/crepererum/clap_v3
...
chore: upgrade clap to v3
2022-01-17 11:21:11 +00:00
c399e676ca
chore: upgrade clap to v3
2022-01-17 12:12:46 +01:00
89db894df4
fix: serde_json `arbitrary_precision` ( #3458 ) ( #3469 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-17 09:50:54 +00:00
b036db293f
fix: Format `ParenExpression` RPC storage Expression `Node`s ( #3463 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-14 16:02:51 +00:00
8e2e9b9082
Merge pull request #3464 from influxdata/dom/empty-org-bucket
...
fix: reject empty org & bucket
2022-01-14 14:17:45 +00:00
5cce69b481
fix: reject empty org & bucket
...
Previously a request that specified an empty org & bucket value would be
mapped to a database named "_".
This commit changes the org/bucket mapping fn to return an error if
either org or bucket is empty.
2022-01-14 12:17:26 +00:00
e1d7b71d6a
Merge pull request #3460 from influxdata/er/feat/query_duration
...
feat: add query completion duration to queries system table
2022-01-14 10:49:36 +00:00
cdb4f43d62
refactor: address feedback
2022-01-14 10:41:27 +00:00
9283432a0f
refactor: display as ns
2022-01-14 10:26:11 +00:00
36ec6019f9
feat: wire up token to query frontends
2022-01-14 10:26:11 +00:00
0b343bcf19
feat: add RAII token to time query completion
2022-01-14 10:26:11 +00:00
6a842fc105
feat: add completed duration to system table
2022-01-14 10:26:11 +00:00
211bee5886
feat: add support for setting complete time
2022-01-14 10:26:11 +00:00
d1816b662f
chore: update rust to 1.58 ( #3461 )
...
* chore: update rust to 1.58
* fix: clippy
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
2022-01-13 21:12:46 +00:00
957276faa1
fix: reduce "nothing to do" lifecycle messages from from debug to trace ( #3449 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-13 19:04:47 +00:00
dd23056efd
chore: update datafusion, arrow, prost, tonic, pbjson, etc ( #3455 )
...
* chore: update datafusion, arrow, prost, tonic, etc
* fix: update pprof as well
* chore: update hakari
* fix: update pbjson
* chore: update heappy
* fix: hakari
* fix: workaround https://github.com/influxdata/influxdb_iox/issues/3458
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-13 17:07:15 +00:00
cdf5c21cd4
fix: Fix max timestamp value comparison in chunk metadata ( #3453 )
...
* fix: Fix max timestamp value comparison in chunk metadata
* refactor: rename contains to overlaps
Co-authored-by: Edd Robinson <me@edd.io>
2022-01-13 16:58:30 +00:00
576552cc36
Merge pull request #3456 from influxdata/dom/truncated-lp
...
fix: undetected gzip HTTP body truncation
2022-01-13 15:50:27 +00:00
430823c148
docs: fix typo
...
Co-authored-by: Marko Mikulicic <mkm@influxdata.com>
2022-01-13 15:42:30 +00:00
3d32901877
fix: undected gzip HTTP body truncation
...
When reading the gzip-encoded body of a HTTP request, the stream is read
up until the configured maximum number of allowable bytes, at which
point the body was silently trucated. This could allow fields in
submitted line protocol to be silently lost (amongst other bad things).
This change ensures that truncation results in a RequestSizeExceeded
error.
2022-01-13 14:38:37 +00:00
a750da43f1
test: Reproducer for #3428 ( #3429 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-13 11:44:39 +00:00
ecdb0165d1
Merge pull request #3446 from influxdata/dom/router2
...
feat: router2 skeleton
2022-01-12 17:00:25 +00:00
b9bee7f735
build: update workspace-hack
2022-01-12 15:09:06 +00:00
7fc17203e2
refactor: add router2 server mode
...
Plumbs the router2 crate into IOx's CLI & server-runner framework.
2022-01-12 14:52:47 +00:00
a8cb8755de
feat: new router2 crate
...
This commit adds an almost-empty router2 crate containing enough of a
skeleton to plumb into the IOx CLI/server runner.
2022-01-12 14:43:10 +00:00
c5cf03511c
fix: parquet column count statistics ( #2124 ) ( #3444 )
...
* fix: parquet metadata total_count (#2124 )
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-11 21:56:24 +00:00
530240cb5a
chore: Update datafusion dependency ( #3443 )
2022-01-11 20:08:25 +00:00
f3f6f335a9
chore: upgrade to snafu 0.7 ( #3440 )
2022-01-11 19:22:36 +00:00
0c5664fada
Merge pull request #3432 from influxdata/crepererum/cargo_update
...
chore: `cargo update`
2022-01-11 14:06:14 +00:00
37bb7f2120
chore: `cargo update`
...
dependabot currently doesn't work due to
https://github.com/dependabot/dependabot-core/issues/4574
Excluded `quote` due to
https://github.com/dtolnay/quote/issues/204
2022-01-11 14:57:51 +01:00
d894b3b991
Merge pull request #3435 from influxdata/crepererum/fix_ci
...
ci: use CLI-driven SSH for cargo
2022-01-11 10:48:01 +00:00
328286029f
ci: use CLI-driven SSH for cargo
...
Workaround for <https://github.com/rust-lang/cargo/issues/10280 >.
2022-01-11 11:38:02 +01:00
b76921d26e
fix(influxrpc): Support _field references in front end conversion ( #3426 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-10 21:54:56 +00:00
Dom
Paul Dix
kodiakhq[bot]
Marco Neumann
Raphael Taylor-Davies
Andrew Lamb
Edd Robinson