1bf519c2f6
Merge pull request #4573 from influxdata/cn/write-info-grpc-more
...
feat: Querier can get write status from ingesters
2022-05-12 13:59:41 +00:00
2eb2db5286
Merge branch 'main' into cn/write-info-grpc-more
2022-05-12 13:53:19 +00:00
51a1067425
chore(deps): Bump zstd from 0.11.1+zstd.1.5.2 to 0.11.2+zstd.1.5.2 ( #4576 )
...
Bumps [zstd](https://github.com/gyscos/zstd-rs ) from 0.11.1+zstd.1.5.2 to 0.11.2+zstd.1.5.2.
- [Release notes](https://github.com/gyscos/zstd-rs/releases )
- [Commits](https://github.com/gyscos/zstd-rs/commits/v0.11.2 )
---
updated-dependencies:
- dependency-name: zstd
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-12 13:53:10 +00:00
10413a6e9a
docs: Explain that the querier gets the write info from the ingesters
...
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
2022-05-12 09:48:46 -04:00
f9e3495e47
feat: add more metrics for compactor ( #4575 )
...
* feat: add more metrics for compactor
* chore: clearer comment
2022-05-12 13:20:43 +00:00
2079cf98f6
fix: Add back a test case that needs to check ingester for write info
...
Specifically because the querier doesn't know about the ingester.
2022-05-11 15:30:59 -04:00
0d5e3c97f0
chore: dump out the diff for SQL tests ( #4571 )
...
* chore: dump out the diff for SQL tests
* refactor: more prety assertion to a specific test to avoid affecting other available tests
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-11 18:43:36 +00:00
3912328497
chore(deps): Bump pprof from 0.8.0 to 0.9.0 ( #4562 )
...
Bumps [pprof](https://github.com/tikv/pprof-rs ) from 0.8.0 to 0.9.0.
- [Release notes](https://github.com/tikv/pprof-rs/releases )
- [Changelog](https://github.com/tikv/pprof-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/tikv/pprof-rs/commits )
---
updated-dependencies:
- dependency-name: pprof
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-11 18:30:49 +00:00
48b84b3bdf
feat: Querier can get write status from ingesters
...
Connects to influxdata/influxdb-iox-client-go#27 .
2022-05-11 14:12:10 -04:00
77205d9a8e
fix: Remove some unused error variants
2022-05-11 14:07:48 -04:00
2ee4a6669a
refactor: Move the code merging write infos to generated_types to share
2022-05-11 14:07:42 -04:00
26170b7a07
refactor: Move gRPC conversion code to generated_types to share
2022-05-11 14:07:12 -04:00
8545bb60c6
refactor: Move KafkaPartitionWriteStatus to data_types to share more
2022-05-11 14:07:06 -04:00
b026073b02
feat: support HEAD requests against object storage ( #4553 )
...
* feat: add head request to ObjectStore
* fix: tests
* fix: gcp build
* chore: update GCS tests
* chore: review feedback
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-11 16:57:48 +00:00
2a6b383dd6
Merge pull request #4569 from influxdata/dom/query-metrics
...
feat(ingester): emit query latency metrics
2022-05-11 15:58:29 +00:00
5b866989ca
Merge branch 'main' into dom/query-metrics
2022-05-11 15:51:55 +00:00
b8bda5f84d
docs: Add docs for CLI ( #4559 )
...
* docs: Add docs for CLI
* fix: add todo
* fix: Update docs/cli.md
Co-authored-by: Nga Tran <nga-tran@live.com>
Co-authored-by: Nga Tran <nga-tran@live.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-11 15:51:34 +00:00
ce5fdaaa4b
Merge pull request #4570 from influxdata/dom/ingest-op-debug
...
refactor(ingester): emit per-op debugging info
2022-05-11 15:42:08 +00:00
7f3473e19f
refactor(ingester): emit per-op debugging info
...
Emit a TRACE level log containing the op offset & other helpful fields.
This will allow us to identify which messages were last successfully
decoded, and which caused errors so we can pull them from analysis.
2022-05-11 16:35:35 +01:00
3890a8986b
feat(ingester): emit query latency metrics
...
Adds a histogram metric "flight_query_duration_ms" that records the
duration a flight RPC query takes to complete. Broken down by query
result (success/error).
2022-05-11 16:14:47 +01:00
575f0376b5
Merge pull request #4566 from influxdata/alamb/update_heappy_again
...
chore: Update heappy
2022-05-11 15:03:29 +00:00
381ad3b81d
chore: Update heappy
2022-05-11 09:49:10 -04:00
5c894db70f
chore(deps): Bump syn from 1.0.92 to 1.0.93 ( #4563 )
...
Bumps [syn](https://github.com/dtolnay/syn ) from 1.0.92 to 1.0.93.
- [Release notes](https://github.com/dtolnay/syn/releases )
- [Commits](https://github.com/dtolnay/syn/compare/1.0.92...1.0.93 )
---
updated-dependencies:
- dependency-name: syn
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-11 13:43:54 +00:00
8a81bffee5
chore(deps): Bump clap from 3.1.17 to 3.1.18 ( #4561 )
...
Bumps [clap](https://github.com/clap-rs/clap ) from 3.1.17 to 3.1.18.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v3.1.17...v3.1.18 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-05-11 13:11:22 +00:00
613cec4513
chore: remove azure git pin ( #4564 )
...
* chore: remove azure git pin
* chore: fix hakari
* chore: Run cargo hakari tasks
* chore: remove outdated comment
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-11 10:21:17 +00:00
d4e1380ade
chore(deps): Bump sqlparser from 0.16.0 to 0.17.0 ( #4560 )
...
Bumps [sqlparser](https://github.com/sqlparser-rs/sqlparser-rs ) from 0.16.0 to 0.17.0.
- [Release notes](https://github.com/sqlparser-rs/sqlparser-rs/releases )
- [Changelog](https://github.com/sqlparser-rs/sqlparser-rs/blob/main/CHANGELOG.md )
- [Commits](https://github.com/sqlparser-rs/sqlparser-rs/compare/v0.16.0...v0.17.0 )
---
updated-dependencies:
- dependency-name: sqlparser
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-05-11 10:09:22 +00:00
b8cb4c3f2b
feat: Interrogate schema from querier (as well as router) ( #4557 )
...
* refactor: move SchemaService into `service_grpc_schema`
* feat: implement schema gRPC for querier
* chore: Run cargo hakari tasks
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2022-05-10 20:55:58 +00:00
03ee6840d0
feat: Add `debug namespaces` CLI command ( #4556 )
2022-05-10 18:35:05 +00:00
84fd883688
feat: Add query_ingester CLI command ( #4554 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-10 18:18:07 +00:00
1c3a3f25e6
feat: make ObjectStore::list return stream of ObjectMeta ( #4549 )
...
* feat: make ObjectStore::list return stream of ObjectMeta
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-10 16:39:25 +00:00
9befcd5b3d
chore: rename INFLUXDB_IOX_BUCKET to OBJECT_STORE_BUCKET in object_store ( #4548 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-10 16:31:46 +00:00
84d60ce56e
fix: feature flags ( #4550 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-10 13:42:51 +00:00
1913a0150f
test: explain tests for queries whose data come from both parquet and ingester ( #4546 )
...
* refactor: remove New from a test scenario setup
* test: add explain for 2 different chunk stages
* test: expplain for several chunks from both parquet and ingester
2022-05-10 13:17:18 +00:00
99b1a9b83f
refactor: split out ObjectStoreMetrics ( #4547 )
...
* refactor: split out ObjectStoreMetrics
* chore: add workspace hack
* fix: compile
2022-05-10 10:56:28 +00:00
8b379c83cc
refactor: simplify object_store path handling ( #4534 )
...
* refactor: simplify object_store path handling
* fix: aws integration tests
* chore: lint
* fix: update gcs tests
* refactor: move errors into submodules
* chore: lint
* chore: review feedback
* refactor: replace provider with Display
* fix: failing tests
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-09 18:43:22 +00:00
9b00e4c0da
chore: update deps ( #4545 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-09 18:18:02 +00:00
dec628d48b
refactor: rewrite all structs and functions to remove "new" ( #4544 )
...
* refactor: ChunkStageNew to ChunkStage and DeleteTimeNew to DeleteTime
* refactor: PredNew -> Pred
* refactor: ChunkDataNew -> ChunkData
* refactor: new name functions to remove _new
2022-05-09 17:58:49 +00:00
de32b1ca54
Merge pull request #4532 from influxdata/cn/more-cleanup
...
fix: Remove or rescope dead code warnings
2022-05-09 14:05:00 +00:00
ebd078133c
Merge branch 'main' into cn/more-cleanup
2022-05-09 13:58:25 +00:00
a96fd1cde2
Merge pull request #4491 from influxdata/dom/delete-shard-no-table
...
feat: shard delete ops with no table predicate
2022-05-09 13:53:00 +00:00
776b0e0778
docs: finish incomplete comments
2022-05-09 14:46:32 +01:00
31f805faa5
docs: partial sharded write semantics
...
Documents the partial write semantics and expected resolution for the
ShardedWriteBuffer in the router.
2022-05-09 14:46:32 +01:00
5a33749c98
chore: fix test comments
...
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
2022-05-09 14:46:32 +01:00
5069e37bd7
feat: shard delete ops with no table predicate
...
Changes the JumpHash sharder and modifies the ShardedWriteBuffer's
DmlHandler::delete() impl in order to enqueue delete ops across all
shards if no table name is specified.
If a table name is specified, it is sharded as before: a delete for a
given table & namespace always maps to the same shard as a write to the
same table & namespace.
2022-05-09 14:46:30 +01:00
cbe9eb4b1e
chore: fix comment typo ( #4533 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-09 11:24:12 +00:00
2a15b525a9
chore(deps): Bump clap from 3.1.12 to 3.1.17 ( #4537 )
...
* chore(deps): Bump clap from 3.1.12 to 3.1.17
Bumps [clap](https://github.com/clap-rs/clap ) from 3.1.12 to 3.1.17.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v3.1.12...v3.1.17 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* chore: update lockfile
* chore: Run cargo hakari tasks
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
Co-authored-by: Raphael Taylor-Davies <r.taylordavies@googlemail.com>
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2022-05-09 10:13:28 +00:00
02b75da401
Merge branch 'main' into cn/more-cleanup
2022-05-09 10:56:18 +01:00
f23d569054
Merge pull request #4522 from influxdata/cn/delete-more
...
fix: Delete even more
2022-05-09 08:53:33 +00:00
a12172dfe8
Merge branch 'main' into cn/delete-more
2022-05-09 08:47:03 +00:00
1c7ef3a3f8
chore(deps): Bump memchr from 2.4.1 to 2.5.0 ( #4542 )
...
Bumps [memchr](https://github.com/BurntSushi/memchr ) from 2.4.1 to 2.5.0.
- [Release notes](https://github.com/BurntSushi/memchr/releases )
- [Commits](https://github.com/BurntSushi/memchr/compare/2.4.1...2.5.0 )
---
updated-dependencies:
- dependency-name: memchr
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-09 08:46:44 +00:00
kodiakhq[bot]
dependabot[bot]
Carol (Nichols || Goulding)
Nga Tran
Carol (Nichols || Goulding)
Raphael Taylor-Davies
Andrew Lamb
Dom Dwyer
YIXIAO SHI