Commit Graph

2722 Commits (98820873219cf74c765d381b8ba9de1f244d31d7)

Author SHA1 Message Date
Andrew Lamb 5ef9be4abd
refactor: use RecordBatch::try_from_iter to make system tables (#1374)
* refactor: use RecordBatch::try_from_iter to make system tables

* fix: clippy
2021-04-29 15:32:35 +00:00
Andrew Lamb 0788892413
feat: add row_count to system.chunks and Chunk managment API (#1373)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-29 13:53:25 +00:00
kodiakhq[bot] ef62d8b795
Merge pull request #1371 from influxdata/er/feat/grpc_metrics
feat: add instrumentation via RED metrics in gRPC API
2021-04-29 13:21:49 +00:00
Edd Robinson a0753ca227 refactor: DRY metric assertions 2021-04-29 14:00:05 +01:00
Edd Robinson 4311ba18fe feat: instrument measurement_names 2021-04-29 14:00:05 +01:00
Edd Robinson 9f059bc81c feat: instrument measurement_names 2021-04-29 14:00:05 +01:00
Edd Robinson 83978ef4f9 feat: instrument tag_values 2021-04-29 14:00:05 +01:00
Edd Robinson e25dd1836f feat: instrument tag_keys 2021-04-29 14:00:05 +01:00
Edd Robinson a6a5115384 feat: instrument read_window_aggregate 2021-04-29 14:00:05 +01:00
Edd Robinson 89e21003e7 feat: instrument read_group 2021-04-29 14:00:05 +01:00
Edd Robinson e4d6bde9f8 feat: instrument read_filter 2021-04-29 14:00:05 +01:00
Edd Robinson 13fbf2e68d refactor: plumb registry to gRPC server 2021-04-29 14:00:05 +01:00
Edd Robinson 8ea0d60cae refactor: return Arc 2021-04-29 14:00:05 +01:00
kodiakhq[bot] 98be7e8b00
Merge pull request #1369 from influxdata/entrysize
feat: Add ingest_entries_bytes_total counter
2021-04-29 12:40:55 +00:00
kodiakhq[bot] bc2dfe85f6
Merge branch 'main' into entrysize 2021-04-29 12:36:38 +00:00
Marko Mikulicic 3672a20570
feat: Add ingest_entries_bytes_total counter 2021-04-29 14:03:05 +02:00
Andrew Lamb c64f25e777
feat: Add `OBSERVER` mode to SQL repl along with SQL primer / cookbook (#1349)
* feat: add OBSERVER command to repl

* fix: fixup test

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-29 11:47:25 +00:00
kodiakhq[bot] 951e2413bd
Merge pull request #1367 from influxdata/scriptbase
feat: Improve git-log-pr
2021-04-29 11:16:59 +00:00
kodiakhq[bot] 28bd5cf135
Merge branch 'main' into scriptbase 2021-04-29 11:12:20 +00:00
Raphael Taylor-Davies 262bf446ab
feat: change background worker to use backoff instead of poll (#1339) (#1347)
* feat: change background worker to use backoff instead (#1339)

* chore: fix comment

* chore: fix tests

* chore: review comments

* chore: review feedback
2021-04-29 11:10:51 +00:00
Andrew Lamb 74d35ce9a4
chore: update deps (#1365) 2021-04-29 10:52:43 +00:00
Marko Mikulicic dce0dce122
feat: Improve git-log-pr
1. by default use the repo where the `git-log-pr` script is located in, allowing it to be called
   from other scripts in other repos (e.g. k8s-idpe) without too much cerimony
2. allow the git repo to be overriden with the `-C` flag (like the `git` command itself)
3. add a `--commits` flag which prints also commit shas in addition to PR numbers
4. GH merge commits contain the PR title as the body; if present use that instead of using the `gh` cli (which is slow and requires this tool to be installed).
2021-04-29 12:51:49 +02:00
Raphael Taylor-Davies d509daab8c
fix: tracker join shouldn't return if pending registrations (#1350)
* fix: tracker join shouldn't return if pending registrations

* chore: review feedback
2021-04-29 08:15:43 +00:00
kodiakhq[bot] ef05b53831
Merge pull request #1338 from influxdata/sharding_refa
feat: Add multiple matchers to shard config
2021-04-28 22:03:53 +00:00
kodiakhq[bot] 1f3bf6b5a6
Merge branch 'main' into sharding_refa 2021-04-28 21:58:21 +00:00
Andrew Lamb b1924d10b4
fix: Only show current database's system.operations table (#1310)
* test: add test for operations.system_tables

* fix: only show operations for current database

* fix: update test

* fix: improve test

* refactor: filter in Schema provider rather than in job tracker

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-28 21:06:19 +00:00
Marko Mikulicic bde36bfe47 feat: Add the git-log-prs script
__Scenarios__

You may know the git sha of what's running in the staging cluster,
and you may know the sha of the latest built image is, but will upgrading to a new
version include the PRs I'm interested in?

Or alternatively: I noticed in the dashboard that IOx was working fine until
we rolled out a new version. Which PRs were included in this new rollout?

__Description__

Getting the answers to the scenarios above is surprisingly hard, because scanning
our git history is complicated by the fact that just about anybody uses a different
merging technique.

This script does the right magic to skim through all that cruft and get the answers.

__Demo__

```console
$ ./scripts/git-log-prs 8376983b74311df970339e106c62ce4038b20e5f..
1330
1336
$ ./scripts/git-log-prs 8376983b74311df970339e106c62ce4038b20e5f.. --titles
1330 feat: Make background task period configurable
1336 feat: Build a perf_image image for every commit in main
```
2021-04-28 21:01:13 +00:00
Nga Tran 402d9c748c chore: cargo fmt 2021-04-28 16:52:52 -04:00
Edd Robinson bc359821e3 feat: allow histogram metrics to be registered 2021-04-28 20:49:11 +00:00
Edd Robinson ccec8f2ca8 test: add histogram test assertions 2021-04-28 20:49:11 +00:00
Edd Robinson a66f50949a feat: add new Histogram metric 2021-04-28 20:49:11 +00:00
Nga Tran a5a5f359ca chore: continue cresolving conflict after pulling branch 2021-04-28 16:46:15 -04:00
Andrew Lamb a64e622f6e
feat: Add interactive SQL repl (#1332)
* feat: Add interactive SQL repl

* fix: try and fix test

* fix: remove test for prompt

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-28 20:41:02 +00:00
Nga Tran 0ea8861a65 chore: fix merge that causes test failures 2021-04-28 16:38:29 -04:00
Nga Tran 2a2760bd18 feat: complete tests where data in both RUB and OS 2021-04-28 16:14:07 -04:00
Nga Tran 140d96dbea feat: tests ffor loading data to object store and make sure twe still query read buffer 2021-04-28 15:59:17 -04:00
Nga Tran 1f0b329ff9 feat: complete tests where data in both RUB and OS 2021-04-28 15:12:36 -04:00
kodiakhq[bot] a45e2174a5
Merge pull request #1346 from influxdata/cn/clock-value-never-0
fix: Validate that ClockValue is never 0
2021-04-28 18:37:01 +00:00
Carol (Nichols || Goulding) 9aefcd216f fix: Validate that ClockValue is never 0 2021-04-28 13:54:55 -04:00
kodiakhq[bot] ccaf981e75
Merge pull request #1344 from influxdata/cn/server-id-fix
fix: Validate ServerId when creating structs from flatbuffers
2021-04-28 17:23:38 +00:00
kodiakhq[bot] dcc732b154
Merge branch 'main' into cn/server-id-fix 2021-04-28 17:19:29 +00:00
Carol (Nichols || Goulding) 2f4d7189ff fix: Validate ServerId when creating structs from flatbuffers
When we get the flatbuffers, we won't have the server ID in addition to
the flatbuffers-- it's in the flatbuffers. But we want to validate the
`ServerId` once when the `SequencedEntry` is created so that its
`server_id` method can assume it has a valid `ServerId`.
2021-04-28 13:06:12 -04:00
Edd Robinson 4acbdcf1c9 refactor: address PR feedback 2021-04-28 16:11:57 +00:00
Edd Robinson c4259d5336 refactor: update benchmarks 2021-04-28 16:11:57 +00:00
Edd Robinson bc799c6cc0 refactor: remove channels from gRPC API 2021-04-28 16:11:57 +00:00
Edd Robinson a9ef604ef6 perf: avoid using channels for query execution
Pre-sized channels get full when the results to send over them are larger than the capacities. This causes significant runtime overhead and slows down query performance.

This commit removes the intermediate channels. The potential downside to this approach is there may be more buffering which could increase memory usage during query and also block a thread for longer periods of time.
2021-04-28 16:11:57 +00:00
Edd Robinson d6c0f40630 test: add read_group benchmark 2021-04-28 16:11:57 +00:00
Edd Robinson 5dfe312867 test: add benchmark for influxrpc read_filter 2021-04-28 16:11:57 +00:00
kodiakhq[bot] fedab46c7f
Merge pull request #1330 from influxdata/lifecycle_speed
feat: Make background task period configurable
2021-04-28 15:27:23 +00:00
kodiakhq[bot] d1e37c45a5
Merge branch 'main' into lifecycle_speed 2021-04-28 15:22:59 +00:00