Commit Graph

2652 Commits (98be7e8b0017f11d8d441597cfb3b231f082e8f1)

Author SHA1 Message Date
kodiakhq[bot] 98be7e8b00
Merge pull request #1369 from influxdata/entrysize
feat: Add ingest_entries_bytes_total counter
2021-04-29 12:40:55 +00:00
kodiakhq[bot] bc2dfe85f6
Merge branch 'main' into entrysize 2021-04-29 12:36:38 +00:00
Marko Mikulicic 3672a20570
feat: Add ingest_entries_bytes_total counter 2021-04-29 14:03:05 +02:00
Andrew Lamb c64f25e777
feat: Add `OBSERVER` mode to SQL repl along with SQL primer / cookbook (#1349)
* feat: add OBSERVER command to repl

* fix: fixup test

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-29 11:47:25 +00:00
kodiakhq[bot] 951e2413bd
Merge pull request #1367 from influxdata/scriptbase
feat: Improve git-log-pr
2021-04-29 11:16:59 +00:00
kodiakhq[bot] 28bd5cf135
Merge branch 'main' into scriptbase 2021-04-29 11:12:20 +00:00
Raphael Taylor-Davies 262bf446ab
feat: change background worker to use backoff instead of poll (#1339) (#1347)
* feat: change background worker to use backoff instead (#1339)

* chore: fix comment

* chore: fix tests

* chore: review comments

* chore: review feedback
2021-04-29 11:10:51 +00:00
Andrew Lamb 74d35ce9a4
chore: update deps (#1365) 2021-04-29 10:52:43 +00:00
Marko Mikulicic dce0dce122
feat: Improve git-log-pr
1. by default use the repo where the `git-log-pr` script is located in, allowing it to be called
   from other scripts in other repos (e.g. k8s-idpe) without too much cerimony
2. allow the git repo to be overriden with the `-C` flag (like the `git` command itself)
3. add a `--commits` flag which prints also commit shas in addition to PR numbers
4. GH merge commits contain the PR title as the body; if present use that instead of using the `gh` cli (which is slow and requires this tool to be installed).
2021-04-29 12:51:49 +02:00
Raphael Taylor-Davies d509daab8c
fix: tracker join shouldn't return if pending registrations (#1350)
* fix: tracker join shouldn't return if pending registrations

* chore: review feedback
2021-04-29 08:15:43 +00:00
kodiakhq[bot] ef05b53831
Merge pull request #1338 from influxdata/sharding_refa
feat: Add multiple matchers to shard config
2021-04-28 22:03:53 +00:00
kodiakhq[bot] 1f3bf6b5a6
Merge branch 'main' into sharding_refa 2021-04-28 21:58:21 +00:00
Andrew Lamb b1924d10b4
fix: Only show current database's system.operations table (#1310)
* test: add test for operations.system_tables

* fix: only show operations for current database

* fix: update test

* fix: improve test

* refactor: filter in Schema provider rather than in job tracker

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-28 21:06:19 +00:00
Marko Mikulicic bde36bfe47 feat: Add the git-log-prs script
__Scenarios__

You may know the git sha of what's running in the staging cluster,
and you may know the sha of the latest built image is, but will upgrading to a new
version include the PRs I'm interested in?

Or alternatively: I noticed in the dashboard that IOx was working fine until
we rolled out a new version. Which PRs were included in this new rollout?

__Description__

Getting the answers to the scenarios above is surprisingly hard, because scanning
our git history is complicated by the fact that just about anybody uses a different
merging technique.

This script does the right magic to skim through all that cruft and get the answers.

__Demo__

```console
$ ./scripts/git-log-prs 8376983b74311df970339e106c62ce4038b20e5f..
1330
1336
$ ./scripts/git-log-prs 8376983b74311df970339e106c62ce4038b20e5f.. --titles
1330 feat: Make background task period configurable
1336 feat: Build a perf_image image for every commit in main
```
2021-04-28 21:01:13 +00:00
Edd Robinson bc359821e3 feat: allow histogram metrics to be registered 2021-04-28 20:49:11 +00:00
Edd Robinson ccec8f2ca8 test: add histogram test assertions 2021-04-28 20:49:11 +00:00
Edd Robinson a66f50949a feat: add new Histogram metric 2021-04-28 20:49:11 +00:00
Andrew Lamb a64e622f6e
feat: Add interactive SQL repl (#1332)
* feat: Add interactive SQL repl

* fix: try and fix test

* fix: remove test for prompt

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-28 20:41:02 +00:00
kodiakhq[bot] a45e2174a5
Merge pull request #1346 from influxdata/cn/clock-value-never-0
fix: Validate that ClockValue is never 0
2021-04-28 18:37:01 +00:00
Carol (Nichols || Goulding) 9aefcd216f fix: Validate that ClockValue is never 0 2021-04-28 13:54:55 -04:00
kodiakhq[bot] ccaf981e75
Merge pull request #1344 from influxdata/cn/server-id-fix
fix: Validate ServerId when creating structs from flatbuffers
2021-04-28 17:23:38 +00:00
kodiakhq[bot] dcc732b154
Merge branch 'main' into cn/server-id-fix 2021-04-28 17:19:29 +00:00
Carol (Nichols || Goulding) 2f4d7189ff fix: Validate ServerId when creating structs from flatbuffers
When we get the flatbuffers, we won't have the server ID in addition to
the flatbuffers-- it's in the flatbuffers. But we want to validate the
`ServerId` once when the `SequencedEntry` is created so that its
`server_id` method can assume it has a valid `ServerId`.
2021-04-28 13:06:12 -04:00
Edd Robinson 4acbdcf1c9 refactor: address PR feedback 2021-04-28 16:11:57 +00:00
Edd Robinson c4259d5336 refactor: update benchmarks 2021-04-28 16:11:57 +00:00
Edd Robinson bc799c6cc0 refactor: remove channels from gRPC API 2021-04-28 16:11:57 +00:00
Edd Robinson a9ef604ef6 perf: avoid using channels for query execution
Pre-sized channels get full when the results to send over them are larger than the capacities. This causes significant runtime overhead and slows down query performance.

This commit removes the intermediate channels. The potential downside to this approach is there may be more buffering which could increase memory usage during query and also block a thread for longer periods of time.
2021-04-28 16:11:57 +00:00
Edd Robinson d6c0f40630 test: add read_group benchmark 2021-04-28 16:11:57 +00:00
Edd Robinson 5dfe312867 test: add benchmark for influxrpc read_filter 2021-04-28 16:11:57 +00:00
kodiakhq[bot] fedab46c7f
Merge pull request #1330 from influxdata/lifecycle_speed
feat: Make background task period configurable
2021-04-28 15:27:23 +00:00
kodiakhq[bot] d1e37c45a5
Merge branch 'main' into lifecycle_speed 2021-04-28 15:22:59 +00:00
Edd Robinson 96e1289c94 refactor: log time to create row group 2021-04-28 15:08:19 +00:00
Edd Robinson c3b41649ee refactor: use space saving compression 2021-04-28 15:08:19 +00:00
Edd Robinson 5e3d43d62f fix: report row group rows correctly 2021-04-28 15:08:19 +00:00
Marko Mikulicic 91ee005ada
feat: Add multiple matchers to shard config 2021-04-28 17:02:58 +02:00
Jacob Marble 97f2d7acad chore: fix usize 32-bit overflow 2021-04-28 13:51:47 +00:00
Marko Mikulicic b6054f9df9
feat: Make background task period configurable 2021-04-28 15:47:31 +02:00
kodiakhq[bot] b6447a1363
Merge pull request #1336 from influxdata/alwayspush
feat: Build a perf_image image for every commit in main
2021-04-28 08:23:42 +00:00
Marko Mikulicic 756e1b769e
feat: Build a perf_image image for every commit in main 2021-04-28 10:12:34 +02:00
Raphael Taylor-Davies 9b57214344
feat: move closing chunks as soon as possible (#1329)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-28 07:50:15 +00:00
kodiakhq[bot] 451b87a30e
Merge pull request #1320 from influxdata/crepererum/issue1219
docs: add design docs for catalog persistence
2021-04-28 07:38:06 +00:00
kodiakhq[bot] 3ce3afe544
Merge branch 'main' into crepererum/issue1219 2021-04-28 07:33:43 +00:00
Raphael Taylor-Davies 6bdc153361
feat: sort RUB (read buffer) chunks (#1308)
* feat: sort chunks before upserting to read buffer (#1216)

* chore: review feedback

* chore: fix merge conflict

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-27 16:50:48 +00:00
Raphael Taylor-Davies 7ca1da3fcd
feat: pushdown table and partition key predicates to catalog (#736) (#1327)
* feat: catalog predicate pushdown (#736)

* chore: fix lints

* chore: review comments

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-27 15:31:47 +00:00
kodiakhq[bot] 2dd6371148
Merge pull request #1325 from influxdata/crepererum/ci_doc2
ci: pass `--document-private-items` to `cargo doc`
2021-04-27 13:49:30 +00:00
kodiakhq[bot] f3739599a9
Merge branch 'main' into crepererum/ci_doc2 2021-04-27 13:44:50 +00:00
Marco Neumann 91bccdfca3 ci: pass `--document-private-items` to `cargo doc` 2021-04-27 15:42:07 +02:00
kodiakhq[bot] 108b4f9093
Merge pull request #1322 from influxdata/fixbuckets
fix: Histogram boundaries are durations not percentiles
2021-04-27 13:41:59 +00:00
Marko Mikulicic 2bbfd1d007
fix: Histogram boundaries are durations not percentiles 2021-04-27 15:19:09 +02:00
Marco Neumann 74927527b6 docs: add design docs for catalog persistence
Closes #1219.
2021-04-27 15:18:41 +02:00