Commit Graph

2776 Commits (febc1538ffb1abcc95b4d49ea781a5e27a37afa4)

Author SHA1 Message Date
Raphael Taylor-Davies 0a835436ac
feat: use bitmasks within MUB (#1274) (#1289)
* feat: use bitmasks within MUB (#1274)

* chore: review feedback

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-26 18:00:16 +00:00
Andrew Lamb e33af0c084 fix: remove wait_for_complete 2021-04-26 16:59:36 +00:00
Andrew Lamb fcf5c304a6 fix: fixup merge conflicts 2021-04-26 16:59:36 +00:00
Andrew Lamb 348f38c2c9 feat: add status column 2021-04-26 16:59:36 +00:00
Andrew Lamb 9c74074095 feat: List background operations as system.operations table 2021-04-26 16:59:36 +00:00
Marko Mikulicic 3b3ac33575
fix: Set a global log/tracing subscriber (#1305)
Closes #1288

__Rationale__

`tracing::subscriber::set_default` only sets the subscriber for the current thread.
However, we're using multi-threaded tokio runtime, which means that most of the threads running
async code won't inherit the tracing subscriber, which means error/info/debug... logs won't be emitted!

To make things even more confusing, some logs do work (because they just happen to run in the same thread
that called `subscriber::set_default`.

__Change__

This PR makes us call `subscriber::set_global_default`.
This call can only be called once and is meant to be invoked by the main program (not by libraries).

It preserves the `TracingGuard` type, but now it's only used to flush the opentelemetry stuff.
2021-04-26 13:45:35 +00:00
Luke Bond 8aabef0141
Merge pull request #1304 from influxdata/chore/ci-debug-logging
chore: logging to debug CI
2021-04-26 13:06:32 +01:00
Luke Bond 39abadba0d chore: logging to debug CI 2021-04-26 12:49:23 +01:00
kodiakhq[bot] ae7ce8762d
Merge pull request #1303 from influxdata/dom/obs_deps
chore: fix observability dependency key
2021-04-26 11:36:36 +00:00
Dom 1826d86938 chore: fix observability dependency key
The observability_deps crate name was erroneously wrapped in double
quotes.
2021-04-26 12:22:21 +01:00
Raphael Taylor-Davies e393d16e36
chore: update arrow versions (#1300) 2021-04-26 10:11:25 +00:00
Edd Robinson faec98eab9 refactor: remove time column from row group 2021-04-26 09:51:06 +00:00
Edd Robinson 15bde2f8fa refactor: remove time field from Table meta 2021-04-26 09:51:06 +00:00
kodiakhq[bot] 2a6eed97c6
Merge pull request #1291 from influxdata/er/fix/open_chunk_metric
fix: don't over count new chunks
2021-04-23 19:31:21 +00:00
Edd Robinson dd2bee3343 fix: don't over count new chunks 2021-04-23 20:25:37 +01:00
Edd Robinson 552409ea70 feat: add metrics for chunk lifecycle 2021-04-23 17:13:43 +00:00
Edd Robinson 0e3b7bff49 refactor: plumb metrics registry to catalog 2021-04-23 17:13:43 +00:00
Edd Robinson 7a3f536232 refactor: more API metric coverage 2021-04-23 17:13:43 +00:00
Edd Robinson 59282bce6e refactor: swap existing metrics for THE NEW WAY 2021-04-23 17:13:43 +00:00
Edd Robinson cd7df48718 refactor: apply suggestions from code review
Co-authored-by: Dom <dom@itsallbroken.com>
Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
2021-04-23 15:58:48 +00:00
Edd Robinson eacfe9af6a refactor: address PR feedback 2021-04-23 15:58:48 +00:00
Edd Robinson 14ee33b523 refactor: apply suggestions from code review
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-04-23 15:58:48 +00:00
Edd Robinson 5dea3c6146 refactor: PR feedback 2021-04-23 15:58:48 +00:00
Edd Robinson d3218802ab refactor: more API metric coverage 2021-04-23 15:58:48 +00:00
Edd Robinson 87de656d23 feat: metrics test helpers 2021-04-23 15:58:48 +00:00
Edd Robinson ae11983e44 test: verify metrics working 2021-04-23 15:58:48 +00:00
Edd Robinson c596910425 refactor: remove old metrics 2021-04-23 15:58:48 +00:00
Edd Robinson 97b2369140 refactor: swap existing metrics for THE NEW WAY 2021-04-23 15:58:48 +00:00
Edd Robinson f7271f73b6 feat: add counter metric 2021-04-23 15:58:48 +00:00
Edd Robinson 1396b86a6f refactor: tidy up labels 2021-04-23 15:58:48 +00:00
Edd Robinson 71016a7726 refactor: implement Default 2021-04-23 15:58:48 +00:00
Dom 9cdf652453 refactor: initialise per-instance registries
Removes the reliance on the global meter registry, avoiding shared
global state. Instead, each MetricRegistry instance contains it's own
Prometheus registry/exporter and OpenTelemetry collector/meter provider.
2021-04-23 15:58:48 +00:00
Edd Robinson ea909f45ad feat: RED metrics 2021-04-23 15:58:48 +00:00
kodiakhq[bot] 1741c063f6
Merge pull request #1283 from influxdata/debug-log-errors
feat(iox): Log write points errors at debug level
2021-04-23 13:24:53 +00:00
Marko Mikulicic d45fb7dbb4
feat(iox): Log write points errors at debug level 2021-04-23 15:20:53 +02:00
kodiakhq[bot] 4086e3373a
Merge pull request #1272 from influxdata/crepererum/issue1256
refactor: make chunks per-table
2021-04-23 07:23:19 +00:00
Marco Neumann f12f1eeef7 refactor: make chunks per-table
This changes the hierarchy from

```
database -> partition -> chunk -> table
```

to

```
database -> partition -> table -> chunk
```

Only the high-level APIs are changed for now. The chunk states (like
MutableBuffer and ReadBuffer) still multiplex tables, although they will
always only get a single table assigned (or no table if no data was
presented yet).

Closes #1256.
2021-04-23 09:18:55 +02:00
Edd Robinson 1f0e760f2f refactor: use bool::then 2021-04-22 21:59:41 +00:00
Edd Robinson 146b48325b refactor: use bool::then 2021-04-22 21:59:41 +00:00
Raphael Taylor-Davies 74c25f541d
feat: fast MUB dictionary arrow conversion (#1273)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-22 20:31:44 +00:00
kodiakhq[bot] 85d8a85e93
Merge pull request #1277 from influxdata/cn/dont-try-integration
test: Don't run any integration tests unless TEST_INTEGRATION is set
2021-04-22 18:59:53 +00:00
Carol (Nichols || Goulding) d8a92a8570 test: Don't run any integration tests unless TEST_INTEGRATION is set 2021-04-22 14:21:50 -04:00
Marko Mikulicic 9868e18d0a feat: Log git_hash when starting
Currently we log the git_hash version the binary has been compiled at only when the server actually starts,
which means that we don't easily see the version of the binary when it crashes before starting.
2021-04-22 14:40:48 +00:00
Raphael Taylor-Davies fe4fa29930
feat: MUB benchmarks (#635) (#1271) 2021-04-22 11:15:32 +00:00
Marko Mikulicic 83d6550316 feat: Implement write_entry_downstream 2021-04-21 20:50:46 +00:00
Carol (Nichols || Goulding) 938acb98e8 refactor: Rename WAL within the types, variables, and comments in the write_buffer crate 2021-04-21 17:43:03 +00:00
Carol (Nichols || Goulding) f0b93c5c8c refactor: Rename the wal crate to write_buffer 2021-04-21 17:43:03 +00:00
Carol (Nichols || Goulding) 18d253e82a fix: Rename a variable from expected_wal to expected_wall, it's wall clock 2021-04-21 17:43:03 +00:00
Carol (Nichols || Goulding) 88ca1a5245 fix: Rename wal.fbs to write_buffer.fbs 2021-04-21 17:43:03 +00:00
Carol (Nichols || Goulding) 80995afb70 fix: Change WAL to Write Buffer in comments and documentation 2021-04-21 17:43:03 +00:00