1877 lines
53 KiB
Markdown
1877 lines
53 KiB
Markdown
---
|
|
title: InfluxDB OSS metrics
|
|
description: >
|
|
Get metrics about the workload performance of an InfluxDB OSS instance.
|
|
menu:
|
|
influxdb_v2:
|
|
parent: InfluxDB internals
|
|
name: Metrics
|
|
influxdb/v2/tags: [cpu, memory, metrics, performance, Prometheus, storage, usage]
|
|
---
|
|
Get metrics about the workload performance of an InfluxDB OSS instance.
|
|
|
|
InfluxDB OSS exposes a `/metrics` endpoint that returns
|
|
performance, resource, and usage metrics formatted in the [Prometheus plain-text exposition format](https://prometheus.io/docs/instrumenting/exposition_formats).
|
|
|
|
{{< api-endpoint method="GET" endpoint="http://localhost:8086/metrics" api-ref="/influxdb/v2/api/#operation/GetMetrics" >}}
|
|
|
|
Metrics contain a name, an optional set of key-value pairs, and a value.
|
|
|
|
The following descriptors precede each metric:
|
|
|
|
- `HELP`: description of the metric
|
|
- `TYPE`: [Prometheus metric type](https://prometheus.io/docs/concepts/metric_types/) (`counter`, `gauge`, `histogram`, or `summary`)
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_info Information about the Go environment.
|
|
# TYPE go_info gauge
|
|
go_info{version="go1.17"} 1
|
|
# HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.
|
|
# TYPE go_memstats_alloc_bytes gauge
|
|
go_memstats_alloc_bytes 2.27988488e+08
|
|
# HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.
|
|
# TYPE go_memstats_alloc_bytes_total counter
|
|
go_memstats_alloc_bytes_total 9.68016566648e+11
|
|
```
|
|
|
|
The InfluxDB `/metrics` endpoint returns metrics associated with the following categories:
|
|
|
|
- [Boltdb](#boltdb-statistics)
|
|
- [Go runtime](#go-runtime-statistics)
|
|
- [HTTP API](#http-api-statistics)
|
|
- [InfluxDB objects and queries](#influxdb-object-and-query-statistics)
|
|
- [QC (query controller)](#qc-query-controller-statistics)
|
|
- [InfluxDB services](#influxdb-service-statistics)
|
|
- [InfluxDB storage](#influxdb-storage-statistics)
|
|
- [InfluxDB tasks](#influxdb-task-statistics)
|
|
|
|
## Boltdb statistics
|
|
|
|
### Reads total
|
|
|
|
Total number of boltdb reads.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP boltdb_reads_total Total number of boltdb reads
|
|
# TYPE boltdb_reads_total counter
|
|
boltdb_reads_total 75129
|
|
```
|
|
### Writes total
|
|
|
|
Total number of boltdb writes.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP boltdb_writes_total Total number of boltdb writes
|
|
# TYPE boltdb_writes_total counter
|
|
boltdb_writes_total 201591
|
|
```
|
|
|
|
## Go runtime statistics
|
|
|
|
For more detail about Go runtime statistics, see the following:
|
|
- [Go diagostics documentation](https://go.dev/doc/diagnostics)
|
|
- [Go mstats](https://github.com/golang/go/blob/master/src/runtime/mstats.go)
|
|
|
|
### GC (garbage collection) duration seconds
|
|
|
|
Summary of the pause duration of garbage collection cycles.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_gc_duration_seconds A summary of the pause duration of garbage collection cycles.
|
|
# TYPE go_gc_duration_seconds summary
|
|
go_gc_duration_seconds{quantile="0"} 5.1467e-05
|
|
--
|
|
```
|
|
|
|
### Goroutines
|
|
|
|
Number of goroutines that currently exist.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_goroutines Number of goroutines that currently exist.
|
|
# TYPE go_goroutines gauge
|
|
go_goroutines 1566
|
|
```
|
|
|
|
### Info
|
|
|
|
Information about the Go environment.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_info Information about the Go environment.
|
|
# TYPE go_info gauge
|
|
go_info{version="go1.17"} 1
|
|
```
|
|
|
|
### Memory allocated bytes
|
|
|
|
Number of bytes allocated and still in use.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.
|
|
# TYPE go_memstats_alloc_bytes gauge
|
|
go_memstats_alloc_bytes 2.27988488e+08
|
|
```
|
|
|
|
### Memory allocated bytes total
|
|
|
|
Total number of bytes allocated, even if freed.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.
|
|
# TYPE go_memstats_alloc_bytes_total counter
|
|
go_memstats_alloc_bytes_total 9.68016566648e+11
|
|
```
|
|
|
|
### Memory bucket hash system bytes
|
|
|
|
Number of bytes used by the profiling bucket hash table.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_buck_hash_sys_bytes Number of bytes used by the profiling bucket hash table.
|
|
# TYPE go_memstats_buck_hash_sys_bytes gauge
|
|
go_memstats_buck_hash_sys_bytes 1.0067613e+07
|
|
```
|
|
|
|
### Memory frees total
|
|
|
|
Total number of frees.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_frees_total Total number of frees.
|
|
# TYPE go_memstats_frees_total counter
|
|
go_memstats_frees_total 1.3774541795e+10
|
|
```
|
|
|
|
### Memory GC (garbage collection) CPU fraction
|
|
|
|
Fraction of this program's available CPU time used by the GC since the program started.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_gc_cpu_fraction The fraction of this program's available CPU time used by the GC since the program started.
|
|
# TYPE go_memstats_gc_cpu_fraction gauge
|
|
go_memstats_gc_cpu_fraction 0.011634918451016558
|
|
```
|
|
|
|
### Memory GC (garbage collection) system bytes
|
|
|
|
Number of bytes used for garbage collection system metadata.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_gc_sys_bytes Number of bytes used for garbage collection system metadata.
|
|
# TYPE go_memstats_gc_sys_bytes gauge
|
|
go_memstats_gc_sys_bytes 4.63048016e+08
|
|
```
|
|
|
|
### Memory heap allocated bytes
|
|
|
|
Number of heap bytes allocated and still in use.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_heap_alloc_bytes Number of heap bytes allocated and still in use.
|
|
# TYPE go_memstats_heap_alloc_bytes gauge
|
|
go_memstats_heap_alloc_bytes 2.27988488e+08
|
|
```
|
|
|
|
### Memory heap idle bytes
|
|
|
|
Number of heap bytes waiting to be used.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_heap_idle_bytes Number of heap bytes waiting to be used.
|
|
# TYPE go_memstats_heap_idle_bytes gauge
|
|
go_memstats_heap_idle_bytes 1.0918273024e+10
|
|
```
|
|
|
|
### Memory heap in use bytes
|
|
|
|
Number of heap bytes that are in use.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_heap_inuse_bytes Number of heap bytes that are in use.
|
|
# TYPE go_memstats_heap_inuse_bytes gauge
|
|
go_memstats_heap_inuse_bytes 3.5975168e+08
|
|
```
|
|
|
|
### Memory heap objects
|
|
|
|
Number of allocated objects.
|
|
_Allocated_ heap objects include all reachable objects, as
|
|
well as unreachable objects that the garbage collector has not yet freed.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_heap_objects Number of allocated objects.
|
|
# TYPE go_memstats_heap_objects gauge
|
|
go_memstats_heap_objects 2.404017e+06
|
|
```
|
|
|
|
### Memory heap released bytes
|
|
|
|
Number of heap bytes released to the OS.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_heap_released_bytes Number of heap bytes released to OS.
|
|
# TYPE go_memstats_heap_released_bytes gauge
|
|
go_memstats_heap_released_bytes 2.095038464e+09
|
|
```
|
|
|
|
### Memory heap system bytes
|
|
|
|
Number of heap bytes obtained from the system.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_heap_sys_bytes Number of heap bytes obtained from system.
|
|
# TYPE go_memstats_heap_sys_bytes gauge
|
|
go_memstats_heap_sys_bytes 1.1278024704e+10
|
|
```
|
|
|
|
### Memory last GC (garbage collection) time seconds
|
|
|
|
Number of seconds since 1970 of the last garbage collection.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_last_gc_time_seconds Number of seconds since 1970 of last garbage collection.
|
|
# TYPE go_memstats_last_gc_time_seconds gauge
|
|
go_memstats_last_gc_time_seconds 1.64217120199452e+09
|
|
```
|
|
|
|
### Memory lookups total
|
|
|
|
Total number of pointer lookups.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_lookups_total Total number of pointer lookups.
|
|
# TYPE go_memstats_lookups_total counter
|
|
go_memstats_lookups_total 0
|
|
```
|
|
|
|
### Memory allocations total
|
|
|
|
Cumulative count of heap objects allocated.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_mallocs_total Total number of mallocs.
|
|
# TYPE go_memstats_mallocs_total counter
|
|
go_memstats_mallocs_total 1.3776945812e+10
|
|
```
|
|
|
|
### Memory mcache in use bytes
|
|
|
|
Number of bytes in use by mcache structures.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_mcache_inuse_bytes Number of bytes in use by mcache structures.
|
|
# TYPE go_memstats_mcache_inuse_bytes gauge
|
|
go_memstats_mcache_inuse_bytes 9600
|
|
```
|
|
|
|
### Memory mcache system bytes
|
|
|
|
Number of bytes used for mcache structures obtained from system.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_mcache_sys_bytes Number of bytes used for mcache structures obtained from system.
|
|
# TYPE go_memstats_mcache_sys_bytes gauge
|
|
go_memstats_mcache_sys_bytes 16384
|
|
```
|
|
|
|
### Memory mspan in use bytes
|
|
|
|
Number of bytes of allocated mspan structures.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_mspan_inuse_bytes Number of bytes in use by mspan structures.
|
|
# TYPE go_memstats_mspan_inuse_bytes gauge
|
|
go_memstats_mspan_inuse_bytes 4.199e+06
|
|
```
|
|
|
|
### Memory mspan system bytes
|
|
|
|
Bytes of memory obtained from the OS for mspan structures.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_mspan_sys_bytes Number of bytes used for mspan structures obtained from system.
|
|
# TYPE go_memstats_mspan_sys_bytes gauge
|
|
go_memstats_mspan_sys_bytes 1.65609472e+08
|
|
```
|
|
|
|
### Memory next GC (garbage collection) bytes
|
|
|
|
Number of heap bytes when next garbage collection will take place.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_next_gc_bytes Number of heap bytes when next garbage collection will take place.
|
|
# TYPE go_memstats_next_gc_bytes gauge
|
|
go_memstats_next_gc_bytes 4.45628016e+08
|
|
```
|
|
|
|
### Memory other system bytes
|
|
|
|
Number of bytes used for other system allocations.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_other_sys_bytes Number of bytes used for other system allocations.
|
|
# TYPE go_memstats_other_sys_bytes gauge
|
|
go_memstats_other_sys_bytes 8.1917722e+07
|
|
```
|
|
|
|
### Memory stack in use bytes
|
|
|
|
Number of bytes in use by the stack allocator.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_stack_inuse_bytes Number of bytes in use by the stack allocator.
|
|
# TYPE go_memstats_stack_inuse_bytes gauge
|
|
go_memstats_stack_inuse_bytes 8.84736e+06
|
|
```
|
|
|
|
### Memory stack system bytes
|
|
|
|
Number of bytes obtained from system for stack allocator.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_stack_sys_bytes Number of bytes obtained from system for stack allocator.
|
|
# TYPE go_memstats_stack_sys_bytes gauge
|
|
go_memstats_stack_sys_bytes 8.84736e+06
|
|
```
|
|
|
|
### Memory system bytes
|
|
|
|
Number of bytes obtained from system.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_memstats_sys_bytes Number of bytes obtained from system.
|
|
# TYPE go_memstats_sys_bytes gauge
|
|
go_memstats_sys_bytes 1.2007531271e+10
|
|
```
|
|
|
|
### Threads
|
|
|
|
Number of OS threads created.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP go_threads Number of OS threads created.
|
|
# TYPE go_threads gauge
|
|
go_threads 27
|
|
```
|
|
|
|
## HTTP API statistics
|
|
|
|
### API request duration seconds
|
|
|
|
How long InfluxDB took to respond to the HTTP request.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP http_api_request_duration_seconds Time taken to respond to HTTP request
|
|
# TYPE http_api_request_duration_seconds histogram
|
|
http_api_request_duration_seconds_bucket{handler="platform",method="DELETE",path="/api/v2/authorizations/:id",response_code="204",status="2XX",user_agent="Chrome",le="0.005"} 0
|
|
--
|
|
```
|
|
|
|
### API requests total
|
|
|
|
Number of HTTP requests received.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP http_api_requests_total Number of http requests received
|
|
# TYPE http_api_requests_total counter
|
|
http_api_requests_total{handler="platform",method="DELETE",path="/api/v2/authorizations/:id",response_code="204",status="2XX",user_agent="Chrome"} 1
|
|
--
|
|
```
|
|
|
|
### Query request bytes
|
|
|
|
Count of bytes received.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP http_query_request_bytes Count of bytes received
|
|
# TYPE http_query_request_bytes counter
|
|
http_query_request_bytes{endpoint="/api/v2/query",org_id="48c88459ee424a04",status="200"} 727
|
|
```
|
|
|
|
### Query request count
|
|
|
|
Total number of query requests.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP http_query_request_count Total number of query requests
|
|
# TYPE http_query_request_count counter
|
|
http_query_request_count{endpoint="/api/v2/query",org_id="48c88459ee424a04",status="200"} 2
|
|
```
|
|
|
|
### Query response bytes
|
|
|
|
Count of bytes returned by the query endpoint.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP http_query_response_bytes Count of bytes returned
|
|
# TYPE http_query_response_bytes counter
|
|
http_query_response_bytes{endpoint="/api/v2/query",org_id="48c88459ee424a04",status="200"} 103
|
|
```
|
|
|
|
## InfluxDB object and query statistics
|
|
|
|
### Buckets total
|
|
|
|
Total number of buckets on the server.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP influxdb_buckets_total Number of total buckets on the server
|
|
# TYPE influxdb_buckets_total counter
|
|
influxdb_buckets_total 9
|
|
```
|
|
|
|
### Dashboards total
|
|
|
|
Total number of dashboards on the server.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP influxdb_dashboards_total Number of total dashboards on the server
|
|
# TYPE influxdb_dashboards_total counter
|
|
influxdb_dashboards_total 2
|
|
```
|
|
|
|
### Info
|
|
|
|
Information about the InfluxDB environment.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP influxdb_info Information about the influxdb environment.
|
|
# TYPE influxdb_info gauge
|
|
influxdb_info{arch="amd64",build_date="2021-12-28T22:12:40Z",commit="657e1839de",cpus="8",os="darwin",version="v2.1.1"} 1
|
|
```
|
|
|
|
### Organizations total
|
|
|
|
Total number of organizations on the server.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP influxdb_organizations_total Number of total organizations on the server
|
|
# TYPE influxdb_organizations_total counter
|
|
influxdb_organizations_total 2
|
|
```
|
|
|
|
### Replications total
|
|
|
|
Total number of replication configurations on the server
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP influxdb_replications_total Number of total replication configurations on the server
|
|
# TYPE influxdb_replications_total counter
|
|
influxdb_replications_total 1
|
|
```
|
|
|
|
### Scrapers total
|
|
|
|
Total number of scrapers on the server.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP influxdb_scrapers_total Number of total scrapers on the server
|
|
# TYPE influxdb_scrapers_total counter
|
|
influxdb_scrapers_total 0
|
|
```
|
|
|
|
### Telegrafs total
|
|
|
|
Total number of Telegraf configurations on the server.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP influxdb_telegrafs_total Number of total telegraf configurations on the server
|
|
# TYPE influxdb_telegrafs_total counter
|
|
influxdb_telegrafs_total 0
|
|
```
|
|
|
|
### Token services total
|
|
|
|
Total number of API tokens on the server.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP influxdb_tokens_total Number of total tokens on the server
|
|
# TYPE influxdb_tokens_total counter
|
|
influxdb_tokens_total 23
|
|
```
|
|
|
|
### Uptime seconds
|
|
|
|
InfluxDB process uptime in seconds.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP influxdb_uptime_seconds influxdb process uptime in seconds
|
|
# TYPE influxdb_uptime_seconds gauge
|
|
influxdb_uptime_seconds{id="077238f9ca108000"} 343354.914499305
|
|
```
|
|
|
|
### Users total
|
|
|
|
Total number of users on the server.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP influxdb_users_total Number of total users on the server
|
|
# TYPE influxdb_users_total counter
|
|
influxdb_users_total 84
|
|
```
|
|
|
|
## QC (query controller) statistics
|
|
|
|
### All active
|
|
|
|
Number of queries in all states.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP qc_all_active Number of queries in all states
|
|
# TYPE qc_all_active gauge
|
|
qc_all_active{org="48c88459ee424a04"} 0
|
|
--
|
|
```
|
|
|
|
### All duration seconds
|
|
|
|
Total time spent in all query states.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP qc_all_duration_seconds Histogram of total times spent in all query states
|
|
# TYPE qc_all_duration_seconds histogram
|
|
qc_all_duration_seconds_bucket{org="48c88459ee424a04",le="0.001"} 0
|
|
--
|
|
```
|
|
|
|
### Compiling active
|
|
|
|
Number of queries actively compiling.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP qc_compiling_active Number of queries actively compiling
|
|
# TYPE qc_compiling_active gauge
|
|
qc_compiling_active{compiler_type="ast",org="ed32b47572a0137b"} 0
|
|
--
|
|
```
|
|
|
|
### Compiling duration seconds
|
|
|
|
Histogram of times spent compiling queries.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP qc_compiling_duration_seconds Histogram of times spent compiling queries
|
|
# TYPE qc_compiling_duration_seconds histogram
|
|
qc_compiling_duration_seconds_bucket{compiler_type="ast",org="ed32b47572a0137b",le="0.001"} 999
|
|
--
|
|
```
|
|
|
|
### Executing active
|
|
|
|
Number of queries actively executing.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP qc_executing_active Number of queries actively executing
|
|
# TYPE qc_executing_active gauge
|
|
qc_executing_active{org="48c88459ee424a04"} 0
|
|
--
|
|
```
|
|
|
|
### Executing duration seconds
|
|
|
|
Histogram of times spent executing queries.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP qc_executing_duration_seconds Histogram of times spent executing queries
|
|
# TYPE qc_executing_duration_seconds histogram
|
|
qc_executing_duration_seconds_bucket{org="48c88459ee424a04",le="0.001"} 0
|
|
--
|
|
```
|
|
|
|
### Memory unused bytes
|
|
|
|
Free memory as seen by the internal memory manager.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP qc_memory_unused_bytes The free memory as seen by the internal memory manager
|
|
# TYPE qc_memory_unused_bytes gauge
|
|
qc_memory_unused_bytes{org="48c88459ee424a04"} 0
|
|
--
|
|
```
|
|
|
|
### Queueing active
|
|
|
|
Number of queries actively queueing.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP qc_queueing_active Number of queries actively queueing
|
|
# TYPE qc_queueing_active gauge
|
|
qc_queueing_active{org="48c88459ee424a04"} 0
|
|
--
|
|
```
|
|
|
|
### Queueing duration seconds
|
|
|
|
Histogram of times spent queueing queries.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP qc_queueing_duration_seconds Histogram of times spent queueing queries
|
|
# TYPE qc_queueing_duration_seconds histogram
|
|
qc_queueing_duration_seconds_bucket{org="48c88459ee424a04",le="0.001"} 2
|
|
--
|
|
```
|
|
|
|
### Requests total
|
|
|
|
Count of the query requests.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP qc_requests_total Count of the query requests
|
|
# TYPE qc_requests_total counter
|
|
qc_requests_total{org="48c88459ee424a04",result="success"} 2
|
|
--
|
|
```
|
|
|
|
### Read request duration
|
|
|
|
Histogram of times spent in read requests.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP query_influxdb_source_read_request_duration_seconds Histogram of times spent in read requests
|
|
# TYPE query_influxdb_source_read_request_duration_seconds histogram
|
|
query_influxdb_source_read_request_duration_seconds_bucket{op="readTagKeys",org="48c88459ee424a04",le="0.001"} 0
|
|
--
|
|
```
|
|
|
|
## InfluxDB service statistics
|
|
|
|
### Bucket service new call total
|
|
|
|
Number of calls to the bucket creation service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_bucket_new_call_total Number of calls
|
|
# TYPE service_bucket_new_call_total counter
|
|
service_bucket_new_call_total{method="find_bucket"} 6177
|
|
--
|
|
```
|
|
|
|
### Bucket service new duration
|
|
|
|
Duration of calls to the bucket creation service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_bucket_new_duration Duration of calls
|
|
# TYPE service_bucket_new_duration histogram
|
|
service_bucket_new_duration_bucket{method="find_bucket",le="0.005"} 5876
|
|
--
|
|
```
|
|
|
|
### Bucket service new error total
|
|
|
|
Number of errors encountered by the bucket creation service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_bucket_new_error_total Number of errors encountered
|
|
# TYPE service_bucket_new_error_total counter
|
|
service_bucket_new_error_total{code="not found",method="find_bucket_by_id"} 76
|
|
```
|
|
|
|
### Onboard service new call total
|
|
|
|
Number of calls to the onboarding service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_onboard_new_call_total Number of calls
|
|
# TYPE service_onboard_new_call_total counter
|
|
service_onboard_new_call_total{method="is_onboarding"} 11
|
|
```
|
|
|
|
### Onboard service new duration
|
|
|
|
Duration of calls to the onboarding service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_onboard_new_duration Duration of calls
|
|
# TYPE service_onboard_new_duration histogram
|
|
service_onboard_new_duration_bucket{method="is_onboarding",le="0.005"} 11
|
|
--
|
|
```
|
|
|
|
### Organization service call total
|
|
|
|
Number of calls to the organization service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_org_call_total Number of calls
|
|
# TYPE service_org_call_total counter
|
|
service_org_call_total{method="find_labels_for_resource"} 10
|
|
```
|
|
|
|
### Organization service duration
|
|
|
|
Duration of calls to the organization service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_org_duration Duration of calls
|
|
# TYPE service_org_duration histogram
|
|
service_org_duration_bucket{method="find_labels_for_resource",le="0.005"} 10
|
|
--
|
|
```
|
|
|
|
### Organization service new call total
|
|
|
|
Number of calls to the organization creation service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_org_new_call_total Number of calls
|
|
# TYPE service_org_new_call_total counter
|
|
service_org_new_call_total{method="find_org"} 1572
|
|
--
|
|
```
|
|
|
|
### Organization service new duration
|
|
|
|
Duration of calls to the organization creation service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_org_new_duration Duration of calls
|
|
# TYPE service_org_new_duration histogram
|
|
service_org_new_duration_bucket{method="find_org",le="0.005"} 1475
|
|
--
|
|
```
|
|
|
|
### Organization service new error total
|
|
|
|
Number of errors encountered by the organization creation service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_org_new_error_total Number of errors encountered
|
|
# TYPE service_org_new_error_total counter
|
|
service_org_new_error_total{code="not found",method="find_orgs"} 1
|
|
```
|
|
|
|
### Password service new call total
|
|
|
|
Number of calls to the password creation service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_password_new_call_total Number of calls
|
|
# TYPE service_password_new_call_total counter
|
|
service_password_new_call_total{method="compare_password"} 4
|
|
```
|
|
|
|
### Password service new duration
|
|
|
|
Duration of calls to the password creation service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_password_new_duration Duration of calls
|
|
# TYPE service_password_new_duration histogram
|
|
service_password_new_duration_bucket{method="compare_password",le="0.005"} 0
|
|
--
|
|
```
|
|
|
|
### Password service new error total
|
|
|
|
Number of errors encountered by the password creation service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_password_new_error_total Number of errors encountered
|
|
# TYPE service_password_new_error_total counter
|
|
service_password_new_error_total{code="forbidden",method="compare_password"} 1
|
|
```
|
|
|
|
### Pkger service call total
|
|
|
|
Number of calls to the `pkger` service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_pkger_call_total Number of calls
|
|
# TYPE service_pkger_call_total counter
|
|
service_pkger_call_total{method="export"} 3
|
|
```
|
|
|
|
### Pkger service duration
|
|
|
|
Duration of calls to the `pkger` service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_pkger_duration Duration of calls
|
|
# TYPE service_pkger_duration histogram
|
|
service_pkger_duration_bucket{method="export",le="0.005"} 0
|
|
--
|
|
```
|
|
|
|
### Pkger service template export
|
|
|
|
Metrics for exported resources.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_pkger_template_export Metrics for resources being exported
|
|
# TYPE service_pkger_template_export counter
|
|
service_pkger_template_export{buckets="0",by_stack="false",checks="0",dashboards="0",endpoints="0",label_mappings="0",labels="0",method="export",num_org_ids="1",rules="0",tasks="0",telegraf_configs="0",variables="0"} 3
|
|
```
|
|
|
|
### Replication service call total
|
|
|
|
Number of calls to the replication service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_replication_call_total Number of calls
|
|
# TYPE service_replication_call_total counter
|
|
service_replication_call_total{method="find_replications"} 1
|
|
```
|
|
|
|
### Replication service call duration
|
|
|
|
Duration of calls to the replication service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_replication_duration Duration of calls
|
|
# TYPE service_replication_duration histogram
|
|
service_replication_duration_bucket{method="create_replication",le="0.005"} 0
|
|
service_replication_duration_bucket{method="find_replications",le="0.005"} 1
|
|
```
|
|
|
|
### Replication queue total points queued
|
|
|
|
Sum of all points that have been successfully added to the replication stream queue.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP replications_queue_total_points_queued Sum of all points
|
|
# TYPE replications_queue_total_points_queued Counter
|
|
replications_queue_total_points_queued
|
|
```
|
|
|
|
### Replications queue total bytes queued
|
|
|
|
Sum of all bytes that have been successfully added to the replication stream queue.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP replications_queue_total_bytes_queued Sum of all bytes that have been successfully added to the replication stream queue
|
|
# TYPE replications_queue_total_bytes_queued counter
|
|
replications_queue_total_bytes_queued{replicationID="0cd2cd54e9fe9000"} 289
|
|
```
|
|
|
|
### Replications queue current bytes queued
|
|
|
|
Current number of bytes in the replication stream queue remaining to be processed.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP replications_queue_current_bytes_queued Current number of bytes in the replication stream queue remaining to be processed
|
|
# TYPE replications_queue_current_bytes_queued gauge
|
|
replications_queue_current_bytes_queued{replicationID="0cd2cd54e9fe9000"} 297
|
|
```
|
|
|
|
### Replications queue remote write errors
|
|
|
|
Error codes returned from attempted remote writes.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP replications_queue_remote_write_errors Error codes returned from attempted remote writes
|
|
# TYPE replications_queue_remote_write_errors counter
|
|
replications_queue_remote_write_errors{code="404",replicationID="0cd2cd54e9fe9000"} 11
|
|
```
|
|
|
|
### Replications queue remote write bytes sent
|
|
|
|
Bytes of data successfully sent to the remote by the replication stream.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP replications_queue_remote_write_bytes_sent Bytes of data successfully sent to the remote by the replication stream
|
|
# TYPE replications_queue_remote_write_bytes_sent counter
|
|
replications_queue_remote_write_bytes_sent{...}
|
|
```
|
|
|
|
### Replications queue
|
|
|
|
Bytes of data dropped due to remote write failures.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP replications_queue_remote_write_bytes_dropped Bytes of data dropped due to remote write failures
|
|
# TYPE replications_queue_remote_write_bytes_dropped counter
|
|
replications_queue_remote_write_bytes_dropped{...}
|
|
```
|
|
|
|
### Replications queue
|
|
|
|
Sum of all points that could not be added to the local replication queue.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP replications_queue_points_failed_to_queue
|
|
# TYPE replications_queue_points_failed_to_queue
|
|
replications_queue_points_failed_to_queue{...}
|
|
```
|
|
|
|
### Replications queue
|
|
|
|
Sum of all bytes that could not be added to the local replication queue.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP replications_queue_bytes_failed_to_queue Sum of all bytes that could not be added to the local replication queue
|
|
# TYPE replications_queue_bytes_failed_to_queue counter
|
|
replications_queue_bytes_failed_to_queue{...}
|
|
```
|
|
|
|
### Session service call total
|
|
|
|
Number of calls to the session service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_session_call_total Number of calls
|
|
# TYPE service_session_call_total counter
|
|
service_session_call_total{method="create_session"} 3
|
|
--
|
|
```
|
|
|
|
### Session service duration
|
|
|
|
Duration of calls to the session service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_session_duration Duration of calls
|
|
# TYPE service_session_duration histogram
|
|
service_session_duration_bucket{method="create_session",le="0.005"} 3
|
|
--
|
|
```
|
|
|
|
### Session service error total
|
|
|
|
Number of errors encountered by the session service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_session_error_total Number of errors encountered
|
|
# TYPE service_session_error_total counter
|
|
service_session_error_total{code="not found",method="find_session"} 4
|
|
```
|
|
|
|
### Token service call total
|
|
|
|
Number of calls to the token service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_token_call_total Number of calls
|
|
# TYPE service_token_call_total counter
|
|
service_token_call_total{method="delete_authorization"} 3
|
|
--
|
|
```
|
|
|
|
### Token service duration
|
|
|
|
Duration of calls to the token service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_token_duration Duration of calls
|
|
# TYPE service_token_duration histogram
|
|
service_token_duration_bucket{method="delete_authorization",le="0.005"} 1
|
|
--
|
|
```
|
|
|
|
### Token service error total
|
|
|
|
Number of errors encountered by the token service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_token_error_total Number of errors encountered
|
|
# TYPE service_token_error_total counter
|
|
service_token_error_total{code="not found",method="delete_authorization"} 1
|
|
```
|
|
|
|
### URM new call total
|
|
Number of calls to the URM (unified resource management) creation service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_urm_new_call_total Number of calls
|
|
# TYPE service_urm_new_call_total counter
|
|
service_urm_new_call_total{method="find_urms"} 6451
|
|
```
|
|
|
|
### urm new duration
|
|
Duration of calls to the URM creation service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_urm_new_duration Duration of calls
|
|
# TYPE service_urm_new_duration histogram
|
|
service_urm_new_duration_bucket{method="find_urms",le="0.005"} 6198
|
|
--
|
|
```
|
|
|
|
### User new call total
|
|
Number of calls to the user creation service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_user_new_call_total Number of calls
|
|
# TYPE service_user_new_call_total counter
|
|
service_user_new_call_total{method="find_permission_for_user"} 4806
|
|
--
|
|
```
|
|
|
|
### User new duration
|
|
Duration of calls to the user creation service.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP service_user_new_duration Duration of calls
|
|
# TYPE service_user_new_duration histogram
|
|
service_user_new_duration_bucket{method="find_permission_for_user",le="0.005"} 4039
|
|
--
|
|
```
|
|
|
|
## InfluxDB storage statistics
|
|
|
|
To learn how InfluxDB writes, stores, and caches data, see [InfluxDB storage engine](/influxdb/v2/reference/internals/storage-engine/).
|
|
|
|
### Bucket measurement number
|
|
|
|
Number of measurements in a bucket.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_bucket_measurement_num Gauge of measurement cardinality per bucket
|
|
# TYPE storage_bucket_measurement_num gauge
|
|
storage_bucket_measurement_num{bucket="0c3dd7d2d97f4b23"} 4
|
|
--
|
|
```
|
|
|
|
### Bucket series number
|
|
|
|
Number of series in a bucket.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_bucket_series_num Gauge of series cardinality per bucket
|
|
# TYPE storage_bucket_series_num gauge
|
|
storage_bucket_series_num{bucket="0c3dd7d2d97f4b23"} 38
|
|
--
|
|
```
|
|
|
|
### Cache disk bytes
|
|
|
|
Size (in bytes) of the most recent [snapshot](/influxdb/v2/reference/internals/storage-engine/#cache).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_cache_disk_bytes Gauge of size of most recent snapshot
|
|
# TYPE storage_cache_disk_bytes gauge
|
|
storage_cache_disk_bytes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
|
|
--
|
|
```
|
|
|
|
### Cache in use bytes
|
|
|
|
Current memory consumption (in bytes) of the [cache](/influxdb/v2/reference/internals/storage-engine/#cache).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_cache_inuse_bytes Gauge of current memory consumption of cache
|
|
# TYPE storage_cache_inuse_bytes gauge
|
|
storage_cache_inuse_bytes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
|
|
--
|
|
```
|
|
|
|
### Cache latest snapshot
|
|
|
|
[Unix time](/influxdb/v2/reference/glossary/#unix-timestamp) of the most recent [snapshot](/influxdb/v2/reference/internals/storage-engine/#cache).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_cache_latest_snapshot Unix time of most recent snapshot
|
|
# TYPE storage_cache_latest_snapshot gauge
|
|
storage_cache_latest_snapshot{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 1.644269658196893e+09
|
|
--
|
|
```
|
|
|
|
### Cache writes with dropped points
|
|
|
|
Cumulative number of [cached](/influxdb/v2/reference/internals/storage-engine/#cache) writes that had [rejected points](/influxdb/v2/reference/glossary/#rejected-point). Writes with rejected points also increment the [write errors counter (`storage_cache_writes_err`)](#cache-writes-failed).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_cache_writes_dropped Counter of writes to cache with some dropped points
|
|
# TYPE storage_cache_writes_dropped counter
|
|
storage_cache_writes_dropped{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
|
|
--
|
|
```
|
|
|
|
### Cache writes failed
|
|
|
|
Cumulative number of [cached](/influxdb/v2/reference/internals/storage-engine/#cache) writes that [failed](/influxdb/v2/write-data/troubleshoot/#troubleshoot-failures), inclusive of [cache writes with dropped points (`storage_cache_writes_dropped`)](#cache-writes-with-dropped-points).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_cache_writes_err Counter of failed writes to cache
|
|
# TYPE storage_cache_writes_err counter
|
|
storage_cache_writes_err{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
|
|
--
|
|
```
|
|
|
|
### Cache writes total
|
|
|
|
Cumulative number of writes to [cache](/influxdb/v2/reference/internals/storage-engine/#cache).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_cache_writes_total Counter of all writes to cache
|
|
# TYPE storage_cache_writes_total counter
|
|
storage_cache_writes_total{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
|
|
--
|
|
```
|
|
|
|
### Compactions active
|
|
|
|
Currently running [TSM](/influxdb/v2/reference/internals/storage-engine/#time-structured-merge-tree-tsm) compactions (by level).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_compactions_active Gauge of compactions (by level) currently running
|
|
# TYPE storage_compactions_active gauge
|
|
storage_compactions_active{bucket="ec3f82d1de90eddf",engine="tsm1",id="565",level="1",path="/Users/me/.influxdbv2/engine/data/ec3f82d1de90eddf/autogen/565",walPath="/Users/me/.influxdbv2/engine/wal/ec3f82d1de90eddf/autogen/565"} 0
|
|
--
|
|
```
|
|
|
|
### Compactions since startup
|
|
|
|
[TSM](/influxdb/v2/reference/internals/storage-engine/#time-structured-merge-tree-tsm) compactions (by level) since startup.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_compactions_duration_seconds Histogram of compactions by level since startup
|
|
# TYPE storage_compactions_duration_seconds histogram
|
|
storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="60"} 1
|
|
storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="600"} 1
|
|
storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="6000"} 1
|
|
storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="+Inf"} 1
|
|
storage_compactions_duration_seconds_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567"} 0.167250668
|
|
storage_compactions_duration_seconds_count{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567"} 1
|
|
--
|
|
```
|
|
|
|
### Compactions failed
|
|
|
|
Failed [TSM](/influxdb/v2/reference/internals/storage-engine/#time-structured-merge-tree-tsm) compactions (by level).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_compactions_failed Counter of TSM compactions (by level) that have failed due to error
|
|
# TYPE storage_compactions_failed counter
|
|
storage_compactions_failed{bucket="ec3f82d1de90eddf",engine="tsm1",id="565",level="1",path="/Users/me/.influxdbv2/engine/data/ec3f82d1de90eddf/autogen/565",walPath="/Users/me/.influxdbv2/engine/wal/ec3f82d1de90eddf/autogen/565"} 0
|
|
--
|
|
```
|
|
|
|
### Compactions queued
|
|
|
|
Queued [TSM](/influxdb/v2/reference/internals/storage-engine/#time-structured-merge-tree-tsm) compactions (by level).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_compactions_queued Counter of TSM compactions (by level) that are currently queued
|
|
# TYPE storage_compactions_queued gauge
|
|
storage_compactions_queued{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="1",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567"} 0
|
|
--
|
|
```
|
|
|
|
### Retention check duration
|
|
|
|
Retention policy check duration (in seconds).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_retention_check_duration Histogram of duration of retention check (in seconds)
|
|
# TYPE storage_retention_check_duration histogram
|
|
storage_retention_check_duration_bucket{le="0.005"} 1
|
|
storage_retention_check_duration_bucket{le="0.01"} 1
|
|
storage_retention_check_duration_bucket{le="0.025"} 1
|
|
storage_retention_check_duration_bucket{le="0.05"} 1
|
|
storage_retention_check_duration_bucket{le="0.1"} 1
|
|
storage_retention_check_duration_bucket{le="0.25"} 1
|
|
storage_retention_check_duration_bucket{le="0.5"} 1
|
|
storage_retention_check_duration_bucket{le="1"} 1
|
|
storage_retention_check_duration_bucket{le="2.5"} 1
|
|
storage_retention_check_duration_bucket{le="5"} 1
|
|
storage_retention_check_duration_bucket{le="10"} 1
|
|
storage_retention_check_duration_bucket{le="+Inf"} 1
|
|
storage_retention_check_duration_sum 0.000351857
|
|
storage_retention_check_duration_count 1
|
|
--
|
|
```
|
|
|
|
### Shard disk size
|
|
|
|
Disk size (in bytes) of the [shard](/influxdb/v2/reference/internals/shards/).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_shard_disk_size Gauge of the disk size for the shard
|
|
# TYPE storage_shard_disk_size gauge
|
|
storage_shard_disk_size{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 4.188743e+06
|
|
--
|
|
```
|
|
|
|
### Shard fields created
|
|
|
|
Number of [shard](/influxdb/v2/reference/internals/shards/) fields created.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_shard_fields_created Counter of the number of fields created
|
|
# TYPE storage_shard_fields_created counter
|
|
storage_shard_fields_created{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
|
|
--
|
|
```
|
|
|
|
### Shard series
|
|
|
|
Number of series in the [shard](/influxdb/v2/reference/internals/shards/) index.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_shard_series Gauge of the number of series in the shard index
|
|
# TYPE storage_shard_series gauge
|
|
storage_shard_series{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 38
|
|
--
|
|
```
|
|
|
|
### Shard writes
|
|
|
|
Number of [shard write](/influxdb/v2/reference/internals/shards/#shard-writes) requests.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_shard_write_count Count of the number of write requests
|
|
# TYPE storage_shard_write_count counter
|
|
storage_shard_write_count{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
|
|
--
|
|
```
|
|
|
|
### Shard dropped points
|
|
|
|
Number of [rejected points](/influxdb/v2/reference/glossary/#rejected-point) in [shard writes](/influxdb/v2/reference/internals/shards/#shard-writes).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_shard_write_dropped_sum Counter of the number of points dropped
|
|
# TYPE storage_shard_write_dropped_sum counter
|
|
storage_shard_write_dropped_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
|
|
--
|
|
```
|
|
|
|
### Shard writes with errors
|
|
|
|
Number of [shard write](/influxdb/v2/reference/internals/shards/#shard-writes) requests with errors.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_shard_write_err_count Count of the number of write requests with errors
|
|
# TYPE storage_shard_write_err_count counter
|
|
storage_shard_write_err_count{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
|
|
--
|
|
```
|
|
|
|
### Points in shard writes with errors
|
|
|
|
Number of points in [shard write](/influxdb/v2/reference/internals/shards/#shard-writes) requests with errors.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_shard_write_err_sum Counter of the number of points for write requests with errors
|
|
# TYPE storage_shard_write_err_sum counter
|
|
storage_shard_write_err_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
|
|
--
|
|
```
|
|
|
|
### Points in shard writes
|
|
|
|
Number of points in [shard write](/influxdb/v2/reference/internals/shards/#shard-writes) requests.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_shard_write_sum Counter of the number of points for write requests
|
|
# TYPE storage_shard_write_sum counter
|
|
storage_shard_write_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
|
|
--
|
|
```
|
|
|
|
### Shard data size
|
|
|
|
Gauge of the data size (in bytes) for each [shard](/influxdb/v2/reference/internals/shards/).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_tsm_files_disk_bytes Gauge of data size in bytes for each shard
|
|
# TYPE storage_tsm_files_disk_bytes gauge
|
|
storage_tsm_files_disk_bytes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 4.188743e+06
|
|
--
|
|
```
|
|
|
|
### Shard files
|
|
|
|
Number of files per [shard](/influxdb/v2/reference/internals/shards/).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_tsm_files_total Gauge of number of files per shard
|
|
# TYPE storage_tsm_files_total gauge
|
|
storage_tsm_files_total{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 1
|
|
--
|
|
```
|
|
|
|
### WAL size
|
|
|
|
[WAL](/influxdb/v2/reference/internals/storage-engine/#write-ahead-log-wal) size (in bytes).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_wal_size Gauge of size of WAL in bytes
|
|
# TYPE storage_wal_size gauge
|
|
storage_wal_size{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
|
|
--
|
|
```
|
|
|
|
## WAL write attempts
|
|
|
|
Cumulative number of write attempts to the [WAL](/influxdb/v2/reference/internals/storage-engine/#write-ahead-log-wal).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_wal_writes Number of write attempts to the WAL
|
|
# TYPE storage_wal_writes counter
|
|
storage_wal_writes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
|
|
--
|
|
```
|
|
|
|
## WAL failed write attempts
|
|
|
|
Cumulative number of failed write attempts to the [WAL](/influxdb/v2/reference/internals/storage-engine/#write-ahead-log-wal).
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_wal_writes_err Number of failed write attempts to the WAL
|
|
# TYPE storage_wal_writes_err counter
|
|
storage_wal_writes_err{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
|
|
--
|
|
```
|
|
|
|
## Points dropped due to partial writes
|
|
|
|
Number of points dropped due to partial writes.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_writer_dropped_points Histogram of number of points dropped due to partial writes
|
|
# TYPE storage_writer_dropped_points histogram
|
|
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 0
|
|
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 0
|
|
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 0
|
|
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 0
|
|
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 0
|
|
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 0
|
|
storage_writer_dropped_points_sum{path="/Users/me/.influxdbv2/engine"} 0
|
|
storage_writer_dropped_points_count{path="/Users/me/.influxdbv2/engine"} 0
|
|
--
|
|
```
|
|
|
|
## Points in shard write requests with errors
|
|
|
|
Number of points in [shard write](/influxdb/v2/reference/internals/shards/#shard-writes) requests with errors.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_writer_err_points Histogram of number of points in errored shard write requests
|
|
# TYPE storage_writer_err_points histogram
|
|
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 0
|
|
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 0
|
|
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 0
|
|
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 0
|
|
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 0
|
|
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 0
|
|
storage_writer_err_points_sum{path="/Users/me/.influxdbv2/engine"} 0
|
|
storage_writer_err_points_count{path="/Users/me/.influxdbv2/engine"} 0
|
|
--
|
|
```
|
|
|
|
## Points in successful shard write requests
|
|
|
|
Number of points in successful [shard write](/influxdb/v2/reference/internals/shards/#shard-writes) requests.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_writer_ok_points Histogram of number of points in successful shard write requests
|
|
# TYPE storage_writer_ok_points histogram
|
|
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 6
|
|
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 6
|
|
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 8
|
|
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 20
|
|
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 24
|
|
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 24
|
|
storage_writer_ok_points_sum{path="/Users/me/.influxdbv2/engine"} 125787
|
|
storage_writer_ok_points_count{path="/Users/me/.influxdbv2/engine"} 24
|
|
--
|
|
```
|
|
|
|
## Points in write requests
|
|
|
|
Number of points in write requests.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_writer_req_points Histogram of number of points requested to be written
|
|
# TYPE storage_writer_req_points histogram
|
|
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 6
|
|
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 6
|
|
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 6
|
|
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 14
|
|
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 18
|
|
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 18
|
|
storage_writer_req_points_sum{path="/Users/me/.influxdbv2/engine"} 125787
|
|
storage_writer_req_points_count{path="/Users/me/.influxdbv2/engine"} 18
|
|
--
|
|
```
|
|
|
|
## Shard write request timeouts
|
|
|
|
Cumulative number of [shard write](/influxdb/v2/reference/internals/shards/#shard-writes) request timeouts.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP storage_writer_timeouts Number of shard write request timeouts
|
|
# TYPE storage_writer_timeouts counter
|
|
storage_writer_timeouts{path="/Users/me/.influxdbv2/engine"} 0
|
|
--
|
|
```
|
|
|
|
## InfluxDB task statistics
|
|
|
|
### Task executor errors
|
|
|
|
Number of errors thrown by the executor with the type of error (ex. Invalid, Internal, etc.)
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_executor_errors_counter The number of errors thrown by the executor with the type of error (ex. Invalid, Internal, etc.)
|
|
# TYPE task_executor_errors_counter counter
|
|
task_executor_errors_counter{errorType="internal error",task_type="system"} 1183
|
|
--
|
|
```
|
|
|
|
### Task executor promise queue usage
|
|
|
|
Percent of the promise queue that is currently full.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_executor_promise_queue_usage Percent of the promise queue that is currently full
|
|
# TYPE task_executor_promise_queue_usage gauge
|
|
task_executor_promise_queue_usage 0
|
|
```
|
|
|
|
### Task executor run duration
|
|
|
|
Duration (in seconds) between a task run starting and finishing.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_executor_run_duration The duration in seconds between a run starting and finishing.
|
|
# TYPE task_executor_run_duration summary
|
|
|
|
task_executor_run_duration{taskID="08017725990f6000",task_type="",quantile="0.5"} 0.865043855
|
|
task_executor_run_duration{taskID="08017725990f6000",task_type="",quantile="0.9"} 0.865043855
|
|
task_executor_run_duration{taskID="08017725990f6000",task_type="",quantile="0.99"} 0.865043855
|
|
task_executor_run_duration_sum{taskID="08017725990f6000",task_type=""} 1.524920552
|
|
task_executor_run_duration_count{taskID="08017725990f6000",task_type=""} 2
|
|
--
|
|
```
|
|
|
|
### Task executor run latency seconds
|
|
|
|
Latency between the task run's scheduled start time and the execution time, by task type.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_executor_run_latency_seconds Records the latency between the time the run was due to run and the time the task started execution, by task type
|
|
# TYPE task_executor_run_latency_seconds histogram
|
|
task_executor_run_latency_seconds_bucket{task_type="system",le="0.005"} 0
|
|
task_executor_run_latency_seconds_bucket{task_type="system",le="0.01"} 0
|
|
task_executor_run_latency_seconds_bucket{task_type="system",le="0.025"} 0
|
|
task_executor_run_latency_seconds_bucket{task_type="system",le="0.05"} 0
|
|
task_executor_run_latency_seconds_bucket{task_type="system",le="0.1"} 0
|
|
task_executor_run_latency_seconds_bucket{task_type="system",le="0.25"} 2
|
|
task_executor_run_latency_seconds_bucket{task_type="system",le="0.5"} 6
|
|
task_executor_run_latency_seconds_bucket{task_type="system",le="1"} 6
|
|
task_executor_run_latency_seconds_bucket{task_type="system",le="2.5"} 6
|
|
task_executor_run_latency_seconds_bucket{task_type="system",le="5"} 6
|
|
task_executor_run_latency_seconds_bucket{task_type="system",le="10"} 6
|
|
task_executor_run_latency_seconds_bucket{task_type="system",le="+Inf"} 6
|
|
task_executor_run_latency_seconds_sum{task_type="system"} 2.237636
|
|
task_executor_run_latency_seconds_count{task_type="system"} 6
|
|
--
|
|
```
|
|
|
|
### Task executor run queue delta
|
|
|
|
Duration (in seconds) between the task run's scheduled start time and the execution time.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_executor_run_queue_delta The duration in seconds between a run being due to start and actually starting.
|
|
# TYPE task_executor_run_queue_delta summary
|
|
task_executor_run_queue_delta{taskID="08017725990f6000",task_type="",quantile="0.5"} 0.324742
|
|
task_executor_run_queue_delta{taskID="08017725990f6000",task_type="",quantile="0.9"} 0.324742
|
|
task_executor_run_queue_delta{taskID="08017725990f6000",task_type="",quantile="0.99"} 0.324742
|
|
task_executor_run_queue_delta_sum{taskID="08017725990f6000",task_type=""} 0.674875
|
|
task_executor_run_queue_delta_count{taskID="08017725990f6000",task_type=""} 2
|
|
--
|
|
```
|
|
|
|
### Task executor total runs active
|
|
|
|
Number of workers currently running tasks.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_executor_total_runs_active Total number of workers currently running tasks
|
|
# TYPE task_executor_total_runs_active gauge
|
|
task_executor_total_runs_active 0
|
|
```
|
|
|
|
### Task executor total runs complete
|
|
|
|
Number of task runs completed across all tasks, split out by success or failure.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_executor_total_runs_complete Total number of runs completed across all tasks, split out by success or failure.
|
|
# TYPE task_executor_total_runs_complete counter
|
|
task_executor_total_runs_complete{status="failed",task_type="system"} 1384
|
|
task_executor_total_runs_complete{status="success",task_type="system"} 6
|
|
--
|
|
```
|
|
|
|
### Task executor workers busy
|
|
|
|
Percent of total available workers that are currently busy.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_executor_workers_busy Percent of total available workers that are currently busy
|
|
# TYPE task_executor_workers_busy gauge
|
|
task_executor_workers_busy 0
|
|
```
|
|
|
|
### Task scheduler current execution
|
|
|
|
Number of tasks currently being executed.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_scheduler_current_execution Number of tasks currently being executed
|
|
# TYPE task_scheduler_current_execution gauge
|
|
task_scheduler_current_execution 128
|
|
```
|
|
|
|
### Task scheduler execute delta
|
|
|
|
Duration (in seconds) between a task run starting and finishing.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_scheduler_execute_delta The duration in seconds between a run starting and finishing.
|
|
# TYPE task_scheduler_execute_delta summary
|
|
task_scheduler_execute_delta{quantile="0.5"} NaN
|
|
--
|
|
```
|
|
|
|
### Task scheduler schedule delay
|
|
|
|
Summary of the delay between when a task is scheduled to run and when it is told to execute.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_scheduler_schedule_delay The duration between when a Item should be scheduled and when it is told to execute.
|
|
# TYPE task_scheduler_schedule_delay summary
|
|
task_scheduler_schedule_delay{quantile="0.5"} 120.001036
|
|
task_scheduler_schedule_delay{quantile="0.9"} 120.001074
|
|
task_scheduler_schedule_delay{quantile="0.99"} 120.001074
|
|
task_scheduler_schedule_delay_sum 720.0033010000001
|
|
task_scheduler_schedule_delay_count 6
|
|
--
|
|
```
|
|
|
|
### Task scheduler total execute failure
|
|
|
|
Number of times a scheduled task execution has failed.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_scheduler_total_execute_failure Total number of times an execution has failed.
|
|
# TYPE task_scheduler_total_execute_failure counter
|
|
task_scheduler_total_execute_failure 0
|
|
```
|
|
|
|
### Task scheduler total execution calls
|
|
|
|
Number of scheduled executions across all tasks.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_scheduler_total_execution_calls Total number of executions across all tasks.
|
|
# TYPE task_scheduler_total_execution_calls counter
|
|
task_scheduler_total_execution_calls 4806
|
|
```
|
|
|
|
### Task scheduler total release calls
|
|
|
|
Number of release requests.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_scheduler_total_release_calls Total number of release requests.
|
|
# TYPE task_scheduler_total_release_calls counter
|
|
task_scheduler_total_release_calls 0
|
|
```
|
|
|
|
### Task scheduler total schedule calls
|
|
|
|
Number of schedule requests.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_scheduler_total_schedule_calls Total number of schedule requests.
|
|
# TYPE task_scheduler_total_schedule_calls counter
|
|
task_scheduler_total_schedule_calls 6
|
|
```
|
|
|
|
### Task scheduler total schedule fails
|
|
|
|
Number of schedule requests that fail to schedule.
|
|
|
|
#### Example
|
|
|
|
```text
|
|
# HELP task_scheduler_total_schedule_fails Total number of schedule requests that fail to schedule.
|
|
# TYPE task_scheduler_total_schedule_fails counter
|
|
task_scheduler_total_schedule_fails 0
|
|
```
|