69 lines
3.4 KiB
Markdown
69 lines
3.4 KiB
Markdown
|
# Metrics in IOx
|
||
|
|
|
||
|
|
IOx output metrics to Jaeger for distributed request correlation.
|
||
|
|
|
||
|
|
Here are useful metrics
|
||
|
|
|
||
|
|
### Requests to IOx Server including Routers and Query Servers
|
||
|
|
| Metric name | Code Name | Description |
|
||
|
|
| --- | --- | --- |
|
||
|
|
| http_requests_total | http_requests | Total number of HTTP requests |
|
||
|
|
| gRPC_requests_total | requests | Total number of gROC requests |
|
||
|
|
| http_request_duration_seconds| ? | ? |
|
||
|
|
| http_mem_bytes | ? | ? |
|
||
|
|
| http_mem_bytes_total | ? | ? |
|
||
|
|
|
||
|
|
|
||
|
|
### Line Protocol Data ingested into Routers
|
||
|
|
|
||
|
|
| Metric name | Code Name | Description |
|
||
|
|
| --- | --- | --- |
|
||
|
|
| ingest_points_total | ingest_lines_total | Total number of lines ingested |
|
||
|
|
| ingest_fields_total | ingest_fields_total | Total number of fields (columns) ingested |
|
||
|
|
| ingest_points_bytes_total | ingest_points_bytes_total | Total number of bytes ingested |
|
||
|
|
| ingest_entries_bytes_total | ingest_entries_bytes_total | Total number of entry bytes ingested (Not sure what this means |
|
||
|
|
|
||
|
|
### Chunks
|
||
|
|
| Metric name | Code Name | Description |
|
||
|
|
| --- | --- | --- |
|
||
|
|
| catalog_chunks_mem_usage_bytes | memory_metrics | Total memory usage by chunks (MUB, RUB, OS statistics) |
|
||
|
|
| catalog_loaded_chunks | chunk_storage | Total number of chunks (MUB, RUB, RUBandOS) for each table |
|
||
|
|
| catalog_loaded_rows | row_count | Total number of rows (MUB, RUB, RUBandOS) for each table |
|
||
|
|
| catalog_lock_total | ? | ? |
|
||
|
|
| catalog_lock_wait_seconds_total | ? | ? |
|
||
|
|
| ? | table_lock_tracker| ? |
|
||
|
|
| ? | partition_lock_tracker | ? |
|
||
|
|
| ? | chunk_lock_tracker | ? |
|
||
|
|
| ? | timestamp_histogram| ? |
|
||
|
|
| catalog_chunks_total | chunk_state | Number of chunks in different states (open, closed, compacting, compacted, writing_os, rub_and_os, ...)) |
|
||
|
|
|
||
|
|
### Chunks and Rows Pruned by Queries
|
||
|
|
| Metric name | Code Name | Description |
|
||
|
|
| --- | --- | --- |
|
||
|
|
| query_access_pruned_chunks_total | pruned_chunks | Number of chunks of a table pruned while running queries |
|
||
|
|
| query_access_pruned_rows_total | pruned_rows | Number of chunks of a table pruned while running queries |
|
||
|
|
|
||
|
|
|
||
|
|
### Read buffer RUB
|
||
|
|
| Metric name | Code Name | Description |
|
||
|
|
| --- | --- | --- |
|
||
|
|
| read_buffer_column_total | columns_total | Total number of columns in read buffer |
|
||
|
|
| read_buffer_column_values | column_values_total | Total number of values stored in read buffer column encodings, further segmented by nullness |
|
||
|
|
| read_buffer_column_raw_bytes | column_raw_bytes_total | Estimated uncompressed data size for read buffer columns, further segmented by nullness |
|
||
|
|
|
||
|
|
|
||
|
|
### Ingest Request (from Kafka?)
|
||
|
|
| Metric name | Code Name | Description |
|
||
|
|
| --- | --- | --- |
|
||
|
|
| write_buffer_ingest_requests_total | red | Total number of write requests |
|
||
|
|
| write_buffer_read_bytes_total | bytes_read | Total number of write requested bytes |
|
||
|
|
| write_buffer_last_sequence_number | last_sequence_number | sequence number of last write request |
|
||
|
|
| write_buffer_sequence_number_lag | sequence_number_lag | The difference between the the last sequence number available (e.g. Kafka offset) and (= minus) last consumed sequence number |
|
||
|
|
| write_buffer_last_min_ts | last_min_ts | Minimum timestamp of last write as unix timestamp in nanoseconds |
|
||
|
|
| write_buffer_last_max_ts | last_max_ts | Maximum timestamp of last write as unix timestamp in nanoseconds |
|
||
|
|
| write_buffer_last_ingest_ts | last_ingest_ts | Last seen ingest timestamp as unix timestamp in nanoseconds |
|
||
|
|
|
||
|
|
### jemalloc
|
||
|
|
| Metric name | Code Name | Description |
|
||
|
|
| --- | --- | --- |
|
||
|
|
| jemalloc_memstats_bytes | ? | ? |
|