# Metrics in IOx

IOx output metrics to Jaeger for distributed request correlation.

Here are useful metrics

### Requests to IOx Server including Routers and Query Servers
| Metric name |  Code Name | Description |
| --- | --- | --- | 
| http_requests_total | http_requests | Total number of HTTP requests |
| gRPC_requests_total | requests | Total number of gROC requests |
| http_request_duration_seconds| ? | ? |
| http_mem_bytes | ? | ? |
| http_mem_bytes_total | ? | ? |


### Line Protocol Data ingested into Routers

| Metric name |  Code Name | Description |
| --- | --- | --- | 
| ingest_points_total | ingest_lines_total | Total number of lines ingested |
| ingest_fields_total | ingest_fields_total | Total number of fields (columns) ingested |
| ingest_points_bytes_total | ingest_points_bytes_total | Total number of bytes ingested |
| ingest_entries_bytes_total |  ingest_entries_bytes_total | Total number of entry bytes ingested (Not sure what this means |

### Chunks
| Metric name |  Code Name | Description |
| --- | --- | --- |
| catalog_chunks_mem_usage_bytes | memory_metrics | Total memory usage by chunks (MUB, RUB, OS statistics) |
| catalog_loaded_chunks | chunk_storage | Total number of chunks (MUB, RUB, RUBandOS) for each table |
| catalog_loaded_rows | row_count | Total number of rows (MUB, RUB, RUBandOS) for each table |
| catalog_lock_total | ? | ? |
| catalog_lock_wait_seconds_total | ? | ? |
| ? | table_lock_tracker| ? |
| ? | partition_lock_tracker | ? |
| ? | chunk_lock_tracker | ? |
| ? | timestamp_histogram| ? |
| catalog_chunks_total | chunk_state | Number of chunks in different states (open, closed, compacting, compacted, writing_os, rub_and_os, ...)) |

### Chunks and Rows Pruned by Queries
| Metric name |  Code Name | Description |
| --- | --- | --- |
| query_access_pruned_chunks_total | pruned_chunks | Number of chunks of a table pruned while running queries |
| query_access_pruned_rows_total  | pruned_rows | Number of chunks of a table pruned while running queries |


### Read buffer RUB
| Metric name |  Code Name | Description |
| --- | --- | --- |
| read_buffer_column_total | columns_total | Total number of columns in read buffer |
| read_buffer_column_values | column_values_total | Total number of values stored in read buffer column encodings, further segmented by nullness |
| read_buffer_column_raw_bytes | column_raw_bytes_total | Estimated uncompressed data size for read buffer columns, further segmented by nullness |


### Ingest Request (from Kafka?)
| Metric name |  Code Name | Description |
| --- | --- | --- |
| write_buffer_ingest_requests_total | red | Total number of write requests |
| write_buffer_read_bytes_total | bytes_read | Total number of write requested bytes | 
| write_buffer_last_sequence_number | last_sequence_number | sequence number of last write request |
| write_buffer_sequence_number_lag  |  sequence_number_lag | The difference between the the last sequence number available (e.g. Kafka offset) and (= minus) last consumed sequence number |
| write_buffer_last_min_ts | last_min_ts | Minimum timestamp of last write as unix timestamp in nanoseconds |
| write_buffer_last_max_ts | last_max_ts | Maximum timestamp of last write as unix timestamp in nanoseconds |
| write_buffer_last_ingest_ts | last_ingest_ts | Last seen ingest timestamp as unix timestamp in nanoseconds |

### jemalloc
| Metric name |  Code Name | Description |
| --- | --- | --- |
| jemalloc_memstats_bytes | ? | ? |