38 lines
3.3 KiB
Markdown
38 lines
3.3 KiB
Markdown
# InfluxDB IOx Documentation
|
|
|
|
This directory contains internal design documentation of potential
|
|
interest for those who wish to understand how the code works. It is
|
|
not intended to be general user facing documentation
|
|
|
|
## IOx Tech Talks
|
|
|
|
We hold monthly Tech Talks that explain the project's technical underpinnings. You can register for the [InfluxDB IOx Tech Talks here](https://www.influxdata.com/community-showcase/influxdb-tech-talks/), or you can find links to previous sessions below:
|
|
|
|
* December 2020: Rusty Introduction to Apache Arrow [recording](https://www.youtube.com/watch?v=dQFjKa9vKhM)
|
|
* Jan 2021: Data Lifecycle in InfluxDB IOx & How it Uses Object Storage for Persistence [recording](https://www.youtube.com/watch?v=KwdPifHC1Gc)
|
|
* February 2021: Intro to the InfluxDB IOx Read Buffer [recording](https://www.youtube.com/watch?v=KslD31VNqPU) [slides](https://www.slideshare.net/influxdata/influxdb-iox-tech-talks-intro-to-the-influxdb-iox-read-buffer-a-readoptimized-inmemory-query-execution-engine)
|
|
* March 2021: Query Engine Design and the Rust-Based DataFusion in Apache Arrow [recording](https://www.youtube.com/watch?v=K6eCAVEk4kU) [slides](https://www.slideshare.net/influxdata/influxdb-iox-tech-talks-query-engine-design-and-the-rustbased-datafusion-in-apache-arrow-244161934)
|
|
* April 2021: InfluxDB IOx Tech Talks: Replication, Durability and Subscriptions in InfluxDB IOx [recording](https://www.youtube.com/watch?v=UQj8ZaH5Yi4) [slides](https://www.slideshare.net/influxdata/influxdb-iox-tech-talks-replication-durability-and-subscriptions-in-influxdb-iox)
|
|
* May 2021: Catalogs - Turning a Set of Parquet Files into a Data Set [recording](https://www.youtube.com/watch?v=Zaei3l3qk0c), [slides](https://www.slideshare.net/influxdata/catalogs-turning-a-set-of-parquet-files-into-a-data-set)
|
|
* June 2021: Performance Profiling in Rust [recording](https://www.youtube.com/watch?v=_ZNcg-nAVTM), [slides](https://www.slideshare.net/influxdata/performance-profiling-in-rust)
|
|
* July 2021: Impacts of Sharding, Partitioning, Encoding & Sorting on Distributed Query Performance [recording](https://www.youtube.com/watch?v=VHYMpItvBZQ), [slides](https://www.slideshare.net/influxdata/impacts-of-sharding-partitioning-encoding-and-sorting-on-distributed-query-performance)
|
|
|
|
|
|
|
|
## Table of Contents:
|
|
|
|
* Rust style and Idiom guide: [style_guide.md](style_guide.md)
|
|
* Tracing and logging Guide: [tracing.md](tracing.md)
|
|
* Profiling Guide: [profiling.md](profiling.md)
|
|
* How InfluxDB IOx manages the lifecycle of time series data: [data_management.md](data_management.md)
|
|
* Thoughts on parquet encoding and compression for timeseries data: [encoding_thoughts.md](encoding_thoughts.md)
|
|
* Thoughts on using multiple cores / thread pools: [multi_core_tasks.md](multi_core_tasks.md)
|
|
* [Query Engine Docs](../query/README.md)
|
|
* [Testing documentation](testing.md) for developers of IOx
|
|
* [Regenerating Flatbuffers code](regenerating_flatbuffers.md) when updating the version of the `flatbuffers` crate
|
|
* Protobuf tips and tricks: [Protobuf](protobuf.md).
|
|
* Catalog Persistence: [`catalog_persistence.md`](catalog_persistence.md).
|
|
* SQL command line tips and tricks: [SQL](sql.md).
|
|
* Notes on server startup and error recovery: [`server_startup.md`](server_startup.md)
|
|
* Notes on the use of local filesystems: [`local_filesystems.md`](local_filesystems.md)
|