Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
influxdb/ingester/src
History
Marco Neumann 45b3984aa3
refactor: simplify `QueryChunk` data access (#6015) 
* refactor: simplify `QueryChunk` data access

We have only two types for chunks (now that the RUB is gone):

1. In-memory RecordBatches
2. Parquet files

Loads of logic is duplicated in the different `read_filter`
implementations. Also `read_filter` hides a solid amount of logic from
DataFusion, which will prevent certain (future) optimizations. To enable #5897
and to simplify the interface, let the chunks return the data (batches
or metadata for parquet files) directly and let `iox_query` perform the
actual heavy-lifting.

* docs: improve

Co-authored-by: Andrew Lamb <alamb@influxdata.com>

* docs: improve

Co-authored-by: Andrew Lamb <alamb@influxdata.com>

Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
 		2022-11-02 08:18:33 +00:00
..
data refactor(dml): PartitionKey required for writes 2022-10-28 10:57:30 +02:00
lifecycle test: MockLifecycleHandle captures calls 2022-10-03 12:13:43 +02:00
server feat: Add the catalog service to ingester, querier, and compactor 2022-10-28 10:49:26 -04:00
stream_handler refactor(dml): PartitionKey required for writes 2022-10-28 10:57:30 +02:00
compact.rs refactor(ingester): use partition buffer FSM 2022-10-27 10:15:15 +02:00
data.rs feat: Log how long each persist plan takes to complete (#5989) 2022-10-28 13:52:39 +00:00
handler.rs refactor(dml): PartitionKey required for writes 2022-10-28 10:57:30 +02:00
job.rs style(ingester): fmt imports & long strings 2022-09-14 14:20:19 +02:00
lib.rs refactor(ingester): use partition buffer FSM 2022-10-27 10:15:15 +02:00
lifecycle.rs test(ingester): add integration TestContext 2022-10-19 11:51:15 +02:00
poison.rs style(ingester): fmt imports & long strings 2022-09-14 14:20:19 +02:00
querier_handler.rs refactor(ingester): use partition buffer FSM 2022-10-27 10:15:15 +02:00
query_adaptor.rs refactor: simplify `QueryChunk` data access (#6015) 2022-11-02 08:18:33 +00:00
server.rs feat: Add the catalog service to ingester, querier, and compactor 2022-10-28 10:49:26 -04:00
test_util.rs refactor(dml): PartitionKey required for writes 2022-10-28 10:57:30 +02:00