influxdb/predicate/src
Marco Neumann 159250e776
refactor: concurrent table planning in InfluxRPC (#5647)
* refactor: concurrent table planning in InfluxRPC

Some InfluxRPC can scan multiple tables. Prior to this PR we were always
scanning the tables in sequence, adding up potential latencies (catalog,
ingester, object store). There is no reason we need to do this,
"ordinary" SQL queries would not serialize this way either.

So let's scan tables concurrently. This add concurrency to:

- read filter
- read group
- read window aggregate

There are other query types that could benefit from a similar treatment.
They will be changed in a follow-up.

* docs: improve

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

* test: explain `Send` assertion

* refactor: change `CONCURRENT_TABLE_JOBS` to 10

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
2022-09-15 13:55:22 +00:00
..
rpc_predicate fix: Support RegExMatch and RegExNotMatch predicates on `_field` (#5301) 2022-08-04 19:42:16 +00:00
delete_expr.rs chore: Update datafusion pin (#5148) 2022-07-19 13:13:37 +00:00
delete_predicate.rs fix: Derive Eq when we derive PartialEq and members can derive Eq 2022-08-11 15:04:06 -04:00
lib.rs chore: Update datafusion / `arrow` / `arrow-flight` / `parquet` to version 22.0.0 (#5591) 2022-09-12 17:45:03 +00:00
rewrite.rs chore: Update datafusion + object_store (#5619) 2022-09-13 12:34:54 +00:00
rpc_predicate.rs refactor: concurrent table planning in InfluxRPC (#5647) 2022-09-15 13:55:22 +00:00