Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
influxdb/query_tests/cases/in/several_chunks.expected

95 lines
9.8 KiB
Plaintext
Raw Normal View History

test: explain tests for queries whose data come from both parquet and ingester (#4546) * refactor: remove New from a test scenario setup * test: add explain for 2 different chunk stages * test: expplain for several chunks from both parquet and ingester
2022-05-10 13:17:18 +00:00
-- Test Setup: ManyFieldsSeveralChunks
chore: convert some debug to trace to reduce noises (#4589)
2022-05-12 22:40:29 +00:00
-- SQL: SELECT * from h2o;
test: explain tests for queries whose data come from both parquet and ingester (#4546) * refactor: remove New from a test scenario setup * test: add explain for 2 different chunk stages * test: expplain for several chunks from both parquet and ingester
2022-05-10 13:17:18 +00:00
-- Results After Sorting
+---------+------------+-------+------+--------------------------------+
| city | other_temp | state | temp | time |
+---------+------------+-------+------+--------------------------------+
| Andover | 72.4 | CA | | 1970-01-01T00:00:00.000000150Z |
| Andover | | CA | 67.3 | 1970-01-01T00:00:00.000000500Z |
| Boston | 68.2 | MA | | 1970-01-01T00:00:00.000000450Z |
| Boston | 80 | MA | | 1970-01-01T00:00:00.000000250Z |
| Boston | | MA | 70.4 | 1970-01-01T00:00:00.000000050Z |
| Boston | | MA | 80.7 | 1970-01-01T00:00:00.000000350Z |
| Boston | | MA | 88.6 | 1970-01-01T00:00:00.000000230Z |
+---------+------------+-------+------+--------------------------------+
-- SQL: EXPLAIN SELECT * from h2o;
+---------------+---------------------------------------------------------------------------------------------------------------------+
| plan_type | plan |
+---------------+---------------------------------------------------------------------------------------------------------------------+
chore: Update datafusion + `arrow`, `arrow-flight`, and `parquet` to 24.0.0.0 (#5792) * chore: Update datafusion + `arrow`, `arrow-flight`, and `parquet` to 24.0.0.0 * fix: Update for coercion, fix explain plans for change in column name display * chore: Update datafusion lock * fix: Update for other API changes * chore: Update to latest datafusion pin * chore: Run cargo hakari tasks Co-authored-by: CircleCI[bot] <circleci@influxdata.com> Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-10-12 16:19:14 +00:00
| logical_plan | Projection: h2o.city, h2o.other_temp, h2o.state, h2o.temp, h2o.time |
chore: Update datafusion pin (#4969) * chore: Update datafusion pin * fix: Update for api * fix: Explicitly set coalsce batch size * fix: Update batch size as well * fix: update tests for new explain plan, and improved coercion
2022-06-29 17:52:37 +00:00
| | TableScan: h2o projection=[city, other_temp, state, temp, time] |
test: explain tests for queries whose data come from both parquet and ingester (#4546) * refactor: remove New from a test scenario setup * test: add explain for 2 different chunk stages * test: expplain for several chunks from both parquet and ingester
2022-05-10 13:17:18 +00:00
| physical_plan | ProjectionExec: expr=[city@0 as city, other_temp@1 as other_temp, state@2 as state, temp@3 as temp, time@4 as time] |
| | UnionExec |
| | DeduplicateExec: [city@0 ASC,state@2 ASC,time@4 ASC] |
| | SortPreservingMergeExec: [city@0 ASC,state@2 ASC,time@4 ASC] |
| | UnionExec |
| | IOxReadFilterNode: table_name=h2o, chunks=1 predicate=Predicate |
| | IOxReadFilterNode: table_name=h2o, chunks=1 predicate=Predicate |
| | IOxReadFilterNode: table_name=h2o, chunks=1 predicate=Predicate |
refactor: do not run de-dup in ingester for querier requests (#5626) * refactor: do not run de-dup in ingester for querier requests This removes the entire de-dup logic from the inegster for querier requests. Furthermore, it even removes the entire datafusion execution from the querier and just dumps the in-memory record batches as quickly as possible. No filters are applied. Note that even prior to this PR, we've never applied projections (tracked by #5624). **Pros:** - speed up query planning within the querier (since we need the ingester response for state reconciling) - lowered ingester CPU load **Cons:** - more querier<>ingester network traffic Closes #5602. * test: extend query test case * fix: ingester tests Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-09-22 07:33:54 +00:00
| | DeduplicateExec: [city@0 ASC,state@2 ASC,time@4 ASC] |
| | SortExec: [city@0 ASC,state@2 ASC,time@4 ASC] |
| | IOxReadFilterNode: table_name=h2o, chunks=1 predicate=Predicate |
| | IOxReadFilterNode: table_name=h2o, chunks=1 predicate=Predicate |
test: explain tests for queries whose data come from both parquet and ingester (#4546) * refactor: remove New from a test scenario setup * test: add explain for 2 different chunk stages * test: expplain for several chunks from both parquet and ingester
2022-05-10 13:17:18 +00:00
| | |
+---------------+---------------------------------------------------------------------------------------------------------------------+
chore: convert some debug to trace to reduce noises (#4589)
2022-05-12 22:40:29 +00:00
-- SQL: select temp, other_temp, time from h2o;
-- Results After Sorting
test: explain tests for queries whose data come from both parquet and ingester (#4546) * refactor: remove New from a test scenario setup * test: add explain for 2 different chunk stages * test: expplain for several chunks from both parquet and ingester
2022-05-10 13:17:18 +00:00
+------+------------+--------------------------------+
| temp | other_temp | time |
+------+------------+--------------------------------+
| 67.3 | | 1970-01-01T00:00:00.000000500Z |
fix: make test output deterministic (#4578) Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-12 14:15:51 +00:00
| 70.4 | | 1970-01-01T00:00:00.000000050Z |
test: explain tests for queries whose data come from both parquet and ingester (#4546) * refactor: remove New from a test scenario setup * test: add explain for 2 different chunk stages * test: expplain for several chunks from both parquet and ingester
2022-05-10 13:17:18 +00:00
| 80.7 | | 1970-01-01T00:00:00.000000350Z |
fix: make test output deterministic (#4578) Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-12 14:15:51 +00:00
| 88.6 | | 1970-01-01T00:00:00.000000230Z |
test: explain tests for queries whose data come from both parquet and ingester (#4546) * refactor: remove New from a test scenario setup * test: add explain for 2 different chunk stages * test: expplain for several chunks from both parquet and ingester
2022-05-10 13:17:18 +00:00
| | 68.2 | 1970-01-01T00:00:00.000000450Z |
| | 72.4 | 1970-01-01T00:00:00.000000150Z |
| | 80 | 1970-01-01T00:00:00.000000250Z |
+------+------------+--------------------------------+
-- SQL: EXPLAIN select temp, other_temp, time from h2o;
+---------------+---------------------------------------------------------------------------------------+
| plan_type | plan |
+---------------+---------------------------------------------------------------------------------------+
chore: Update datafusion + `arrow`, `arrow-flight`, and `parquet` to 24.0.0.0 (#5792) * chore: Update datafusion + `arrow`, `arrow-flight`, and `parquet` to 24.0.0.0 * fix: Update for coercion, fix explain plans for change in column name display * chore: Update datafusion lock * fix: Update for other API changes * chore: Update to latest datafusion pin * chore: Run cargo hakari tasks Co-authored-by: CircleCI[bot] <circleci@influxdata.com> Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-10-12 16:19:14 +00:00
| logical_plan | Projection: h2o.temp, h2o.other_temp, h2o.time |
chore: Update datafusion pin (#4969) * chore: Update datafusion pin * fix: Update for api * fix: Explicitly set coalsce batch size * fix: Update batch size as well * fix: update tests for new explain plan, and improved coercion
2022-06-29 17:52:37 +00:00
| | TableScan: h2o projection=[other_temp, temp, time] |
test: explain tests for queries whose data come from both parquet and ingester (#4546) * refactor: remove New from a test scenario setup * test: add explain for 2 different chunk stages * test: expplain for several chunks from both parquet and ingester
2022-05-10 13:17:18 +00:00
| physical_plan | ProjectionExec: expr=[temp@1 as temp, other_temp@0 as other_temp, time@2 as time] |
| | UnionExec |
| | ProjectionExec: expr=[other_temp@1 as other_temp, temp@3 as temp, time@4 as time] |
| | RepartitionExec: partitioning=RoundRobinBatch(4) |
| | DeduplicateExec: [city@0 ASC,state@2 ASC,time@4 ASC] |
| | SortPreservingMergeExec: [city@0 ASC,state@2 ASC,time@4 ASC] |
| | UnionExec |
| | IOxReadFilterNode: table_name=h2o, chunks=1 predicate=Predicate |
| | IOxReadFilterNode: table_name=h2o, chunks=1 predicate=Predicate |
| | IOxReadFilterNode: table_name=h2o, chunks=1 predicate=Predicate |
refactor: do not run de-dup in ingester for querier requests (#5626) * refactor: do not run de-dup in ingester for querier requests This removes the entire de-dup logic from the inegster for querier requests. Furthermore, it even removes the entire datafusion execution from the querier and just dumps the in-memory record batches as quickly as possible. No filters are applied. Note that even prior to this PR, we've never applied projections (tracked by #5624). **Pros:** - speed up query planning within the querier (since we need the ingester response for state reconciling) - lowered ingester CPU load **Cons:** - more querier<>ingester network traffic Closes #5602. * test: extend query test case * fix: ingester tests Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-09-22 07:33:54 +00:00
| | ProjectionExec: expr=[other_temp@1 as other_temp, temp@3 as temp, time@4 as time] |
| | RepartitionExec: partitioning=RoundRobinBatch(4) |
| | DeduplicateExec: [city@0 ASC,state@2 ASC,time@4 ASC] |
| | SortExec: [city@0 ASC,state@2 ASC,time@4 ASC] |
| | IOxReadFilterNode: table_name=h2o, chunks=1 predicate=Predicate |
| | IOxReadFilterNode: table_name=h2o, chunks=1 predicate=Predicate |
test: explain tests for queries whose data come from both parquet and ingester (#4546) * refactor: remove New from a test scenario setup * test: add explain for 2 different chunk stages * test: expplain for several chunks from both parquet and ingester
2022-05-10 13:17:18 +00:00
| | |
+---------------+---------------------------------------------------------------------------------------+
feat: filter chunks before requesting read buffers (#4996) Fixes #4976.
2022-07-01 08:59:07 +00:00
-- SQL: EXPLAIN SELECT * from h2o where time >= to_timestamp('1970-01-01T00:00:00.000000250+00:00');
chore: Update datafusion + `arrow`, `arrow-flight`, and `parquet` to 24.0.0.0 (#5792) * chore: Update datafusion + `arrow`, `arrow-flight`, and `parquet` to 24.0.0.0 * fix: Update for coercion, fix explain plans for change in column name display * chore: Update datafusion lock * fix: Update for other API changes * chore: Update to latest datafusion pin * chore: Run cargo hakari tasks Co-authored-by: CircleCI[bot] <circleci@influxdata.com> Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-10-12 16:19:14 +00:00
+---------------+-----------------------------------------------------------------------------------------------------------------------------------+
| plan_type | plan |
+---------------+-----------------------------------------------------------------------------------------------------------------------------------+
| logical_plan | Projection: h2o.city, h2o.other_temp, h2o.state, h2o.temp, h2o.time |
| | Filter: h2o.time >= TimestampNanosecond(250, None) |
| | TableScan: h2o projection=[city, other_temp, state, temp, time], partial_filters=[h2o.time >= TimestampNanosecond(250, None)] |
| physical_plan | ProjectionExec: expr=[city@0 as city, other_temp@1 as other_temp, state@2 as state, temp@3 as temp, time@4 as time] |
| | CoalesceBatchesExec: target_batch_size=4096 |
| | FilterExec: time@4 >= 250 |
| | RepartitionExec: partitioning=RoundRobinBatch(4) |
| | UnionExec |
| | DeduplicateExec: [city@0 ASC,state@2 ASC,time@4 ASC] |
| | SortPreservingMergeExec: [city@0 ASC,state@2 ASC,time@4 ASC] |
| | UnionExec |
| | IOxReadFilterNode: table_name=h2o, chunks=1 predicate=Predicate exprs: [time >= TimestampNanosecond(250, None)] |
| | IOxReadFilterNode: table_name=h2o, chunks=1 predicate=Predicate exprs: [time >= TimestampNanosecond(250, None)] |
| | DeduplicateExec: [city@0 ASC,state@2 ASC,time@4 ASC] |
| | SortExec: [city@0 ASC,state@2 ASC,time@4 ASC] |
| | IOxReadFilterNode: table_name=h2o, chunks=1 predicate=Predicate exprs: [time >= TimestampNanosecond(250, None)] |
| | IOxReadFilterNode: table_name=h2o, chunks=1 predicate=Predicate exprs: [time >= TimestampNanosecond(250, None)] |
| | |
+---------------+-----------------------------------------------------------------------------------------------------------------------------------+