7e47d48d01
chore: SLIMIT and SOFFSET are not implemented
2023-05-05 07:48:20 +10:00
743a548a6b
Merge pull request #7741 from influxdata/sgc/issue/7739_select_ir_01
...
feat: Create intermediate representation of `SelectStatement`
2023-05-04 21:13:17 +00:00
593d3354ca
Merge branch 'main' into sgc/issue/7739_select_ir_01
2023-05-05 07:07:41 +10:00
55b35367ac
test: add test for gap fill query missing time bounds ( #7747 )
...
* test: add test for gap fill query missing time bounds
* chore: update unit test
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-04 21:01:45 +00:00
a81c1d328a
Merge branch 'main' into sgc/issue/7739_select_ir_01
2023-05-05 06:51:48 +10:00
187ad74435
chore: add compactor logging detail ( #7748 )
2023-05-04 20:33:58 +00:00
85f461fbda
Merge branch 'main' into sgc/issue/7739_select_ir_01
2023-05-05 06:29:21 +10:00
41d93aea4d
chore: Merge remote-tracking branch 'origin/main' into smith/remove-transactions-main
2023-05-04 14:05:49 -04:00
8b87a10fe0
fix(garbage collector): larger list batches and another tunable ( #7738 )
...
This PR increases the batch/page size of list operations in the gc 10x
to 10,000; it introduces a new cli config for the sleep interval between
batches. Previously a single sleep config was used between batches and
between entirely new list operations. This PR also moves to debug some
noisy logging.
* tag to #7689
2023-05-04 17:47:28 +00:00
a98952bff6
feat(flightsql): Support `CommandGetXdbcTypeInfo` metadata endpoint with actual data type info ( #7696 )
...
* chore: add expected xdbc type info value to jdbc test
* chore: add query skeleton to kick off plan_get_xdbc_type_info()`
* chore: implement a minimun version query for type info
* chore: rewrite `plan_get_xdbc_type_info` to use a static recrod batch
* chore: construct create_params as a string list
* chore: add create_params column in e2e test result
* chore: re-define create_params list items to be non-nullable
* chore: remove comment
* chore: refactor TYPE_INFO_RECORD_BATCH using XdbcTypeInfo struct and rewrite metadata for character types
chore: lint
chore: lint doc
chore: lint doc use automatic link
* chore: add unimplemented error msg
* chore: add `INTEGER`, `FLOAT`, `TIMESTAMP`, `INTERVAL` and remove `CHAR`, `TEXT`, `STRING`
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-04 17:22:57 +00:00
ef9ef75e56
fix: Remove unsupported TemplatePart variants ( #7746 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-04 16:20:18 +00:00
91867e8a59
refactor: simplify `{First,Last}Selector` ( #7745 )
...
* refactor: lift selector creation
* refactor: simplify `FirstSelector`
* refactor: simplify `LastSelector`
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-04 15:24:39 +00:00
b0959667d5
fix: Move topic and query pool within iox catalog ( #7734 )
...
Still insert them into the database and associate them with namespaces,
but don't ever query them back out.
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-04 13:45:56 +00:00
cb80308082
chore: Merge remote-tracking branch 'origin/main' into smith/remove-transactions-main
2023-05-04 09:02:23 -04:00
6cdc95e49d
refactor(wal): Use a separate DecodeError type for WriteOpEntryDecoder
...
Having a ginormous error enum returned for this method means that
the catch-all behaviour gets leaked into the error naming and
semantics of callers. The decoder is a new type and could benefit from
not adding to the existing error enum.
2023-05-04 12:36:23 +01:00
667da5eea4
chore: Add test for `dsn-file://` catalog urls ( #7735 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-04 10:48:18 +00:00
23a74111c8
chore: Stop using cargo cache in CI ( #7721 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-04 10:33:15 +00:00
2cfb30d5df
refactor: remove non-struct selector functions ( #7743 )
...
Clean up for #7533 .
2023-05-04 10:25:52 +00:00
e1825ec45b
refactor: use struct-style selectors in InfluxRPC ( #7742 )
...
Some clean up before I implement the core logic for #7533 .
2023-05-04 09:08:46 +00:00
b47e0efc85
feat: Step 1 on N for an intermediate representation of `SELECT`
...
The end goal is that each `Select` node will contain a schema to be
referenced directly by the InfluxQL planner. Additionally, further
refinement of the field data types used by the `Select` node
are expected, to remove ambiguity from the planner.
2023-05-04 18:27:32 +10:00
ccacd7e78e
chore: Fix doc
2023-05-04 18:25:19 +10:00
90186e1937
Merge pull request #7727 from influxdata/sgc/issue/subquery_6891_03
...
chore: Ensure time column is projected in subqueries
2023-05-04 02:15:50 +00:00
60931631b8
Merge branch 'main' into sgc/issue/subquery_6891_03
2023-05-04 08:58:05 +10:00
2d601bf211
test: num files to read exceed the max_parquet_fanout and all sorted files are resorted ( #7737 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-03 22:29:26 +00:00
54d50bb6cf
Merge branch 'main' into sgc/issue/subquery_6891_03
2023-05-04 07:07:02 +10:00
6de18b6544
chore: conditionally parse shard_id from HOSTNAME ( #7733 )
...
* chore: conditionally parse shard_id from HOSTNAME
* chore: remove HOSTNAME env from test case relying on it not being there.
2023-05-03 20:09:00 +00:00
abe5d26d2f
chore: update DataFusion to `2787e7a36a6be83d91201df20827d3695f933300` ( #7732 )
...
Required to get:
- https://github.com/apache/arrow-datafusion/pull/6199
2023-05-03 16:40:00 +00:00
05688799c4
fix: handle aliases in gapfill aggregate columns ( #7725 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-03 15:20:14 +00:00
cfb947d84b
Merge pull request #7697 from influxdata/cn/metadata
...
fix: Require some metadata, delete some metadata
2023-05-03 15:06:48 +00:00
621caab2e9
fix: Remove unused parquet_max_sequence_number metadata
2023-05-03 10:57:27 -04:00
dfa184e296
fix: Make ingester UUID an expected, required field of IngesterPartition
2023-05-03 10:45:02 -04:00
424c949818
chore: Merge remote-tracking branch 'origin/main' into smith/remove-transactions-main
2023-05-03 09:35:40 -04:00
8a8da349e7
fix: fix deadlock in tests
2023-05-03 09:30:33 -04:00
6c39fb7f60
chore: Merge remote-tracking branch 'origin/main' into smith/remove-transactions-main
2023-05-03 08:46:54 -04:00
231e0f48ab
test: add test for InfluxQL md queries w/ `FROM ""` ( #7728 )
...
See https://github.com/influxdata/idpe/issues/17559 .
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-03 12:46:51 +00:00
b2e5ea2266
refactor(wal): Add test & docs for WriteOpEntryDecoder
...
Adds some documentation for the WriteOpEntryDecoder and
a unit test that asserts it skips over non write entries
and can continue to be consumed from.
2023-05-03 11:51:00 +01:00
f6dea224e8
feat(wal): Add wal_inspect crate & a write op entry decoder
...
This adds a new crate with a type capable of converting
decoded WAL Write Op entries to line protocol and writing
the result to a namespaced destination. The wal crate
now exports a type which reads the sequenced wal ops and
decodes them as namespaced table batch writes.
2023-05-03 11:50:59 +01:00
bd07add78d
chore(deps): Bump clap from 4.2.5 to 4.2.7 ( #7726 )
...
Bumps [clap](https://github.com/clap-rs/clap ) from 4.2.5 to 4.2.7.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v4.2.5...v4.2.7 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-03 09:39:10 +00:00
72397f63e5
Merge branch 'main' into sgc/issue/subquery_6891_03
2023-05-03 12:06:18 +10:00
43baecbb1a
chore: handle aliased time column in sort expression
2023-05-03 12:04:24 +10:00
19ea80390a
chore: ignore time column when processing SELECT
2023-05-03 11:04:54 +10:00
91f5464375
chore: add additional tests
2023-05-03 09:23:15 +10:00
24378bd460
chore: `time` is always present and at first position of projection
2023-05-03 07:47:14 +10:00
65ca52ce3b
chore: Update DataFusion again ( #7722 )
...
* chore: Update DF again
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-05-02 18:34:45 +00:00
2b1f8b56e2
chore: Update DataFusion ( #7719 )
...
* chore: Update DataFusion
* chore: update for API change
* chore: update some tests
* fix: Update plans in optimizer
* chore: Update plans
* chore: Update error messages
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-05-02 17:55:04 +00:00
530ee94558
fix: use correct sort key in projection_pushdown ( #7718 )
...
* fix: use correct sort key in projection_pushdown
* fix: tabs in docs
* refactor: Use Serde to format test results
2023-05-02 16:50:04 +00:00
9ca8dbfcd2
fix: removed clean files from hashtable to enable re-adding them later ( #7711 )
...
* fix: removed clean files from hashtable to enable re-adding them later
* chore: acquire hashtable lock once
* chore: add comments, remove duplicate clear()
2023-05-02 16:26:07 +00:00
18b02a03cf
chore: move to the smaller, cargo-team maintained `home` crate ( #7716 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-02 16:10:22 +00:00
323c8ac4f0
Merge pull request #7714 from influxdata/dom/revert-dns
...
revert: PR #7708
2023-05-02 12:01:53 +00:00
c9cfe05f8d
revert: PR #7708
...
This reverts commit 61abb58933
2023-05-02 13:51:30 +02:00
Stuart Carnie
kodiakhq[bot]
Christopher M. Wolff
Joe-Blount
Jeffrey Smith II
Phil Bracikowski
Chunchun Ye
Carol (Nichols || Goulding)
Marco Neumann
Fraser Savage
Andrew Lamb
Nga Tran
Carol (Nichols || Goulding)
dependabot[bot]
Utkarsh Gupta
Dom Dwyer