Commit Graph

12037 Commits (ef9ef75e56b25fa6df6695a353dd86da90d2d7fc)

Author SHA1 Message Date
Carol (Nichols || Goulding) ef9ef75e56
fix: Remove unsupported TemplatePart variants (#7746)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-04 16:20:18 +00:00
Marco Neumann 91867e8a59
refactor: simplify `{First,Last}Selector` (#7745)
* refactor: lift selector creation

* refactor: simplify `FirstSelector`

* refactor: simplify `LastSelector`

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-04 15:24:39 +00:00
Carol (Nichols || Goulding) b0959667d5
fix: Move topic and query pool within iox catalog (#7734)
Still insert them into the database and associate them with namespaces,
but don't ever query them back out.

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-04 13:45:56 +00:00
Andrew Lamb 667da5eea4
chore: Add test for `dsn-file://` catalog urls (#7735)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-04 10:48:18 +00:00
Andrew Lamb 23a74111c8
chore: Stop using cargo cache in CI (#7721)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-04 10:33:15 +00:00
Marco Neumann 2cfb30d5df
refactor: remove non-struct selector functions (#7743)
Clean up for #7533.
2023-05-04 10:25:52 +00:00
Marco Neumann e1825ec45b
refactor: use struct-style selectors in InfluxRPC (#7742)
Some clean up before I implement the core logic for #7533.
2023-05-04 09:08:46 +00:00
kodiakhq[bot] 90186e1937
Merge pull request #7727 from influxdata/sgc/issue/subquery_6891_03
chore: Ensure time column is projected in subqueries
2023-05-04 02:15:50 +00:00
Stuart Carnie 60931631b8
Merge branch 'main' into sgc/issue/subquery_6891_03 2023-05-04 08:58:05 +10:00
Nga Tran 2d601bf211
test: num files to read exceed the max_parquet_fanout and all sorted files are resorted (#7737)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-03 22:29:26 +00:00
Stuart Carnie 54d50bb6cf
Merge branch 'main' into sgc/issue/subquery_6891_03 2023-05-04 07:07:02 +10:00
Joe-Blount 6de18b6544
chore: conditionally parse shard_id from HOSTNAME (#7733)
* chore: conditionally parse shard_id from HOSTNAME

* chore: remove HOSTNAME env from test case relying on it not being there.
2023-05-03 20:09:00 +00:00
Marco Neumann abe5d26d2f
chore: update DataFusion to `2787e7a36a6be83d91201df20827d3695f933300` (#7732)
Required to get:

- https://github.com/apache/arrow-datafusion/pull/6199
2023-05-03 16:40:00 +00:00
Christopher M. Wolff 05688799c4
fix: handle aliases in gapfill aggregate columns (#7725)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-03 15:20:14 +00:00
kodiakhq[bot] cfb947d84b
Merge pull request #7697 from influxdata/cn/metadata
fix: Require some metadata, delete some metadata
2023-05-03 15:06:48 +00:00
Carol (Nichols || Goulding) 621caab2e9
fix: Remove unused parquet_max_sequence_number metadata 2023-05-03 10:57:27 -04:00
Carol (Nichols || Goulding) dfa184e296
fix: Make ingester UUID an expected, required field of IngesterPartition 2023-05-03 10:45:02 -04:00
Marco Neumann 231e0f48ab
test: add test for InfluxQL md queries w/ `FROM ""` (#7728)
See https://github.com/influxdata/idpe/issues/17559 .

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-03 12:46:51 +00:00
dependabot[bot] bd07add78d
chore(deps): Bump clap from 4.2.5 to 4.2.7 (#7726)
Bumps [clap](https://github.com/clap-rs/clap) from 4.2.5 to 4.2.7.
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/compare/v4.2.5...v4.2.7)

---
updated-dependencies:
- dependency-name: clap
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-03 09:39:10 +00:00
Stuart Carnie 72397f63e5
Merge branch 'main' into sgc/issue/subquery_6891_03 2023-05-03 12:06:18 +10:00
Stuart Carnie 43baecbb1a
chore: handle aliased time column in sort expression 2023-05-03 12:04:24 +10:00
Stuart Carnie 19ea80390a
chore: ignore time column when processing SELECT 2023-05-03 11:04:54 +10:00
Stuart Carnie 91f5464375
chore: add additional tests 2023-05-03 09:23:15 +10:00
Stuart Carnie 24378bd460
chore: `time` is always present and at first position of projection 2023-05-03 07:47:14 +10:00
Andrew Lamb 65ca52ce3b
chore: Update DataFusion again (#7722)
* chore: Update DF again

* chore: Run cargo hakari tasks

---------

Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-05-02 18:34:45 +00:00
Andrew Lamb 2b1f8b56e2
chore: Update DataFusion (#7719)
* chore: Update DataFusion

* chore: update for API change

* chore: update some tests

* fix: Update plans in optimizer

* chore: Update plans

* chore: Update error messages

* chore: Run cargo hakari tasks

---------

Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-05-02 17:55:04 +00:00
Andrew Lamb 530ee94558
fix: use correct sort key in projection_pushdown (#7718)
* fix: use correct sort key in projection_pushdown

* fix: tabs in docs

* refactor: Use Serde to format test results
2023-05-02 16:50:04 +00:00
Joe-Blount 9ca8dbfcd2
fix: removed clean files from hashtable to enable re-adding them later (#7711)
* fix: removed clean files from hashtable to enable re-adding them later

* chore: acquire hashtable lock once

* chore: add comments, remove duplicate clear()
2023-05-02 16:26:07 +00:00
Utkarsh Gupta 18b02a03cf
chore: move to the smaller, cargo-team maintained `home` crate (#7716)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-02 16:10:22 +00:00
kodiakhq[bot] 323c8ac4f0
Merge pull request #7714 from influxdata/dom/revert-dns
revert: PR #7708
2023-05-02 12:01:53 +00:00
Dom Dwyer c9cfe05f8d
revert: PR #7708
This reverts commit 61abb58933.
2023-05-02 13:51:30 +02:00
Andrew Lamb 61abb58933
refactor: Change catalog configuration so it is entirely dsn based / support end to end testing without postgres (#7708)
* refactor: Change catalog configuration so it is entirely dsn based

* docs: Add documentation

* chore: update docs

* chore: review feedback

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-02 10:48:33 +00:00
Carol (Nichols || Goulding) e8fccd6795
fix: Round sizes in compactor2 insta snapshots to the nearest KB or MB (#7699)
* fix: Remove file size from compactor2 insta snapshots

To reduce churn when metadata is adjusted

* fix: Put back final output size in compactor snapshots

* fix: Return file sizes but round kb and mb to the nearest byte

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-01 21:27:26 +00:00
Christopher M. Wolff 493b26831d
fix: make influx RPC interface break up series into multiple frames (#7691)
* fix: make influx RPC interface break up series into multiple frames

* refactor: code review feedback

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-01 20:18:05 +00:00
kodiakhq[bot] 78ad824705
Merge pull request #7712 from influxdata/cn/bye-chrono-time
fix: Use only humantime; get rid of chrono-english
2023-05-01 17:34:11 +00:00
Carol (Nichols || Goulding) f7eb465ee6
fix: Add chrono-english to the cargo-deny config to avoid pulling it in again in the future 2023-05-01 11:31:42 -04:00
Carol (Nichols || Goulding) 0c4a86cbaa
fix: Use humantime rather than chrono-english 2023-05-01 11:31:42 -04:00
Carol (Nichols || Goulding) cd4d961db9
fix: garbage_collector no longer uses chrono-english so it can use the workspace hack crate 2023-05-01 11:31:42 -04:00
dependabot[bot] 67957d6fb5
chore(deps): Bump rustix from 0.37.15 to 0.37.18 (#7701)
Bumps [rustix](https://github.com/bytecodealliance/rustix) from 0.37.15 to 0.37.18.
- [Release notes](https://github.com/bytecodealliance/rustix/releases)
- [Commits](https://github.com/bytecodealliance/rustix/compare/v0.37.15...v0.37.18)

---
updated-dependencies:
- dependency-name: rustix
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-01 15:11:37 +00:00
Andrew Lamb 7a77ba2e48
fix: Remove `remote store pull` command (#7688)
* fix: Remove  `remote store pull` command

* fix: fmt

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-01 15:03:27 +00:00
dependabot[bot] b7c3711282
chore(deps): Bump uuid from 1.3.1 to 1.3.2 (#7702)
Bumps [uuid](https://github.com/uuid-rs/uuid) from 1.3.1 to 1.3.2.
- [Release notes](https://github.com/uuid-rs/uuid/releases)
- [Commits](https://github.com/uuid-rs/uuid/compare/1.3.1...1.3.2)

---
updated-dependencies:
- dependency-name: uuid
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-01 14:54:28 +00:00
dependabot[bot] 9146306015
chore(deps): Bump flate2 from 1.0.25 to 1.0.26 (#7703)
Bumps [flate2](https://github.com/rust-lang/flate2-rs) from 1.0.25 to 1.0.26.
- [Release notes](https://github.com/rust-lang/flate2-rs/releases)
- [Commits](https://github.com/rust-lang/flate2-rs/commits)

---
updated-dependencies:
- dependency-name: flate2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-01 14:44:06 +00:00
Andrew Lamb 3bbeb99c9f
fix: Fix cargo_audit using tracing-subscriber (#7710) 2023-05-01 14:09:21 +00:00
Andrew Lamb 2217799256
feat: Add --partition_filter to `remote get table` command (#7685)
* feat: Add --partition_filter to `remote get table` command

* fix: update command description

---------

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-01 11:15:13 +00:00
dependabot[bot] ea7872760d
chore(deps): Bump reqwest from 0.11.16 to 0.11.17 (#7700)
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.16 to 0.11.17.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.16...v0.11.17)

---
updated-dependencies:
- dependency-name: reqwest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-01 11:02:23 +00:00
Phil Bracikowski b7bd66195f
chore(garbage collector): improve logging in lister (#7695)
* follow up to #7689
2023-04-28 16:37:08 +00:00
Joe-Blount 5f7efcac58
chore: add compactor logging (#7694) 2023-04-28 14:59:35 +00:00
kodiakhq[bot] 2297900990
Merge pull request #7682 from influxdata/dom/deps
chore(clap_blocks): remove unused dep
2023-04-28 13:33:49 +00:00
kodiakhq[bot] 8354358add
Merge branch 'main' into dom/deps 2023-04-28 13:26:49 +00:00
Phil Bracikowski fb4083d993
fix(garbage collector): respect lister limit, display source errors (#7689)
GC object store lister adjustments: the previous take wasn't being
respected because of where it was; a chunked list is now used instead.
The lister specific errors will now display the source error too.

* follow up to #7562

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-28 13:25:39 +00:00