5027c9a88c
chore: sort workspace members
...
Sort the package names in the workspace member declaration.
2023-07-10 12:11:03 +02:00
3ce11d8d66
chore: Update DataFusion ( #8190 )
...
* chore: Update DataFusion
* chore: Run cargo hakari tasks
* fix: Update for API changes
* fix: use display format
* chore: Update explain plan output
* fix: update plans
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-07-10 09:54:50 +00:00
4a1f8db254
chore: Update datafusion + arrow/arrow-flight/parquet to patched version `42.0.0` ( #8113 )
...
* Revert "Revert "chore: Update datafusion + arrow/arrow-flight/parquet to version `42.0.0` (#8036 )" (#8049 )"
This reverts commit fb0674fc01
2023-06-30 12:59:31 +00:00
9874b283b7
feat: tokio metrics bridge ( #8091 )
2023-06-29 08:43:57 +00:00
fb0674fc01
Revert "chore: Update datafusion + arrow/arrow-flight/parquet to version `42.0.0` ( #8036 )" ( #8049 )
...
This reverts commit 70ffedadc7
2023-06-22 11:03:25 +00:00
70ffedadc7
chore: Update datafusion + arrow/arrow-flight/parquet to version `42.0.0` ( #8036 )
...
* chore: Update datafusion + arrow/arrow-flight/parquet to version `42.0.0`
* chore: Update for new APIs
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-06-21 16:11:36 +00:00
8b7ef69f6f
refactor: move partitions_source to scheduler ( #8010 )
...
* refactor: make compactor_scheduler crate
* refactor: move PartitionsSource into the compactor_scheduler
The compactor currently uses PartitionsSource in two ways:
* for the preparation of PartitionIds prior to the compactor pipeline.
* for the abstraction which utilize the PartitionIds during the IO pipeline.
This commit is a refactoring to enable us to delineate between these two utilizations.
The former (preparation) utilization will now be done in the compactor_scheduler.
Since the compactor is dependent on the compactor_scheduler, it made sense to move the trait to the scheduler.
2023-06-16 10:02:13 -07:00
e10b8c93c8
chore: Update DataFusion and other dependencies ( #8014 )
...
* chore: Update DataFusion pin
* chore: Update API changes
* chore: Don't use deprecated API
* chore: Run cargo hakari tasks
* chore: Update tests due to changes in logical plan nodes from DF update
* chore: Fix broken links in docs
* chore: Adjust changes to expected output
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
2023-06-16 10:39:36 +00:00
5889c96501
chore: Update `datafusion` and other dependencies ( #7981 )
...
* chore: Update DatFaFusion pin
* chore: Update other dependencies
* chore: Update hakari
* fix: Update for API changes
* fix: Update explain plan
* fix: Update influxql plans
* fix: rustdoc links
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-06-16 09:48:55 +00:00
be75ba23e0
Merge branch 'main' into dependabot/cargo/hashbrown-0.14.0
2023-06-08 09:32:01 +01:00
17c0d837b3
chore: Update DataFusion, arrow, object_store pins ( #7942 )
...
* chore: Update DataFusion, arrow, object_store pins
* chore: Update for hakari
* chore: Update for new APIs
* fix: update test
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-06-07 17:08:31 +00:00
fcd9d9e3e6
chore(deps): Bump hashbrown from 0.13.2 to 0.14.0
...
Bumps [hashbrown](https://github.com/rust-lang/hashbrown ) from 0.13.2 to 0.14.0.
- [Changelog](https://github.com/rust-lang/hashbrown/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/hashbrown/compare/v0.13.2...v0.14.0 )
---
updated-dependencies:
- dependency-name: hashbrown
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-06-07 11:52:16 -04:00
f571aeb445
chore: Update DataFusion pin ( #7916 )
...
* chore: Update DataFusion pin
* chore: Update cargo
* fix: update for API changes
* fix: Update plans
* chore: Update for new api
* fix: Update plans
* chore: Update for API changes more
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-06-05 18:38:59 +00:00
a48f681e56
feat(parquet): reduce and limit buffering when writing parquet files ( #7880 )
...
* feat: limit buffering when writing parquet files ("combined solution")
* chore: Run cargo hakari tasks
---------
Co-authored-by: Raphael Taylor-Davies <r.taylordavies@googlemail.com>
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-31 13:27:32 +00:00
1ff76b7bf2
chore: use workspace dependencies for `object_store`
2023-05-26 07:03:42 -04:00
c4eca5fecf
Merge branch 'main' into cn/table-create-grpc-api
2023-05-25 18:53:12 +00:00
138b14e0db
chore: Update DataFusion and arrow to `40.0.0` ( #7864 )
...
* chore: Update DataFusion and arrow to `40.0.0`
* chore: Run cargo hakari tasks
* fix: update for API
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-25 17:34:51 +00:00
e1a93252c5
feat: Add a new table service crate
2023-05-25 10:44:57 -04:00
90a25a3ff0
chore: update DataFusion ( #7825 )
...
* chore: update DataFusion
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-05-18 17:51:16 +00:00
62fed73bcd
refactor: upgrade DataFusion to `19b03240920ad63cac916b42951754c0337bdac8#19b03240920ad63cac916b42951754c0337bdac8` ( #7813 )
...
I need:
- https://github.com/apache/arrow-datafusion/pull/6226 .
Changes in code due to:
- https://github.com/apache/arrow-datafusion/pull/6332
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-17 13:57:12 +00:00
c077dec0e0
refactor: rename `import` to `iox_import_export` ( #7799 )
...
* refactor: rename `import` crate to `import_export`
* chore: Consolidate tsm import/export
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-16 17:10:17 +00:00
2bb6445668
chore: update DataFusion and arrow / arrow-flight / parquet to `39.0.0` ( #7793 )
...
* chore: update DataFusion and arrow/parquet/arrow-flight to 39.0.0
* chore: update DataFusion and arrow/parquet/arrow-flight to 39.0.0 in workspace-hack/Cargo.toml
* chore: Run cargo hakari tasks
* chore: fix CI test and lint
* chore: update csv schema
* refactor: remove type-annotate for `Arc`
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-16 13:42:26 +00:00
6bfa269896
Merge branch 'main' into savage/wal-inspect-library-refactor
2023-05-16 11:07:47 +00:00
e14bc925db
Merge branch 'main' into cn/move-peas
2023-05-15 14:36:18 +00:00
7735e7c95b
chore: Update DataFusion again ( #7777 )
...
* chore: Update datafusion again
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-15 12:38:45 +00:00
1770d0f4d8
fix: Move ingester-querier gRPC communication to its own crate
2023-05-12 13:28:30 -04:00
9229ce5668
fix: Rename compactor2_test_utils to compactor_test_utils
2023-05-09 11:02:11 +02:00
45493b91e5
fix: Rename ioxd_compactor2 to ioxd_compactor
2023-05-09 11:02:11 +02:00
dd9c5d1b13
fix: Rename compactor2 to compactor
2023-05-09 10:58:55 +02:00
0849ce6f2b
fix: Rename ingester2_test_ctx to ingester_test_ctx
2023-05-08 20:23:02 -04:00
19a56bdf4b
fix: Rename ioxd_ingester2 to ioxd_ingester
2023-05-08 20:20:03 -04:00
56916cf942
fix: Rename ingester2 to ingester
2023-05-08 12:03:05 -04:00
2860d87fe1
chore: Update DataFusion ( #7756 )
...
* chore: Update DataFusion pin
* chore: Update explain plans
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-05-05 18:58:18 +00:00
abe5d26d2f
chore: update DataFusion to `2787e7a36a6be83d91201df20827d3695f933300` ( #7732 )
...
Required to get:
- https://github.com/apache/arrow-datafusion/pull/6199
2023-05-03 16:40:00 +00:00
f6dea224e8
feat(wal): Add wal_inspect crate & a write op entry decoder
...
This adds a new crate with a type capable of converting
decoded WAL Write Op entries to line protocol and writing
the result to a namespaced destination. The wal crate
now exports a type which reads the sequenced wal ops and
decodes them as namespaced table batch writes.
2023-05-03 11:50:59 +01:00
65ca52ce3b
chore: Update DataFusion again ( #7722 )
...
* chore: Update DF again
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-05-02 18:34:45 +00:00
2b1f8b56e2
chore: Update DataFusion ( #7719 )
...
* chore: Update DataFusion
* chore: update for API change
* chore: update some tests
* fix: Update plans in optimizer
* chore: Update plans
* chore: Update error messages
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-05-02 17:55:04 +00:00
0c4a86cbaa
fix: Use humantime rather than chrono-english
2023-05-01 11:31:42 -04:00
bc324c4ac2
chore: Update DataFusion and arrow/parquet/arrow-flight to `38.0.0` ( #7662 )
...
* chore: Update DataFusion and arrow/parquet/arrow-flight to `38.0.0`
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-04-25 14:29:23 -04:00
f411f5d6d5
chore: update DF to `181e5ccf2816ccaa05d8aaef0b375d4b7bbceece` ( #7630 )
...
I need the following two PRs:
- https://github.com/apache/arrow-datafusion/pull/6045
- https://github.com/apache/arrow-datafusion/pull/6085
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-24 09:46:54 +00:00
26575f8bb9
Merge branch 'main' into dom/tidy-authz
2023-04-18 10:47:18 +00:00
a409fd45f7
chore(deps): Bump tonic-reflection from 0.9.1 to 0.9.2 ( #7581 )
...
Bumps [tonic-reflection](https://github.com/hyperium/tonic ) from 0.9.1 to 0.9.2.
- [Release notes](https://github.com/hyperium/tonic/releases )
- [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md )
- [Commits](https://github.com/hyperium/tonic/compare/v0.9.1...v0.9.2 )
---
updated-dependencies:
- dependency-name: tonic-reflection
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-18 10:40:49 +00:00
2b9a809de4
refactor: move HTTP authz helpers into authz
...
The "server_util" crate exists only to support HTTP authz operations, so
this commit moves it under the authz crate. This helper is gated by a
feature flag allowing callers to opt into this extra HTTP dependency
(disabled by default).
2023-04-18 12:30:56 +02:00
36947616fd
chore(deps): Bump tonic-health from 0.9.1 to 0.9.2 ( #7580 )
...
Bumps [tonic-health](https://github.com/hyperium/tonic ) from 0.9.1 to 0.9.2.
- [Release notes](https://github.com/hyperium/tonic/releases )
- [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md )
- [Commits](https://github.com/hyperium/tonic/compare/v0.9.1...v0.9.2 )
---
updated-dependencies:
- dependency-name: tonic-health
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-18 10:04:53 +00:00
2e818fb370
chore(deps): Bump tonic from 0.9.1 to 0.9.2
...
Bumps [tonic](https://github.com/hyperium/tonic ) from 0.9.1 to 0.9.2.
- [Release notes](https://github.com/hyperium/tonic/releases )
- [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md )
- [Commits](https://github.com/hyperium/tonic/compare/v0.9.1...v0.9.2 )
---
updated-dependencies:
- dependency-name: tonic
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-04-18 07:54:43 +00:00
91d1441031
chore(deps): Bump tonic-build from 0.9.1 to 0.9.2 ( #7579 )
...
Bumps [tonic-build](https://github.com/hyperium/tonic ) from 0.9.1 to 0.9.2.
- [Release notes](https://github.com/hyperium/tonic/releases )
- [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md )
- [Commits](https://github.com/hyperium/tonic/compare/v0.9.1...v0.9.2 )
---
updated-dependencies:
- dependency-name: tonic-build
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-18 07:53:01 +00:00
808a13cf40
chore: remove `time` 0.1 & fix RUSTSEC-2020-0071 ( #7568 )
...
`time` 0.1 suffers from [RUSTSEC-2020-0071] and many upstream crates
have tried to remove it for years. The last dependency is
1. `chrono-english`
2. `chrono` (default features)
3. `chrono` (oldtime)
4. `time` 0.1
`chrono-english` doesn't seem to be super well maintained, but I
couldn't find a nice replacement for it. Luckily the master branch of
`chrono-english` is already fixed, so let's just directly use that.
[RUSTSEC-2020-0071]: https://rustsec.org/advisories/RUSTSEC-2020-0071
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-17 12:36:10 +00:00
c26981d51b
chore: Update datafusion again ( #7557 )
...
* chore: Update datafusion again
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-14 17:37:00 +00:00
f46d06d56f
chore: Update DataFusion + arrow ecosystem to 37 ( #7544 )
...
* chore: Update datafusion and arrow/parquet to 37, tonic to 0.9.1
* refactor: Update for FieldRef and other API changes
* fix: Update field size calculation
* fix: Use `NullBuffer` directly
* fix: remove outdated comment
* chore: Update test for tonic
* chore: Run cargo hakari tasks
* chore: cargo update
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-14 12:43:01 +00:00
134ff2ef83
chore: update DataFusion pin (right before arrow 37 update) ( #7540 )
...
* chore: update DataFusion pin
* refactor: Update for deprecated API
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-13 17:25:24 +00:00
Dom Dwyer
Andrew Lamb
Marco Neumann
wiedld
Stuart Carnie
dependabot[bot]
Andrew Lamb
kodiakhq[bot]
Carol (Nichols || Goulding)
Christopher M. Wolff
Chunchun Ye
Fraser Savage