be75ba23e0
Merge branch 'main' into dependabot/cargo/hashbrown-0.14.0
2023-06-08 09:32:01 +01:00
17c0d837b3
chore: Update DataFusion, arrow, object_store pins ( #7942 )
...
* chore: Update DataFusion, arrow, object_store pins
* chore: Update for hakari
* chore: Update for new APIs
* fix: update test
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-06-07 17:08:31 +00:00
fcd9d9e3e6
chore(deps): Bump hashbrown from 0.13.2 to 0.14.0
...
Bumps [hashbrown](https://github.com/rust-lang/hashbrown ) from 0.13.2 to 0.14.0.
- [Changelog](https://github.com/rust-lang/hashbrown/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/hashbrown/compare/v0.13.2...v0.14.0 )
---
updated-dependencies:
- dependency-name: hashbrown
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-06-07 11:52:16 -04:00
f571aeb445
chore: Update DataFusion pin ( #7916 )
...
* chore: Update DataFusion pin
* chore: Update cargo
* fix: update for API changes
* fix: Update plans
* chore: Update for new api
* fix: Update plans
* chore: Update for API changes more
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-06-05 18:38:59 +00:00
a48f681e56
feat(parquet): reduce and limit buffering when writing parquet files ( #7880 )
...
* feat: limit buffering when writing parquet files ("combined solution")
* chore: Run cargo hakari tasks
---------
Co-authored-by: Raphael Taylor-Davies <r.taylordavies@googlemail.com>
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-31 13:27:32 +00:00
1ff76b7bf2
chore: use workspace dependencies for `object_store`
2023-05-26 07:03:42 -04:00
c4eca5fecf
Merge branch 'main' into cn/table-create-grpc-api
2023-05-25 18:53:12 +00:00
138b14e0db
chore: Update DataFusion and arrow to `40.0.0` ( #7864 )
...
* chore: Update DataFusion and arrow to `40.0.0`
* chore: Run cargo hakari tasks
* fix: update for API
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-25 17:34:51 +00:00
e1a93252c5
feat: Add a new table service crate
2023-05-25 10:44:57 -04:00
90a25a3ff0
chore: update DataFusion ( #7825 )
...
* chore: update DataFusion
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-05-18 17:51:16 +00:00
62fed73bcd
refactor: upgrade DataFusion to `19b03240920ad63cac916b42951754c0337bdac8#19b03240920ad63cac916b42951754c0337bdac8` ( #7813 )
...
I need:
- https://github.com/apache/arrow-datafusion/pull/6226 .
Changes in code due to:
- https://github.com/apache/arrow-datafusion/pull/6332
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-17 13:57:12 +00:00
c077dec0e0
refactor: rename `import` to `iox_import_export` ( #7799 )
...
* refactor: rename `import` crate to `import_export`
* chore: Consolidate tsm import/export
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-16 17:10:17 +00:00
2bb6445668
chore: update DataFusion and arrow / arrow-flight / parquet to `39.0.0` ( #7793 )
...
* chore: update DataFusion and arrow/parquet/arrow-flight to 39.0.0
* chore: update DataFusion and arrow/parquet/arrow-flight to 39.0.0 in workspace-hack/Cargo.toml
* chore: Run cargo hakari tasks
* chore: fix CI test and lint
* chore: update csv schema
* refactor: remove type-annotate for `Arc`
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-16 13:42:26 +00:00
6bfa269896
Merge branch 'main' into savage/wal-inspect-library-refactor
2023-05-16 11:07:47 +00:00
e14bc925db
Merge branch 'main' into cn/move-peas
2023-05-15 14:36:18 +00:00
7735e7c95b
chore: Update DataFusion again ( #7777 )
...
* chore: Update datafusion again
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-15 12:38:45 +00:00
1770d0f4d8
fix: Move ingester-querier gRPC communication to its own crate
2023-05-12 13:28:30 -04:00
9229ce5668
fix: Rename compactor2_test_utils to compactor_test_utils
2023-05-09 11:02:11 +02:00
45493b91e5
fix: Rename ioxd_compactor2 to ioxd_compactor
2023-05-09 11:02:11 +02:00
dd9c5d1b13
fix: Rename compactor2 to compactor
2023-05-09 10:58:55 +02:00
0849ce6f2b
fix: Rename ingester2_test_ctx to ingester_test_ctx
2023-05-08 20:23:02 -04:00
19a56bdf4b
fix: Rename ioxd_ingester2 to ioxd_ingester
2023-05-08 20:20:03 -04:00
56916cf942
fix: Rename ingester2 to ingester
2023-05-08 12:03:05 -04:00
2860d87fe1
chore: Update DataFusion ( #7756 )
...
* chore: Update DataFusion pin
* chore: Update explain plans
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-05-05 18:58:18 +00:00
abe5d26d2f
chore: update DataFusion to `2787e7a36a6be83d91201df20827d3695f933300` ( #7732 )
...
Required to get:
- https://github.com/apache/arrow-datafusion/pull/6199
2023-05-03 16:40:00 +00:00
f6dea224e8
feat(wal): Add wal_inspect crate & a write op entry decoder
...
This adds a new crate with a type capable of converting
decoded WAL Write Op entries to line protocol and writing
the result to a namespaced destination. The wal crate
now exports a type which reads the sequenced wal ops and
decodes them as namespaced table batch writes.
2023-05-03 11:50:59 +01:00
65ca52ce3b
chore: Update DataFusion again ( #7722 )
...
* chore: Update DF again
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-05-02 18:34:45 +00:00
2b1f8b56e2
chore: Update DataFusion ( #7719 )
...
* chore: Update DataFusion
* chore: update for API change
* chore: update some tests
* fix: Update plans in optimizer
* chore: Update plans
* chore: Update error messages
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-05-02 17:55:04 +00:00
0c4a86cbaa
fix: Use humantime rather than chrono-english
2023-05-01 11:31:42 -04:00
bc324c4ac2
chore: Update DataFusion and arrow/parquet/arrow-flight to `38.0.0` ( #7662 )
...
* chore: Update DataFusion and arrow/parquet/arrow-flight to `38.0.0`
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2023-04-25 14:29:23 -04:00
f411f5d6d5
chore: update DF to `181e5ccf2816ccaa05d8aaef0b375d4b7bbceece` ( #7630 )
...
I need the following two PRs:
- https://github.com/apache/arrow-datafusion/pull/6045
- https://github.com/apache/arrow-datafusion/pull/6085
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-24 09:46:54 +00:00
26575f8bb9
Merge branch 'main' into dom/tidy-authz
2023-04-18 10:47:18 +00:00
a409fd45f7
chore(deps): Bump tonic-reflection from 0.9.1 to 0.9.2 ( #7581 )
...
Bumps [tonic-reflection](https://github.com/hyperium/tonic ) from 0.9.1 to 0.9.2.
- [Release notes](https://github.com/hyperium/tonic/releases )
- [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md )
- [Commits](https://github.com/hyperium/tonic/compare/v0.9.1...v0.9.2 )
---
updated-dependencies:
- dependency-name: tonic-reflection
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-18 10:40:49 +00:00
2b9a809de4
refactor: move HTTP authz helpers into authz
...
The "server_util" crate exists only to support HTTP authz operations, so
this commit moves it under the authz crate. This helper is gated by a
feature flag allowing callers to opt into this extra HTTP dependency
(disabled by default).
2023-04-18 12:30:56 +02:00
36947616fd
chore(deps): Bump tonic-health from 0.9.1 to 0.9.2 ( #7580 )
...
Bumps [tonic-health](https://github.com/hyperium/tonic ) from 0.9.1 to 0.9.2.
- [Release notes](https://github.com/hyperium/tonic/releases )
- [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md )
- [Commits](https://github.com/hyperium/tonic/compare/v0.9.1...v0.9.2 )
---
updated-dependencies:
- dependency-name: tonic-health
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-18 10:04:53 +00:00
2e818fb370
chore(deps): Bump tonic from 0.9.1 to 0.9.2
...
Bumps [tonic](https://github.com/hyperium/tonic ) from 0.9.1 to 0.9.2.
- [Release notes](https://github.com/hyperium/tonic/releases )
- [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md )
- [Commits](https://github.com/hyperium/tonic/compare/v0.9.1...v0.9.2 )
---
updated-dependencies:
- dependency-name: tonic
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-04-18 07:54:43 +00:00
91d1441031
chore(deps): Bump tonic-build from 0.9.1 to 0.9.2 ( #7579 )
...
Bumps [tonic-build](https://github.com/hyperium/tonic ) from 0.9.1 to 0.9.2.
- [Release notes](https://github.com/hyperium/tonic/releases )
- [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md )
- [Commits](https://github.com/hyperium/tonic/compare/v0.9.1...v0.9.2 )
---
updated-dependencies:
- dependency-name: tonic-build
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-18 07:53:01 +00:00
808a13cf40
chore: remove `time` 0.1 & fix RUSTSEC-2020-0071 ( #7568 )
...
`time` 0.1 suffers from [RUSTSEC-2020-0071] and many upstream crates
have tried to remove it for years. The last dependency is
1. `chrono-english`
2. `chrono` (default features)
3. `chrono` (oldtime)
4. `time` 0.1
`chrono-english` doesn't seem to be super well maintained, but I
couldn't find a nice replacement for it. Luckily the master branch of
`chrono-english` is already fixed, so let's just directly use that.
[RUSTSEC-2020-0071]: https://rustsec.org/advisories/RUSTSEC-2020-0071
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-17 12:36:10 +00:00
c26981d51b
chore: Update datafusion again ( #7557 )
...
* chore: Update datafusion again
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-14 17:37:00 +00:00
f46d06d56f
chore: Update DataFusion + arrow ecosystem to 37 ( #7544 )
...
* chore: Update datafusion and arrow/parquet to 37, tonic to 0.9.1
* refactor: Update for FieldRef and other API changes
* fix: Update field size calculation
* fix: Use `NullBuffer` directly
* fix: remove outdated comment
* chore: Update test for tonic
* chore: Run cargo hakari tasks
* chore: cargo update
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-14 12:43:01 +00:00
134ff2ef83
chore: update DataFusion pin (right before arrow 37 update) ( #7540 )
...
* chore: update DataFusion pin
* refactor: Update for deprecated API
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-13 17:25:24 +00:00
3ebd07358b
chore: Update DataFusion pin, upgrade `date_bin` and `InfluxQL` to use `Interval(MonthDayNano)` ( #7516 )
...
* chore: Update datafusion
* chore: Update for change in PhysicalSortExpr
* refactor: Update date_bin_gapfill to take IntervalMonthDayNano, fix FlightSQL
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-13 10:43:32 +00:00
53ddca45d8
Merge branch 'main' into cn/remove-write-summary
2023-04-12 16:07:35 +00:00
20e9c91866
refactor: Use workspace dependencies for `tonic`, `tonic-build`, etc ( #7515 )
...
* refactor: Use workspace dependencies for `tonic`, `tonic-build`, etc
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-12 16:07:19 +00:00
6387a9576a
fix: Remove the write_summary crate and write info service
2023-04-12 11:31:23 -04:00
65c90b0281
fix: Remove the write buffer crate
2023-04-12 11:01:26 -04:00
02c7ec0727
test: add ingester2_test_ctx
...
Moves the ingester2 TestContext & builder to its own crate for reuse
between integration tests & benchmarks (and more?!)
This allows us to DRY & reuse the test code with it's nice API for
benchmarks too, without forcing it all to be in the "prod" build of
ingester2 (and the dependencies, and their dependencies, etc).
This also means this code can be built and cached instead of being
rebuilt all the time during normal development.
2023-04-12 12:51:47 +02:00
6c2ce01f1e
fix: Remove old ingester and ioxd_ingester
2023-04-07 11:06:37 -04:00
a5769a461b
fix: Remove old compactor and ioxd_compactor
2023-04-06 16:49:52 -04:00
e8b7d69b0f
chore: Update datafusion again ( #7442 )
...
* chore: Update datafusion
* chore: Fix up plans for datafusion API change
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-04-05 18:21:53 +00:00
Dom
Andrew Lamb
dependabot[bot]
Andrew Lamb
kodiakhq[bot]
Carol (Nichols || Goulding)
Christopher M. Wolff
Marco Neumann
Chunchun Ye
Fraser Savage