0cbd9f6a82
chore(deps): Bump tokio-util from 0.7.5 to 0.7.7 ( #6964 )
...
---
updated-dependencies:
- dependency-name: tokio-util
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-13 10:10:53 +00:00
083f9bc0a7
chore(deps): Bump zstd-safe from 6.0.3+zstd.1.5.2 to 6.0.4+zstd.1.5.4 ( #6962 )
...
Bumps [zstd-safe](https://github.com/gyscos/zstd-rs ) from 6.0.3+zstd.1.5.2 to 6.0.4+zstd.1.5.4.
- [Release notes](https://github.com/gyscos/zstd-rs/releases )
- [Commits](https://github.com/gyscos/zstd-rs/commits/zstd-safe-6.0.4 )
---
updated-dependencies:
- dependency-name: zstd-safe
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-13 09:58:17 +00:00
c805a7527b
chore(deps): Bump zstd-sys from 2.0.6+zstd.1.5.2 to 2.0.7+zstd.1.5.4 ( #6963 )
...
Bumps [zstd-sys](https://github.com/gyscos/zstd-rs ) from 2.0.6+zstd.1.5.2 to 2.0.7+zstd.1.5.4.
- [Release notes](https://github.com/gyscos/zstd-rs/releases )
- [Commits](https://github.com/gyscos/zstd-rs/commits/zstd-sys-2.0.7 )
---
updated-dependencies:
- dependency-name: zstd-sys
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-13 09:23:39 +00:00
06d50e8611
chore(deps): Bump croaring from 0.7.0 to 0.8.0 ( #6965 )
...
Bumps [croaring](https://github.com/saulius/croaring-rs ) from 0.7.0 to 0.8.0.
- [Release notes](https://github.com/saulius/croaring-rs/releases )
- [Commits](https://github.com/saulius/croaring-rs/compare/0.7.0...0.8.0 )
---
updated-dependencies:
- dependency-name: croaring
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-13 09:09:32 +00:00
c15de72249
fix: Remove the use of write buffer config from import schema command ( #6957 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-11 15:02:32 +00:00
0db37f564c
chore: Update display, and add initial scenario tests ( #6954 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-10 20:20:19 +00:00
a2510c8343
feat: partial implementation of gap filling operator ( #6911 )
...
* feat: partial implementation of gap filling operator
* chore: code review feedback
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-10 19:03:34 +00:00
779fb93ce7
refactor: move test builders out of compactor2 code ( #6953 )
...
* refactor: move test builders out of compactor2 code
* fix: docs
2023-02-10 18:28:09 +00:00
de765a99b7
Merge pull request #6936 from influxdata/cn/multi-ingester-test
...
test: Test with multiple ingesters, like in production
2023-02-10 15:11:48 +00:00
8824342763
Merge branch 'main' into cn/multi-ingester-test
2023-02-10 15:05:39 +00:00
d790406085
feat(compactor): Implement ParquetFileSimulator and use it to show layout testing ( #6932 )
...
* feat(compactor): implement ParquetFileSimulator, show it working in tests
* fix: Update compactor2/src/components/parquet_files_sink/simulator.rs
Co-authored-by: Nga Tran <nga-tran@live.com>
* feat: Improve display of plan_ir
* refactor: return CompactResult, avoid `mut TestSetup`
---------
Co-authored-by: Nga Tran <nga-tran@live.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-10 14:51:17 +00:00
92bdb450e0
Merge pull request #6947 from influxdata/dom/expose-soft-delete-column
...
refactor(catalog): expose deleted_at on Namespace
2023-02-10 14:38:45 +00:00
a85dcd745b
refactor(catalog): expose deleted_at on Namespace
...
Add the new catalog column to the Namespace representation/model.
2023-02-10 14:15:01 +01:00
2283b3d401
fix: `clap_blocks` clippy warning ( #6945 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-10 12:29:45 +00:00
501032c2fb
chore: Update datafusion again ( #6929 )
...
* chore: Update DataFusion
* fix: disable repartitioned sorting
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-10 11:51:47 +00:00
c0c9b51b9e
chore(deps): Bump tokio-util from 0.7.4 to 0.7.5 ( #6941 )
...
Bumps [tokio-util](https://github.com/tokio-rs/tokio ) from 0.7.4 to 0.7.5.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-util-0.7.4...tokio-util-0.7.5 )
---
updated-dependencies:
- dependency-name: tokio-util
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-10 09:42:00 +00:00
7b80b03b28
test: Test with multiple ingesters, like in production
2023-02-09 17:31:28 -05:00
c244b8c229
Merge pull request #6913 from influxdata/cn/fix-ingester-addresses-once-and-for-all
...
fix: Consolidate ingester address specification
2023-02-09 21:23:29 +00:00
d7150b83bf
fix: Consolidate ingester address specification
...
Fixes #6418 .
Makes sure the querier, the router, and the ingest replica CLI all
accept and validate ingester addresses the same, except whether or not
at least one value is required.
2023-02-09 15:23:23 -05:00
67f0eb62b6
Merge pull request #6850 from influxdata/cn/delete-more-old-test-code
...
fix: Switch more tests over to the kafkaless architecture
2023-02-09 19:12:00 +00:00
8eace0d4d8
docs: Try to clarify what MiniCluster does in regard to compactor
2023-02-09 13:56:07 -05:00
fcb7f4c61d
fix: Remove unused "other server" minicluster code
2023-02-09 13:56:07 -05:00
1794147b3c
fix: Only test querier panic logging; router2 and ingester2 now exit on panic
2023-02-09 13:56:07 -05:00
b5464aa82e
fix: Remove test that compacts once for now
2023-02-09 13:56:07 -05:00
b8360e7710
fix: Remove old test ServerTypes
2023-02-09 13:56:07 -05:00
c4fa0cc7ad
fix: Remove test configs for old server types
2023-02-09 13:56:07 -05:00
2204630d90
fix: Remove test steps and helper functions only used in Kafkaful arch
2023-02-09 13:56:07 -05:00
38f8e18357
fix: Only run end-to-end tests against Kafkaless
2023-02-09 13:56:06 -05:00
d7c59da46b
fix: Switch more tests over to the kafkaless architecture
2023-02-09 13:56:06 -05:00
eb15e2e8d9
Merge pull request #6926 from influxdata/dom/doc-persist-endpoint
...
docs(proto): ingester persist API strangeness
2023-02-09 18:28:12 +00:00
c6d19cdb92
Merge branch 'main' into dom/doc-persist-endpoint
2023-02-09 17:15:29 +00:00
822b1ffe18
Merge pull request #6931 from influxdata/dom/clean-catalog-test-state
...
test(catalog): independent test state
2023-02-09 16:44:37 +00:00
e486f51d77
Merge branch 'main' into dom/clean-catalog-test-state
2023-02-09 16:32:00 +00:00
22881041c3
Merge branch 'main' into dom/doc-persist-endpoint
2023-02-09 16:30:28 +00:00
6a470252ac
refactor: `PartitionInfoSource` ( #6930 )
...
* refactor: `PartitionInfoSource`
Clean up the driver code a bit. There is certainly a good point in
having all these three sources (partition, table, namespace) separate,
but the driver doesn't really need to know that. In the end, it just
wants to have a `PartitionInfo` instance.
* docs: typo
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
---------
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2023-02-09 16:29:28 +00:00
aa74bb6292
test(catalog): independent test state
...
All our catalog tests run as one test, over one database connection.
Prior to this commit, there was no state reset during test execution, so
earlier tests would pollute the state of later tests, making it an
increasingly complex and intermingled set of tests trying to assert
their entities while ignoring other, previously created entities (or
changing the order of test execution in search of the golden ordering
that makes everything great again.)
This is a bit of a hack, and is not how I'd have structured catalog
testing w/ clean state if I was writing it fresh. It is what it is.
This has been driving me mad for SO LONG it's SO BAD <shakes fist>.
2023-02-09 17:27:58 +01:00
f4e22528f0
Merge branch 'main' into dom/doc-persist-endpoint
2023-02-09 16:27:37 +00:00
fd42f94fb8
test(compactor): show compactor working ( #6910 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-09 16:06:37 +00:00
4a97620664
refactor: `ParquetFilesSink` ( #6928 )
...
* refactor: pass `PlanIR` by ref
* refactor: `ParquetFilesSink`
2023-02-09 15:53:19 +00:00
0e5f31c576
feat: add log around job semaphore and per-partition ( #6927 )
...
May help w/ debug OOMs.
2023-02-09 15:02:34 +00:00
00fd545a18
Merge pull request #6924 from influxdata/dom/soft-delete-namespaces
...
refactor(catalog): soft delete namespace column
2023-02-09 13:50:55 +00:00
8d62a55743
Merge branch 'main' into dom/soft-delete-namespaces
2023-02-09 13:43:08 +00:00
7ae6dda87c
docs(proto): ingester persist endpoint
...
This endpoint has some serious usability caveats that should be known by
users of this API!
2023-02-09 14:11:37 +01:00
08cf71e0ac
refactor(proto): move PersistService to new file
...
Separate the PersistService into it's own file.
2023-02-09 14:04:46 +01:00
7f4fd1013c
feat: measure scratchpad store ( #6925 )
...
* refactor: create `objec_store` submodule
* feat: add gauge for scratchpad size
2023-02-09 13:03:26 +00:00
e33ac920a5
refactor: introduce IR before creating actual DF plan ( #6922 )
...
* refactor: introduce IR before creating actual DF plan
Let's have an IR that presents a machine-readable form of how output
files may look like.
* docs: improve
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
* feat: also log plan type
---------
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2023-02-09 11:31:18 +00:00
f374b022ed
Merge branch 'main' into dom/soft-delete-namespaces
2023-02-09 10:47:53 +00:00
905ffddd74
chore: gitignore pending insta snapshots ( #6923 )
...
You never want to commit these, they are mere local state.
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-09 10:47:29 +00:00
cdd8a9c8e8
Merge branch 'main' into dom/soft-delete-namespaces
2023-02-09 10:45:09 +00:00
6327e3d9c0
chore(deps): Bump serde_json from 1.0.92 to 1.0.93 ( #6918 )
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.92 to 1.0.93.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.92...v1.0.93 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-09 10:39:33 +00:00
dependabot[bot]
Carol (Nichols || Goulding)
Andrew Lamb
Christopher M. Wolff
kodiakhq[bot]
Dom
Marco Neumann
Carol (Nichols || Goulding)