c9cd1fdc44
chore: add a go_package option to the authz proto file ( #7802 )
...
This is to fix a downstream service that builds a go package from
these definitions.
2023-05-16 16:51:51 +00:00
8fa7e7cbef
Merge pull request #7801 from influxdata/dom/fix-minutes
...
fix: correct time range buckets
2023-05-16 16:05:36 +00:00
0a31afd00d
fix: correct time range buckets
...
Turns out there are 60 seconds in a minute, not 3,600.
2023-05-16 17:47:34 +02:00
522b1fca4f
Merge pull request #7611 from influxdata/smith/remove-transactions-main
...
feat: remove transactions from the Catalog
2023-05-16 10:08:05 -04:00
87b941180d
Merge branch 'main' into smith/remove-transactions-main
2023-05-16 09:47:51 -04:00
2bb6445668
chore: update DataFusion and arrow / arrow-flight / parquet to `39.0.0` ( #7793 )
...
* chore: update DataFusion and arrow/parquet/arrow-flight to 39.0.0
* chore: update DataFusion and arrow/parquet/arrow-flight to 39.0.0 in workspace-hack/Cargo.toml
* chore: Run cargo hakari tasks
* chore: fix CI test and lint
* chore: update csv schema
* refactor: remove type-annotate for `Arc`
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-16 13:42:26 +00:00
f6c3531df7
Merge pull request #7797 from influxdata/dom/file-metrics
...
feat(metrics): Parquet file attribute statistics
2023-05-16 14:35:25 +01:00
3514667a04
docs: fix comments
...
Fix two lines.
2023-05-16 15:25:47 +02:00
40acf7b86f
chore: fix bad merge
2023-05-16 09:22:42 -04:00
45628ba4d3
chore: Merge remote-tracking branch 'origin/main' into smith/remove-transactions-main
2023-05-16 08:49:25 -04:00
9b211df053
test(ingester): persist & persistence metrics
...
Adds a test that asserts (manually triggered) persistence generates a
file, uploads it to object storage, inserts metadata into the catalog,
and emits various persistence metrics.
2023-05-16 14:20:30 +02:00
74210b6257
refactor(ingester): emit Parquet file metrics
...
Register the ParquetFileInstrumentation as a PersistCompletionObserver
in the persist subsystem.
2023-05-16 14:20:30 +02:00
3114c67cf1
feat: persisted Parquet file attribute metrics
...
Implements a PersistCompletionObserver that records various attributes
of the generated and persisted Parquet file as histogram metrics to
capture the distribution of values:
* File size
* Row count
* Column count
* Time range of data (max - min timestamp)
These metrics will give us insight into the generated files instead of
relying on intuition when tuning various configuration parameters.
2023-05-16 14:20:29 +02:00
507ccc2eb5
refactor: parquet metadata in persist notification
...
Changes the CompletedPersist notification data structure to embed the
generated parquet file's metadata for completion observers.
2023-05-16 14:20:29 +02:00
74a7b7102b
Merge pull request #7729 from influxdata/savage/wal-inspect-library-refactor
...
feat(wal): Add `wal_inspect` crate & a write op entry decoder
2023-05-16 11:33:37 +00:00
cfb6abf05b
fix(wal_inspect): Make LineProtoWriter flush best effort
2023-05-16 12:26:59 +01:00
6bfa269896
Merge branch 'main' into savage/wal-inspect-library-refactor
2023-05-16 11:07:47 +00:00
a4a22b2732
refactor(wal): Tidy up WriteOpEntryDecoder next() body
...
Refactor out op comparison for `wal` decode tests to be
more general.
2023-05-16 12:06:54 +01:00
6febaef382
Merge pull request #7787 from influxdata/dom/parallel-replicate
...
perf(router): parallel write replication
2023-05-16 11:12:40 +01:00
3c47226244
Merge branch 'main' into dom/parallel-replicate
2023-05-16 11:05:10 +01:00
4efc973060
Merge pull request #7796 from influxdata/dependabot/cargo/uuid-1.3.3
...
chore(deps): Bump uuid from 1.3.2 to 1.3.3
2023-05-16 10:54:11 +01:00
06a2345708
Merge branch 'main' into dependabot/cargo/uuid-1.3.3
2023-05-16 10:36:46 +01:00
52a2084637
Merge pull request #7792 from influxdata/cn/refactor-tests
...
refactor: Extract some catalog test helper methods to reduce places that need to change
2023-05-16 10:36:27 +01:00
f196060fa8
Merge branch 'main' into cn/refactor-tests
2023-05-16 10:26:35 +01:00
3462e29859
chore(deps): Bump uuid from 1.3.2 to 1.3.3
...
Bumps [uuid](https://github.com/uuid-rs/uuid ) from 1.3.2 to 1.3.3.
- [Release notes](https://github.com/uuid-rs/uuid/releases )
- [Commits](https://github.com/uuid-rs/uuid/compare/1.3.2...1.3.3 )
---
updated-dependencies:
- dependency-name: uuid
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-05-16 02:00:24 +00:00
fcd80060be
feat(wal): Make `wal` WriteOpEntryDecoder an interator
...
Also, implement drop on `wal_inspect`'s LineProtoWriter and
bubble up flush to the caller.
2023-05-15 20:46:56 +01:00
7268ea5c29
refactor: Extract a test helper function to create a basic table
2023-05-15 14:31:24 -04:00
57bedb1c2d
refactor: Extract a test helper function to create a basic namespace
2023-05-15 14:20:38 -04:00
ea3eaee056
chore: accept database in addition to namespace_name ( #7788 )
...
* chore: accept database in addition to namespace_name
* chore: accept bucket and bucket-name as well
* test: additional test for sql request namespace aliases
2023-05-15 16:47:24 +00:00
cfd64e04fb
chore: fix bad merge
2023-05-15 12:41:42 -04:00
d252866e18
chore: Merge remote-tracking branch 'origin/main' into smith/remove-transactions-main
2023-05-15 12:35:22 -04:00
6969d94cda
Merge pull request #7740 from influxdata/authz/refactor-interface
...
refactor: Authorizer trait, and the explicit contract of IoxAuthorizer
2023-05-15 08:09:25 -07:00
867fd39dbf
Merge branch 'main' into authz/refactor-interface
2023-05-15 08:03:10 -07:00
41ec673f6f
Merge pull request #7789 from influxdata/cn/move-peas
...
fix: Have data_types depend on generated_types rather than the other way around
2023-05-15 14:42:10 +00:00
e14bc925db
Merge branch 'main' into cn/move-peas
2023-05-15 14:36:18 +00:00
09dc622078
chore: Merge remote-tracking branch 'origin/main' into smith/remove-transactions-main
2023-05-15 10:06:11 -04:00
7735e7c95b
chore: Update DataFusion again ( #7777 )
...
* chore: Update datafusion again
* chore: Run cargo hakari tasks
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-15 12:38:45 +00:00
6aa634c1b9
Merge branch 'main' into cn/move-peas
2023-05-15 13:29:42 +01:00
8543c3ca1f
Merge pull request #7775 from kayagokalp/kayagokalp/7764
...
refactor: accept `impl Into<String>` instead of `&str` for schema methods
2023-05-15 11:42:43 +01:00
b9857545e6
Merge branch 'main' into kayagokalp/7764
2023-05-15 11:37:19 +01:00
7f52959d29
perf: move column names for Schema construction
...
When converting from a ColumnsByName into a schema::Schema instance,
move the column names instead of cloning them.
2023-05-15 12:31:19 +02:00
160628a7f8
refactor: impl intoIterator for ColumnsByName
...
Allows the ColumnsByName to be converted into an iterator yielding owned
column names & schema.
2023-05-15 12:30:11 +02:00
5fe8affb18
refactor: accept NamespaceName with Namespace create ( #7774 )
...
Co-authored-by: Dom <dom@itsallbroken.com>
2023-05-15 10:03:55 +00:00
6257918d4c
Merge branch 'main' into kayagokalp/7764
2023-05-15 11:01:08 +01:00
9c5028676e
Merge pull request #7791 from influxdata/dependabot/cargo/pin-project-1.1.0
...
chore(deps): Bump pin-project from 1.0.12 to 1.1.0
2023-05-15 10:55:53 +01:00
f51ff7bb45
chore: Run cargo hakari tasks
2023-05-15 02:03:37 +00:00
fba9836f2a
chore(deps): Bump pin-project from 1.0.12 to 1.1.0
...
Bumps [pin-project](https://github.com/taiki-e/pin-project ) from 1.0.12 to 1.1.0.
- [Release notes](https://github.com/taiki-e/pin-project/releases )
- [Changelog](https://github.com/taiki-e/pin-project/blob/main/CHANGELOG.md )
- [Commits](https://github.com/taiki-e/pin-project/compare/v1.0.12...v1.1.0 )
---
updated-dependencies:
- dependency-name: pin-project
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-05-15 02:02:32 +00:00
e1333ed227
chore: update description of errors returned from Authorizer trait.
...
Co-authored-by: Dom <dom@itsallbroken.com>
2023-05-13 16:32:21 -07:00
cb0fb92d86
refactor: remove borrowed from impl of ColumnsByName for Schema
2023-05-13 15:39:06 +03:00
75d285a83a
test: fix IoxAuthorizeService mock to not return valid for unrecognized tokens
2023-05-12 15:31:14 -05:00
Martin Hilton
kodiakhq[bot]
Dom Dwyer
Jeffrey Smith II
Chunchun Ye
Jeffrey Smith II
Fraser Savage
dependabot[bot]
Carol (Nichols || Goulding)
Gavin Cabbage
wiedld
Andrew Lamb
Kaya Gökalp
CircleCI[bot]
kayagokalp
wiedld