Commit Graph

4666 Commits (fdfec8fa4f1c91653631a7f0ff016ddf7f0bb64c)

Author SHA1 Message Date
kodiakhq[bot] 4cbbdf1fad
Merge branch 'main' into crepererum/issue2434 2021-08-30 14:00:10 +00:00
kodiakhq[bot] b19f78e179
Merge pull request #2441 from influxdata/dependabot/cargo/serde_json-1.0.67
chore(deps): bump serde_json from 1.0.66 to 1.0.67
2021-08-30 11:36:56 +00:00
dependabot[bot] 3e154b3b02
chore(deps): bump serde_json from 1.0.66 to 1.0.67
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.66 to 1.0.67.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.66...v1.0.67)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-30 11:28:35 +00:00
kodiakhq[bot] 0880886381
Merge pull request #2439 from influxdata/dependabot/cargo/handlebars-4.1.2
chore(deps): bump handlebars from 3.5.5 to 4.1.2
2021-08-30 11:26:39 +00:00
dependabot[bot] fee8a986b6
chore(deps): bump handlebars from 3.5.5 to 4.1.2
Bumps [handlebars](https://github.com/sunng87/handlebars-rust) from 3.5.5 to 4.1.2.
- [Release notes](https://github.com/sunng87/handlebars-rust/releases)
- [Changelog](https://github.com/sunng87/handlebars-rust/blob/master/CHANGELOG.md)
- [Commits](https://github.com/sunng87/handlebars-rust/compare/v3.5.5...v4.1.2)

---
updated-dependencies:
- dependency-name: handlebars
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-30 11:18:48 +00:00
kodiakhq[bot] f9bf7f6da2
Merge pull request #2437 from influxdata/dependabot/cargo/thiserror-1.0.28
chore(deps): bump thiserror from 1.0.26 to 1.0.28
2021-08-30 11:13:18 +00:00
Marco Neumann 96b0026203 fix: make "persist partition" a bit more stable
- add longer wait times to tests
- exclude chunks that have active lifecycle actions early (instead of
  failing the whole set)
- properly catch the "no chunks" case

Fixes #2434.
2021-08-30 13:11:12 +02:00
dependabot[bot] 52fbaef2df
chore(deps): bump thiserror from 1.0.26 to 1.0.28
Bumps [thiserror](https://github.com/dtolnay/thiserror) from 1.0.26 to 1.0.28.
- [Release notes](https://github.com/dtolnay/thiserror/releases)
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.26...1.0.28)

---
updated-dependencies:
- dependency-name: thiserror
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-30 11:05:11 +00:00
kodiakhq[bot] be113daaf8
Merge pull request #2438 from influxdata/dependabot/cargo/rustyline-9.0.0
chore(deps): bump rustyline from 8.2.0 to 9.0.0
2021-08-30 11:02:45 +00:00
dependabot[bot] 13161de003
chore(deps): bump rustyline from 8.2.0 to 9.0.0
Bumps [rustyline](https://github.com/kkawakam/rustyline) from 8.2.0 to 9.0.0.
- [Release notes](https://github.com/kkawakam/rustyline/releases)
- [Changelog](https://github.com/kkawakam/rustyline/blob/master/History.md)
- [Commits](https://github.com/kkawakam/rustyline/compare/v8.2.0...v9.0.0)

---
updated-dependencies:
- dependency-name: rustyline
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-30 01:19:49 +00:00
Andrew Lamb 2f49e47a23
feat: return DatabaseRules for ListDatabases request (#2431) 2021-08-28 10:53:24 +00:00
Andrew Lamb 07b1722412
docs: Add local filesystem assumptions (#2410)
* docs: Add local filesystem assumptions

* docs: Update docs/local_filesystems.md

Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>

* docs: Clarify local filesystem is different than file based object store

* docs: clarify IOx may delete files

Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-28 10:34:34 +00:00
Andrew Lamb 779b027271
feat: Store only the database rules sent by the client (do not store default values) (#2430)
* feat: add omit_default to protobuf definition

* feat: Persist only the client provided rules

* fix: Remove race conditions

* fix: merge confit

* refactor: do not use macro

* refactor: restore use of glob import

* fix: review comments

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-28 10:26:32 +00:00
kodiakhq[bot] 317a83fc50
Merge pull request #2425 from influxdata/ntran/issue_delete
feat: Management API for delete
2021-08-27 21:59:22 +00:00
Nga Tran 499af57299 chore: merge mian to branch and resolve conflicts 2021-08-27 17:51:07 -04:00
Nga Tran b79eaa34d1 refactor: address review comments 2021-08-27 15:53:27 -04:00
kodiakhq[bot] 4aa10a3108
Merge pull request #2429 from influxdata/crepererum/refactor_catalog_crate
refactor: restructure catalog code in `parquet_file`
2021-08-27 14:24:48 +00:00
kodiakhq[bot] 400ee89e70
Merge branch 'main' into crepererum/refactor_catalog_crate 2021-08-27 14:16:14 +00:00
kodiakhq[bot] d79fc4226a
Merge pull request #2335 from influxdata/crepererum/issue2334
feat: management API to persist partitions
2021-08-27 14:02:30 +00:00
Marco Neumann a312f81bf2 refactor: move `storage_testing` to `storage::tests` 2021-08-27 15:59:59 +02:00
kodiakhq[bot] 88185f56bd
Merge branch 'main' into crepererum/issue2334 2021-08-27 13:54:08 +00:00
Marco Neumann 589bb31497 fix: make error msg clearer 2021-08-27 15:49:16 +02:00
pierwill 989e9d71e3
chore: Add edition to `rustfmt.toml` (#2423)
When running outside the context of cargo, rustfmt needs the edition specified in its toml file.

See https://rust-lang.github.io/rustfmt/?version=v1.4.36&search=#edition

This patch fixes a problem in development with emacs and LSP which gives `error[E0670]: async fn is not permitted in Rust 2015` repeatedly.

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-27 13:39:51 +00:00
Marco Neumann 8591aac761 test: improve error checking 2021-08-27 15:16:13 +02:00
Marco Neumann 90c60fd181 feat: "persist partition" CLI 2021-08-27 15:16:13 +02:00
Marco Neumann 6625b3a768 feat: "persist partition" gRPC 2021-08-27 15:16:13 +02:00
Marco Neumann a2efe3299d refactor: restructure catalog code in `parquet_file`
No functional change (except for slightly changing error messages). This
will make it easier to add more functionality.
2021-08-27 15:06:31 +02:00
Raphael Taylor-Davies fcec394a28
feat: connect up new metrics (#2428) 2021-08-27 12:55:35 +00:00
Raphael Taylor-Davies 3a26f7857f
feat: add new metrics abstraction (#2076) (#2365)
* feat: add new metrics abstraction (#2076)

* chore: fix lint

* feat: add tests

feat: histogram export

* chore: further docs

* chore: docs

* chore: log on prometheus export error

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-27 11:54:23 +00:00
kodiakhq[bot] 19e8d6ea09
Merge pull request #2414 from influxdata/er/feat/read_buffer/delete
feat: Add delete support to read_filter in Read Buffer
2021-08-27 11:45:13 +00:00
kodiakhq[bot] 6dffc4fb30
Merge branch 'main' into er/feat/read_buffer/delete 2021-08-27 11:36:58 +00:00
Edd Robinson 8dd0576070 refactor: address PR feedback 2021-08-27 12:36:19 +01:00
Edd Robinson 6c49ac5bd4 refactor: update read_buffer/src/chunk.rs 2021-08-27 12:30:20 +01:00
Edd Robinson 6c7f8d6630 feat: add delete to crate Read Buffer API 2021-08-27 12:30:20 +01:00
Edd Robinson dbbfd2a9f8 feat: add delete support to row_group: 2021-08-27 12:30:20 +01:00
Edd Robinson 95548dcec9 feat: add relative complement to RowIDs(bitmap) 2021-08-27 12:30:20 +01:00
kodiakhq[bot] 1e8aa6111a
Merge pull request #2426 from influxdata/re-enable-heappy
feat(iox): Enable heappy again
2021-08-27 09:23:29 +00:00
Marko Mikulicic 6e2aa2eef3
feat(iox): Enable heappy again 2021-08-27 11:13:30 +02:00
Nga Tran bcd39e225c feat: Management API for delete 2021-08-26 17:31:21 -04:00
Andrew Lamb f42f0349ed
feat: Implement basic metrics for `DeduplicateExec`, `IOxReadFilterNode`, `SchemaPivotExec` and `StreamSplitExec` (#2387)
* feat: Add baseline metrics to DeduplicateExec

* feat: Add metrics to `IOxReadFilterNode`

* feat: Add metrics for SchemaPivotExec

* feat: Add metrics to StreamSplitExec

* fix: Update for new API, cleanups

* test: Add tests

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-26 20:31:28 +00:00
kodiakhq[bot] ee0e8be70c
Merge pull request #2412 from influxdata/pd/duration-sampling-interval
feat: Support sampling interval strings in data generator
2021-08-26 18:02:09 +00:00
kodiakhq[bot] 8cf84a24eb
Merge branch 'main' into pd/duration-sampling-interval 2021-08-26 17:52:34 +00:00
Raphael Taylor-Davies e3e801d29a
feat: propagate span context into storage RPC queries (#2407)
* feat: propagate span context into storage RPC queries

* refactor: create ExecutionContextProvider trait

* chore: cleanup imports

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-26 17:11:49 +00:00
kodiakhq[bot] 3603f219fb
Merge pull request #2355 from influxdata/cn/create-database
feat: Add a generation directory inside the database directory on object storage
2021-08-26 13:45:16 +00:00
Carol (Nichols || Goulding) 7ca177978e fix: Add missing await from a logical merge conflict 2021-08-26 09:27:16 -04:00
Carol (Nichols || Goulding) 5566e1926c refactor: Use max_by_key instead of map max 2021-08-26 09:14:23 -04:00
Carol (Nichols || Goulding) 82b566a3bb fix: Warn when a non-generation item is found in a database directory 2021-08-26 09:14:23 -04:00
Carol (Nichols || Goulding) 7cf7fb02ed refactor: Rename database ObjectStore state types to DatabaseObjectStore 2021-08-26 09:14:23 -04:00
Carol (Nichols || Goulding) c16b4b1bff refactor: Have GenerationPath save a Generation field 2021-08-26 09:14:23 -04:00
Carol (Nichols || Goulding) 63efda8213 fix: Avoid leaking generation id in an error type 2021-08-26 09:14:23 -04:00