Commit Graph

5032 Commits (c107434d2008694461499b38257f79be34b7d054)

Author SHA1 Message Date
Nga Tran f962d0ef2e feat: first step to add delete_predicate into chunk catalog 2021-08-30 17:16:08 -04:00
kodiakhq[bot] 2ff5a163ce
Merge pull request #2445 from influxdata/ntran/potential_overlap
fix: time column is alwyas last even if the column is sorted lexicographically
2021-08-30 20:42:19 +00:00
Nga Tran b42784d8a0 refactor: address review comments 2021-08-30 16:31:59 -04:00
Carol (Nichols || Goulding) 396bc6a3ad test: Database startup error when there are multiple active generations
Fixes #2196.
2021-08-30 15:49:12 -04:00
Nga Tran 7edb3fd270 fix: time column is alwyas last even if the column is sorted lexicographically 2021-08-30 14:48:18 -04:00
Carol (Nichols || Goulding) 3558e46cae test: Check deleted databases are omitted from management API list 2021-08-30 14:14:32 -04:00
Carol (Nichols || Goulding) c4693a08a5 fix: Remove an unnecessary clone 2021-08-30 14:14:23 -04:00
Carol (Nichols || Goulding) 8dc375100a feat: Wire database deletion through the CLI
Fixes #2432.
2021-08-30 14:14:22 -04:00
kodiakhq[bot] 55d6140099
Merge pull request #2424 from influxdata/cn/delete-database
feat: Add an iox_object_store API for writing the tombstone file
2021-08-30 15:40:28 +00:00
Carol (Nichols || Goulding) e67624dd37 fix: Assert on which error getting a deleted database returns 2021-08-30 11:29:25 -04:00
Carol (Nichols || Goulding) 442a26bb99 fix: Remove some unneded snafu-related allocations 2021-08-30 10:49:20 -04:00
Carol (Nichols || Goulding) e420fe13a4 test: Add delete database to the end-to-end tests 2021-08-30 10:49:19 -04:00
Carol (Nichols || Goulding) fe8e551f2c feat: Add delete database to the management client 2021-08-30 10:42:46 -04:00
Carol (Nichols || Goulding) 01103002f4 fix: Return an error if we can't find an iox object store to write a tombstone file in 2021-08-30 10:42:46 -04:00
Carol (Nichols || Goulding) d688678464 feat: Add an iox_object_store API for writing the tombstone file
Connects to #1871.
2021-08-30 10:42:45 -04:00
kodiakhq[bot] 5cf09a61ed
Merge pull request #2442 from influxdata/crepererum/issue2434
fix: make "persist partition" a bit more stable
2021-08-30 14:09:13 +00:00
kodiakhq[bot] 4cbbdf1fad
Merge branch 'main' into crepererum/issue2434 2021-08-30 14:00:10 +00:00
kodiakhq[bot] b19f78e179
Merge pull request #2441 from influxdata/dependabot/cargo/serde_json-1.0.67
chore(deps): bump serde_json from 1.0.66 to 1.0.67
2021-08-30 11:36:56 +00:00
dependabot[bot] 3e154b3b02
chore(deps): bump serde_json from 1.0.66 to 1.0.67
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.66 to 1.0.67.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.66...v1.0.67)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-30 11:28:35 +00:00
kodiakhq[bot] 0880886381
Merge pull request #2439 from influxdata/dependabot/cargo/handlebars-4.1.2
chore(deps): bump handlebars from 3.5.5 to 4.1.2
2021-08-30 11:26:39 +00:00
dependabot[bot] fee8a986b6
chore(deps): bump handlebars from 3.5.5 to 4.1.2
Bumps [handlebars](https://github.com/sunng87/handlebars-rust) from 3.5.5 to 4.1.2.
- [Release notes](https://github.com/sunng87/handlebars-rust/releases)
- [Changelog](https://github.com/sunng87/handlebars-rust/blob/master/CHANGELOG.md)
- [Commits](https://github.com/sunng87/handlebars-rust/compare/v3.5.5...v4.1.2)

---
updated-dependencies:
- dependency-name: handlebars
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-30 11:18:48 +00:00
kodiakhq[bot] f9bf7f6da2
Merge pull request #2437 from influxdata/dependabot/cargo/thiserror-1.0.28
chore(deps): bump thiserror from 1.0.26 to 1.0.28
2021-08-30 11:13:18 +00:00
Marco Neumann 96b0026203 fix: make "persist partition" a bit more stable
- add longer wait times to tests
- exclude chunks that have active lifecycle actions early (instead of
  failing the whole set)
- properly catch the "no chunks" case

Fixes #2434.
2021-08-30 13:11:12 +02:00
dependabot[bot] 52fbaef2df
chore(deps): bump thiserror from 1.0.26 to 1.0.28
Bumps [thiserror](https://github.com/dtolnay/thiserror) from 1.0.26 to 1.0.28.
- [Release notes](https://github.com/dtolnay/thiserror/releases)
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.26...1.0.28)

---
updated-dependencies:
- dependency-name: thiserror
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-30 11:05:11 +00:00
kodiakhq[bot] be113daaf8
Merge pull request #2438 from influxdata/dependabot/cargo/rustyline-9.0.0
chore(deps): bump rustyline from 8.2.0 to 9.0.0
2021-08-30 11:02:45 +00:00
dependabot[bot] 13161de003
chore(deps): bump rustyline from 8.2.0 to 9.0.0
Bumps [rustyline](https://github.com/kkawakam/rustyline) from 8.2.0 to 9.0.0.
- [Release notes](https://github.com/kkawakam/rustyline/releases)
- [Changelog](https://github.com/kkawakam/rustyline/blob/master/History.md)
- [Commits](https://github.com/kkawakam/rustyline/compare/v8.2.0...v9.0.0)

---
updated-dependencies:
- dependency-name: rustyline
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-30 01:19:49 +00:00
Andrew Lamb 2f49e47a23
feat: return DatabaseRules for ListDatabases request (#2431) 2021-08-28 10:53:24 +00:00
Andrew Lamb 07b1722412
docs: Add local filesystem assumptions (#2410)
* docs: Add local filesystem assumptions

* docs: Update docs/local_filesystems.md

Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>

* docs: Clarify local filesystem is different than file based object store

* docs: clarify IOx may delete files

Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-28 10:34:34 +00:00
Andrew Lamb 779b027271
feat: Store only the database rules sent by the client (do not store default values) (#2430)
* feat: add omit_default to protobuf definition

* feat: Persist only the client provided rules

* fix: Remove race conditions

* fix: merge confit

* refactor: do not use macro

* refactor: restore use of glob import

* fix: review comments

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-28 10:26:32 +00:00
kodiakhq[bot] 317a83fc50
Merge pull request #2425 from influxdata/ntran/issue_delete
feat: Management API for delete
2021-08-27 21:59:22 +00:00
Nga Tran 499af57299 chore: merge mian to branch and resolve conflicts 2021-08-27 17:51:07 -04:00
Nga Tran b79eaa34d1 refactor: address review comments 2021-08-27 15:53:27 -04:00
kodiakhq[bot] 4aa10a3108
Merge pull request #2429 from influxdata/crepererum/refactor_catalog_crate
refactor: restructure catalog code in `parquet_file`
2021-08-27 14:24:48 +00:00
kodiakhq[bot] 400ee89e70
Merge branch 'main' into crepererum/refactor_catalog_crate 2021-08-27 14:16:14 +00:00
kodiakhq[bot] d79fc4226a
Merge pull request #2335 from influxdata/crepererum/issue2334
feat: management API to persist partitions
2021-08-27 14:02:30 +00:00
Marco Neumann a312f81bf2 refactor: move `storage_testing` to `storage::tests` 2021-08-27 15:59:59 +02:00
kodiakhq[bot] 88185f56bd
Merge branch 'main' into crepererum/issue2334 2021-08-27 13:54:08 +00:00
Marco Neumann 589bb31497 fix: make error msg clearer 2021-08-27 15:49:16 +02:00
pierwill 989e9d71e3
chore: Add edition to `rustfmt.toml` (#2423)
When running outside the context of cargo, rustfmt needs the edition specified in its toml file.

See https://rust-lang.github.io/rustfmt/?version=v1.4.36&search=#edition

This patch fixes a problem in development with emacs and LSP which gives `error[E0670]: async fn is not permitted in Rust 2015` repeatedly.

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-27 13:39:51 +00:00
Marco Neumann 8591aac761 test: improve error checking 2021-08-27 15:16:13 +02:00
Marco Neumann 90c60fd181 feat: "persist partition" CLI 2021-08-27 15:16:13 +02:00
Marco Neumann 6625b3a768 feat: "persist partition" gRPC 2021-08-27 15:16:13 +02:00
Marco Neumann a2efe3299d refactor: restructure catalog code in `parquet_file`
No functional change (except for slightly changing error messages). This
will make it easier to add more functionality.
2021-08-27 15:06:31 +02:00
Raphael Taylor-Davies fcec394a28
feat: connect up new metrics (#2428) 2021-08-27 12:55:35 +00:00
Raphael Taylor-Davies 3a26f7857f
feat: add new metrics abstraction (#2076) (#2365)
* feat: add new metrics abstraction (#2076)

* chore: fix lint

* feat: add tests

feat: histogram export

* chore: further docs

* chore: docs

* chore: log on prometheus export error

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-27 11:54:23 +00:00
kodiakhq[bot] 19e8d6ea09
Merge pull request #2414 from influxdata/er/feat/read_buffer/delete
feat: Add delete support to read_filter in Read Buffer
2021-08-27 11:45:13 +00:00
kodiakhq[bot] 6dffc4fb30
Merge branch 'main' into er/feat/read_buffer/delete 2021-08-27 11:36:58 +00:00
Edd Robinson 8dd0576070 refactor: address PR feedback 2021-08-27 12:36:19 +01:00
Edd Robinson 6c49ac5bd4 refactor: update read_buffer/src/chunk.rs 2021-08-27 12:30:20 +01:00
Edd Robinson 6c7f8d6630 feat: add delete to crate Read Buffer API 2021-08-27 12:30:20 +01:00