b3d04b3e26
Merge branch 'main' into cn/server-startup-delete
2021-09-01 13:32:34 +00:00
5808d73541
Merge pull request #2444 from influxdata/cn/list-but-not-deleted-databases
...
feat: Wire database deletion through the CLI, add tests for not including deleted databases in database list
2021-09-01 13:13:28 +00:00
c89ad70d07
test: Ensure we deleted some tombstone file
...
To guard against forgetting to change this test if we change the tombstone file.
Co-authored-by: Marco Neumann <marco@crepererum.net>
2021-09-01 09:04:25 -04:00
e183ecb3e7
Merge branch 'main' into cn/list-but-not-deleted-databases
2021-09-01 13:03:09 +00:00
983ae49494
Merge pull request #2450 from influxdata/crepererum/dump_catalog_prep
...
test: simplify testing around preserved catalog
2021-09-01 09:34:30 +00:00
06c941d798
refactor: split up `make_record_batch`
2021-09-01 11:26:05 +02:00
6ce586a2ac
docs: add docstrings to `PreservedCatalog` members
2021-09-01 11:26:05 +02:00
70a5ffeae7
test: allow creation of deterministic chunks and transactions
2021-09-01 11:26:05 +02:00
06833110ab
test: allow creation of less complex parquet chunks
2021-09-01 11:26:05 +02:00
27248850e5
refactor: use `byte::Bytes` for metadata in protobuf messages
...
That simplifies printing a bit since we `Vec<u8>` prints quite badly.
2021-09-01 11:26:05 +02:00
a4183de411
feat: more progress on the delete flow from grpc API to catalog chunks
2021-08-31 17:42:07 -04:00
6ba25728e1
chore: exclude non-source code from package ( #2452 )
...
Before this change, modifications to the following files would trigger a
rebuild on `cargo build`.
```
2,13d1
< .circleci/config.yml
< .circleci/get-deploy-tags.sh
< .editorconfig
< .gitattributes
< .github/ISSUE_TEMPLATE/bug_report.md
< .github/ISSUE_TEMPLATE/feature_request.md
< .github/PULL_REQUEST_TEMPLATE.md
< .github/dependabot.yml
< .github/semantic.yml
< .gitignore
< .kodiak.toml
< CONTRIBUTING.md
17,22d4
< Dockerfile
< Dockerfile.dockerignore
< LICENSE-APACHE
< LICENSE-MIT
< README.md
< buf.yaml
24,76d5
< docker/Dockerfile.ci
< docker/Dockerfile.ci.dockerignore
< docker/Dockerfile.ci.integration
< docker/Dockerfile.ci.integration.dockerignore
< docker/Dockerfile.iox
< docker/Dockerfile.iox.dockerignore
< docker/ci-kafka-docker-compose.yml
< docker/integration_test.sh
< docs/README.md
< docs/catalog_persistence.md
< docs/data_management.md
< docs/drawings/data_lifecycle.monopic
< docs/drawings/data_organization.monopic
< docs/encoding_thoughts.md
< docs/env.example
< docs/images/flame_graph.png
< docs/local_filesystems.md
< docs/metrics.md
< docs/multi_core_tasks.md
< docs/profiling.md
< docs/protobuf.md
< docs/regenerating_flatbuffers.md
< docs/server_startup.md
< docs/sql.md
< docs/style_guide.md
< docs/testing.md
< docs/tracing.md
< docs/valgrind.md
< perf/logs/iox_router.log
< perf/logs/iox_writer.log
< perf/logs/jaeger.log
< perf/logs/kafka.log
< perf/logs/minio.log
< perf/logs/zookeeper.log
< perf/volumes/minio/.minio.sys/buckets/.bloomcycle.bin
<
perf/volumes/minio/.minio.sys/buckets/.minio.sys/buckets/.bloomcycle.bin/fs.json
<
perf/volumes/minio/.minio.sys/buckets/.minio.sys/buckets/.usage-cache.bin/fs.json
<
perf/volumes/minio/.minio.sys/buckets/.minio.sys/buckets/.usage.json/fs.json
<
perf/volumes/minio/.minio.sys/buckets/.minio.sys/buckets/iox1/.usage-cache.bin/fs.json
<
perf/volumes/minio/.minio.sys/buckets/.minio.sys/buckets/iox2/.usage-cache.bin/fs.json
< perf/volumes/minio/.minio.sys/buckets/.tracker.bin
< perf/volumes/minio/.minio.sys/buckets/.usage-cache.bin
< perf/volumes/minio/.minio.sys/buckets/.usage.json
< perf/volumes/minio/.minio.sys/buckets/iox1/.metadata.bin
< perf/volumes/minio/.minio.sys/buckets/iox1/.usage-cache.bin
< perf/volumes/minio/.minio.sys/buckets/iox2/.metadata.bin
< perf/volumes/minio/.minio.sys/buckets/iox2/.usage-cache.bin
< perf/volumes/minio/.minio.sys/config/config.json
< perf/volumes/minio/.minio.sys/config/iam/format.json
< perf/volumes/minio/.minio.sys/format.json
< perf/volumes/zookeeper/data/myid
< perf/volumes/zookeeper/data/version-2/log.1
< perf/volumes/zookeeper/data/version-2/snapshot.0
79,87d7
< scripts/edit_db_rules
< scripts/genlp.py
< scripts/git-log-prs
< scripts/grpcurl
< scripts/jq_edit_db_rules
< scripts/logfmts
< scripts/prototxt
< scripts/valgrind.supp
< scripts/valigrind_leak
161d80
< tools/iplan
```
2021-08-31 17:14:02 +00:00
9972e04a18
Merge pull request #2440 from influxdata/dependabot/cargo/opentelemetry-jaeger-0.15.0
...
chore(deps): bump opentelemetry-jaeger from 0.14.0 to 0.15.0
2021-08-31 09:40:41 +00:00
79ad48ac3a
chore: rename "labels" to "attributes"
2021-08-31 11:31:15 +02:00
a5b8c1631b
chore: upgrade `opentelemetry[-prometheus]`
...
- "labels" are now named "attributes"
- `PrometheusExpoerter` is now created via a builder pattern which
provides way better defaults (e.g. it construct a sane controller
itself)
2021-08-31 10:39:57 +02:00
7ff28405ea
chore: fix `opentelemetry-jeager` upgrade
2021-08-31 10:39:57 +02:00
29b13ad2a6
chore(deps): bump opentelemetry-jaeger from 0.14.0 to 0.15.0
...
Bumps [opentelemetry-jaeger](https://github.com/open-telemetry/opentelemetry-rust ) from 0.14.0 to 0.15.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-rust/releases )
- [Commits](https://github.com/open-telemetry/opentelemetry-rust/compare/v0.14.0...v0.15.0 )
---
updated-dependencies:
- dependency-name: opentelemetry-jaeger
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-08-31 10:39:57 +02:00
4b46e3064d
Merge pull request #2443 from influxdata/crepererum/issue2403
...
test: use random free port for end2end tests
2021-08-31 08:25:21 +00:00
7e7855f727
test: avoid picking the same port twice under multi-threaded tests
2021-08-31 10:16:22 +02:00
69eae490ef
test: avoid picking the same port twice
2021-08-31 10:16:22 +02:00
e6afb844ff
test: use random free port for end2end tests
...
Fixes #786 .
Fixes #2403 .
2021-08-31 10:16:22 +02:00
f962d0ef2e
feat: first step to add delete_predicate into chunk catalog
2021-08-30 17:16:08 -04:00
2ff5a163ce
Merge pull request #2445 from influxdata/ntran/potential_overlap
...
fix: time column is alwyas last even if the column is sorted lexicographically
2021-08-30 20:42:19 +00:00
b42784d8a0
refactor: address review comments
2021-08-30 16:31:59 -04:00
396bc6a3ad
test: Database startup error when there are multiple active generations
...
Fixes #2196 .
2021-08-30 15:49:12 -04:00
7edb3fd270
fix: time column is alwyas last even if the column is sorted lexicographically
2021-08-30 14:48:18 -04:00
3558e46cae
test: Check deleted databases are omitted from management API list
2021-08-30 14:14:32 -04:00
c4693a08a5
fix: Remove an unnecessary clone
2021-08-30 14:14:23 -04:00
8dc375100a
feat: Wire database deletion through the CLI
...
Fixes #2432 .
2021-08-30 14:14:22 -04:00
55d6140099
Merge pull request #2424 from influxdata/cn/delete-database
...
feat: Add an iox_object_store API for writing the tombstone file
2021-08-30 15:40:28 +00:00
e67624dd37
fix: Assert on which error getting a deleted database returns
2021-08-30 11:29:25 -04:00
442a26bb99
fix: Remove some unneded snafu-related allocations
2021-08-30 10:49:20 -04:00
e420fe13a4
test: Add delete database to the end-to-end tests
2021-08-30 10:49:19 -04:00
fe8e551f2c
feat: Add delete database to the management client
2021-08-30 10:42:46 -04:00
01103002f4
fix: Return an error if we can't find an iox object store to write a tombstone file in
2021-08-30 10:42:46 -04:00
d688678464
feat: Add an iox_object_store API for writing the tombstone file
...
Connects to #1871 .
2021-08-30 10:42:45 -04:00
5cf09a61ed
Merge pull request #2442 from influxdata/crepererum/issue2434
...
fix: make "persist partition" a bit more stable
2021-08-30 14:09:13 +00:00
4cbbdf1fad
Merge branch 'main' into crepererum/issue2434
2021-08-30 14:00:10 +00:00
b19f78e179
Merge pull request #2441 from influxdata/dependabot/cargo/serde_json-1.0.67
...
chore(deps): bump serde_json from 1.0.66 to 1.0.67
2021-08-30 11:36:56 +00:00
3e154b3b02
chore(deps): bump serde_json from 1.0.66 to 1.0.67
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.66 to 1.0.67.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.66...v1.0.67 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-08-30 11:28:35 +00:00
0880886381
Merge pull request #2439 from influxdata/dependabot/cargo/handlebars-4.1.2
...
chore(deps): bump handlebars from 3.5.5 to 4.1.2
2021-08-30 11:26:39 +00:00
fee8a986b6
chore(deps): bump handlebars from 3.5.5 to 4.1.2
...
Bumps [handlebars](https://github.com/sunng87/handlebars-rust ) from 3.5.5 to 4.1.2.
- [Release notes](https://github.com/sunng87/handlebars-rust/releases )
- [Changelog](https://github.com/sunng87/handlebars-rust/blob/master/CHANGELOG.md )
- [Commits](https://github.com/sunng87/handlebars-rust/compare/v3.5.5...v4.1.2 )
---
updated-dependencies:
- dependency-name: handlebars
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-08-30 11:18:48 +00:00
f9bf7f6da2
Merge pull request #2437 from influxdata/dependabot/cargo/thiserror-1.0.28
...
chore(deps): bump thiserror from 1.0.26 to 1.0.28
2021-08-30 11:13:18 +00:00
96b0026203
fix: make "persist partition" a bit more stable
...
- add longer wait times to tests
- exclude chunks that have active lifecycle actions early (instead of
failing the whole set)
- properly catch the "no chunks" case
Fixes #2434 .
2021-08-30 13:11:12 +02:00
52fbaef2df
chore(deps): bump thiserror from 1.0.26 to 1.0.28
...
Bumps [thiserror](https://github.com/dtolnay/thiserror ) from 1.0.26 to 1.0.28.
- [Release notes](https://github.com/dtolnay/thiserror/releases )
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.26...1.0.28 )
---
updated-dependencies:
- dependency-name: thiserror
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-08-30 11:05:11 +00:00
be113daaf8
Merge pull request #2438 from influxdata/dependabot/cargo/rustyline-9.0.0
...
chore(deps): bump rustyline from 8.2.0 to 9.0.0
2021-08-30 11:02:45 +00:00
13161de003
chore(deps): bump rustyline from 8.2.0 to 9.0.0
...
Bumps [rustyline](https://github.com/kkawakam/rustyline ) from 8.2.0 to 9.0.0.
- [Release notes](https://github.com/kkawakam/rustyline/releases )
- [Changelog](https://github.com/kkawakam/rustyline/blob/master/History.md )
- [Commits](https://github.com/kkawakam/rustyline/compare/v8.2.0...v9.0.0 )
---
updated-dependencies:
- dependency-name: rustyline
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-08-30 01:19:49 +00:00
2f49e47a23
feat: return DatabaseRules for ListDatabases request ( #2431 )
2021-08-28 10:53:24 +00:00
07b1722412
docs: Add local filesystem assumptions ( #2410 )
...
* docs: Add local filesystem assumptions
* docs: Update docs/local_filesystems.md
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
* docs: Clarify local filesystem is different than file based object store
* docs: clarify IOx may delete files
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-28 10:34:34 +00:00
779b027271
feat: Store only the database rules sent by the client (do not store default values) ( #2430 )
...
* feat: add omit_default to protobuf definition
* feat: Persist only the client provided rules
* fix: Remove race conditions
* fix: merge confit
* refactor: do not use macro
* refactor: restore use of glob import
* fix: review comments
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-28 10:26:32 +00:00
kodiakhq[bot]
Carol (Nichols || Goulding)
Marco Neumann
Nga Tran
Jacob Marble
dependabot[bot]
Carol (Nichols || Goulding)
Andrew Lamb