8414e6edbb
feat: migrate preserved catalog to TimeProvider ( #2722 ) ( #2808 )
...
* feat: migrate preserved catalog to TimeProvider (#2722 )
* fix: deterministic catalog prune tests
* fix: failing test
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-12 14:43:05 +00:00
c31bcbced5
feat: Translate null in fields correctly to timeseries (Frames) ( #2799 )
...
* feat: Add gRPC frame dumping to trace output
* feat: Translate null in fields correctly to timeseries (Frames)
* refactor: reduce ceremony of iterating over data
* docs: Update src/influxdb_ioxd/rpc/storage/data.rs
* refactor: rename macro
* refactor: use .then()
* refactor: use try_for_each
2021-10-12 14:28:41 +00:00
3dfe400e6b
feat: migrate write path to TimeProvider ( #2722 ) ( #2807 )
2021-10-12 12:09:08 +00:00
0554173684
feat: migrate write buffer to TimeProvider ( #2722 ) ( #2804 )
...
* feat: migrate write buffer to TimeProvider (#2722 )
* chore: review feedback
Co-authored-by: Marco Neumann <marco@crepererum.net>
Co-authored-by: Marco Neumann <marco@crepererum.net>
2021-10-12 10:32:34 +00:00
62aa61026b
Merge pull request #2797 from influxdata/crepererum/write_buffer_sequencer_ids
...
feat: allow write buffer producers to read sequencer IDs
2021-10-12 10:04:59 +00:00
896ce03415
refactor: use sets and maps for write buffer sequencers
...
Use the type to reflect that entries are unique and sorted.
2021-10-12 11:13:09 +02:00
2e8af77e41
feat: allow write buffer producers to read possible sequencer IDs
2021-10-12 10:37:32 +02:00
b39e01f7ba
feat: migrate PersistenceWindows to TimeProvider ( #2722 ) ( #2798 )
2021-10-11 20:40:00 +00:00
06c2c23322
refactor: create PreservedCatalogConfig struct ( #2793 )
...
* refactor: create PreservedCatalogConfig struct
* chore: fmt
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-11 15:43:05 +00:00
98f5711784
Merge pull request #2784 from influxdata/dependabot/cargo/cache_loader_async-0.1.2
...
chore(deps): bump cache_loader_async from 0.1.1 to 0.1.2
2021-10-11 17:32:51 +02:00
05fe4701c1
Merge branch 'main' into dependabot/cargo/cache_loader_async-0.1.2
2021-10-11 15:20:28 +00:00
ea6ba1eedc
Merge pull request #2774 from influxdata/crepererum/issue2729
...
fix: do not break chunk ordering during persistence
2021-10-11 15:19:48 +00:00
ad41b74a03
fix: adjust code to `cache_loader_async` 0.1.2
2021-10-11 17:12:08 +02:00
f8ec261276
Merge branch 'main' into crepererum/issue2729
2021-10-11 15:10:50 +00:00
21ceb2de93
Merge pull request #2777 from influxdata/ntran/count_star
...
fix: select query panics if columns of delete predicates are not included in the query
2021-10-11 15:10:17 +00:00
49c63d35b1
chore(deps): bump cache_loader_async from 0.1.1 to 0.1.2
...
Bumps [cache_loader_async](https://github.com/ZeroTwo-Bot/cache-loader-async-rs ) from 0.1.1 to 0.1.2.
- [Release notes](https://github.com/ZeroTwo-Bot/cache-loader-async-rs/releases )
- [Changelog](https://github.com/ZeroTwo-Bot/cache-loader-async-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/ZeroTwo-Bot/cache-loader-async-rs/commits )
---
updated-dependencies:
- dependency-name: cache_loader_async
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-11 15:02:12 +00:00
ae0acf0024
refactor: remove `db_name` param from `select_persistable_chunks`
...
This was only used for logging but is already part of `ChunkAddr`.
2021-10-11 17:01:28 +02:00
8ab3ffde8c
docs: explain error handling for `select_persistable_chunks`
2021-10-11 17:01:28 +02:00
9ff2213ecb
fix: typo
...
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2021-10-11 17:01:28 +02:00
3561dfa16c
refactor: reduce vector re-allocations
...
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-10-11 17:01:28 +02:00
8185feddb9
fix: do not break chunk ordering during persistence
...
Fixes #2729 .
2021-10-11 17:01:28 +02:00
6b42f1cdbb
Merge branch 'main' into ntran/count_star
2021-10-11 15:01:00 +00:00
7bd32a4916
feat: add time provider abstraction ( #2722 ) ( #2792 )
...
* feat: add time provider abstraction (#2722 )
* chore: tests
* chore: more tests
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-11 15:00:29 +00:00
4b66dafd8d
Merge pull request #2778 from influxdata/cn/less-database-name
...
fix: Remove all uses of `IoxObjectStore.database_name()`
2021-10-11 14:51:17 +00:00
1718b55283
chore: Merge branch 'ntran/count_star' of https://github.com/influxdata/influxdb_iox into ntran/count_star
2021-10-11 10:47:38 -04:00
fbf5539336
chore: merge main to branch
2021-10-11 10:47:10 -04:00
d4a975b812
Merge branch 'main' into cn/less-database-name
2021-10-11 10:42:43 -04:00
8ca4c3a658
Merge pull request #2791 from influxdata/dependabot/cargo/predicates-2.0.3
...
chore(deps): bump predicates from 2.0.2 to 2.0.3
2021-10-11 16:41:14 +02:00
5da2f7b1b0
Merge branch 'main' into cn/less-database-name
2021-10-11 10:35:42 -04:00
61190a9d08
chore(deps): bump predicates from 2.0.2 to 2.0.3
...
Bumps [predicates](https://github.com/assert-rs/predicates-rs ) from 2.0.2 to 2.0.3.
- [Release notes](https://github.com/assert-rs/predicates-rs/releases )
- [Changelog](https://github.com/assert-rs/predicates-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/assert-rs/predicates-rs/compare/v2.0.2...v2.0.3 )
---
updated-dependencies:
- dependency-name: predicates
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-11 14:32:08 +00:00
d0fcf4d74f
Merge pull request #2790 from influxdata/crepererum/cancel_executor_jobs_on_drop
...
refactor: cancel executor jobs on drop
2021-10-11 16:30:10 +02:00
24ae269b3a
refactor: cancel executor jobs on drop
...
Our executor is not meant as a fire-and-forget system. Instead the
submitter should always poll the result. Dropping the receiver side (aka
the job handle) should cancel the job.
2021-10-11 16:13:04 +02:00
470de36f3b
Merge pull request #2794 from influxdata/crepererum/issue1846
...
refactor: remove `time_closed`
2021-10-11 16:12:33 +02:00
c4a2641764
refactor: remove `time_closed`
...
The "time closed" is a leftover from an old lifecycle system, where
chunks moved through the system (open=>closed=>persisted) without being
merged. Now we have the compaction as well as the split query for
persistence that can merge chunks, so a single "time closed" doesn't
make sense any longer. So in fact it is `None` for many chunks and is
also not persisted. Also the current lifecycle policy doesn't use this
value. So let's just remove it.
Closes #1846 .
2021-10-11 15:49:34 +02:00
d13e61c201
fix: Apply suggestions from code review
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-10-11 09:33:23 -04:00
afe34751e7
refactor: split out schema crate ( #2781 )
...
* refactor: split out schema crate
* chore: fix doc
2021-10-11 09:45:08 +00:00
f35a49edd0
refactor: move Sequence to data_types ( #2780 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-11 09:23:00 +00:00
435a8aec91
chore(deps): bump reqwest from 0.11.4 to 0.11.5 ( #2789 )
...
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.11.4 to 0.11.5.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.4...v0.11.5 )
---
updated-dependencies:
- dependency-name: reqwest
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-11 09:14:15 +00:00
7cf3cf252a
chore(deps): bump tracing from 0.1.28 to 0.1.29 ( #2788 )
...
Bumps [tracing](https://github.com/tokio-rs/tracing ) from 0.1.28 to 0.1.29.
- [Release notes](https://github.com/tokio-rs/tracing/releases )
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-0.1.28...tracing-0.1.29 )
---
updated-dependencies:
- dependency-name: tracing
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-11 09:05:33 +00:00
a6aa7fa0c8
Merge pull request #2787 from influxdata/dependabot/cargo/ahash-0.7.5
...
chore(deps): bump ahash from 0.7.4 to 0.7.5
2021-10-11 08:45:07 +00:00
42d4ad61e1
chore(deps): bump ahash from 0.7.4 to 0.7.5
...
Bumps [ahash](https://github.com/tkaitchuck/ahash ) from 0.7.4 to 0.7.5.
- [Release notes](https://github.com/tkaitchuck/ahash/releases )
- [Commits](https://github.com/tkaitchuck/ahash/commits )
---
updated-dependencies:
- dependency-name: ahash
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-11 08:36:50 +00:00
d6bde08f7e
Merge pull request #2785 from influxdata/dependabot/cargo/ouroboros-0.13.0
...
chore(deps): bump ouroboros from 0.12.0 to 0.13.0
2021-10-11 08:34:54 +00:00
71a9aa2120
chore(deps): bump ouroboros from 0.12.0 to 0.13.0
...
Bumps [ouroboros](https://github.com/joshua-maros/ouroboros ) from 0.12.0 to 0.13.0.
- [Release notes](https://github.com/joshua-maros/ouroboros/releases )
- [Commits](https://github.com/joshua-maros/ouroboros/commits )
---
updated-dependencies:
- dependency-name: ouroboros
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-11 08:24:27 +00:00
185a78862b
Merge pull request #2783 from influxdata/dependabot/cargo/tracing-subscriber-0.2.25
...
chore(deps): bump tracing-subscriber from 0.2.24 to 0.2.25
2021-10-11 08:22:24 +00:00
3f921d43e6
chore(deps): bump tracing-subscriber from 0.2.24 to 0.2.25
...
Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing ) from 0.2.24 to 0.2.25.
- [Release notes](https://github.com/tokio-rs/tracing/releases )
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.2.24...tracing-subscriber-0.2.25 )
---
updated-dependencies:
- dependency-name: tracing-subscriber
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-11 08:14:11 +00:00
d6f2689d15
Merge pull request #2782 from influxdata/dependabot/cargo/thiserror-1.0.30
...
chore(deps): bump thiserror from 1.0.29 to 1.0.30
2021-10-11 08:10:05 +00:00
1327735537
chore(deps): bump thiserror from 1.0.29 to 1.0.30
...
Bumps [thiserror](https://github.com/dtolnay/thiserror ) from 1.0.29 to 1.0.30.
- [Release notes](https://github.com/dtolnay/thiserror/releases )
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.29...1.0.30 )
---
updated-dependencies:
- dependency-name: thiserror
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-11 08:01:21 +00:00
94852f9c44
Merge pull request #2786 from influxdata/dependabot/cargo/assert_cmd-2.0.2
...
chore(deps): bump assert_cmd from 2.0.1 to 2.0.2
2021-10-11 07:59:35 +00:00
01a44899fd
chore(deps): bump assert_cmd from 2.0.1 to 2.0.2
...
Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd ) from 2.0.1 to 2.0.2.
- [Release notes](https://github.com/assert-rs/assert_cmd/releases )
- [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md )
- [Commits](https://github.com/assert-rs/assert_cmd/compare/v2.0.1...v2.0.2 )
---
updated-dependencies:
- dependency-name: assert_cmd
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-11 01:45:35 +00:00
d0a17ca79d
refactor: address Edd's review comments
2021-10-08 16:47:37 -04:00
Raphael Taylor-Davies
Andrew Lamb
kodiakhq[bot]
Marco Neumann
dependabot[bot]
Nga Tran
Carol (Nichols || Goulding)