Commit Graph

5510 Commits (e838a22f9252b692554e4d63c109ab8028228c29)

Author SHA1 Message Date
kodiakhq[bot] b726317ca0
Merge branch 'main' into crepererum/write_buffer_format_header 2021-10-12 15:48:35 +00:00
kodiakhq[bot] ccb30bd273
Merge pull request #2803 from influxdata/crepererum/trace_links
feat: ability to link other spans in span context
2021-10-12 14:54:36 +00:00
kodiakhq[bot] 545b5eccab
Merge branch 'main' into crepererum/trace_links 2021-10-12 14:45:15 +00:00
Marco Neumann 293620395e test: ensure jeager trace IDs integer conversion works 2021-10-12 16:44:25 +02:00
Raphael Taylor-Davies 8414e6edbb
feat: migrate preserved catalog to TimeProvider (#2722) (#2808)
* feat: migrate preserved catalog to TimeProvider (#2722)

* fix: deterministic catalog prune tests

* fix: failing test

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-12 14:43:05 +00:00
Marco Neumann f62d2d2277 refactor: `Vec::with_capacity(0)` => `vec![]`
`vec![]` also results in a capacity of 0, see
https://play.rust-lang.org/?version=stable&mode=debug&edition=2018&gist=184113a9afa945cf3cf3b8f854f4c5ce
2021-10-12 16:36:09 +02:00
Nga Tran 9b6726b99c refactor: rename to a more general name function 2021-10-12 10:34:55 -04:00
Marco Neumann 173f9aefcf feat: ability to link other spans in span context
This can be used when aggregating from multiple parent spans, e.g. when
we want to implement #1473.
2021-10-12 16:32:57 +02:00
Marco Neumann 90d2f1d60d refactor: use Kafka headers similar to HTTP 2021-10-12 16:31:06 +02:00
Marco Neumann b955ecc6a7 feat: add format header to Kafka messages
This allows us to transition to new formats in the future.
2021-10-12 16:31:06 +02:00
Andrew Lamb c31bcbced5
feat: Translate null in fields correctly to timeseries (Frames) (#2799)
* feat: Add gRPC frame dumping to trace output

* feat: Translate null in fields correctly to timeseries (Frames)

* refactor: reduce ceremony of iterating over data

* docs: Update src/influxdb_ioxd/rpc/storage/data.rs

* refactor: rename macro

* refactor: use .then()

* refactor: use try_for_each
2021-10-12 14:28:41 +00:00
Raphael Taylor-Davies 3dfe400e6b
feat: migrate write path to TimeProvider (#2722) (#2807) 2021-10-12 12:09:08 +00:00
Raphael Taylor-Davies 0554173684
feat: migrate write buffer to TimeProvider (#2722) (#2804)
* feat: migrate write buffer to TimeProvider (#2722)

* chore: review feedback

Co-authored-by: Marco Neumann <marco@crepererum.net>

Co-authored-by: Marco Neumann <marco@crepererum.net>
2021-10-12 10:32:34 +00:00
kodiakhq[bot] 62aa61026b
Merge pull request #2797 from influxdata/crepererum/write_buffer_sequencer_ids
feat: allow write buffer producers to read sequencer IDs
2021-10-12 10:04:59 +00:00
Marco Neumann 896ce03415 refactor: use sets and maps for write buffer sequencers
Use the type to reflect that entries are unique and sorted.
2021-10-12 11:13:09 +02:00
Marco Neumann 2e8af77e41 feat: allow write buffer producers to read possible sequencer IDs 2021-10-12 10:37:32 +02:00
Nga Tran 0b4ae95ca4 refactor: exhaust scenarios for one-chunk test 2021-10-11 17:47:41 -04:00
Raphael Taylor-Davies b39e01f7ba
feat: migrate PersistenceWindows to TimeProvider (#2722) (#2798) 2021-10-11 20:40:00 +00:00
Raphael Taylor-Davies 06c2c23322
refactor: create PreservedCatalogConfig struct (#2793)
* refactor: create PreservedCatalogConfig struct

* chore: fmt

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-11 15:43:05 +00:00
Marco Neumann 98f5711784
Merge pull request #2784 from influxdata/dependabot/cargo/cache_loader_async-0.1.2
chore(deps): bump cache_loader_async from 0.1.1 to 0.1.2
2021-10-11 17:32:51 +02:00
kodiakhq[bot] 05fe4701c1
Merge branch 'main' into dependabot/cargo/cache_loader_async-0.1.2 2021-10-11 15:20:28 +00:00
kodiakhq[bot] ea6ba1eedc
Merge pull request #2774 from influxdata/crepererum/issue2729
fix: do not break chunk ordering during persistence
2021-10-11 15:19:48 +00:00
Marco Neumann ad41b74a03 fix: adjust code to `cache_loader_async` 0.1.2 2021-10-11 17:12:08 +02:00
kodiakhq[bot] f8ec261276
Merge branch 'main' into crepererum/issue2729 2021-10-11 15:10:50 +00:00
kodiakhq[bot] 21ceb2de93
Merge pull request #2777 from influxdata/ntran/count_star
fix: select query panics if columns of delete predicates are not included in the query
2021-10-11 15:10:17 +00:00
dependabot[bot] 49c63d35b1
chore(deps): bump cache_loader_async from 0.1.1 to 0.1.2
Bumps [cache_loader_async](https://github.com/ZeroTwo-Bot/cache-loader-async-rs) from 0.1.1 to 0.1.2.
- [Release notes](https://github.com/ZeroTwo-Bot/cache-loader-async-rs/releases)
- [Changelog](https://github.com/ZeroTwo-Bot/cache-loader-async-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/ZeroTwo-Bot/cache-loader-async-rs/commits)

---
updated-dependencies:
- dependency-name: cache_loader_async
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-10-11 15:02:12 +00:00
Marco Neumann ae0acf0024 refactor: remove `db_name` param from `select_persistable_chunks`
This was only used for logging but is already part of `ChunkAddr`.
2021-10-11 17:01:28 +02:00
Marco Neumann 8ab3ffde8c docs: explain error handling for `select_persistable_chunks` 2021-10-11 17:01:28 +02:00
Marco Neumann 9ff2213ecb fix: typo
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2021-10-11 17:01:28 +02:00
Marco Neumann 3561dfa16c refactor: reduce vector re-allocations
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-10-11 17:01:28 +02:00
Marco Neumann 8185feddb9 fix: do not break chunk ordering during persistence
Fixes #2729.
2021-10-11 17:01:28 +02:00
kodiakhq[bot] 6b42f1cdbb
Merge branch 'main' into ntran/count_star 2021-10-11 15:01:00 +00:00
Raphael Taylor-Davies 7bd32a4916
feat: add time provider abstraction (#2722) (#2792)
* feat: add time provider abstraction (#2722)

* chore: tests

* chore: more tests

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-11 15:00:29 +00:00
kodiakhq[bot] 4b66dafd8d
Merge pull request #2778 from influxdata/cn/less-database-name
fix: Remove all uses of `IoxObjectStore.database_name()`
2021-10-11 14:51:17 +00:00
Nga Tran 1718b55283 chore: Merge branch 'ntran/count_star' of https://github.com/influxdata/influxdb_iox into ntran/count_star 2021-10-11 10:47:38 -04:00
Nga Tran fbf5539336 chore: merge main to branch 2021-10-11 10:47:10 -04:00
Carol (Nichols || Goulding) d4a975b812
Merge branch 'main' into cn/less-database-name 2021-10-11 10:42:43 -04:00
Marco Neumann 8ca4c3a658
Merge pull request #2791 from influxdata/dependabot/cargo/predicates-2.0.3
chore(deps): bump predicates from 2.0.2 to 2.0.3
2021-10-11 16:41:14 +02:00
Carol (Nichols || Goulding) 5da2f7b1b0
Merge branch 'main' into cn/less-database-name 2021-10-11 10:35:42 -04:00
dependabot[bot] 61190a9d08
chore(deps): bump predicates from 2.0.2 to 2.0.3
Bumps [predicates](https://github.com/assert-rs/predicates-rs) from 2.0.2 to 2.0.3.
- [Release notes](https://github.com/assert-rs/predicates-rs/releases)
- [Changelog](https://github.com/assert-rs/predicates-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/assert-rs/predicates-rs/compare/v2.0.2...v2.0.3)

---
updated-dependencies:
- dependency-name: predicates
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-10-11 14:32:08 +00:00
Marco Neumann d0fcf4d74f
Merge pull request #2790 from influxdata/crepererum/cancel_executor_jobs_on_drop
refactor: cancel executor jobs on drop
2021-10-11 16:30:10 +02:00
Marco Neumann 24ae269b3a refactor: cancel executor jobs on drop
Our executor is not meant as a fire-and-forget system. Instead the
submitter should always poll the result. Dropping the receiver side (aka
the job handle) should cancel the job.
2021-10-11 16:13:04 +02:00
Marco Neumann 470de36f3b
Merge pull request #2794 from influxdata/crepererum/issue1846
refactor: remove `time_closed`
2021-10-11 16:12:33 +02:00
Marco Neumann c4a2641764 refactor: remove `time_closed`
The "time closed" is a leftover from an old lifecycle system, where
chunks moved through the system (open=>closed=>persisted) without being
merged. Now we have the compaction as well as the split query for
persistence that can merge chunks, so a single "time closed" doesn't
make sense any longer. So in fact it is `None` for many chunks and is
also not persisted. Also the current lifecycle policy doesn't use this
value. So let's just remove it.

Closes #1846.
2021-10-11 15:49:34 +02:00
Nga Tran d13e61c201
fix: Apply suggestions from code review
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-10-11 09:33:23 -04:00
Raphael Taylor-Davies afe34751e7
refactor: split out schema crate (#2781)
* refactor: split out schema crate

* chore: fix doc
2021-10-11 09:45:08 +00:00
Raphael Taylor-Davies f35a49edd0
refactor: move Sequence to data_types (#2780)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-11 09:23:00 +00:00
dependabot[bot] 435a8aec91
chore(deps): bump reqwest from 0.11.4 to 0.11.5 (#2789)
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.4 to 0.11.5.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.4...v0.11.5)

---
updated-dependencies:
- dependency-name: reqwest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-11 09:14:15 +00:00
dependabot[bot] 7cf3cf252a
chore(deps): bump tracing from 0.1.28 to 0.1.29 (#2788)
Bumps [tracing](https://github.com/tokio-rs/tracing) from 0.1.28 to 0.1.29.
- [Release notes](https://github.com/tokio-rs/tracing/releases)
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-0.1.28...tracing-0.1.29)

---
updated-dependencies:
- dependency-name: tracing
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-11 09:05:33 +00:00
kodiakhq[bot] a6aa7fa0c8
Merge pull request #2787 from influxdata/dependabot/cargo/ahash-0.7.5
chore(deps): bump ahash from 0.7.4 to 0.7.5
2021-10-11 08:45:07 +00:00