Commit Graph

4518 Commits (a6c9cc2bf294d113f66f85401a47e94206a93803)

Author SHA1 Message Date
Raphael Taylor-Davies a6c9cc2bf2
refactor: rework exec module (#2384)
* refactor: rework exec module

* chore: update docs

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-24 08:39:54 +00:00
Andrew Lamb 35cf560c9f
fix: do not error if partition has no chunks (#2383)
* fix: do not error if partition has no chunks

* fix: do not panic

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-23 17:33:54 +00:00
dependabot[bot] 7a11b7cfd2
chore(deps): bump ouroboros from 0.8.3 to 0.10.1 (#2374)
* chore(deps): bump ouroboros from 0.8.3 to 0.10.1

Bumps [ouroboros](https://github.com/joshua-maros/ouroboros) from 0.8.3 to 0.10.1.
- [Release notes](https://github.com/joshua-maros/ouroboros/releases)
- [Commits](https://github.com/joshua-maros/ouroboros/commits)

---
updated-dependencies:
- dependency-name: ouroboros
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* refactor: manual derives for `Entry`

- works better w/ ouroboros
- `Debug` now does not show useless+verbose raw data
- `PartialEq` now only compares deserialized data (which is likely more
  correct)

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marco Neumann <marco@crepererum.net>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-23 17:25:14 +00:00
Raphael Taylor-Davies 0946ffe916
refactor: reuse IOxExecutionContext (#2373)
* refactor: reuse IOxExecutionContext

* fix: orphaned comment

* chore: review feedback

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-23 15:47:15 +00:00
kodiakhq[bot] 62a4a21a3f
Merge pull request #2382 from influxdata/dom/re-export-google-types
refactor: re-export google proto types
2021-08-23 15:38:16 +00:00
Dom 2da438de2b refactor: move re-export to crate root 2021-08-23 16:28:16 +01:00
Dom 87beefa96c refactor: re-export google proto types
The TemplatePart::Table() variant contains a google::protobuf::Empty
type which is defined in the generated_types crate.

Rather than force consumers to import two crates which have to be kept
in sync, this commit re-exports the google types within the
influxdb_iox_client crate as it's already a dependency, and makes using
types like protobuf's Duration or long-running-operation API easier for
the consumer.
2021-08-23 16:11:42 +01:00
Raphael Taylor-Davies 58716dee71
refactor: remove mem-qe (#2344)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-23 14:35:12 +00:00
kodiakhq[bot] 9fb717382b
Merge pull request #2380 from influxdata/er/fix/rub_cap
refactor: improve string storage and sizing metrics for Read Buffer columns
2021-08-23 13:56:09 +00:00
kodiakhq[bot] dbcdc0da68
Merge branch 'main' into er/fix/rub_cap 2021-08-23 13:48:19 +00:00
kodiakhq[bot] 1996548557
Merge pull request #2378 from influxdata/dependabot/cargo/integer-encoding-3.0.2
chore(deps): bump integer-encoding from 1.1.7 to 3.0.2
2021-08-23 13:43:32 +00:00
Edd Robinson 143472e430
Merge branch 'main' into dependabot/cargo/integer-encoding-3.0.2 2021-08-23 14:35:54 +01:00
Edd Robinson 49fc23bd7e perf: remove redunant clone 2021-08-23 14:27:06 +01:00
Edd Robinson 74c767337b perf: ensure RLE strings minimally sized 2021-08-23 14:26:53 +01:00
Edd Robinson e2130b075b refactor: account for string cap in RLE size 2021-08-23 14:22:49 +01:00
Edd Robinson 47747a602d refactor: remove cruft 2021-08-23 14:19:19 +01:00
Edd Robinson 891bb4f03a refactor: shrink strings 2021-08-23 14:17:53 +01:00
Edd Robinson 1ed086ab55 refactor: use capacity for dictionary encoding 2021-08-23 14:15:37 +01:00
kodiakhq[bot] 8e042fa664
Merge pull request #2379 from influxdata/crepererum/rub_str_rle_shrink_to_fit
fix: shrink RUB-string-RLE keys capacity to fit
2021-08-23 12:53:46 +00:00
kodiakhq[bot] 0971f4dfca
Merge branch 'main' into crepererum/rub_str_rle_shrink_to_fit 2021-08-23 12:46:13 +00:00
Andrew Lamb 9c46bebbcd fix: Update for new integer_encoding API 2021-08-23 08:37:54 -04:00
kodiakhq[bot] 60937bdad9
Merge pull request #2368 from influxdata/jpg/for-whom-the-while-tolls
refactor: avoid manual iteration
2021-08-23 11:48:20 +00:00
dependabot[bot] 631ef17d31
chore(deps): bump integer-encoding from 1.1.7 to 3.0.2
Bumps [integer-encoding](https://github.com/dermesser/integer-encoding-rs) from 1.1.7 to 3.0.2.
- [Release notes](https://github.com/dermesser/integer-encoding-rs/releases)
- [Commits](https://github.com/dermesser/integer-encoding-rs/compare/v1.1.7...v3.0.2)

---
updated-dependencies:
- dependency-name: integer-encoding
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-23 11:42:16 +00:00
kodiakhq[bot] 0f6aad62b4
Merge branch 'main' into jpg/for-whom-the-while-tolls 2021-08-23 11:40:56 +00:00
kodiakhq[bot] c39be6272b
Merge pull request #2376 from influxdata/dependabot/cargo/cloud-storage-0.10.2
chore(deps): bump cloud-storage from 0.9.0 to 0.10.2
2021-08-23 11:40:28 +00:00
kodiakhq[bot] 4b864e8756
Merge branch 'main' into dependabot/cargo/cloud-storage-0.10.2 2021-08-23 11:32:58 +00:00
kodiakhq[bot] 8430dfe007
Merge pull request #2375 from influxdata/dependabot/cargo/serde-1.0.128
chore(deps): bump serde from 1.0.127 to 1.0.128
2021-08-23 11:32:39 +00:00
dependabot[bot] 37c81fb483
chore(deps): bump cloud-storage from 0.9.0 to 0.10.2
Bumps [cloud-storage](https://github.com/ThouCheese/cloud-storage-rs) from 0.9.0 to 0.10.2.
- [Release notes](https://github.com/ThouCheese/cloud-storage-rs/releases)
- [Changelog](https://github.com/ThouCheese/cloud-storage-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/ThouCheese/cloud-storage-rs/commits)

---
updated-dependencies:
- dependency-name: cloud-storage
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-23 11:26:28 +00:00
kodiakhq[bot] 045989e173
Merge branch 'main' into dependabot/cargo/serde-1.0.128 2021-08-23 11:24:56 +00:00
kodiakhq[bot] f079c1a20b
Merge pull request #2377 from influxdata/dependabot/cargo/assert_cmd-2.0.0
chore(deps): bump assert_cmd from 1.0.8 to 2.0.0
2021-08-23 11:24:27 +00:00
Marco Neumann b2682c0b0e fix: shrink RUB-string-RLE keys capacity to fit
We were underestimating the size of a RUB string-RLE column depending on
how the data came into existence. A well-placed debug assert proved
that.
2021-08-23 13:18:46 +02:00
kodiakhq[bot] 501f199467
Merge branch 'main' into dependabot/cargo/assert_cmd-2.0.0 2021-08-23 11:17:00 +00:00
kodiakhq[bot] 95872ba7a6
Merge pull request #2350 from influxdata/crepererum/valgrind
feat: memory allocator selection and valgrind support
2021-08-23 07:50:11 +00:00
Marco Neumann 803d49648a feat: valgrind support 2021-08-23 09:30:36 +02:00
Marco Neumann a20990fc49 feat: Make jemalloc optional
Add a way to use the system memory allocator which is required for some
analysis tools like valgrind.
2021-08-23 09:29:49 +02:00
dependabot[bot] 0d4bc4190f
chore(deps): bump assert_cmd from 1.0.8 to 2.0.0
Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd) from 1.0.8 to 2.0.0.
- [Release notes](https://github.com/assert-rs/assert_cmd/releases)
- [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md)
- [Commits](https://github.com/assert-rs/assert_cmd/compare/v1.0.8...v2.0.0)

---
updated-dependencies:
- dependency-name: assert_cmd
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-23 01:17:06 +00:00
dependabot[bot] f11ad0bf1d
chore(deps): bump serde from 1.0.127 to 1.0.128
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.127 to 1.0.128.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.127...v1.0.128)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-23 01:16:38 +00:00
Jason Tianyi Wang 4f2503d92c
docs: Update system table schema in docs/sql.md (#2364)
* docs: Update system table schema in docs/sql.md

* docs: fix `Total row count by table` query

* docs: add a period to try and trigger CI

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
2021-08-22 10:59:43 +00:00
Jake Goulding 405e6d4bf5 refactor: avoid manual iteration 2021-08-20 16:14:10 -04:00
kodiakhq[bot] f5dbc9fdfd
Merge pull request #2363 from influxdata/upgrade_heappy
fix(heappy): Prevent re-entering a running heap profile
2021-08-20 16:02:27 +00:00
kodiakhq[bot] 704d2c40cd
Merge branch 'main' into upgrade_heappy 2021-08-20 15:54:37 +00:00
kodiakhq[bot] 3c94a4f60b
Merge pull request #2360 from influxdata/pd/data-generator-batch
feat: Add batching to the data generator
2021-08-20 15:16:40 +00:00
Paul Dix e854527182 chore: fixup data generator based on feedback 2021-08-20 11:08:45 -04:00
Paul Dix 42fbb90d8c feat: Add batching to the data generator
Adds batch_size to the data genrator to optionally gather multiple calls to generate for each agent. For example, if you have a sampling interval of 10 seconds and start at some point back in time with a batch size of 3, it gather 3 samplings before writing to the points writer. For runs against a server API, this will batch them together in a single API call.
2021-08-20 11:08:45 -04:00
Marko Mikulicic bbbd38bb12
fix(heappy): Prevent re-entering a running heap profile
Upgrades heappy to include https://github.com/mkmik/heappy/pull/2
and adapts to the API change.
2021-08-20 14:36:36 +02:00
kodiakhq[bot] 16cb900f3c
Merge pull request #2356 from influxdata/single_allocator
fix: Make heappy and nonheappy mutually exclusive
2021-08-20 12:06:40 +00:00
Marko Mikulicic 4a2f0b0a52
fix: Make heappy and nonheappy mutually exclusive
Closes #2288
2021-08-20 11:35:07 +02:00
Raphael Taylor-Davies db97069ecd
feat: jaeger span export (#2273) (#2348)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-20 08:57:16 +00:00
kodiakhq[bot] a0e294fbe3
Merge pull request #2362 from influxdata/crepererum/try_small_kafka_buffer
fix: limit kafka consumer queue to 10MB
2021-08-20 08:14:48 +00:00
Marco Neumann f81885c172 fix: limit kafka consumer queue to 10MB
I think that while this value limits the maximum memory consumption, it
is too optimistic.
2021-08-20 09:55:49 +02:00