Commit Graph

4494 Commits (0f6aad62b4583c1948605375499f6fa0266e9398)

Author SHA1 Message Date
kodiakhq[bot] 0f6aad62b4
Merge branch 'main' into jpg/for-whom-the-while-tolls 2021-08-23 11:40:56 +00:00
kodiakhq[bot] c39be6272b
Merge pull request #2376 from influxdata/dependabot/cargo/cloud-storage-0.10.2
chore(deps): bump cloud-storage from 0.9.0 to 0.10.2
2021-08-23 11:40:28 +00:00
kodiakhq[bot] 4b864e8756
Merge branch 'main' into dependabot/cargo/cloud-storage-0.10.2 2021-08-23 11:32:58 +00:00
kodiakhq[bot] 8430dfe007
Merge pull request #2375 from influxdata/dependabot/cargo/serde-1.0.128
chore(deps): bump serde from 1.0.127 to 1.0.128
2021-08-23 11:32:39 +00:00
dependabot[bot] 37c81fb483
chore(deps): bump cloud-storage from 0.9.0 to 0.10.2
Bumps [cloud-storage](https://github.com/ThouCheese/cloud-storage-rs) from 0.9.0 to 0.10.2.
- [Release notes](https://github.com/ThouCheese/cloud-storage-rs/releases)
- [Changelog](https://github.com/ThouCheese/cloud-storage-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/ThouCheese/cloud-storage-rs/commits)

---
updated-dependencies:
- dependency-name: cloud-storage
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-23 11:26:28 +00:00
kodiakhq[bot] 045989e173
Merge branch 'main' into dependabot/cargo/serde-1.0.128 2021-08-23 11:24:56 +00:00
kodiakhq[bot] f079c1a20b
Merge pull request #2377 from influxdata/dependabot/cargo/assert_cmd-2.0.0
chore(deps): bump assert_cmd from 1.0.8 to 2.0.0
2021-08-23 11:24:27 +00:00
kodiakhq[bot] 501f199467
Merge branch 'main' into dependabot/cargo/assert_cmd-2.0.0 2021-08-23 11:17:00 +00:00
kodiakhq[bot] 95872ba7a6
Merge pull request #2350 from influxdata/crepererum/valgrind
feat: memory allocator selection and valgrind support
2021-08-23 07:50:11 +00:00
Marco Neumann 803d49648a feat: valgrind support 2021-08-23 09:30:36 +02:00
Marco Neumann a20990fc49 feat: Make jemalloc optional
Add a way to use the system memory allocator which is required for some
analysis tools like valgrind.
2021-08-23 09:29:49 +02:00
dependabot[bot] 0d4bc4190f
chore(deps): bump assert_cmd from 1.0.8 to 2.0.0
Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd) from 1.0.8 to 2.0.0.
- [Release notes](https://github.com/assert-rs/assert_cmd/releases)
- [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md)
- [Commits](https://github.com/assert-rs/assert_cmd/compare/v1.0.8...v2.0.0)

---
updated-dependencies:
- dependency-name: assert_cmd
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-23 01:17:06 +00:00
dependabot[bot] f11ad0bf1d
chore(deps): bump serde from 1.0.127 to 1.0.128
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.127 to 1.0.128.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.127...v1.0.128)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-08-23 01:16:38 +00:00
Jason Tianyi Wang 4f2503d92c
docs: Update system table schema in docs/sql.md (#2364)
* docs: Update system table schema in docs/sql.md

* docs: fix `Total row count by table` query

* docs: add a period to try and trigger CI

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
2021-08-22 10:59:43 +00:00
Jake Goulding 405e6d4bf5 refactor: avoid manual iteration 2021-08-20 16:14:10 -04:00
kodiakhq[bot] f5dbc9fdfd
Merge pull request #2363 from influxdata/upgrade_heappy
fix(heappy): Prevent re-entering a running heap profile
2021-08-20 16:02:27 +00:00
kodiakhq[bot] 704d2c40cd
Merge branch 'main' into upgrade_heappy 2021-08-20 15:54:37 +00:00
kodiakhq[bot] 3c94a4f60b
Merge pull request #2360 from influxdata/pd/data-generator-batch
feat: Add batching to the data generator
2021-08-20 15:16:40 +00:00
Paul Dix e854527182 chore: fixup data generator based on feedback 2021-08-20 11:08:45 -04:00
Paul Dix 42fbb90d8c feat: Add batching to the data generator
Adds batch_size to the data genrator to optionally gather multiple calls to generate for each agent. For example, if you have a sampling interval of 10 seconds and start at some point back in time with a batch size of 3, it gather 3 samplings before writing to the points writer. For runs against a server API, this will batch them together in a single API call.
2021-08-20 11:08:45 -04:00
Marko Mikulicic bbbd38bb12
fix(heappy): Prevent re-entering a running heap profile
Upgrades heappy to include https://github.com/mkmik/heappy/pull/2
and adapts to the API change.
2021-08-20 14:36:36 +02:00
kodiakhq[bot] 16cb900f3c
Merge pull request #2356 from influxdata/single_allocator
fix: Make heappy and nonheappy mutually exclusive
2021-08-20 12:06:40 +00:00
Marko Mikulicic 4a2f0b0a52
fix: Make heappy and nonheappy mutually exclusive
Closes #2288
2021-08-20 11:35:07 +02:00
Raphael Taylor-Davies db97069ecd
feat: jaeger span export (#2273) (#2348)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-20 08:57:16 +00:00
kodiakhq[bot] a0e294fbe3
Merge pull request #2362 from influxdata/crepererum/try_small_kafka_buffer
fix: limit kafka consumer queue to 10MB
2021-08-20 08:14:48 +00:00
Marco Neumann f81885c172 fix: limit kafka consumer queue to 10MB
I think that while this value limits the maximum memory consumption, it
is too optimistic.
2021-08-20 09:55:49 +02:00
kodiakhq[bot] 823c0dd3b7
Merge pull request #2361 from influxdata/cn/database-rules-file
fix: The path to db rules.pb shouldn't end in a slash
2021-08-20 01:22:51 +00:00
Carol (Nichols || Goulding) cc214fa9b9 fix: The path to db rules.pb shouldn't end in a slash 2021-08-19 21:07:33 -04:00
kodiakhq[bot] 98b288abb5
Merge pull request #2352 from influxdata/remove-global-allocator
fix: Remove confusing and unnecessary rust global allocator
2021-08-19 19:46:53 +00:00
kodiakhq[bot] f9bcca92f4
Merge branch 'main' into remove-global-allocator 2021-08-19 19:39:07 +00:00
kodiakhq[bot] 19bdc00d4a
Merge pull request #2357 from influxdata/pd/add-data-generator
refactor: move data generator to IOx repo and fix build
2021-08-19 19:35:48 +00:00
kodiakhq[bot] 86a1daec21
Merge branch 'main' into pd/add-data-generator 2021-08-19 19:27:37 +00:00
Carol (Nichols || Goulding) 033035d10a docs: Update a few more instances of un-prefixed data_generator 2021-08-19 15:23:31 -04:00
Paul Dix 7c401fbf28 fix: fmt in data generator field 2021-08-19 15:17:22 -04:00
Carol (Nichols || Goulding) be6ac694a5 fix: Bump transaction version because of a change in the Parquet files 2021-08-19 15:16:53 -04:00
Carol (Nichols || Goulding) 31ead36fc0 test: Don't compare floats for strict equality 2021-08-19 15:02:34 -04:00
Carol (Nichols || Goulding) 266dffea86 fix: Don't pass a unit value to a function arg 2021-08-19 15:00:19 -04:00
Carol (Nichols || Goulding) a72fb5b468 fix: Don't assert_eq on a bool 2021-08-19 14:56:52 -04:00
Carol (Nichols || Goulding) 9fe1117d89 fix: Crate rename 2021-08-19 14:56:25 -04:00
Paul Dix d5f01a2a68 refactor: move data generator to IOx repo and fix build 2021-08-19 14:26:15 -04:00
kodiakhq[bot] 12a82226e8
Merge pull request #2354 from influxdata/cn/bump
fix: Bump transaction version because of a change in the Parquet files
2021-08-19 18:16:47 +00:00
Andrew Lamb 3ca0d5d42f
Merge branch 'main' into cn/bump 2021-08-19 14:08:49 -04:00
kodiakhq[bot] 9860efb6b6
Merge pull request #2351 from influxdata/catalog-test-determinism
feat: make catalog state test deterministic (#2349)
2021-08-19 18:00:53 +00:00
kodiakhq[bot] ec0152714e
Merge branch 'main' into catalog-test-determinism 2021-08-19 17:53:04 +00:00
Raphael Taylor-Davies b0e8b75a8a fix: TestCatalogState unique chunk ID 2021-08-19 17:19:12 +01:00
kodiakhq[bot] 3f1a3e52dd
Merge branch 'main' into cn/bump 2021-08-19 15:25:27 +00:00
kodiakhq[bot] 008541b070
Merge pull request #2333 from influxdata/er/refactor/read_buffer/bitmap_size
feat: improve size estimation of roaring bitmaps
2021-08-19 14:30:03 +00:00
kodiakhq[bot] fc6a7ea532
Merge branch 'main' into er/refactor/read_buffer/bitmap_size 2021-08-19 14:20:38 +00:00
Carol (Nichols || Goulding) 7246f2702a fix: Bump transaction version because of a change in the Parquet files 2021-08-19 09:32:37 -04:00
Marko Mikulicic a9b185e508
fix: Remove confusing and unnecessary rust global allocator
The jemalloctor rust global allocator only intercepts allocations coming from rust.
We used to enabled the `unprefixed_malloc_on_supported_platforms` on the jemallocator crate
which effectivelly installs jemalloc as a replacement for system malloc so that both rust and C libraries
would use jemalloc. This not only ensures that all libraries use jemalloc for the sake of using
a better allocator, but also allows us to use the jemalloc metrics (exposed by jemalloc-ctl) to figure
out how much memory we are consuming; if we don't enable `unprefixed_malloc_on_supported_platforms` and only install the rust global allocator everything works just fine, except the memory metrics return a lower number because memory allocated by e.g. croaring bitmaps wouldn't be tracked.

However since heappy is is incompatible with `unprefixed_malloc_on_supported_platforms` but effectively plays the same role (by installing a replacement of malloc that ultimately invokes jemalloc) and we
were in a rush last week, we turned on heappy and turned off `unprefixed_malloc_on_supported_platforms`
without doing the full work of figuring out how to tell Cargo that those flags have that mutually-exclusive logic; the followup work has been put in a #2288.

This PR removes this rust global allocator since it's a source of confusion. Now if we'll accidentally
disable jemalloc for C we'll also disable it for rust which will be immediately visible since we won't
have any memory metrics at all.
2021-08-19 15:14:37 +02:00