266dffea86
fix: Don't pass a unit value to a function arg
2021-08-19 15:00:19 -04:00
a72fb5b468
fix: Don't assert_eq on a bool
2021-08-19 14:56:52 -04:00
9fe1117d89
fix: Crate rename
2021-08-19 14:56:25 -04:00
d5f01a2a68
refactor: move data generator to IOx repo and fix build
2021-08-19 14:26:15 -04:00
9860efb6b6
Merge pull request #2351 from influxdata/catalog-test-determinism
...
feat: make catalog state test deterministic (#2349 )
2021-08-19 18:00:53 +00:00
ec0152714e
Merge branch 'main' into catalog-test-determinism
2021-08-19 17:53:04 +00:00
b0e8b75a8a
fix: TestCatalogState unique chunk ID
2021-08-19 17:19:12 +01:00
008541b070
Merge pull request #2333 from influxdata/er/refactor/read_buffer/bitmap_size
...
feat: improve size estimation of roaring bitmaps
2021-08-19 14:30:03 +00:00
fc6a7ea532
Merge branch 'main' into er/refactor/read_buffer/bitmap_size
2021-08-19 14:20:38 +00:00
5a841600d9
feat: make catalog state test deterministic ( #2349 )
2021-08-19 14:04:27 +01:00
98627944e7
refactor: make packers a dev-dependency of read buffer ( #2345 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-19 11:09:34 +00:00
04ba139cb2
refactor: split trace crate ( #2343 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-19 11:00:32 +00:00
3d7893b12f
Merge pull request #2346 from influxdata/crepererum/try_debug_kafka2
...
fix: limit kafka consumer queue to 100MB
2021-08-19 10:39:28 +00:00
6c0cefded3
fix: limit kafka consumer queue to 100MB
...
By default the queue will be filled to up to 1GB which makes finding
memory leaks quite hard.
2021-08-19 11:36:15 +02:00
47431148d5
Merge branch 'main' into er/refactor/read_buffer/bitmap_size
2021-08-18 21:20:13 +00:00
e81b82c0a4
feat: split db worker loop ( #2337 )
...
* feat: split db worker loop
* chore: review feedback
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-18 17:33:13 +00:00
710f477e35
refactor: remove opentelemetry from observability_deps ( #2192 ) ( #2336 )
2021-08-18 17:24:05 +00:00
efb091c693
Merge pull request #2278 from influxdata/cn/iox-paths
...
refactor: Extract different types for the paths that databases use in object storage
2021-08-18 15:41:25 +00:00
61263c8774
feat: Add a debugging-suitable way to get the object storage path of a database
2021-08-18 11:32:39 -04:00
997f61c5f6
refactor: Rename Paths to their more specific exported names
2021-08-18 11:32:39 -04:00
10c9acf5c4
refactor: Mark internally-pub items with pub crate to make their privacy status clearer
2021-08-18 11:32:39 -04:00
cb05b29917
docs: Explain reasoning behind the crate design more
2021-08-18 11:32:39 -04:00
fbf3ceb1e2
refactor: Extract listing of all databases into iox_object_store
2021-08-18 11:32:39 -04:00
557e4498cd
refactor: Use the DatabaseName type on IoxObjectStore
2021-08-18 11:32:39 -04:00
f782e77dcc
test: Use the iox_object_store when testing a database's object store files
2021-08-18 11:32:39 -04:00
ff89398132
fix: Remove DatabaseConfig store_path field
...
This is now managed by the iox_object_store crate.
2021-08-18 11:32:39 -04:00
6390156c0e
fix: Remove error types not used anywhere
2021-08-18 11:32:39 -04:00
aba0779162
fix: Update tests to expect new Display format on ObjectStorePaths
2021-08-18 11:32:39 -04:00
ef0e1a3f60
refactor: Extract a transaction file path type
2021-08-18 11:32:39 -04:00
a5ab6c295a
refactor: Move complicated Paths to submodules
2021-08-18 11:32:39 -04:00
be5b5139a2
refactor: Move the catalog transaction paths to iox_object_store
2021-08-18 11:32:39 -04:00
63111d9d9a
refactor: Move the database rules functionality to iox_object_store
2021-08-18 11:32:39 -04:00
4447f1e22c
test: Adjust parquet file sizes; only storing relative paths now
2021-08-18 11:32:39 -04:00
6d5cb9c117
refactor: Extract a ParquetFilePath to handle paths to parquet files in a db's object store
2021-08-18 11:32:39 -04:00
5e1cb244f7
feat: make pprof optional ( #2331 )
2021-08-18 15:13:37 +00:00
3ee0f9268a
Merge pull request #2339 from influxdata/positivefree
...
fix(heappy): Report free as positive numbers
2021-08-18 13:10:21 +00:00
a50b1646bd
fix(heappy): Report free as positive numbers
2021-08-18 14:30:41 +02:00
e62790cf4b
fix: include underlying error message in connection error ( #2326 )
...
* fix: include underlying error message in connection error
* fix: clippy
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-18 11:33:30 +00:00
a0e06014b7
Merge pull request #2338 from influxdata/just_free
...
feat(iox): Upgrade heappy to present free memory events
2021-08-18 11:25:03 +00:00
8d56135ae9
Merge branch 'main' into just_free
2021-08-18 11:17:02 +00:00
8c331cab88
Merge pull request #2330 from influxdata/frequency
...
fix: Make allocs profile record all allocations
2021-08-18 11:16:22 +00:00
fb13570aca
Merge branch 'main' into er/refactor/read_buffer/bitmap_size
2021-08-18 12:10:08 +01:00
c0640bf1f9
fix: Make allocs profile record all allocations
...
Rename `frequency` to `interval` and set the default to `1`, which means that
every allocation will be counted.
Before this PR, we were incorrectly reusing the same "frequency" parameter (and related default of 99)
which meant that we were skipping small allocations that.
The sampling interval is a number of bytes that have to cumulatively allocated for a sample to be taken.
For example if the sampling interval is 99, and you're doing a million of 40 bytes allocations, the allocations profile will account for 16MB instead of 40MB. Heappy will adjust the estimate for sampled recordings, but now that feature is not yet implemented.
2021-08-18 13:08:36 +02:00
fc473995fa
feat(iox): Upgrade heappy to present free memory events
...
Currently heappy is reporting "bytes allocated" and "inuse_bytes" ("bytes allocated - freed bytes").
Since the allocation site and free site can be wildly different, it's very hard to correlate these events
and have a meaningful "inuse_bytes" graph.
I have a plan for how to fix this for good, but in the meantime
I'd like to report raw "freed bytes".
2021-08-18 13:04:48 +02:00
1d6a8703af
feat: support sinking traces to an OTEL SpanExporter ( #2319 )
...
* feat: support sinking traces to an OTEL SpanExporter
* chore: consistent logging
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
* chore: review feedback
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-18 08:05:21 +00:00
b9f09fce49
feat: improve bitset size estimation
2021-08-17 22:54:22 +01:00
1daa30cc7d
fix: include enum in sizing
2021-08-17 22:54:22 +01:00
f93be2bae4
Merge pull request #2320 from influxdata/er/feat/read_buffer/row_group_metrics
...
feat: add metric to track total row groups
2021-08-17 21:51:37 +00:00
006d4db0c1
Merge branch 'main' into er/feat/read_buffer/row_group_metrics
2021-08-17 21:44:01 +00:00
c068c36011
chore: enable object stores and tracing impls in Dockerfile ( #2327 )
...
Make the image generated by Dockerfile very useful for users who don't
have to build it themselves. Enable all object store backends and
tracing destinations.
2021-08-17 10:55:40 -07:00
Carol (Nichols || Goulding)
Paul Dix
kodiakhq[bot]
Raphael Taylor-Davies
Raphael Taylor-Davies
Marco Neumann
Jake Goulding
Andrew Lamb
Marko Mikulicic
Edd Robinson
Jacob Marble