Commit Graph

6287 Commits (5bdadc360c8e271fc8ccb394c314eeb9300a9278)

Author SHA1 Message Date
kodiakhq[bot] 5bdadc360c
Merge pull request #3318 from influxdata/crepererum/issue3287
fix: retry write buffer creation during database init
2021-12-07 13:04:52 +00:00
kodiakhq[bot] 52f1285d28
Merge branch 'main' into crepererum/issue3287 2021-12-07 12:54:29 +00:00
kodiakhq[bot] f0dcc6b1b0
Merge pull request #3320 from influxdata/crepererum/improve_perf_build_time
ci: improve perf image build time by pre-fetching correct rust version
2021-12-07 10:38:49 +00:00
Marco Neumann d9e8bafeb3 fix: improve state machine for write buffer creation retries 2021-12-07 10:29:08 +01:00
Marco Neumann e558f4c708 fix: address review comments 2021-12-07 09:43:47 +01:00
Marco Neumann 43569c11c2 ci: improve perf image build time by pre-fetching correct rust version
This avoids that we have to pull rustc and friends twice (once via
image, once when actually executing it).
2021-12-07 09:26:05 +01:00
Marco Neumann ef9c49087e fix: retry write buffer creation during database init 2021-12-07 09:23:03 +01:00
Marco Neumann 8f098d3ca1 fix: improve Kafka error handling during topic discovery
`MetadataTopic` has an `error` attached which we should check (I'm
wondering why this isn't a proper `Result` though).
2021-12-07 09:23:03 +01:00
kodiakhq[bot] dca1dd1d14
Merge pull request #3296 from influxdata/ntran/grpc_compact_os_chunks
feat: grpc call for compact object store chunks
2021-12-07 03:35:04 +00:00
kodiakhq[bot] 75cd1d24f4
Merge branch 'main' into ntran/grpc_compact_os_chunks 2021-12-07 03:26:06 +00:00
Nga Tran 7073691f04 test: grpc test for compaction os chunks 2021-12-06 22:25:33 -05:00
Raphael Taylor-Davies 5fdaa5b4ab
chore: don't panic with invalid parquet (#3309)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-06 21:15:35 +00:00
Andrew Lamb 5316037ffe
fix: fix flay migrate_database_files_from_one_server_to_another and prepare for reuse + fix (#3314)
* fix: fix flay migrate_database_files_from_one_server_to_another and prepare for reuse + fix

* docs: clarify comments
2021-12-06 18:28:08 +00:00
kodiakhq[bot] 468af9b8a9
Merge pull request #3313 from influxdata/crepererum/issue3310
chore: provide a single way to build prod IOx images
2021-12-06 17:20:27 +00:00
kodiakhq[bot] e750399149
Merge branch 'main' into crepererum/issue3310 2021-12-06 17:10:58 +00:00
Nga Tran 3834435620 chore: Merge branch 'ntran/grpc_compact_os_chunks' of https://github.com/influxdata/influxdb_iox into ntran/grpc_compact_os_chunks 2021-12-06 12:06:22 -05:00
Nga Tran d8ed8a3bf7 refactor: address review comments 2021-12-06 12:06:07 -05:00
Marco Neumann c77637e552 ci: improve buildx output 2021-12-06 17:42:21 +01:00
Marco Neumann 5c9fb4699b ci: allow to trigger perf image build via CircleCI API 2021-12-06 17:37:02 +01:00
kodiakhq[bot] 526cea13d2
Merge pull request #3170 from influxdata/cn/dep-cleanup
fix: Clean up dependencies based on what's in the workspace-hack crate
2021-12-06 15:56:05 +00:00
Carol (Nichols || Goulding) 7499eac067
fix: Disable uuid serde feature; we're not actually serializing any UUIDs
Connects to #3117.
2021-12-06 09:37:31 -05:00
Carol (Nichols || Goulding) d289ba6d03
fix: Make version range specificaton for tracing-subscriber consistent 2021-12-06 09:37:29 -05:00
Carol (Nichols || Goulding) 0b7c7764c6
fix: Use a consistent version range for tokio-stream across all crates 2021-12-06 09:37:16 -05:00
Carol (Nichols || Goulding) 16d8ae5e04
fix: Match tokio features to what's actually in use in each crate
Some crates listed features they don't use; other crates ware relying on
feature flags enabled by something else. I tested these changes by
disabling the workspace hack crate and testing each crate.
2021-12-06 09:37:16 -05:00
Carol (Nichols || Goulding) a23695d470
fix: Remove unused generated_types dependency in iox_data_generator 2021-12-06 09:37:16 -05:00
Carol (Nichols || Goulding) 96afb9ffe9
fix: Remove unused tokio dev-dependency in mutable_buffers 2021-12-06 09:37:16 -05:00
Carol (Nichols || Goulding) 88a58b744b
fix: Remove the tokio signal feature where it isn't needed
The grpc-router crate doesn't use tokio::signal.
2021-12-06 09:37:15 -05:00
Carol (Nichols || Goulding) 02c297e850
fix: Always specify the parking_lot feature of tokio to get potential perf boost 2021-12-06 09:37:15 -05:00
Carol (Nichols || Goulding) d1db5ec4d3
feat: Enable the union feature of smallvec
This feature was only recently added (it only works in Rust 1.49) and
potentially reduces the size of smallvecs. Doesn't seem like it could
hurt.

https://docs.rs/smallvec/1.7.0/smallvec/#union
2021-12-06 09:37:15 -05:00
Carol (Nichols || Goulding) e8d9e35321
fix: influxdb_iox tests need the json feature of reqwest
I think this didn't fail before because influxdb_iox used to use
influxdb2_client, which turned on the json feature. Then the workspace
hack crate also turned on the json feature, so when influxdb_iox stopped
using influxdb2_client, it *still* worked. But excluding the object
store crates from hakari analysis that also turned on the json feature
meant nothing turned it on anymore, so now influxdb_iox needs to turn it
on itself.
2021-12-06 09:37:15 -05:00
Carol (Nichols || Goulding) 76909b07e4
fix: Exclude optional object-store implementation crates from cargo-hakari
Aha! cargo-hakari turns on all features, but usually in development all
the specific object storage implementation crates are off.

Excluding them in the hakari config reduces the workspace crate a bit.

Connects to #3117.
2021-12-06 09:37:15 -05:00
Carol (Nichols || Goulding) 30c4da7ca7
fix: Be consistent with regex version range specification 2021-12-06 09:37:15 -05:00
Carol (Nichols || Goulding) 4e95e1bb75
fix: Remove redundant once_cell race feature
`race` is part of once_cell's default features and we aren't turning off
default features.
2021-12-06 09:37:15 -05:00
Carol (Nichols || Goulding) 3e505951c1
fix: Always enable once_cell's parking_lot dependency to save a bit of space 2021-12-06 09:37:15 -05:00
Carol (Nichols || Goulding) 1b0a2eb7c7
fix: Specify nom features in the same way cexpr does
This removes nom from the workspace-hack crate. I'm not sure what's
going on here as cexpr is setting default-features false but then
explicitly setting the features to be the same as nom's default
features, and cargo-hakari seems to be resolving that differently than
using nom's default features. I think this might be a bug in
cargo-hakari, going to investigate.

Connects to #3117.
2021-12-06 09:37:14 -05:00
Carol (Nichols || Goulding) 6b940166fe
fix: Remove a deprecated memchr feature from the workspace crate
This was made possible by upgrading nom, which was using the deprecated
feature name. This will save us from pain in the future when the
deprecated feature is removed.

Unfortunately, this adds nom to the workspace hack crate, but we'll see
if it needs to stay there :)

Connects to #3117.
2021-12-06 09:37:14 -05:00
Carol (Nichols || Goulding) e4cc04612b
chore: Update bindgen, nom, cexpr, and related crates
Connects to #3117.

This gets rid of some duplicate versions of crates in our dependency
tree.
2021-12-06 09:37:14 -05:00
Carol (Nichols || Goulding) 39a7077cd9
fix: Turn on std for indexmap to avoid a build-time target check
Connects to #3117.
2021-12-06 09:37:14 -05:00
Carol (Nichols || Goulding) bd0a2b36e3
fix: Remove futures-util proc-macro features and update to futures-* 0.3.18
The `futures-util` crate's `proc-macro-hack` and `proc-macro-nested`
features used to be part of `futures-util`'s default feature sets, so
the workspace-hack crate listed them.

`futures-util` 0.3.18 removed those features entirely.

Cargo won't update to versions of crates that don't have features that
have been specified, so the workspace-hack crate was blocking Cargo from
updating `futures-util` and a few other crates to 0.3.18.

Cargo's docs recommend against removing features in semver-compatible
releases, but nothing really prevents crate authors from doing this.

Connects to #3117.
2021-12-06 09:37:14 -05:00
Carol (Nichols || Goulding) 7a241882c2
fix: Make version reqs on futures-related crates consistent 2021-12-06 09:37:14 -05:00
Carol (Nichols || Goulding) ddc1504135
fix: Exclude influxdb2_client from the workspace hack crate
This enables the removal of the futures and futures-io crates.

Connects to #3117.
2021-12-06 09:37:14 -05:00
Carol (Nichols || Goulding) 8ad2b5e9fd
fix: In end-to-end tests, use influxdb_iox_client instead of influxdb2_client 2021-12-06 09:37:14 -05:00
Carol (Nichols || Goulding) 3900324d33
fix: Organize imports 2021-12-06 09:37:13 -05:00
Carol (Nichols || Goulding) 0b24b3c227
fix: Use a consistent version specifier when depending on the futures crate 2021-12-06 09:37:12 -05:00
Carol (Nichols || Goulding) cf6286364e
fix: Exclude criterion from hakari analysis
Connects to #3117.

Criterion builds clap without default features, which causes clap to be
listed in the workspace hack crate with its default features. In
general, actually building criterion will be rare (and we should move
all benches to separate crates that can be excluded) so it should be
fine to rebuild clap when building benchmarks anyway.
2021-12-06 09:36:50 -05:00
Carol (Nichols || Goulding) 39862e3886
fix: Disable default chrono features
Connects to #3117. Won't affect the workspace-hack crate until changes
to some other crates can be upstreamed.
2021-12-06 09:36:49 -05:00
Carol (Nichols || Goulding) a5f54da735
fix: Turn off chrono serde feature that's unused in server_benchmarks
This doesn't affect the workspace hack crate, but might make
server_benchmarks build a bit faster.
2021-12-06 09:36:32 -05:00
Carol (Nichols || Goulding) 0fda9608d8
fix: Exclude optional pprof crate from workspace-hack 2021-12-06 09:36:32 -05:00
Carol (Nichols || Goulding) b3e9fa93d1
fix: Disable unneeded default features for ahash
Connects to #3117. Won't remove ahash from the workspace-hack crate
until changes to datafusion can be upstreamed.
2021-12-06 09:36:32 -05:00
Carol (Nichols || Goulding) 994938b2f0
fix: Alphabetize/organize deps 2021-12-06 09:36:30 -05:00