Commit Graph

105 Commits (80f04e8fec5e1393e67953a2a42bd5ca9b7fa083)

Author SHA1 Message Date
Marco Neumann 81ccf85104 refactor: integrate print-cpu into main binary
It's a less confusing structure and also allows us to have this
information available in our shipped binary.
2021-10-25 18:29:32 +02:00
Andrew Lamb c6858285e5
chore: Allow bypassing 'backwards compatibility' protobuf linting with a label (#2922)
* chore: Allow bypassing 'backwards compatibility' protobuf linting with label

* chore: feedback review

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-21 15:06:45 +00:00
Andrew Lamb 0247ffee1d
chore: Enable 'breaking backwards compatibility' protobuf linter (#2919)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-21 12:37:24 +00:00
Raphael Taylor-Davies 8267e19592
chore: compress CI docs (#2880)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-19 09:03:24 +00:00
Andrew Lamb 035654b4f9
refactor: do not rebuild query_test when .sql or .expected files change (#2816)
* feat: Do not rebuild query_tests if .sql or .expected change

* feat: Add CI check

* refactor: move some sql tests to .sql files

* tests: port tests / expected results to data files

* fix: restore old name check-flatbuffers
2021-10-12 19:34:54 +00:00
Raphael Taylor-Davies b13b092bbd
revert: "feat(iox): Enable heappy again" (#2641)
This reverts commit 6e2aa2eef3.
2021-09-27 16:31:19 +00:00
Andrew Lamb a55a21c644
chore: Update datafusion (#2635)
* chore: Update datafusion and sqlparser

* fix: remove STACK_SIZE workaround

* chore: update datafusion_util

* chore: update predicate

* chore: update query_tests

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-27 14:13:19 +00:00
Nga Tran 2399a932fb chore: Merge branch 'main' into ntran/more_delete_tests 2021-09-22 16:47:15 -04:00
Nga Tran 400ec93498 test: more delete tests 2021-09-22 16:38:27 -04:00
Raphael Taylor-Davies 92e6173f49
feat: implement jaeger-agent protocol directly (#2607)
* feat: implement jaeger-agent protocol directly

* chore: review feedback

* fix: remove jaeger feature flag
2021-09-22 17:30:37 +00:00
Andrew Lamb 823ff1029a
test: Add end to end tracing test with mock Jaeger agent (#2594) 2021-09-21 16:07:05 +00:00
Marco Neumann 98900af703 ci: add cargo audit
For now we ignore warnings (e.g. "crate is yanked" or "crate is
unmaintained") because:

- internal crates w/ names of crates.io crates (e.g. `query`) are
  treated like crates.io-crates even though they shouldn't, see
  https://github.com/rustsec/rustsec/issues/232
- many crates are currently unmaintained and require a bit of upstream
  work (e.g. `chrono` is currently not very active but uses an old
  version of `time` which uses the unmaintained `stdweb`)

Closes #2575.
2021-09-21 15:59:04 +02:00
Jacob Marble 6d762d2ba0 fix: emit traces to Jaeger in perf.py 2021-09-13 16:11:59 -07:00
Jacob Marble 083fd06d0c
fix: checksum rustup in CI (#2501)
* fix: checksum rustup in CI

* chore: integrate feedback

Co-authored-by: Andrew Lamb <alamb@influxdata.com>

Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-10 16:28:09 +00:00
Jacob Marble c415d357cc
fix: perf broken after Protobuf changes (#2479)
* fix: perf broken after proto changes

* feat: add perf to CI

* chore: try different python version selector script

* chore: several fixes to CI

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-09 14:24:24 +00:00
Marko Mikulicic 6e2aa2eef3
feat(iox): Enable heappy again 2021-08-27 11:13:30 +02:00
Marko Mikulicic 31521e076e
feat: Re-enable jemalloc
But without heappy
2021-08-25 14:46:28 +02:00
Marko Mikulicic 595b83d7bc
feat: Disable jemalloc/heappy and use system allocator 2021-08-25 10:49:46 +02:00
Raphael Taylor-Davies 3fdc0e9a6a
chore: remove orphaned code from trogging (#2371)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-24 10:12:59 +00:00
Marko Mikulicic 4a2f0b0a52
fix: Make heappy and nonheappy mutually exclusive
Closes #2288
2021-08-20 11:35:07 +02:00
Andrew Lamb 5e1cb244f7
feat: make pprof optional (#2331) 2021-08-18 15:13:37 +00:00
Raphael Taylor-Davies 70aca081ff
chore: fix dockerignore (#2300) (#2316)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-17 10:09:18 +00:00
Marko Mikulicic e1fe2ea27b fix: Enable heappy in our perf build 2021-08-13 17:21:55 +02:00
Andrew Lamb 05de6c0e31 chore: add heappy end to end tests 2021-08-13 08:20:08 -05:00
Andrew Lamb 697de875ca refactor: make heappy an optional feature, add to build image 2021-08-13 08:11:32 -05:00
Luke Bond 88e4bcd139
chore: update .circleci/get-deploy-tags.sh
Co-authored-by: Marko Mikulicic <mkm@influxdata.com>
2021-08-10 15:15:09 +01:00
Luke Bond 083423a629
chore: update image promotion script 2021-08-10 13:36:55 +01:00
Andrew Lamb 82677d9510
feat: add `jaeger` and `otlp` features, default to off (#2202)
* feat: add jaeger and otlp flags

* chore: add jaeger and otlp features to CI test and deploy image

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-06 13:26:59 +00:00
Andrew Lamb 4a44b14d4d
fix: use avx2 (#2140) 2021-07-28 20:58:38 +00:00
Edd Robinson 287d501aa2
chore: build with avx512 instructions (#2118)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-28 19:47:37 +00:00
Andrew Lamb a1fbac74d5
refactor: Tweak perf_build script (#2121)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-28 13:47:18 +00:00
Edd Robinson 6528cab16f
Merge branch 'main' into er/chore/roaringivy 2021-07-26 17:38:18 +01:00
Edd Robinson fd29d5ae05 chore: target architecture with avx2 2021-07-26 17:36:44 +01:00
Marko Mikulicic 16f867272d
fix: Fix typo in print_cpu command name 2021-07-26 17:55:52 +02:00
Andrew Lamb 4def5bd816
chore: Add print_cpu command line to perf build (#2114)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-26 15:26:34 +00:00
Andrew Lamb 1a79bf7e99
refactor: Make aws/azure/gcs optional features and stop compiling 100 dependencies during dev (#1933)
* feat: make aws, gcp, azure dependencies optional

* fix: only run object store tests if the features are enabled

* fix: clean up testing

* fix: rename step

* fix: add to list of jobs

* fix: remove test with object store

* fix: review comments
2021-07-09 11:38:30 +00:00
Carol (Nichols || Goulding) 3abb4ca12d chore: Add RUST_BACKTRACE=1 to tests in CI
Fixes #1736.
2021-06-23 16:16:47 -04:00
Carol (Nichols || Goulding) 4612afe65d chore: Instead of installing rustup components, print all their versions 2021-06-23 15:28:58 -04:00
Carol (Nichols || Goulding) f0efd20259 chore: Switch to rust-toolchain.toml to specify Rust components we need as well 2021-06-23 15:28:58 -04:00
Marko Mikulicic 60c1b68644
chore: Store generated rustdoc as circleci artifacts 2021-06-23 00:20:55 +02:00
Carol (Nichols || Goulding) a0583381a1 chore: Run kafka integration tests using docker-compose
And, importantly, using the CircleCI machine image to avoid running
Docker-in-Docker.
2021-06-21 09:36:35 -04:00
Marko Mikulicic 05e35537d8
fix: give xlarge image to perf_image build step 2021-06-07 14:03:55 +02:00
Marko Mikulicic c77e57b7dc
feat: Preserve full debug infos in release builds
The `Cargo.toml` file already says:

```toml
[profile.release]
debug = true
```

but we were overriding it in the circleci release script to include only line number info,
probably to shave off some time from the total build time.

The ability to debug a production binary outweighs the few seconds or even a minute overhead it takes to
add the debug infos. If building with full debug infos take much much longer, next time we disable them
it would be nice to include such a dramatic fact in the comments next to where we disable debug infos :-)
2021-06-03 15:50:01 +02:00
Raphael Taylor-Davies 10f89a3e8d
refactor: split entry out into separate crate (#1428)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-06 11:36:23 +00:00
Marco Neumann 7d2a48eb3b ci: disable incremental compilation
This is to avoid overhead. We are not preserving these files anyway.
2021-05-05 13:30:25 +02:00
Marko Mikulicic 6b42c9a5ea
fix(ci): Push each image into its own tag
Using the git sha as the tag
2021-04-29 17:54:09 +02:00
Marko Mikulicic 756e1b769e
feat: Build a perf_image image for every commit in main 2021-04-28 10:12:34 +02:00
Marco Neumann 91bccdfca3 ci: pass `--document-private-items` to `cargo doc` 2021-04-27 15:42:07 +02:00
kodiakhq[bot] e78a81ee59
Merge branch 'main' into crepererum/ci_doc 2021-04-27 12:03:04 +00:00
Marko Mikulicic a9852c2257
fix: Disable docker layer caching in CI 2021-04-27 13:33:25 +02:00