Commit Graph

206 Commits (1d38d400f05a9200debc0d688e6a1eae0b29a289)

Author SHA1 Message Date
Carol (Nichols || Goulding) b86eb763b1
fix: Tell buf to fetch to a depth of 100 commits when looking for breaking changes
Per <https://docs.buf.build/reference/inputs#other-options>, this is by
default 50 (and I have 51 commits on this PR 😰)

100 commits should be enough for anyone.
2022-11-23 17:24:50 -05:00
jaymebrd d41c1290cf
chore: copy iox images skopeo gar registry (#6172)
* chore: copy the iox images to the gar registry with skopeo

* chore: add quotes
2022-11-18 16:37:08 +00:00
Andrew Lamb 1eb0d64210
chore: remove unecessary doc exclude (#6018)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-11-01 20:17:27 +00:00
Luke Bond c39ae97dd4
chore: temporarily disable circle filter to build & push PRs (#5973)
* chore: temporarily disable circle filter to build & push PRs

* chore: allow build & push of container image for branches using param

* chore: indentation fix in circle config

* chore: rename build_perf to release_branch
2022-10-25 15:40:13 +00:00
Marco Neumann adeacf416c
ci: fix (#5569)
* ci: use same feature set in `build_dev` and `build_release`

* ci: also enable unstable tokio for `build_dev`

* chore: update tokio to 1.21 (to fix console-subscriber 0.1.8

* fix: "must use"
2022-09-06 14:13:28 +00:00
Andrew Lamb f9d0e37144
chore: reduce h2 and hyper logging level in tests (#5332)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-08-08 09:39:26 +00:00
Andrew Lamb 38a0cdbb4a
fix: Install cargo deny in ci image (#5317)
* fix: install cargo deny in ci image

* fix: Update docker/Dockerfile.ci

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* fix: Apply suggestions from code review

Co-authored-by: Marco Neumann <marco@crepererum.net>

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
Co-authored-by: Marco Neumann <marco@crepererum.net>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-08-05 15:51:35 +00:00
Dom Dwyer 36d36c507c ci: bump redpanda version 2022-08-04 16:57:28 +02:00
Raphael Taylor-Davies 5f9ade103f
chore: tweak rustc flags (#5293)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-08-04 09:12:21 +00:00
Andrew Lamb e2d871b00b
chore: Update datafusion and arrow/parquet/arrow-flight to `18.0.0` (#5079)
* chore: Update datafusion to 10.0.0, arrow/parquet/arrow-flight to 18

* chore: Run cargo hakari tasks

* fix: update cargo pin

Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-07-18 15:01:03 +00:00
Marco Neumann d33525055b
ci: update CI machine images (#5061) 2022-07-07 09:14:02 +00:00
Marco Neumann e84e1f3de2
ci: clean up and fixes (#5054)
* ci: remove unused helper script

* ci: update CI machine images

Try to fix error a la:

```text
error: failed to solve: failed to solve with frontend dockerfile.v0: failed to solve with frontend gateway.v0: failed to copy: httpReadSeeker: failed open: failed to do request: Get "https://docker-images-prod.s3.dualstack.us-east-1.amazonaws.com/registry-v2/docker/registry/v2/blobs/sha256/...": dial tcp 52.216.28.112:443: i/o timeout
```

See https://discuss.circleci.com/t/increased-rate-of-errors-when-pulling-docker-images-on-machine-executor/42094/9
2022-07-06 14:47:50 +00:00
Marko Mikulicic 015bba8589
chore: c2updater to acs transition (#5045)
1. disable c2updater call
2. use full sha tags (required by `acs`)
2022-07-05 21:47:05 +00:00
Jacob Marble 1ef9c7ceda
chore: remove perf.py (#5012)
Closes #4485
Closes #5010

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-06-30 22:32:47 +00:00
Marco Neumann fba58dbc5f
ci: IOx still needs to push its image tags (#4977)
This will be replaced by a pull-based approach soon, but for the time
being we still need perform the final push.
2022-06-29 09:52:44 +00:00
Marco Neumann 847c84a6b4
ci: fix `docker load` paths (#4961)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-06-29 08:03:02 +00:00
Marco Neumann cede296eb1 ci: fix `docker save` paths 2022-06-28 10:41:04 +02:00
Marco Neumann 2ebb7b195b
ci: fix image deploy (#4953)
The Influx deployment pipeline was changed so the an image push is used
as a signal for deployment (instead of a magic script that was used
before). So we need to adopt our CI to only push images when all tests
pass.

Old workflow:
- build release: builds docker images and push commit-based tags to
  registry
- deploy release: pulls built images from registry, adds+pushes branch
  tags, calls magic deploy script

New workflow:
- build release: builds docker image, saves them to disk
- deploy release: load image files, tags them, pushes tags

You may wonder why there are two steps if we could just use a single
one. The reason is: time-to-deploy. We can already build the image while we
are waiting for the tests. If the tests fail, the image will just not be
published.

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-06-28 07:48:41 +00:00
Andrew Lamb 394c84f3e8
chore: Update CI checks to verify data generator build (#4857)
* chore: Update CI checks to verify data generator build

* fix: bench verify test

* docs: Update .circleci/config.yml

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-06-15 10:31:14 +00:00
Marco Neumann 9accb5912e
chore: lower job count in `build_dev` (#4815) 2022-06-09 13:26:35 +00:00
Carol (Nichols || Goulding) b52a3586a7
fix: Turn cargo doc warnings into errors (#4710)
* fix: Correct intra-doc links

* fix: Turn cargo doc warnings into errors

Co-authored-by: Jake Goulding <jake.goulding@integer32.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-28 11:24:22 +00:00
Dom Dwyer 6b6dbb0286 build: remove iox_gitops_adapter from build
Broken release builds since:

    https://github.com/influxdata/influxdb_iox/pull/4675
2022-05-24 16:30:19 +01:00
Andrew Lamb 52a50c4a14
fix: use large circleci executor for docs job (#4680) 2022-05-24 14:26:49 +00:00
Jake Goulding 359046f3f2 ci: give the doc builder more memory 2022-05-20 10:44:06 -04:00
Marco Neumann 7d16f57c85
ci: simplify cargo deny (#4640)
Taken from https://github.com/influxdata/object_store_rs/pull/5

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-19 09:51:15 +00:00
Marco Neumann 52346642a0
ci: fix cargo deny (#4629)
* ci: fix cargo deny

* chore: downgrade `socket2`, version 0.4.5 was yanked

* chore: rename `query` to `iox_query`

`query` is already taken on crates.io and yanked and I am getting tired
of working around that.
2022-05-18 09:38:35 +00:00
Raphael Taylor-Davies f2bb0fdf77
feat: update to crates.io object_store version (#4595)
* feat: update to crates.io object_store version

* chore: Run cargo hakari tasks

* fix: tests

* chore: remove object store integration test plumbing

Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
2022-05-13 16:26:07 +00:00
Marko Mikulicic 335374fed5
chore: Enable pprof feature back (#4587) (#4590)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-12 23:33:28 +00:00
Marko Mikulicic 24020403ba
fix: Remove pprof feature; it fails to build (#4588) 2022-05-12 21:45:13 +00:00
Marko Mikulicic d807941804
chore: Enable pprof feature back (#4587) 2022-05-12 21:25:22 +00:00
Carol (Nichols || Goulding) 78bbe629b2
feat: Add more logging to understand the flaky multi ingester test better (#4580)
* feat: Increase logging to investigate multi ingester flaky test

* feat: Temporarily disable a test while logging is increased in CI

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-12 20:05:05 +00:00
Raphael Taylor-Davies 9befcd5b3d
chore: rename INFLUXDB_IOX_BUCKET to OBJECT_STORE_BUCKET in object_store (#4548)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-10 16:31:46 +00:00
Carol (Nichols || Goulding) 620817eed4
feat: Disable perf until it can be updated.
Connects to #4485.
2022-05-06 09:48:30 -04:00
Andrew Lamb 9cc7d73671
chore: Install custom protoc in perf-builder image (#4358)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-20 10:35:05 +00:00
Dom Dwyer 3c89d2a354 ci: enable tokio_console feature
Configures the release CI pipeline to generate a binary with
tokio-console support.

This drops the compile-time log filter to TRACE, which may have some
minor overhead. All our log filters in prod are debug or higher, so the
runtime filter will remove the TRACE events and no additional logs will
be emitted because of this change.
2022-04-12 13:02:31 +01:00
Dom Dwyer 6aac162e4a ci: remove duplicate RUSTFLAGS definition
This commit unifies RUSTFLAGS config in the CircleCI config.

Previously in the CircleCI config file for the "build_release" job, we
specify an env var (RUSTFLAGS) in the env config section, but then
override / use a different value when passing flags to the docker build
steps.
2022-04-12 12:13:40 +01:00
Marko Mikulicic e7ab1908e5
fix: Use a bigger circleci machine for build_dev (#4171) 2022-03-30 09:59:07 +00:00
Dom Dwyer e87313f88b build: manually clone advisory-db repo
Use the git CLI to pull the advisory-db repo, instead of letting
cargo-deny do it as it seems to ignore the "pull with CLI" cargo
setting:

    https://github.com/EmbarkStudios/cargo-deny/issues/388

Potentially related to GitHub killing old key support today:

    https://github.blog/2021-09-01-improving-git-protocol-security-github/
2022-03-15 15:42:24 +00:00
Marko Mikulicic 6fd3c3f1ea
fix: Kick c2updater (#4029) 2022-03-14 15:24:54 +00:00
Carol (Nichols || Goulding) 8af2f60b59
fix: Run catalog setup as part of end-to-end test setup 2022-03-09 09:55:43 -05:00
Carol (Nichols || Goulding) 93b0cdbcc4
fix: Create the test database as part of ng server fixture startup 2022-03-09 09:55:43 -05:00
kodiakhq[bot] caba70f871
Merge branch 'main' into cn/not-database-url 2022-03-09 13:32:02 +00:00
Carol (Nichols || Goulding) 4dacf0d68f
fix: Instead of using DATABASE_URL, use INFLUXDB_IOX_CATALOG_DSN and TEST_INFLUXDB_IOX_CATALOG_DSN 2022-03-07 11:02:58 -05:00
Dom Dwyer 039eb3d5e7 ci: switch cargo-audit to cargo-deny
Use cargo-deny in CI instead of cargo-audit.

Does the same job, but cargo-deny has more features, in particular the
"deny" functionality is helpful to prevent accidentally pulling in
dependencies we don't want (I'm looking at you OpenSSL).
2022-03-07 15:35:41 +00:00
Carol (Nichols || Goulding) b28aa22039
fix: Check hakari even if a hakari commit is already present; fail the build if so 2022-03-04 10:24:42 -05:00
Carol (Nichols || Goulding) b57632fb6c
fix: Fail the build if hakari changes need to be committed before merge 2022-03-04 10:17:17 -05:00
Carol (Nichols || Goulding) c3acf79307
fix: Only make potentially one cargo hakari commit per branch
So that we don't have to skip running tests when cargo hakari makes a
change, but we won't have infinite cargo hakari commits if there's some
sort of problem.
2022-03-03 15:32:31 -05:00
Carol (Nichols || Goulding) 33bbbd9950
fix: Cargo hakari commits have to use semantic commits too 2022-03-03 14:50:36 -05:00
Carol (Nichols || Goulding) 7f8dcf1ed0
chore: Add ssh key to CircleCI hakari job so it can push commits 2022-03-03 14:43:37 -05:00
Carol (Nichols || Goulding) 5018d1bf66
fix: Have auto hakari commits come from a CircleCI bot, not dependabot 2022-03-03 14:43:37 -05:00