Commit Graph

31 Commits (278ecbeb5689a4047520f74fcdd9997d5c645495)

Author SHA1 Message Date
Christopher M. Wolff 069c3795c2
fix: update proto path for parquet meta script (#7911)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-06-02 15:29:11 +00:00
Carol (Nichols || Goulding) b0959667d5
fix: Move topic and query pool within iox catalog (#7734)
Still insert them into the database and associate them with namespaces,
but don't ever query them back out.

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-05-04 13:45:56 +00:00
Carol (Nichols || Goulding) a8ddf76f0c
fix: Remove script to update arrow deps replaced by workspace dep inheritance
There's now only one file to update these crates' versions.
2022-10-26 10:37:52 -04:00
Luke Bond cc93b2c275 chore: add catalog trigger for billing 2022-09-13 16:22:44 +01:00
Andrew Lamb 6669d85fb4
chore: Update datafusion + arrow/parquet to `21.0.0` (#5519)
* chore: Update arrow/arrow-flight/parquet to 21.0.0

* chore: Update datafusion pin

* chore: Fix arrow update script

* chore: Update Cargo.lock

* chore: Update for new API
2022-08-31 13:30:47 +00:00
Luke Bond 061444a23c
chore: added helper script for a docker catalog (#5372) 2022-08-10 15:49:40 +00:00
Marco Neumann 7d16ac7de0
docs: extend profiling guide (#5205)
* docs: extend profiling guide

More tools.

* chore: fix docs lint for `localhost` links

* docs: do not duplicate tracing docs

* refactor: clean up `lint_docs` and strip anchors from relative links
2022-07-26 09:40:42 +00:00
Andrew Lamb 02893e598c
chore: Update datafusion and upgrade arrow/parquet/arrow-flight to 13 (#4516)
* chore: Tool for automating arrow version update

* chore: Update datafusion and arrow/parquet/arrow-flight

* fix: update for changes in Arrow API

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-05 00:21:02 +00:00
Carol (Nichols || Goulding) 455a051653
fix: Remove edit db rules scripts that no longer apply to NG 2022-04-29 16:29:52 -04:00
Raphael Taylor-Davies 5b71306423
chore: lint markdown docs and use relative code references in docs (#3420)
* chore: lint markdown docs

docs: relative source file references in markdown docs

* chore: review feedback
2022-01-04 09:50:13 +00:00
Marco Neumann f1e9ac9ef2 ci: run shellcheck 2021-11-29 15:11:15 +01:00
Marko Mikulicic 4b271fe162
feat: Add a simple script to decode the IOx metadata of a parquet file 2021-11-26 12:25:19 +01:00
Marko Mikulicic ae8947868a
fix(logfmts): Update doc 2021-10-20 17:58:22 +02:00
Marko Mikulicic ae82236bc4
fix(logfmts): Use UTC for ./scripts/logfmts 2021-10-20 14:35:47 +02:00
Jacob Marble 083fd06d0c
fix: checksum rustup in CI (#2501)
* fix: checksum rustup in CI

* chore: integrate feedback

Co-authored-by: Andrew Lamb <alamb@influxdata.com>

Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-10 16:28:09 +00:00
Marco Neumann 803d49648a feat: valgrind support 2021-08-23 09:30:36 +02:00
Carol (Nichols || Goulding) 033035d10a docs: Update a few more instances of un-prefixed data_generator 2021-08-19 15:23:31 -04:00
Marko Mikulicic 076b8f74fb
feat: Add small genlp.py script 2021-07-13 14:04:35 +02:00
Raphael Taylor-Davies 530b5cdf22
feat: namespace issues in git-log-prs (#1849)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-30 13:35:34 +00:00
Marko Mikulicic b77f054a5f
fix: Report error to stderr in git-log-prs 2021-06-21 18:18:50 +02:00
Marko Mikulicic 12b561f140
feat: Add logfmts script to humanize timestamps
```console
$ kubectl logs deploy/iox-router-1000 -c iox -f | TZ=UTC ./scripts/logfmts
2021-06-04 10:25:46 level=debug msg="Successfully processed request" response="Response { status: 204, version: HTTP/1.1, headers: {\"x-powered-by\": \"Routerify v2.0.0-beta-2\"}, body: Body(Empty) }" target="influxdb_iox::influxdb_ioxd::http" location="src/influxdb_ioxd/http.rs:359"
```
2021-06-04 14:16:43 +02:00
Marko Mikulicic dce0dce122
feat: Improve git-log-pr
1. by default use the repo where the `git-log-pr` script is located in, allowing it to be called
   from other scripts in other repos (e.g. k8s-idpe) without too much cerimony
2. allow the git repo to be overriden with the `-C` flag (like the `git` command itself)
3. add a `--commits` flag which prints also commit shas in addition to PR numbers
4. GH merge commits contain the PR title as the body; if present use that instead of using the `gh` cli (which is slow and requires this tool to be installed).
2021-04-29 12:51:49 +02:00
Marko Mikulicic bde36bfe47 feat: Add the git-log-prs script
__Scenarios__

You may know the git sha of what's running in the staging cluster,
and you may know the sha of the latest built image is, but will upgrading to a new
version include the PRs I'm interested in?

Or alternatively: I noticed in the dashboard that IOx was working fine until
we rolled out a new version. Which PRs were included in this new rollout?

__Description__

Getting the answers to the scenarios above is surprisingly hard, because scanning
our git history is complicated by the fact that just about anybody uses a different
merging technique.

This script does the right magic to skim through all that cruft and get the answers.

__Demo__

```console
$ ./scripts/git-log-prs 8376983b74311df970339e106c62ce4038b20e5f..
1330
1336
$ ./scripts/git-log-prs 8376983b74311df970339e106c62ce4038b20e5f.. --titles
1330 feat: Make background task period configurable
1336 feat: Build a perf_image image for every commit in main
```
2021-04-28 21:01:13 +00:00
Marko Mikulicic 2aca0ea592 feat: add jq_edit_db_rules script
Emit also default values for fields in edit_db_rules, this way it's easier to know what to change.

Also simplify argument handling for edit_db_rules script
2021-04-19 10:51:09 +00:00
Marko Mikulicic 664d7103ca fix: Fix edit_db_rules script
- enable quitting on error by fixing `read` (read with heredoc always exits with non-0 causing the script to bail out)
- enable quitting on unbound variables by pulling cleanup outside of main
- accept hosts with `http://` prefix or without (improve compat with iox client)

Now the script cleanly reports errors when you have a typo in the db name or hostname
2021-04-16 13:49:49 +00:00
Marko Mikulicic 89409ca8b7 fix: Update scripts/edit_db_rules
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-04-09 11:12:22 +00:00
Marko Mikulicic f3d40bbff9 feat: Add edit_db_rules script
There are a few yaks to be shaven before we have a good CLI for editing database rules.

This is a simple shell script that uses the grpc API to edit the database rules on a remote
IOx server. It fetches the rules, spawns your default text editor, waits until your editor quits,
and then calls the update API with the results of your local edit.

(if you use emacs, there is a thing called emacsclient which knows how to block until you closed
the buffer in your main persistent emacs)
2021-04-09 11:12:22 +00:00
Marko Mikulicic cd94544e93 feat: Add prototxt script 2021-03-26 12:40:56 +00:00
Andrew Lamb 2b72890028 fix: Revert "fix: Shutdown stest fixture on test harness exit"
This reverts commit 28fe808d7e.

Not needed after https://github.com/influxdata/influxdb_iox/pull/955 is merged
2021-03-10 09:28:03 -05:00
Marko Mikulicic 28fe808d7e fix: Shutdown stest fixture on test harness exit 2021-03-10 11:31:26 +00:00
Marko Mikulicic 9bdc276d5e docs: Document how to use grpcurl to play with API 2021-03-08 13:57:11 +00:00