Commit Graph

5241 Commits (94852f9c441264ca9010b5ebfe3664502de1b20f)

Author SHA1 Message Date
Marco Neumann 70a754a022 refactor: convert `run_sql_test_case` macro to a function
This generated less code and speeds up compilation a bit.
2021-09-22 13:46:53 +02:00
Andrew Lamb 4ed15976de
feat: Add support for custom tracing header name via JAEGER_TRACE_CONTEXT_HEADER_NAME (#2591)
* feat: Add support for custom tracing header name via JAEGER_TRACE_CONTEXT_HEADER_NAME

* test: end to end test

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-22 11:12:06 +00:00
Andrew Lamb d38648952c
chore: Update datafusion (#2602)
* chore: Update datafusion + other deps

* refactor: update query crate for new async interfaces

* refactor: update server crate for new async interface

* refactor: update query_tests crate for new async interfaces

* refactor: update ioxd and server to use new async interface

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-22 10:33:25 +00:00
kodiakhq[bot] 4c6c886015
Merge pull request #2608 from influxdata/crepererum/cleanup_deps
chore: clean up dependencies a bit
2021-09-22 10:14:50 +00:00
Marco Neumann 24c1563535 chore: remove unused `generated_types` => `futures` dep 2021-09-22 11:34:36 +02:00
Marco Neumann 26edaa4d42 chore: `generated_types` uses `num_cpus` only for tests 2021-09-22 11:31:22 +02:00
Marco Neumann 16a257e7b9 chore: remove unused `generated_types` => `serde_json` dep 2021-09-22 11:19:19 +02:00
Marco Neumann 9cdd4799c7 chore: `object_store` needs `reqwest` only for azure 2021-09-22 11:16:00 +02:00
Marco Neumann d7b697dfe9 chore: remove unused `object_store` => `tracker` dep 2021-09-22 11:13:40 +02:00
Marco Neumann 07a72a1daa chore: tell cargo-udeps that `dotenv` is needed for `write_buffer` 2021-09-22 11:09:39 +02:00
Marco Neumann 5a2ee5c385 chore: remove unused `internal_types` => `observability_deps` dep 2021-09-22 11:09:06 +02:00
Marco Neumann a9662b0edb chore: remove unused `mutable_buffer` => `influxdb_line_protocol` dep 2021-09-22 10:56:15 +02:00
Marco Neumann 0d7bb69dd3 feat: teach `Db` to preserve delete predicates 2021-09-22 09:43:37 +02:00
Marco Neumann 981ee0c6df refactor: accept unknown chunks in persisted delete predicates
Due to the timing of the "persist" lifecycle action and that delete
predicates might arrive at any time + the fact that we don't wanna hold
transaction locks for too long, we should accept delete predicates for
chunks that are currently "persisting" even though that lifecycle action
might fail.
2021-09-22 09:29:50 +02:00
Nga Tran ae40d93af4 test: more delete tests 2021-09-21 18:10:12 -04:00
kodiakhq[bot] cbb2f38b1f
Merge pull request #2605 from influxdata/ntran/optimize_scan_without_delete
feat: optimize scan for chunks without delete preidcates and without the need to sort output
2021-09-21 20:59:17 +00:00
Nga Tran 0fc2567161 refactor: address review comment 2021-09-21 16:50:29 -04:00
Nga Tran 4da6044fa6 test: more thorough en to end test 2021-09-21 16:42:53 -04:00
Nga Tran 788fda351f test: more thorough en to end test 2021-09-21 16:42:06 -04:00
Nga Tran a06afb3932 feat: optimize scan for chunks without delete preidcates and without the need to sort output 2021-09-21 15:56:19 -04:00
kodiakhq[bot] 6d38eaaad7
Merge pull request #2604 from influxdata/ntran/delete_tests_on
test: turn all delete tests on
2021-09-21 19:32:49 +00:00
Nga Tran b4b33c378e test: turn all delete tests on 2021-09-21 15:23:41 -04:00
kodiakhq[bot] 4b0d6a8b08
Merge pull request #2601 from influxdata/ntran/delete_more_tests
fix: All chunks now are applied delete predicates during scan
2021-09-21 18:57:10 +00:00
kodiakhq[bot] 91ce46576c
Merge branch 'main' into ntran/delete_more_tests 2021-09-21 18:47:37 +00:00
Nga Tran 2f371b6f79 refactor: address review comments 2021-09-21 14:46:24 -04:00
Nga Tran 61ed67a5d9 refactor: cleanup 2021-09-21 12:28:18 -04:00
Nga Tran 93551bdd1e fix: all chunks now are applied delete predicates during scan 2021-09-21 12:17:59 -04:00
Andrew Lamb 823ff1029a
test: Add end to end tracing test with mock Jaeger agent (#2594) 2021-09-21 16:07:05 +00:00
kodiakhq[bot] 3e74859822
Merge pull request #2595 from influxdata/crepererum/issue2575
ci: add cargo audit
2021-09-21 15:36:56 +00:00
kodiakhq[bot] 0a52822eab
Merge branch 'main' into crepererum/issue2575 2021-09-21 15:25:40 +00:00
Marco Neumann fb7299a169
fix: bubble up write errors (#2598)
Fixes #2538.

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-21 11:08:37 -04:00
Marco Neumann a80f6dfc3e ci: deny cargo audit warnings 2021-09-21 15:59:04 +02:00
Marco Neumann 98900af703 ci: add cargo audit
For now we ignore warnings (e.g. "crate is yanked" or "crate is
unmaintained") because:

- internal crates w/ names of crates.io crates (e.g. `query`) are
  treated like crates.io-crates even though they shouldn't, see
  https://github.com/rustsec/rustsec/issues/232
- many crates are currently unmaintained and require a bit of upstream
  work (e.g. `chrono` is currently not very active but uses an old
  version of `time` which uses the unmaintained `stdweb`)

Closes #2575.
2021-09-21 15:59:04 +02:00
kodiakhq[bot] 2384ea72af
Merge pull request #2599 from influxdata/crepererum/fix_dependabot_cfg
chore: fix dependabot config
2021-09-21 13:56:04 +00:00
Marco Neumann 6c93d99483 chore: fix dependabot config
My mistake in #2597.
2021-09-21 15:45:18 +02:00
kodiakhq[bot] 15cbba4201
Merge pull request #2597 from influxdata/crepererum/upgrade_azure
chore: upgrade azure dependencies
2021-09-21 13:35:36 +00:00
Marco Neumann ef5ab67c77 chore: upgrade azure dependencies 2021-09-21 13:35:11 +02:00
kodiakhq[bot] b21440af39
Merge pull request #2596 from influxdata/crepererum/do_not_abuse_panic_hook
test: do not (ab)use the panic hook for replay tests
2021-09-21 10:58:32 +00:00
kodiakhq[bot] c46bc8722c
Merge branch 'main' into crepererum/do_not_abuse_panic_hook 2021-09-21 10:50:35 +00:00
Andrew Lamb cf39825770
chore: update DataFusion (#2592)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-21 10:25:24 +00:00
Marco Neumann 015dfb3b16 test: do not (ab)use the panic hook for replay tests
The old construct uses a single assert-statement for both:

- "bubble-up" scenario, were a panic should fire
- a check, were a panic should not fire

That makes it easy to add new tests. However we need two rather
questionable things to make that work:

- catch panic: to convert an assertion to a check
- a custom panic hook: to make tests not overly verbose (aka caught
  panics should not show up on stdout)

Esp. the custom panic hook doesn't work too well w/ multi-threaded tests
since it might swallow error messages from unrelated tests and makes
debugging of CI failures hard.

So instead of using assertions for checks, we now implement a proper
assertion and a check for each test. That's a bit more code per check
but easier probably more stable.
2021-09-21 12:00:37 +02:00
kodiakhq[bot] afe0d11083
Merge pull request #2589 from influxdata/crepererum/issue2518b
feat: teach preserved catalog to handle delete predicates
2021-09-21 07:47:50 +00:00
kodiakhq[bot] fa30f2206d
Merge branch 'main' into crepererum/issue2518b 2021-09-21 07:39:57 +00:00
Nga Tran 85989cc8a3 test: add more delete tests and test scenarios 2021-09-20 18:18:08 -04:00
Raphael Taylor-Davies 46088a7ff1
feat: disable rustyline dirs-next dependency (#2579) 2021-09-20 14:42:07 +00:00
Marco Neumann 6682178d6f feat: teach preserved catalog to handle delete predicates 2021-09-20 15:51:14 +02:00
kodiakhq[bot] 680f70f1e9
Merge pull request #2588 from influxdata/crepererum/chunk_id
refactor: introduce `ChunkId` type
2021-09-20 13:47:11 +00:00
kodiakhq[bot] 77d84ca5ab
Merge branch 'main' into crepererum/chunk_id 2021-09-20 13:39:05 +00:00
kodiakhq[bot] 2c9b07264c
Merge pull request #2572 from influxdata/ntran/delete_scan
feat: apply negated delete predicates during scan
2021-09-20 13:38:30 +00:00
Marco Neumann 11413eae8d docs: mention that `Chunk{Id,Order}::next` might panic 2021-09-20 15:32:44 +02:00