Commit Graph

5032 Commits (c107434d2008694461499b38257f79be34b7d054)

Author SHA1 Message Date
Marco Neumann 07a72a1daa chore: tell cargo-udeps that `dotenv` is needed for `write_buffer` 2021-09-22 11:09:39 +02:00
Marco Neumann 5a2ee5c385 chore: remove unused `internal_types` => `observability_deps` dep 2021-09-22 11:09:06 +02:00
Marco Neumann a9662b0edb chore: remove unused `mutable_buffer` => `influxdb_line_protocol` dep 2021-09-22 10:56:15 +02:00
Marco Neumann 0d7bb69dd3 feat: teach `Db` to preserve delete predicates 2021-09-22 09:43:37 +02:00
Marco Neumann 981ee0c6df refactor: accept unknown chunks in persisted delete predicates
Due to the timing of the "persist" lifecycle action and that delete
predicates might arrive at any time + the fact that we don't wanna hold
transaction locks for too long, we should accept delete predicates for
chunks that are currently "persisting" even though that lifecycle action
might fail.
2021-09-22 09:29:50 +02:00
Nga Tran ae40d93af4 test: more delete tests 2021-09-21 18:10:12 -04:00
kodiakhq[bot] cbb2f38b1f
Merge pull request #2605 from influxdata/ntran/optimize_scan_without_delete
feat: optimize scan for chunks without delete preidcates and without the need to sort output
2021-09-21 20:59:17 +00:00
Nga Tran 0fc2567161 refactor: address review comment 2021-09-21 16:50:29 -04:00
Nga Tran 4da6044fa6 test: more thorough en to end test 2021-09-21 16:42:53 -04:00
Nga Tran 788fda351f test: more thorough en to end test 2021-09-21 16:42:06 -04:00
Nga Tran a06afb3932 feat: optimize scan for chunks without delete preidcates and without the need to sort output 2021-09-21 15:56:19 -04:00
kodiakhq[bot] 6d38eaaad7
Merge pull request #2604 from influxdata/ntran/delete_tests_on
test: turn all delete tests on
2021-09-21 19:32:49 +00:00
Nga Tran b4b33c378e test: turn all delete tests on 2021-09-21 15:23:41 -04:00
kodiakhq[bot] 4b0d6a8b08
Merge pull request #2601 from influxdata/ntran/delete_more_tests
fix: All chunks now are applied delete predicates during scan
2021-09-21 18:57:10 +00:00
kodiakhq[bot] 91ce46576c
Merge branch 'main' into ntran/delete_more_tests 2021-09-21 18:47:37 +00:00
Nga Tran 2f371b6f79 refactor: address review comments 2021-09-21 14:46:24 -04:00
Nga Tran 61ed67a5d9 refactor: cleanup 2021-09-21 12:28:18 -04:00
Nga Tran 93551bdd1e fix: all chunks now are applied delete predicates during scan 2021-09-21 12:17:59 -04:00
Andrew Lamb 823ff1029a
test: Add end to end tracing test with mock Jaeger agent (#2594) 2021-09-21 16:07:05 +00:00
kodiakhq[bot] 3e74859822
Merge pull request #2595 from influxdata/crepererum/issue2575
ci: add cargo audit
2021-09-21 15:36:56 +00:00
kodiakhq[bot] 0a52822eab
Merge branch 'main' into crepererum/issue2575 2021-09-21 15:25:40 +00:00
Marco Neumann fb7299a169
fix: bubble up write errors (#2598)
Fixes #2538.

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-21 11:08:37 -04:00
Marco Neumann a80f6dfc3e ci: deny cargo audit warnings 2021-09-21 15:59:04 +02:00
Marco Neumann 98900af703 ci: add cargo audit
For now we ignore warnings (e.g. "crate is yanked" or "crate is
unmaintained") because:

- internal crates w/ names of crates.io crates (e.g. `query`) are
  treated like crates.io-crates even though they shouldn't, see
  https://github.com/rustsec/rustsec/issues/232
- many crates are currently unmaintained and require a bit of upstream
  work (e.g. `chrono` is currently not very active but uses an old
  version of `time` which uses the unmaintained `stdweb`)

Closes #2575.
2021-09-21 15:59:04 +02:00
kodiakhq[bot] 2384ea72af
Merge pull request #2599 from influxdata/crepererum/fix_dependabot_cfg
chore: fix dependabot config
2021-09-21 13:56:04 +00:00
Marco Neumann 6c93d99483 chore: fix dependabot config
My mistake in #2597.
2021-09-21 15:45:18 +02:00
kodiakhq[bot] 15cbba4201
Merge pull request #2597 from influxdata/crepererum/upgrade_azure
chore: upgrade azure dependencies
2021-09-21 13:35:36 +00:00
Marco Neumann ef5ab67c77 chore: upgrade azure dependencies 2021-09-21 13:35:11 +02:00
kodiakhq[bot] b21440af39
Merge pull request #2596 from influxdata/crepererum/do_not_abuse_panic_hook
test: do not (ab)use the panic hook for replay tests
2021-09-21 10:58:32 +00:00
kodiakhq[bot] c46bc8722c
Merge branch 'main' into crepererum/do_not_abuse_panic_hook 2021-09-21 10:50:35 +00:00
Andrew Lamb cf39825770
chore: update DataFusion (#2592)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-21 10:25:24 +00:00
Marco Neumann 015dfb3b16 test: do not (ab)use the panic hook for replay tests
The old construct uses a single assert-statement for both:

- "bubble-up" scenario, were a panic should fire
- a check, were a panic should not fire

That makes it easy to add new tests. However we need two rather
questionable things to make that work:

- catch panic: to convert an assertion to a check
- a custom panic hook: to make tests not overly verbose (aka caught
  panics should not show up on stdout)

Esp. the custom panic hook doesn't work too well w/ multi-threaded tests
since it might swallow error messages from unrelated tests and makes
debugging of CI failures hard.

So instead of using assertions for checks, we now implement a proper
assertion and a check for each test. That's a bit more code per check
but easier probably more stable.
2021-09-21 12:00:37 +02:00
kodiakhq[bot] afe0d11083
Merge pull request #2589 from influxdata/crepererum/issue2518b
feat: teach preserved catalog to handle delete predicates
2021-09-21 07:47:50 +00:00
kodiakhq[bot] fa30f2206d
Merge branch 'main' into crepererum/issue2518b 2021-09-21 07:39:57 +00:00
Nga Tran 85989cc8a3 test: add more delete tests and test scenarios 2021-09-20 18:18:08 -04:00
Raphael Taylor-Davies 46088a7ff1
feat: disable rustyline dirs-next dependency (#2579) 2021-09-20 14:42:07 +00:00
Marco Neumann 6682178d6f feat: teach preserved catalog to handle delete predicates 2021-09-20 15:51:14 +02:00
kodiakhq[bot] 680f70f1e9
Merge pull request #2588 from influxdata/crepererum/chunk_id
refactor: introduce `ChunkId` type
2021-09-20 13:47:11 +00:00
kodiakhq[bot] 77d84ca5ab
Merge branch 'main' into crepererum/chunk_id 2021-09-20 13:39:05 +00:00
kodiakhq[bot] 2c9b07264c
Merge pull request #2572 from influxdata/ntran/delete_scan
feat: apply negated delete predicates during scan
2021-09-20 13:38:30 +00:00
Marco Neumann 11413eae8d docs: mention that `Chunk{Id,Order}::next` might panic 2021-09-20 15:32:44 +02:00
kodiakhq[bot] c7e6fffaaa
Merge branch 'main' into ntran/delete_scan 2021-09-20 13:29:47 +00:00
Marco Neumann cef5aeee52 refactor: introduce `ChunkId` type 2021-09-20 13:10:41 +02:00
kodiakhq[bot] 96b1d29c1f
Merge pull request #2585 from influxdata/dependabot/cargo/tracing-subscriber-0.2.24
chore(deps): bump tracing-subscriber from 0.2.22 to 0.2.24
2021-09-20 09:52:13 +00:00
dependabot[bot] a51e9d8c19
chore(deps): bump tracing-subscriber from 0.2.22 to 0.2.24
Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing) from 0.2.22 to 0.2.24.
- [Release notes](https://github.com/tokio-rs/tracing/releases)
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.2.22...tracing-subscriber-0.2.24)

---
updated-dependencies:
- dependency-name: tracing-subscriber
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-20 09:27:21 +00:00
kodiakhq[bot] c77f1ef4e2
Merge pull request #2564 from influxdata/crepererum/issue2518a
feat: delete catalog pres. catalog <=> in-mem catalog API
2021-09-20 09:24:27 +00:00
kodiakhq[bot] 140c71eaf0
Merge branch 'main' into crepererum/issue2518a 2021-09-20 09:16:39 +00:00
Raphael Taylor-Davies e96aa49390
feat: disable prometheus protobuf (#2578)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-20 09:16:04 +00:00
Raphael Taylor-Davies f62d0eab3c
feat: disable bytes serde (#2580)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-20 09:07:12 +00:00
Raphael Taylor-Davies 9fba7b0ba0
feat: remove routerify (#2586)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-20 08:57:19 +00:00