Commit Graph

5339 Commits (e911cf9ac172f09e3716d23bb8d0ec95c9a78c4c)

Author SHA1 Message Date
Raphael Taylor-Davies e911cf9ac1
refactor: make WriteBufferConfigFactory interior mutable (#2829)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-14 10:30:59 +00:00
Raphael Taylor-Davies d752b79cbe
fix: disable persistence during replay (#2812)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-14 08:41:10 +00:00
kodiakhq[bot] 0829711fe3
Merge pull request #2836 from influxdata/er/fix/storage_grpc/2697
fix: use correct timestamps for selectors in read_window_aggregate
2021-10-14 08:31:58 +00:00
Edd Robinson 693c878781 refactor: update test 2021-10-14 09:23:29 +01:00
Edd Robinson 8342e138b0 refactor: PR feedback
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-10-14 09:23:29 +01:00
Edd Robinson fcf31eebb2 fix: use correct timestamps for selectors 2021-10-14 09:23:29 +01:00
Edd Robinson 75caa4aad8 test: add test duplicating defect input 2021-10-14 09:23:29 +01:00
Andrew Lamb 0568452a0c
chore: Update datafusion (#2838)
* chore: update datafusion version

* refactor: Update to use new datafusion apis

* fix: do not upgrade other packages
2021-10-13 20:51:19 +00:00
Andrew Lamb e0929f20ae
refactor: Pull out read_group order creation (#2832) 2021-10-13 19:05:15 +00:00
kodiakhq[bot] e07461b250
Merge pull request #2824 from influxdata/crepererum/cleanup_pres_catalog_interace
refactor: clean up preserved catalog interface
2021-10-13 14:57:43 +00:00
kodiakhq[bot] a6ca469876
Merge branch 'main' into crepererum/cleanup_pres_catalog_interace 2021-10-13 14:49:02 +00:00
Andrew Lamb d2cf6fa9f7
docs: improve docstring for InfluxRPCPlanner::read_group (#2827)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-13 14:48:32 +00:00
Raphael Taylor-Davies 3c953cdf59
feat: improve legibility of task tracker logs (#2826)
* feat: improve legibility of task tracker logs

* feat: include start time

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-13 14:32:47 +00:00
Raphael Taylor-Davies ba829436d7
feat: restart Database (#2822) (#2825)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-13 14:23:20 +00:00
kodiakhq[bot] ed50c17114
Merge pull request #2809 from influxdata/ntran/grpc_delete
test: refactor to cover more test scenarios
2021-10-13 13:31:46 +00:00
kodiakhq[bot] 6d0c15da18
Merge branch 'main' into ntran/grpc_delete 2021-10-13 13:23:08 +00:00
Andrew Lamb b8ae7a8247
docs: Add observability context to documentation (#2814)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-13 13:22:31 +00:00
Marco Neumann 1523e0edcd refactor: clean up preserved catalog interface
1. Remove `new_empty` logic. It's a leftover from the time when the
   `PreservedCatalog` owned the in-memory catalog.
2. Make `db_name` a part of the `PreservedCatalogConfig`.
2021-10-13 13:58:11 +02:00
Raphael Taylor-Davies d390dfa280
feat: rework delete predicate preservation as integration test (#2820)
* feat: rework delete predicate preservation as integration test

* chore: review feedback

* chore: fix lint
2021-10-13 10:40:17 +00:00
Raphael Taylor-Davies f7f6965b65
feat: don't panic if `Db::compact_chunks` with no matching chunks (#2818) 2021-10-12 21:54:43 +00:00
Nga Tran 04468f3208 chore: more cleanup 2021-10-12 17:27:04 -04:00
Nga Tran f85d6d5da8 chore: cleanup 2021-10-12 17:23:01 -04:00
Nga Tran 401124548c chore: ignore failed newly added test due to bug 2021-10-12 17:20:17 -04:00
Raphael Taylor-Davies 8a82f92c5d
refactor: add TimeProvider abstraction (#2722) (#2815)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-12 21:19:03 +00:00
Nga Tran 144ce77e39 chore: merge main to branch 2021-10-12 15:59:57 -04:00
Nga Tran 459dd46ae9 refactor: move delete tests to .sql 2021-10-12 15:49:23 -04:00
Andrew Lamb 035654b4f9
refactor: do not rebuild query_test when .sql or .expected files change (#2816)
* feat: Do not rebuild query_tests if .sql or .expected change

* feat: Add CI check

* refactor: move some sql tests to .sql files

* tests: port tests / expected results to data files

* fix: restore old name check-flatbuffers
2021-10-12 19:34:54 +00:00
Raphael Taylor-Davies 5b69bb0d72
feat: reduce lifecycle lock scope (#2242) (#2810)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-12 17:34:16 +00:00
kodiakhq[bot] 974a64126a
Merge pull request #2806 from influxdata/crepererum/write_buffer_format_header
feat: add format header to Kafka messages
2021-10-12 15:57:51 +00:00
kodiakhq[bot] b726317ca0
Merge branch 'main' into crepererum/write_buffer_format_header 2021-10-12 15:48:35 +00:00
kodiakhq[bot] ccb30bd273
Merge pull request #2803 from influxdata/crepererum/trace_links
feat: ability to link other spans in span context
2021-10-12 14:54:36 +00:00
kodiakhq[bot] 545b5eccab
Merge branch 'main' into crepererum/trace_links 2021-10-12 14:45:15 +00:00
Marco Neumann 293620395e test: ensure jeager trace IDs integer conversion works 2021-10-12 16:44:25 +02:00
Raphael Taylor-Davies 8414e6edbb
feat: migrate preserved catalog to TimeProvider (#2722) (#2808)
* feat: migrate preserved catalog to TimeProvider (#2722)

* fix: deterministic catalog prune tests

* fix: failing test

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-12 14:43:05 +00:00
Marco Neumann f62d2d2277 refactor: `Vec::with_capacity(0)` => `vec![]`
`vec![]` also results in a capacity of 0, see
https://play.rust-lang.org/?version=stable&mode=debug&edition=2018&gist=184113a9afa945cf3cf3b8f854f4c5ce
2021-10-12 16:36:09 +02:00
Nga Tran 9b6726b99c refactor: rename to a more general name function 2021-10-12 10:34:55 -04:00
Marco Neumann 173f9aefcf feat: ability to link other spans in span context
This can be used when aggregating from multiple parent spans, e.g. when
we want to implement #1473.
2021-10-12 16:32:57 +02:00
Marco Neumann 90d2f1d60d refactor: use Kafka headers similar to HTTP 2021-10-12 16:31:06 +02:00
Marco Neumann b955ecc6a7 feat: add format header to Kafka messages
This allows us to transition to new formats in the future.
2021-10-12 16:31:06 +02:00
Andrew Lamb c31bcbced5
feat: Translate null in fields correctly to timeseries (Frames) (#2799)
* feat: Add gRPC frame dumping to trace output

* feat: Translate null in fields correctly to timeseries (Frames)

* refactor: reduce ceremony of iterating over data

* docs: Update src/influxdb_ioxd/rpc/storage/data.rs

* refactor: rename macro

* refactor: use .then()

* refactor: use try_for_each
2021-10-12 14:28:41 +00:00
Raphael Taylor-Davies 3dfe400e6b
feat: migrate write path to TimeProvider (#2722) (#2807) 2021-10-12 12:09:08 +00:00
Raphael Taylor-Davies 0554173684
feat: migrate write buffer to TimeProvider (#2722) (#2804)
* feat: migrate write buffer to TimeProvider (#2722)

* chore: review feedback

Co-authored-by: Marco Neumann <marco@crepererum.net>

Co-authored-by: Marco Neumann <marco@crepererum.net>
2021-10-12 10:32:34 +00:00
kodiakhq[bot] 62aa61026b
Merge pull request #2797 from influxdata/crepererum/write_buffer_sequencer_ids
feat: allow write buffer producers to read sequencer IDs
2021-10-12 10:04:59 +00:00
Marco Neumann 896ce03415 refactor: use sets and maps for write buffer sequencers
Use the type to reflect that entries are unique and sorted.
2021-10-12 11:13:09 +02:00
Marco Neumann 2e8af77e41 feat: allow write buffer producers to read possible sequencer IDs 2021-10-12 10:37:32 +02:00
Nga Tran 0b4ae95ca4 refactor: exhaust scenarios for one-chunk test 2021-10-11 17:47:41 -04:00
Raphael Taylor-Davies b39e01f7ba
feat: migrate PersistenceWindows to TimeProvider (#2722) (#2798) 2021-10-11 20:40:00 +00:00
Raphael Taylor-Davies 06c2c23322
refactor: create PreservedCatalogConfig struct (#2793)
* refactor: create PreservedCatalogConfig struct

* chore: fmt

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-11 15:43:05 +00:00
Marco Neumann 98f5711784
Merge pull request #2784 from influxdata/dependabot/cargo/cache_loader_async-0.1.2
chore(deps): bump cache_loader_async from 0.1.1 to 0.1.2
2021-10-11 17:32:51 +02:00
kodiakhq[bot] 05fe4701c1
Merge branch 'main' into dependabot/cargo/cache_loader_async-0.1.2 2021-10-11 15:20:28 +00:00