influxdb/querier/src
Marco Neumann 21e8fcad25
feat: rework cache refresh logic (#5886)
* feat: rework cache refresh logic

Instead of issuing a single refresh when a GET request for a cached key
comes in, start a background job (using some efficient logic to not
overload tokio) per key that refreshes the key using some exponential
backoff. The timer is reset a new GET request comes in. This has the
following advantages:

- our backoff logic decorrelates the requests
- the longer a key was not used, the less often it will be updated

All test (esp. integration tests) as adjusted accordingly, mostly to
account for the fact that no extra GET is required to start the refresh
timer.

Closes #5720.

* docs: improve

Co-authored-by: Andrew Lamb <alamb@influxdata.com>

* refactor: simplify rng overwrite

Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2022-10-19 16:01:39 +00:00
..
cache feat: rework cache refresh logic (#5886) 2022-10-19 16:01:39 +00:00
chunk refactor: prep work for #5897 (#5907) 2022-10-19 11:54:42 +00:00
ingester fix: reduce verbosity from `INFO querier::ingester: Time spent in ...` to `DEBUG` (#5913) 2022-10-19 15:09:28 +00:00
namespace refactor: avoid some clones while caching ns schema (#5896) 2022-10-19 06:28:15 +00:00
system_tables chore: Update datafusion again (#5855) 2022-10-13 19:18:57 +00:00
table refactor: remove querier chunk load settings (#5888) 2022-10-18 10:22:46 +00:00
database.rs refactor: remove querier chunk load settings (#5888) 2022-10-18 10:22:46 +00:00
handler.rs feat: read from parquet and only parquet (#5879) 2022-10-18 10:09:48 +00:00
lib.rs refactor: remove querier chunk load settings (#5888) 2022-10-18 10:22:46 +00:00
poison.rs fix: Move top-level allow dead code in querier to specific items 2022-05-06 16:58:03 -04:00
query_log.rs ci: fix cargo deny (#4629) 2022-05-18 09:38:35 +00:00
server.rs feat: Interrogate schema from querier (as well as router) (#4557) 2022-05-10 20:55:58 +00:00
tombstone.rs fix: Rename KafkaPartition to ShardIndex 2022-08-29 14:07:18 -04:00