d6c0f40630
test: add read_group benchmark
2021-04-28 16:11:57 +00:00
5dfe312867
test: add benchmark for influxrpc read_filter
2021-04-28 16:11:57 +00:00
fedab46c7f
Merge pull request #1330 from influxdata/lifecycle_speed
...
feat: Make background task period configurable
2021-04-28 15:27:23 +00:00
d1e37c45a5
Merge branch 'main' into lifecycle_speed
2021-04-28 15:22:59 +00:00
96e1289c94
refactor: log time to create row group
2021-04-28 15:08:19 +00:00
c3b41649ee
refactor: use space saving compression
2021-04-28 15:08:19 +00:00
5e3d43d62f
fix: report row group rows correctly
2021-04-28 15:08:19 +00:00
91ee005ada
feat: Add multiple matchers to shard config
2021-04-28 17:02:58 +02:00
97f2d7acad
chore: fix usize 32-bit overflow
2021-04-28 13:51:47 +00:00
b6054f9df9
feat: Make background task period configurable
2021-04-28 15:47:31 +02:00
b6447a1363
Merge pull request #1336 from influxdata/alwayspush
...
feat: Build a perf_image image for every commit in main
2021-04-28 08:23:42 +00:00
756e1b769e
feat: Build a perf_image image for every commit in main
2021-04-28 10:12:34 +02:00
9b57214344
feat: move closing chunks as soon as possible ( #1329 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-28 07:50:15 +00:00
451b87a30e
Merge pull request #1320 from influxdata/crepererum/issue1219
...
docs: add design docs for catalog persistence
2021-04-28 07:38:06 +00:00
3ce3afe544
Merge branch 'main' into crepererum/issue1219
2021-04-28 07:33:43 +00:00
6b25bc3de6
feat: tests ffor loading data to object store and make sure twe still query read buffer
2021-04-27 18:01:21 -04:00
6bdc153361
feat: sort RUB (read buffer) chunks ( #1308 )
...
* feat: sort chunks before upserting to read buffer (#1216 )
* chore: review feedback
* chore: fix merge conflict
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-27 16:50:48 +00:00
7ca1da3fcd
feat: pushdown table and partition key predicates to catalog ( #736 ) ( #1327 )
...
* feat: catalog predicate pushdown (#736 )
* chore: fix lints
* chore: review comments
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-27 15:31:47 +00:00
2dd6371148
Merge pull request #1325 from influxdata/crepererum/ci_doc2
...
ci: pass `--document-private-items` to `cargo doc`
2021-04-27 13:49:30 +00:00
f3739599a9
Merge branch 'main' into crepererum/ci_doc2
2021-04-27 13:44:50 +00:00
91bccdfca3
ci: pass `--document-private-items` to `cargo doc`
2021-04-27 15:42:07 +02:00
108b4f9093
Merge pull request #1322 from influxdata/fixbuckets
...
fix: Histogram boundaries are durations not percentiles
2021-04-27 13:41:59 +00:00
2bbfd1d007
fix: Histogram boundaries are durations not percentiles
2021-04-27 15:19:09 +02:00
74927527b6
docs: add design docs for catalog persistence
...
Closes #1219 .
2021-04-27 15:18:41 +02:00
da7f933be2
Merge pull request #1321 from influxdata/crepererum/ci_doc
...
docs: deny broken intradoc links
2021-04-27 12:07:19 +00:00
e78a81ee59
Merge branch 'main' into crepererum/ci_doc
2021-04-27 12:03:04 +00:00
88a4c1403a
Merge pull request #1307 from influxdata/crepererum/issue1296
...
refactor: chunks shall always have data (= 1 table)
2021-04-27 12:02:40 +00:00
c3cb86fc1a
Merge branch 'main' into crepererum/issue1296
2021-04-27 11:58:10 +00:00
cf62ead1e2
Merge pull request #1323 from influxdata/disablecache
...
fix: Disable docker layer caching in CI
2021-04-27 11:53:53 +00:00
a9852c2257
fix: Disable docker layer caching in CI
2021-04-27 13:33:25 +02:00
2ee12298ef
ci: pass `--no-deps` to `cargo doc`
...
This should speed things up a bit.
2021-04-27 13:22:28 +02:00
eddc9319ff
docs: deny broken intradoc links
2021-04-27 13:22:28 +02:00
af031894a6
ci: run `cargo doc` in CI
...
This will prevent checking in broken docs.
2021-04-27 13:22:26 +02:00
20117de078
feat: string dictionary encoding ( #1220 ) ( #1262 )
...
* feat: string dictionary encoding (#1220 )
* chore: review comments
* chore: fix lint
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-27 09:36:58 +00:00
97a83320c1
Merge pull request #1316 from influxdata/debug
...
fix: Remove authorization header in middleware
2021-04-27 08:36:36 +00:00
c8594ce743
refactor: chunks shall always have data (= 1 table)
...
Chunks now always have "data" (aka exactly 1 table including
schema/columns). Open chunks can only be created with data. Rollovers do
NOT create open chunks anymore (this is now only done for incoming
data).
Closes #1296 .
2021-04-27 10:28:57 +02:00
b95491f723
fix: Remove authorization header in middleware
...
__Rationale__
Debug logs in the middle ware (and potentially elsewhere) can cause authorization headers
(containing authentication tokens) to be accidentally leaked in the logs.
It's easy to just remove those headers early in our HTTP middleware.
2021-04-27 09:57:06 +02:00
90c351770c
Merge pull request #1301 from influxdata/crepererum/throttled_store
...
feat: throttled stores
2021-04-27 07:39:42 +00:00
475f27d20d
Merge branch 'main' into crepererum/throttled_store
2021-04-27 07:35:08 +00:00
9633550cb8
fix: Log sha256sum before running docker build ( #1309 )
...
If the layer is cached, docker build won't print the output of the RUN command.
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-27 07:34:36 +00:00
c4a5e28bc1
feat: wire up throttled in-mem store
2021-04-27 09:31:48 +02:00
53e83f8385
feat: add throttled store wrapper
2021-04-27 09:31:48 +02:00
289332132c
feat: ingest_points_bytes_total records both success and errors ( #1312 )
...
__Rationale__
1. It's useful to know how much data we're throwing on the floor due to errors.
Common ingestion errors are "no such database" or "max hard size reached".
In both cases it's useful to be quickly able to gauge how much data would
be ingested once the limiting factor for ingestion is lifted (e.g. the database is created via
the management interface).
2. The name of the metric is `ingest_points_bytes_total` and the documentation states: `The number of bytes written`
It's confusing to only count successes while not mentioning this neither in the metric name,
nor in the metric description.
3. The sister metric `ingest_points_total` already records both successes and failures.
__Changes__
This PR adds a `status` tag to the `ingest_points_bytes_total`, mirroring what
we already do with `ingest_points_total`, so that both the overall total and the total successfully
ingested bytes can be counted.
2021-04-26 20:53:46 +00:00
35bc09ef7c
refactor: use `FromIter` rather than array builders to create system table arrays ( #1246 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-26 19:47:11 +00:00
84c863aeb0
refactor: remove unused PersistSegment job ( #1245 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-26 19:41:59 +00:00
934bc75855
fix: Remove PartialEq<u32> impls for ServerId, not really necessary
2021-04-26 18:44:32 +00:00
272cdb85ce
fix: Use the ServerId type everywhere, for writing, querying, anything
2021-04-26 18:44:32 +00:00
b8face3335
refactor: Organize use statements
2021-04-26 18:44:32 +00:00
bdb772b243
refactor: Alphabetize module declarations
2021-04-26 18:44:32 +00:00
67f5ad841d
refactor: Introduce ServerId and CurrentServerId types
2021-04-26 18:44:32 +00:00
Edd Robinson
kodiakhq[bot]
Marko Mikulicic
Jacob Marble
Raphael Taylor-Davies
Nga Tran
Marco Neumann
Andrew Lamb
Carol (Nichols || Goulding)
Jake Goulding