Commit Graph

3040 Commits (bba387d6fff2aea0f4d929d428041158c15989bc)

Author SHA1 Message Date
Andrew Lamb a64e622f6e
feat: Add interactive SQL repl (#1332)
* feat: Add interactive SQL repl

* fix: try and fix test

* fix: remove test for prompt

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-28 20:41:02 +00:00
Nga Tran 0ea8861a65 chore: fix merge that causes test failures 2021-04-28 16:38:29 -04:00
Nga Tran 2a2760bd18 feat: complete tests where data in both RUB and OS 2021-04-28 16:14:07 -04:00
Nga Tran 140d96dbea feat: tests ffor loading data to object store and make sure twe still query read buffer 2021-04-28 15:59:17 -04:00
Nga Tran 1f0b329ff9 feat: complete tests where data in both RUB and OS 2021-04-28 15:12:36 -04:00
kodiakhq[bot] a45e2174a5
Merge pull request #1346 from influxdata/cn/clock-value-never-0
fix: Validate that ClockValue is never 0
2021-04-28 18:37:01 +00:00
Carol (Nichols || Goulding) 9aefcd216f fix: Validate that ClockValue is never 0 2021-04-28 13:54:55 -04:00
kodiakhq[bot] ccaf981e75
Merge pull request #1344 from influxdata/cn/server-id-fix
fix: Validate ServerId when creating structs from flatbuffers
2021-04-28 17:23:38 +00:00
kodiakhq[bot] dcc732b154
Merge branch 'main' into cn/server-id-fix 2021-04-28 17:19:29 +00:00
Carol (Nichols || Goulding) 2f4d7189ff fix: Validate ServerId when creating structs from flatbuffers
When we get the flatbuffers, we won't have the server ID in addition to
the flatbuffers-- it's in the flatbuffers. But we want to validate the
`ServerId` once when the `SequencedEntry` is created so that its
`server_id` method can assume it has a valid `ServerId`.
2021-04-28 13:06:12 -04:00
Edd Robinson 4acbdcf1c9 refactor: address PR feedback 2021-04-28 16:11:57 +00:00
Edd Robinson c4259d5336 refactor: update benchmarks 2021-04-28 16:11:57 +00:00
Edd Robinson bc799c6cc0 refactor: remove channels from gRPC API 2021-04-28 16:11:57 +00:00
Edd Robinson a9ef604ef6 perf: avoid using channels for query execution
Pre-sized channels get full when the results to send over them are larger than the capacities. This causes significant runtime overhead and slows down query performance.

This commit removes the intermediate channels. The potential downside to this approach is there may be more buffering which could increase memory usage during query and also block a thread for longer periods of time.
2021-04-28 16:11:57 +00:00
Edd Robinson d6c0f40630 test: add read_group benchmark 2021-04-28 16:11:57 +00:00
Edd Robinson 5dfe312867 test: add benchmark for influxrpc read_filter 2021-04-28 16:11:57 +00:00
kodiakhq[bot] fedab46c7f
Merge pull request #1330 from influxdata/lifecycle_speed
feat: Make background task period configurable
2021-04-28 15:27:23 +00:00
kodiakhq[bot] d1e37c45a5
Merge branch 'main' into lifecycle_speed 2021-04-28 15:22:59 +00:00
Edd Robinson 96e1289c94 refactor: log time to create row group 2021-04-28 15:08:19 +00:00
Edd Robinson c3b41649ee refactor: use space saving compression 2021-04-28 15:08:19 +00:00
Edd Robinson 5e3d43d62f fix: report row group rows correctly 2021-04-28 15:08:19 +00:00
Marko Mikulicic 91ee005ada
feat: Add multiple matchers to shard config 2021-04-28 17:02:58 +02:00
Jacob Marble 97f2d7acad chore: fix usize 32-bit overflow 2021-04-28 13:51:47 +00:00
Marko Mikulicic b6054f9df9
feat: Make background task period configurable 2021-04-28 15:47:31 +02:00
kodiakhq[bot] b6447a1363
Merge pull request #1336 from influxdata/alwayspush
feat: Build a perf_image image for every commit in main
2021-04-28 08:23:42 +00:00
Marko Mikulicic 756e1b769e
feat: Build a perf_image image for every commit in main 2021-04-28 10:12:34 +02:00
Raphael Taylor-Davies 9b57214344
feat: move closing chunks as soon as possible (#1329)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-28 07:50:15 +00:00
kodiakhq[bot] 451b87a30e
Merge pull request #1320 from influxdata/crepererum/issue1219
docs: add design docs for catalog persistence
2021-04-28 07:38:06 +00:00
kodiakhq[bot] 3ce3afe544
Merge branch 'main' into crepererum/issue1219 2021-04-28 07:33:43 +00:00
Nga Tran 6b25bc3de6 feat: tests ffor loading data to object store and make sure twe still query read buffer 2021-04-27 18:01:21 -04:00
Raphael Taylor-Davies 6bdc153361
feat: sort RUB (read buffer) chunks (#1308)
* feat: sort chunks before upserting to read buffer (#1216)

* chore: review feedback

* chore: fix merge conflict

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-27 16:50:48 +00:00
Raphael Taylor-Davies 7ca1da3fcd
feat: pushdown table and partition key predicates to catalog (#736) (#1327)
* feat: catalog predicate pushdown (#736)

* chore: fix lints

* chore: review comments

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-27 15:31:47 +00:00
kodiakhq[bot] 2dd6371148
Merge pull request #1325 from influxdata/crepererum/ci_doc2
ci: pass `--document-private-items` to `cargo doc`
2021-04-27 13:49:30 +00:00
kodiakhq[bot] f3739599a9
Merge branch 'main' into crepererum/ci_doc2 2021-04-27 13:44:50 +00:00
Marco Neumann 91bccdfca3 ci: pass `--document-private-items` to `cargo doc` 2021-04-27 15:42:07 +02:00
kodiakhq[bot] 108b4f9093
Merge pull request #1322 from influxdata/fixbuckets
fix: Histogram boundaries are durations not percentiles
2021-04-27 13:41:59 +00:00
Marko Mikulicic 2bbfd1d007
fix: Histogram boundaries are durations not percentiles 2021-04-27 15:19:09 +02:00
Marco Neumann 74927527b6 docs: add design docs for catalog persistence
Closes #1219.
2021-04-27 15:18:41 +02:00
kodiakhq[bot] da7f933be2
Merge pull request #1321 from influxdata/crepererum/ci_doc
docs: deny broken intradoc links
2021-04-27 12:07:19 +00:00
kodiakhq[bot] e78a81ee59
Merge branch 'main' into crepererum/ci_doc 2021-04-27 12:03:04 +00:00
kodiakhq[bot] 88a4c1403a
Merge pull request #1307 from influxdata/crepererum/issue1296
refactor: chunks shall always have data (= 1 table)
2021-04-27 12:02:40 +00:00
kodiakhq[bot] c3cb86fc1a
Merge branch 'main' into crepererum/issue1296 2021-04-27 11:58:10 +00:00
kodiakhq[bot] cf62ead1e2
Merge pull request #1323 from influxdata/disablecache
fix: Disable docker layer caching in CI
2021-04-27 11:53:53 +00:00
Marko Mikulicic a9852c2257
fix: Disable docker layer caching in CI 2021-04-27 13:33:25 +02:00
Marco Neumann 2ee12298ef ci: pass `--no-deps` to `cargo doc`
This should speed things up a bit.
2021-04-27 13:22:28 +02:00
Marco Neumann eddc9319ff docs: deny broken intradoc links 2021-04-27 13:22:28 +02:00
Marco Neumann af031894a6 ci: run `cargo doc` in CI
This will prevent checking in broken docs.
2021-04-27 13:22:26 +02:00
Raphael Taylor-Davies 20117de078
feat: string dictionary encoding (#1220) (#1262)
* feat: string dictionary encoding (#1220)

* chore: review comments

* chore: fix lint

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-27 09:36:58 +00:00
kodiakhq[bot] 97a83320c1
Merge pull request #1316 from influxdata/debug
fix: Remove authorization header in middleware
2021-04-27 08:36:36 +00:00
Marco Neumann c8594ce743 refactor: chunks shall always have data (= 1 table)
Chunks now always have "data" (aka exactly 1 table including
schema/columns). Open chunks can only be created with data. Rollovers do
NOT create open chunks anymore (this is now only done for incoming
data).

Closes #1296.
2021-04-27 10:28:57 +02:00