Commit Graph

2769 Commits (9eb658eac5ee6814574baf0b0fd79bbc6d3b3dca)

Author SHA1 Message Date
Andrew Lamb 57616c3d16
feat: implement --format and `SET FORMAT <pretty,csv,json>` in SQL repl (#1404)
* feat: add `set format` and --format flag to sql REPL

* fix: fmt

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-04 17:02:10 +00:00
Edd Robinson 9aa144e0f4 feat: add per-stage current chunk storage 2021-05-04 17:43:53 +01:00
Andrew Lamb f36f1efeeb
feat: add row counts to SQL repl output (#1405)
* feat: add row counts to repl

* fix: fmt

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-04 10:57:16 +00:00
Andrew Lamb 3b7c5ac350
fix(storage rpc): do not send back tags with empty values (#1403) 2021-05-04 10:35:24 +00:00
kodiakhq[bot] 8374dc3176
Merge pull request #1386 from influxdata/crepererum/issue1253
feat: implement transaction handling for catalog
2021-05-03 11:16:16 +00:00
kodiakhq[bot] ce568b4b2f
Merge branch 'main' into crepererum/issue1253 2021-05-03 11:11:42 +00:00
kodiakhq[bot] 3a5c1dc03b
Merge pull request #1394 from influxdata/jemalloc-stats
feat: Add jemalloc stats
2021-05-03 10:26:05 +00:00
Marko Mikulicic b579ef8646
feat: Add jemalloc stats 2021-05-03 12:10:48 +02:00
Marco Neumann 1269b5e3f0 docs: adjust catalog preservation design to implementation
For #1253.
2021-05-03 10:04:35 +02:00
Marco Neumann 136c35cb88 feat: implement transaction handling for catalog
Closes #1253.
2021-05-03 10:04:35 +02:00
Marco Neumann ab142efdd3 feat: add protobuf types for preserved catalog
This only includes a minimal type structure to get the transaction layer
going and tested.

See issue #1253.
2021-05-03 09:51:00 +02:00
Marco Neumann 1f5a9b5ebf feat: make DirsAndFileName members public
Helps with #1253.
2021-05-03 09:51:00 +02:00
Marco Neumann ca5351088a feat: add Path->DirsAndFileName conversion
This allows for easier parsing of received paths.

Helps with #1253.
2021-05-03 09:51:00 +02:00
kodiakhq[bot] a2fd01e388
Merge pull request #1399 from influxdata/ntran/unload_chunks
feat: unload chunks from read buffer but keep them in object store
2021-04-30 22:08:00 +00:00
kodiakhq[bot] 3c5595d046
Merge branch 'main' into ntran/unload_chunks 2021-04-30 22:02:38 +00:00
kodiakhq[bot] 2c07edd9bb
Merge pull request #1398 from influxdata/pd-refactor-wal
refactor: write buffer to use sequenced entry and new segment
2021-04-30 21:05:02 +00:00
Paul Dix 979f5f9347 refactor: write buffer to use sequenced entry and new segment
This refactors the write buffer to use the sequenced entry structure and the new segment definition. It removes the old replicated write and write_buffer.fbs.

Finally, it updates the SequencedEntry wrapper type around the Flatbuffer structure to be a trait so that SequencedEntry can be initialized from a borrowed Flatbuffer or an owned Vec<u8>.

How writes go into segments in the buffer and any kind of validation will likely have to be updated based on what kinds of guarantees we want to make in the buffer. However, that should probably come after we've rethought the design a bit around the new layout of chunks in the Parquet persistence.
2021-04-30 17:00:23 -04:00
Raphael Taylor-Davies a967ebfabd
refactor: rename closing to closed (#1396)
* refactor: rename closing to closed

* refactor: further renames
2021-04-30 20:59:45 +00:00
Nga Tran 34a3388a49 feat: unload chunks from read buffer but keep them in object store 2021-04-30 16:12:02 -04:00
Raphael Taylor-Davies c2f7e7efea
feat: warn on dropping from open partition (#1395)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-30 18:56:49 +00:00
Andrew Lamb da440d8d27
feat: add a id() method to `management::Operations` (#1385)
* feat: add Operation::id()

* feat: add a id() method to Operations management client

* fix: broken doc link
2021-04-30 17:09:28 +00:00
kodiakhq[bot] d74aebbc5e
Merge pull request #1393 from influxdata/memgauge
feat: Add user provided callback to Gauge
2021-04-30 15:27:31 +00:00
Marko Mikulicic 73700d767a
feat: Add user provided callback to Gauge 2021-04-30 17:22:52 +02:00
kodiakhq[bot] d8c3140961
Merge pull request #1392 from influxdata/er/feat/gauge_up_down
feat: allow gauges to be increased or decreased
2021-04-30 13:52:02 +00:00
kodiakhq[bot] 72490219e7
Merge branch 'main' into er/feat/gauge_up_down 2021-04-30 13:47:38 +00:00
Edd Robinson 028e7f2aa6 refactor: change gauge to f64 2021-04-30 14:32:00 +01:00
kodiakhq[bot] d1fb8b1f87
Merge pull request #1391 from influxdata/er/refactor/tidy_metrics
refactor: include default labels
2021-04-30 13:29:17 +00:00
Edd Robinson 778bf39705 feat: add support for add/sub on gauges 2021-04-30 14:28:16 +01:00
Edd Robinson ebe671e59e refactor: include default labels 2021-04-30 14:03:09 +01:00
kodiakhq[bot] f0cca59f20
Merge pull request #1390 from influxdata/gauge
feat: Add gauge metric
2021-04-30 12:15:20 +00:00
Marko Mikulicic 234c899631
feat: Add gauge metric 2021-04-30 14:10:42 +02:00
Andrew Lamb 40b9b09cdc
refactor: rename assert_table_eq to assert_batches_eq (#1368) 2021-04-30 10:51:08 +00:00
Andrew Lamb eb8d91cf1c
refactor: remove additional uses of RecordBatch::try_new (#1378)
* refactor: remove additional uses of RecordBatch::try_new

* fix: fix accidental change

* fix: clippy

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-30 10:24:47 +00:00
kodiakhq[bot] 11562305b4
Merge pull request #1388 from influxdata/mkmik-patch-1
docs: Fix typo in comment
2021-04-29 22:30:55 +00:00
kodiakhq[bot] e545ea4acb
Merge branch 'main' into mkmik-patch-1 2021-04-29 22:26:11 +00:00
kodiakhq[bot] 9fea1d56be
Merge pull request #1348 from influxdata/ntran/test_query_parquets
feat: tests for cases when data are in both RUB and OS
2021-04-29 22:25:41 +00:00
Marko Mikulicic 8da332c19c
docs: Fix typo in comment 2021-04-29 23:38:09 +02:00
Nga Tran c9b33c6b7d chore: Merge branch 'main' into ntran/test_query_parquets 2021-04-29 14:22:34 -04:00
Nga Tran f89d56af8a chore: merge mian to branch 2021-04-29 14:14:04 -04:00
Andrew Lamb 2d643d4407
fix: set nullability correctly for system tables (#1387) 2021-04-29 18:09:27 +00:00
Nga Tran e87973babe refactor: address review comments 2021-04-29 13:15:43 -04:00
kodiakhq[bot] 216cde8268
Merge pull request #1377 from influxdata/er/feat/chunk_size_metric
feat: add chunk size histogram
2021-04-29 16:16:50 +00:00
Edd Robinson ea476c86be feat: add chunk size histogram 2021-04-29 17:10:57 +01:00
Marko Mikulicic 938a4027e5
Merge pull request #1384 from influxdata/typo2
docs: Fix typo
2021-04-29 18:10:12 +02:00
Marko Mikulicic bf83c9155e
docs: Fix typo 2021-04-29 18:09:00 +02:00
kodiakhq[bot] 1bcab9751b
Merge pull request #1383 from influxdata/fix-perf-image-tag
fix(ci): Push each image into its own tag
2021-04-29 15:59:35 +00:00
Marko Mikulicic 6b42c9a5ea
fix(ci): Push each image into its own tag
Using the git sha as the tag
2021-04-29 17:54:09 +02:00
Andrew Lamb 5ef9be4abd
refactor: use RecordBatch::try_from_iter to make system tables (#1374)
* refactor: use RecordBatch::try_from_iter to make system tables

* fix: clippy
2021-04-29 15:32:35 +00:00
Andrew Lamb 0788892413
feat: add row_count to system.chunks and Chunk managment API (#1373)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-29 13:53:25 +00:00
kodiakhq[bot] ef62d8b795
Merge pull request #1371 from influxdata/er/feat/grpc_metrics
feat: add instrumentation via RED metrics in gRPC API
2021-04-29 13:21:49 +00:00