Commit Graph

187 Commits (dac0db21960c871c298924269d198a8b01849724)

Author SHA1 Message Date
Andrew Lamb 087dbd3eca
fix: fix heappy + update docs (#4917)
* docs: Update heap profiling documentation

* fix: fix heappy builds

* fix: do not run cli tests with heappy

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-06-21 19:53:28 +00:00
Marco Neumann 66c7d95312
refactor: use new ingester<>querier wire protocol (#4867)
* refactor: use new ingester<>querier wire protocol

Use and document the new and more flexible ingester<>querier wire
protocol.

Note that the ingester does NOT stream the response data yet, but the
internal data structures would allow that. A follow-up change will
adjust the ingester code to stream the data.

Ref #4849.

* fix: typos

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

* refactor: clarify naming and public interface

* test: add schema assertion to `ingester_response_to_record_batches`

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
2022-06-16 08:02:28 +00:00
kodiakhq[bot] 6070421245
Merge branch 'main' into cn/chunk-updating 2022-06-06 12:46:30 +00:00
Ryan Russell 55f5d0ae11
docs: Improving Readability r2 (#4781)
* docs: Improve TOML readability

Signed-off-by: Ryan Russell <git@ryanrussell.org>

* docs: Fix `jemalloc` link

Signed-off-by: Ryan Russell <git@ryanrussell.org>

* docs: Readability in `point_generation.rs`

Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-06-04 16:46:57 +00:00
Carol (Nichols || Goulding) e1061ce623
docs: Don't attempt to list out chunk types exhaustively 2022-06-03 16:29:29 -04:00
Andrew Lamb c73011d4c4
docs: update logging (#4766)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-06-03 17:54:45 +00:00
Andrew Lamb 2e752157b9
docs: Clean up docs (#4764)
* docs: Remove outdated instructions for running OG

* docs: clarify docs / readme

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-06-03 14:21:14 +00:00
Ryan Russell d279deddad
docs(various): Improve Readability (#4768)
Signed-off-by: Ryan Russell <git@ryanrussell.org>

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-06-02 18:01:06 +00:00
Marco Neumann 52346642a0
ci: fix cargo deny (#4629)
* ci: fix cargo deny

* chore: downgrade `socket2`, version 0.4.5 was yanked

* chore: rename `query` to `iox_query`

`query` is already taken on crates.io and yanked and I am getting tired
of working around that.
2022-05-18 09:38:35 +00:00
Carol (Nichols || Goulding) 30e53fd09c
fix: Rename end-to-end NG tests to not contain NG
Connects to #4450.
2022-05-12 16:09:07 -04:00
Andrew Lamb b8bda5f84d
docs: Add docs for CLI (#4559)
* docs: Add docs for CLI

* fix: add todo

* fix: Update docs/cli.md

Co-authored-by: Nga Tran <nga-tran@live.com>

Co-authored-by: Nga Tran <nga-tran@live.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-11 15:51:34 +00:00
Carol (Nichols || Goulding) 72a8736cce
feat: Remove outdated OG docs (#4507)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-02 22:03:15 +00:00
YIXIAO SHI 1e38426484
docs: Update data_organization_lifecycle.md (#4456) 2022-04-29 13:19:26 +00:00
Nga Tran 5688bd63a3
docs: document for deduplication and sort key (#4452)
* docs: document for deduplication and sort key

* chore: Apply suggestions from code review

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: Luke Bond <luke.n.bond@gmail.com>
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* chore: Update query/src/provider.rs

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* chore: address review comments

* fix: fix comment

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: Luke Bond <luke.n.bond@gmail.com>
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-28 16:44:40 +00:00
Andrew Lamb fb75ef7b82
test: add end to end test for all in one mode, restructure fixture (#4114)
* test: add end to end test for all in one mode, restructure fixture

* docs: fix typos and clarify schema requrements
2022-03-24 12:53:25 +00:00
Raphael Taylor-Davies 80fb75d90b
feat: add a flag to enable per-partition tracing (#3928)
* feat: add a flag to enable per-partition tracing

* chore: rename constant

* feat: use BooleanFlag and cache result
2022-03-07 13:49:23 +00:00
Raphael Taylor-Davies bc1cc8dc5c
chore: update database rebuild instructions (#3838)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-02-23 17:46:22 +00:00
Raphael Taylor-Davies 479276b8cd
docs: document ingest flow (#3418)
* docs: document ingest flow

* chore: review feedback

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-01-07 17:37:30 +00:00
Raphael Taylor-Davies 5b71306423
chore: lint markdown docs and use relative code references in docs (#3420)
* chore: lint markdown docs

docs: relative source file references in markdown docs

* chore: review feedback
2022-01-04 09:50:13 +00:00
Nga Tran b943f176a0 fix: update diagram per review feedback 2021-12-20 14:00:53 -05:00
Nga Tran 0a2521c6cb
chore: Apply suggestions from code review
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-12-20 13:56:02 -05:00
Nga Tran f2e22bdb1c
chore: Apply suggestions from code review
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-12-20 13:55:07 -05:00
Nga Tran d2ea7a8eba
chore: Apply suggestions from code review
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-12-20 13:49:26 -05:00
Nga Tran e574c5e10f docs: add a reference 2021-12-20 09:50:54 -05:00
Nga Tran bd914c6727 fix: typos 2021-12-17 17:36:56 -05:00
Nga Tran 548653d934 docs: re structure the doc to reflect review comments 2021-12-17 17:18:06 -05:00
Nga Tran 218032c73b chore: Merge branch 'main' into ntran/doc_catalogs 2021-12-17 13:56:06 -05:00
Nga Tran 2091007c08 fix: title of next topic 2021-12-17 12:22:06 -05:00
Nga Tran 1c962b05a4 fix: address review comments 2021-12-17 12:18:28 -05:00
Nga Tran 8be572812d
chore: Apply suggestions from code review
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-12-17 11:23:20 -05:00
Nga Tran d36db7eea2 chore: cleanup 2021-12-15 17:29:33 -05:00
Nga Tran 36b2cb021d fix: typos 2021-12-15 17:26:52 -05:00
Nga Tran e877bc7033 docs: all 3 catalogs 2021-12-15 17:06:12 -05:00
Nga Tran fa98b89524 docs: in-memory catalog 2021-12-14 18:33:29 -05:00
Nga Tran 9d2020b906 fix: typo 2021-12-14 14:14:37 -05:00
Nga Tran 2e9362839f docs: initial verstion to test text color 2021-12-14 14:13:43 -05:00
Nga Tran e6e21746fa fix: remove a dot 2021-12-14 01:08:54 -05:00
Nga Tran 8e085e32f5 docs: link docs 2021-12-14 01:06:06 -05:00
Nga Tran 36e87d7b2e fix: typos 2021-12-14 00:45:12 -05:00
Nga Tran 888a807936 docs: explain LifeCycle 2021-12-14 00:23:34 -05:00
Nga Tran 12cb0b0df2 docs: Figure for Data LifeCycle 2021-12-13 22:45:41 -05:00
Nga Tran f73dc9998b docs: chunk stages 2021-12-13 21:24:18 -05:00
Nga Tran 1ffd5446b1 docs: chunk stypes and chunk stages 2021-12-13 15:30:28 -05:00
Nga Tran 6e44daabdc docs: make figure 1 smaller 2021-12-13 14:22:02 -05:00
Nga Tran 5b920fb877 docs: test footnote 2021-12-13 13:02:26 -05:00
Nga Tran 7c466d2851 docs: first draft of IOx Data Organization and Life Cycle 2021-12-13 12:52:39 -05:00
Nga Tran 6fce12079a docs: update tech talks 2021-12-10 16:07:45 -05:00
Andrew Lamb c6a3765d76
feat: Add force flag to RebuildCatalog (#3292)
* feat: Add force flag to RebuildCatalog

* fix: small cleanups

* docs: Update comments and add WARNING
2021-12-08 15:36:07 +00:00
Andrew Lamb d3be1c7afa
docs: Document how to import parquet files into a local database (#3264)
* docs: Document how to import parquet files into a local database

* docs: Update docs/server_startup.md

Co-authored-by: Edd Robinson <me@edd.io>

Co-authored-by: Edd Robinson <me@edd.io>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-01 20:12:53 +00:00
Raphael Taylor-Davies f650962221
refactor: merge CI integration tests (#3049)
* refactor: merge CI integration tests

* chore: update docs
2021-11-10 16:48:16 +00:00
Raphael Taylor-Davies 60f0deaf1e
feat: remove flatbuffer entry (#3045) 2021-11-05 20:19:24 +00:00
Marco Neumann 6e29cec502 refactor: rename `query` mode to `database` 2021-10-27 09:31:46 +02:00
Marco Neumann 41bc373fe8 refactor: offer different modes via "run" CLI
Running a server is now using `influxdb_iox run MODE [args]`, e.g.
`influxdb_iox run query --server-id 1`. Another mode that will follow
soon is `router`.

The old syntax `influxdb_iox run [args]` (w/o the mode part) is still
supported but a deprecation note will be printed.
2021-10-27 09:31:46 +02:00
Marco Neumann 93f6519c34 fix: address review comments 2021-10-26 10:09:34 +02:00
Andrew Lamb 92968222fe
docs: Add tech talk links to docs (#2858)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-15 21:44:41 +00:00
Andrew Lamb b8ae7a8247
docs: Add observability context to documentation (#2814)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-13 13:22:31 +00:00
Raphael Taylor-Davies 826d50f14a
chore: update tracing and logging docs (#2657)
* chore: update tracing and logging docs

* chore: review feedback

* chore: add log-format to basic usage section
2021-09-30 08:46:23 +00:00
Raphael Taylor-Davies db22b4bf60
chore: expand protobuf documentation (#2659)
* chore: expand protobuf documentation

* chore: review feedback

Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-29 21:22:03 +00:00
Marco Neumann bb94751d98 docs: add massif guide 2021-09-02 15:58:43 +02:00
Andrew Lamb 07b1722412
docs: Add local filesystem assumptions (#2410)
* docs: Add local filesystem assumptions

* docs: Update docs/local_filesystems.md

Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>

* docs: Clarify local filesystem is different than file based object store

* docs: clarify IOx may delete files

Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-28 10:34:34 +00:00
Marco Neumann 803d49648a feat: valgrind support 2021-08-23 09:30:36 +02:00
Jason Tianyi Wang 4f2503d92c
docs: Update system table schema in docs/sql.md (#2364)
* docs: Update system table schema in docs/sql.md

* docs: fix `Total row count by table` query

* docs: add a period to try and trigger CI

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
2021-08-22 10:59:43 +00:00
Marco Neumann 42d5f9f3a1 feat: skip replay via CLI 2021-08-16 13:47:07 +02:00
Nga Tran 0a79afc8c0 docs: metrics 2021-08-10 15:30:17 -04:00
Nga Tran 7191053899 docs: document Metrics 2021-08-06 17:12:00 -04:00
Andrew Lamb 2afc7e56ae
docs: add writeup on how to use IOx server from source (#2220)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-06 21:04:44 +00:00
Andrew Lamb 3fd6430fb6
fix: rename `estimated_bytes` to `memory_bytes` and expose `object_store_bytes` in ChunkSummary and system.chunks (#2017)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-15 16:00:24 +00:00
Andrew Lamb 3bb32594ba
refactor: rename end-to-end.rs to end_to_end.rs (#2015)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-15 13:50:32 +00:00
Andrew Lamb 0442991e45
docs: Add links to latest tech talks (#2013)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-15 13:10:49 +00:00
Marko Mikulicic fba64a41f5
docs: improve profiling docs (#1869)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-02 10:47:13 +00:00
Carol (Nichols || Goulding) 44c2c0c763 docs: Recommend pulling latest docker image first 2021-06-21 09:41:36 -04:00
Carol (Nichols || Goulding) 135d885ca5 docs: Clarify the differences between the two ways to run the Kafka integration tests 2021-06-21 09:41:36 -04:00
Carol (Nichols || Goulding) b4644e6108 test: Start of Kafka Write Buffer integration tests 2021-06-21 09:41:35 -04:00
Marco Neumann cb09762067 docs: document server startup and error recovery 2021-06-21 10:26:52 +02:00
Andrew Lamb 4f81573f5f
docs: add query for computing time ranges to cookbook (#1620)
* docs: add query for computing time ranges to cookbook

* fix: add note about nanosecond conversion

* fix: Update docs/sql.md

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-04 14:59:05 +00:00
Marco Neumann 1cbe4031d3 feat: allow passing a session token to AWS stores 2021-05-27 11:53:12 +02:00
Andrew Lamb 41093b54d6
docs: tweak profiling.md (#1526) 2021-05-19 17:04:59 +00:00
Andrew Lamb 9b42c1a065
docs: Document how to use pprof tool (#1520) 2021-05-19 13:57:50 +00:00
DCjanus 9eb658eac5 feat: s3 compatibility storages support 2021-05-06 23:27:37 +08:00
Andrew Lamb 884baf7329
feat: add column_type and influxdb_column_type, remove row_count from system.columns (#1415)
* feat: add column_type and influxdb_column_type, remove row_count from system.columns

* fix: update tests

* fix: more test update

* fix: Apply suggestions from code review

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>

* fix: fmt

* fix: copy/paste type conversion to avoid cross dependency between data_types and internal_types

Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-05-06 12:59:30 +00:00
Raphael Taylor-Davies 10f89a3e8d
refactor: split entry out into separate crate (#1428)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-06 11:36:23 +00:00
Marco Neumann 1269b5e3f0 docs: adjust catalog preservation design to implementation
For #1253.
2021-05-03 10:04:35 +02:00
Andrew Lamb c64f25e777
feat: Add `OBSERVER` mode to SQL repl along with SQL primer / cookbook (#1349)
* feat: add OBSERVER command to repl

* fix: fixup test

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-29 11:47:25 +00:00
Marco Neumann 74927527b6 docs: add design docs for catalog persistence
Closes #1219.
2021-04-27 15:18:41 +02:00
Carol (Nichols || Goulding) d8a92a8570 test: Don't run any integration tests unless TEST_INTEGRATION is set 2021-04-22 14:21:50 -04:00
Carol (Nichols || Goulding) 80995afb70 fix: Change WAL to Write Buffer in comments and documentation 2021-04-21 17:43:03 +00:00
Carol (Nichols || Goulding) ce645262c6 fix: Rename LOCAL env var to INFLUXDB_IOX_INTEGRATION_LOCAL 2021-04-21 14:59:08 +00:00
Carol (Nichols || Goulding) 731c586e46 docs: Make a sentence clearer 2021-04-21 14:59:08 +00:00
Carol (Nichols || Goulding) 5f85ad3ba1 docs: Bring markdown about flatbuffers in line with script's docs, mention LOCAL=1 2021-04-21 14:59:08 +00:00
Carol (Nichols || Goulding) 96afb25d1a test: Run influxd in docker by default for integration tests 2021-04-21 14:59:08 +00:00
Andrew Lamb 6d0467277b
docs: update multi core design doc (#1197)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-04-13 21:56:36 +00:00
Edd Robinson 0f53ba8d9a docs: improve flatc install 2021-04-12 20:16:18 +00:00
Carol (Nichols || Goulding) d84f05b2f5 chore: Revert "Merge pull request #1159 from influxdata/er/flatbuffers"
This reverts commit 0efc1d8174, reversing
changes made to a3e04fecc1.
2021-04-09 17:25:59 +00:00
Edd Robinson 10304bdcd8 docs: improve flatc install 2021-04-08 22:16:29 +01:00
Carol (Nichols || Goulding) ebb6bbd13c test: start of integration tests of influxdb2 client against influxdb 2.0 OSS 2021-04-07 14:09:39 -04:00
Carol (Nichols || Goulding) 39c07829bd chore: Remove outdated documentation about testing iox client crate
Looks like the type of integration testing referenced in the docs
deleted here was removed in 51981c9.
2021-04-07 14:09:39 -04:00
Carol (Nichols || Goulding) 4e25147062
docs: Codify our preference for no return type in test functions (#1116)
* docs: Copy edit existing style guide

I can't help myself.

* docs: Codify our preference for no return type in test functions
2021-04-05 18:12:51 +00:00
Marko Mikulicic cd94544e93 feat: Add prototxt script 2021-03-26 12:40:56 +00:00
Carol (Nichols || Goulding) c47a252c15 feat: Check in generated WAL flatbuffers code 2021-03-22 09:38:59 -04:00
Andrew Lamb f542d6216e fix: Update docs/README.md
Co-authored-by: Paul Dix <paul@influxdata.com>
2021-03-12 20:02:34 +00:00