Carol (Nichols || Goulding)
09ad30cbfd
fix: For dumping a db catalog, look up db location in server config first
...
Rather than requiring the user of this command to know the database UUID
or otherwise having the knowledge of how to construct a database object
store location in this debugging command.
2021-10-28 13:20:28 -04:00
Carol (Nichols || Goulding)
4a225cf913
fix: Change database paths to use UUIDs instead of name
...
This commit changes the iox_object_store crate only; the implications of
these changes are handled in following commits.
Connects to #2675 .
2021-10-28 13:20:28 -04:00
Carol (Nichols || Goulding)
f160712f5e
fix: Remove the concept of generations
...
From iox_object_store and everywhere that fails to compile as a result.
Also make path handling in iox_object_store a bit more consistent.
2021-10-28 13:20:28 -04:00
Carol (Nichols || Goulding)
80f04e8fec
docs: Move crate documentation to top of lib.rs
2021-10-28 13:20:28 -04:00
Carol (Nichols || Goulding)
eeb017990d
fix: Add missing features to object_store crate to enable running tests separately
2021-10-28 13:20:28 -04:00
Carol (Nichols || Goulding)
8198c1ff2a
refactor: Rename IoxObjectStore constructors to better match what server does with Databases
2021-10-28 13:20:27 -04:00
Marco Neumann
641c7b3051
refactor: make `influxdb_ioxd` server-type-generic
2021-10-28 17:38:06 +02:00
kodiakhq[bot]
94368c339c
Merge pull request #2976 from influxdata/crepererum/run_modes_boilerplate2
...
refactor: make gRPC server code reusable
2021-10-28 14:39:34 +00:00
Marco Neumann
9996cfc6b3
fix: things I forgot to rename
2021-10-28 16:33:03 +02:00
Marco Neumann
9cd3dfb624
refactor: make gRPC server code reusable
...
Sadly `tonic` is a bit of a type nightmare (see
<23c1392fb7/tonic/src/transport/server/mod.rs (L452-L470)
>
). So I wasn't able to pull into a simple "add all your
services"-function. Instead the server type now builds its own gRPC
server but relies on some helper macros to for common functionality.
2021-10-28 13:19:24 +02:00
kodiakhq[bot]
079ac5cc4b
Merge pull request #2971 from influxdata/crepererum/run_modes_boilerplate
...
refactor: abstract HTTP inteface for different run modes
2021-10-28 09:25:21 +00:00
Marco Neumann
a6e0a069cc
refactor: rename "run mode" to "server type"
2021-10-28 11:16:41 +02:00
Marco Neumann
843551d291
docs: improve
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-10-28 11:16:41 +02:00
Marco Neumann
c465d0af8f
refactor: abstract HTTP inteface for different run modes
...
First iteration of a common interface for the different server run
modes. This splits the existing HTTP server into a part that can be used
by all run modes (e.g. health checks, metrics endpoint, profiling) and a
part that is specific to the the database run mode.
Note that the interface is not final and might require more iterations,
but we have to start somewhere.
2021-10-28 11:16:41 +02:00
Raphael Taylor-Davies
ec07c11d36
feat: add PartitionWrite ( #2724 ) ( #2974 )
...
* feat: add PartitionWrite (#2724 )
* chore: review feedback
2021-10-28 06:18:10 +00:00
Raphael Taylor-Davies
3010ff4176
feat: write entry to MutableBatch ( #2972 )
...
* feat: write entry to MutableBatch
* feat: error on empty TableBatch
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-27 14:05:22 +00:00
kodiakhq[bot]
4e49c3bf72
Merge pull request #2951 from influxdata/ntran/group
...
fix: read_group now returns nothing for empty table (with or without soft delete data)
2021-10-27 13:15:26 +00:00
Nga Tran
b397a6b03c
Merge branch 'main' into ntran/group
2021-10-27 09:09:10 -04:00
Raphael Taylor-Davies
9516b0b81a
feat: fuzz test mutable batch ( #2970 )
...
* feat: fuzz test mutable batch
* chore: review feedback
* chore: fmt
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-27 12:57:32 +00:00
kodiakhq[bot]
7fa7a3091e
Merge pull request #2967 from influxdata/crepererum/prepare_run_mode_cli
...
refactor: offer different modes via "run" CLI
2021-10-27 11:10:48 +00:00
kodiakhq[bot]
6ebca13ed7
Merge branch 'main' into crepererum/prepare_run_mode_cli
2021-10-27 11:04:07 +00:00
Marko Mikulicic
d5f1d52221
Merge pull request #2969 from influxdata/size_histogram
...
feat: Add LP batch size histogram metric
2021-10-27 12:34:09 +02:00
Marko Mikulicic
cdc0c63cb7
feat: Add LP batch size histogram metric
...
Part of #2752
2021-10-27 12:14:48 +02:00
Raphael Taylor-Davies
aafc618337
fix: PackedStringArray extend_from ( #2968 )
...
* fix: PackedStringArray extend_from
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-27 08:07:51 +00:00
Marco Neumann
6e29cec502
refactor: rename `query` mode to `database`
2021-10-27 09:31:46 +02:00
Marco Neumann
41bc373fe8
refactor: offer different modes via "run" CLI
...
Running a server is now using `influxdb_iox run MODE [args]`, e.g.
`influxdb_iox run query --server-id 1`. Another mode that will follow
soon is `router`.
The old syntax `influxdb_iox run [args]` (w/o the mode part) is still
supported but a deprecation note will be printed.
2021-10-27 09:31:46 +02:00
kodiakhq[bot]
6760212e86
Merge branch 'main' into ntran/group
2021-10-26 21:25:57 +00:00
Nga Tran
5c2a5e1030
fix: fmt after appying review comments
2021-10-26 17:17:35 -04:00
Nga Tran
6950e7a9b6
chore: Apply suggestions from code review
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-10-26 17:08:07 -04:00
Nga Tran
7b3b92b161
chore: make comments clearer
2021-10-26 16:52:45 -04:00
Nga Tran
682499d4a7
chore: make comments clearer
2021-10-26 16:50:27 -04:00
Nga Tran
8c43b24745
chore: cleanup
2021-10-26 16:46:50 -04:00
Nga Tran
46cb4df14d
fix: now no rows will be return for read_group if the table has no data or all its data is soft deleted or the table does not exist
2021-10-26 16:40:36 -04:00
Marco Neumann
5451a49620
fix: flaky `test_query_cancellation_slow_store` ( #2966 )
2021-10-26 15:58:28 +00:00
kodiakhq[bot]
f19d53c714
Merge pull request #2965 from influxdata/crepererum/workspace_cleanups
...
chore: flatten workspace
2021-10-26 09:35:48 +00:00
Marco Neumann
fc651ea193
chore: move `gprc-router-test-gen` to top level
2021-10-26 11:02:33 +02:00
Marco Neumann
a0cdca7781
chore: move `influxdb_iox` into a proper workspace package
2021-10-26 11:02:33 +02:00
kodiakhq[bot]
23fa85994e
Merge pull request #2960 from influxdata/crepererum/no_kafka_end2end
...
test: remove Kafka from end2end tests
2021-10-26 08:17:44 +00:00
Marco Neumann
3af1504ed2
fix: race condition in file-based write buffer
2021-10-26 10:09:34 +02:00
Marco Neumann
93f6519c34
fix: address review comments
2021-10-26 10:09:34 +02:00
Marco Neumann
2833cefc12
test: remove Kafka from end2end tests
...
Kafka is now sufficiently tested via the `write_buffer` crate. The
end2end tests can now use the in-memory mock implementation or -- if
servers can only be controlled via CLI -- the file-based implementation.
2021-10-26 10:09:34 +02:00
Marco Neumann
d527775aec
feat: allow gaps in file-based WB + improve error handling
2021-10-26 10:09:34 +02:00
kodiakhq[bot]
e47e9bd86f
Merge pull request #2963 from influxdata/crepererum/cleanup_main_binary
...
refactor: clean up main crate a bit
2021-10-26 08:07:10 +00:00
kodiakhq[bot]
b389eba98d
Merge branch 'main' into crepererum/cleanup_main_binary
2021-10-26 07:59:37 +00:00
kodiakhq[bot]
baf756ff7d
Merge pull request #2933 from influxdata/er/fix/flux/2691
...
fix: correctly handle field projections based on _value expressions
2021-10-25 21:03:27 +00:00
Andrew Lamb
39b3b8d33f
fix: Logical merge conflicts
2021-10-25 13:47:10 -04:00
Andrew Lamb
7cd56cbc56
Merge remote-tracking branch 'origin/main' into er/fix/flux/2691
2021-10-25 13:41:08 -04:00
Marco Neumann
66be42dc0b
refactor: move structopt-related code to common module
2021-10-25 18:36:34 +02:00
Marco Neumann
81ccf85104
refactor: integrate print-cpu into main binary
...
It's a less confusing structure and also allows us to have this
information available in our shipped binary.
2021-10-25 18:29:32 +02:00
Marco Neumann
7f3753f4ce
refactor: move dump-catalog command into its own file
2021-10-25 18:15:14 +02:00