a0764cbafd
test: add failing replay test
2021-07-28 17:28:34 +02:00
29ddc36154
docs: state the reason for some replay tests
2021-07-28 17:28:34 +02:00
ca90e92ecc
fix: replay tests should not fail when awaiting on query results
2021-07-28 17:28:34 +02:00
ad68817513
Merge pull request #2138 from influxdata/cn/update-croaring
...
fix: Upgrade croaring to get a performance fix
2021-07-28 14:05:43 +00:00
cd0910c825
Merge branch 'main' into cn/update-croaring
2021-07-28 13:58:24 +00:00
8aa1e78139
Merge pull request #2115 from influxdata/crepererum/ingest_wallclock
...
feat: metric for ingest wall-clock time
2021-07-28 13:56:00 +00:00
7b73190d79
Merge branch 'main' into crepererum/ingest_wallclock
2021-07-28 13:49:08 +00:00
eb310ecada
fix: ensure that the Kafka producer TS we report is also truncated
2021-07-28 15:48:02 +02:00
a1fbac74d5
refactor: Tweak perf_build script ( #2121 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-28 13:47:18 +00:00
0fcec6b742
refactor: move ingest timestamp from sequence to sequended entry
2021-07-28 15:40:35 +02:00
754d647c06
feat: enable row timestamp metrics with environment variable ( #2135 )
...
* feat: enable row timestamp metrics with environment variable
* chore: fix test
* chore: fix typo
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-28 13:39:56 +00:00
e9f7cda62c
Merge pull request #2122 from influxdata/cn/first-last-write-catalog-chunk
...
feat: Make CatalogChunk first/last write times required
2021-07-28 13:29:04 +00:00
537e031987
fix: Upgrade croaring to get a performance fix
...
This release includes https://github.com/saulius/croaring-rs/pull/73 which
includes 6403d44cbe
2021-07-28 09:25:01 -04:00
8add00e761
feat: Make CatalogChunk first/last write times required
...
Connects to #1927 .
2021-07-28 09:22:06 -04:00
09e48018a0
refactor: Move ts_to_timestamp fn into the only file it's used in
2021-07-28 09:22:06 -04:00
7c9a21632b
refactor: Organize uses
2021-07-28 09:22:04 -04:00
d940d4f6d3
docs: explain how test timestamps are measured
2021-07-28 14:46:33 +02:00
7b1301851a
feat: metric for ingest wall-clock time
2021-07-28 14:41:18 +02:00
e736bc6953
feat: add ingest timestamp to `Sequence`
...
This allows us to track wall-clock ingest time for entries that we
receive via write buffer (e.g. Kafka).
2021-07-28 14:41:18 +02:00
7a389fc237
Merge pull request #2133 from influxdata/kafkasink
...
feat(iox): Quick&Dirty KafkaProducer sink implementation
2021-07-28 08:20:12 +00:00
ec0804900a
feat(iox): Quick&Dirty KafkaProducer sink implementation
...
RoutingRules such as RoutingConfig and ShardConfig use a sink to decide where to write
the entries.
The write buffer is currently implemented in the `db` and is accessed by using the `write_local_entry`
code path. This PR simply invokes that legacy code path whenever a "kafka" sink is selected.
This allows us immediately to benefit from the ability of the ShardingConfig to select or reject
tables and send some to kafka, some to devnull.
This PR does not allow us yet to split an input batch into mulitiple shards and send each
to a different kafka topic. For that, we'll need to pull out the write buffer code path out of
the `db` and do something similar to a ConnectionManager but for write buffers. TODO
2021-07-28 10:13:22 +02:00
4fdc9b2cab
feat: implement Arrow Flight handhake API ( #2131 )
...
* feat: implement Arrow Flight handhake API
* chore: satisfy clippy
2021-07-27 20:41:30 +00:00
6759bffefe
Merge pull request #2130 from influxdata/dom/datatypes-serde
...
feat: DatabaseRules (de)serialisation support
2021-07-27 16:15:56 +00:00
a71c934e96
Merge branch 'main' into dom/datatypes-serde
2021-07-27 16:08:09 +00:00
7d3b6bf80d
feat: DatabaseRules (de)serialisation support
...
Derives serde::Serialise & Deserialise for the DatabaseRules struct and
children.
2021-07-27 14:29:26 +01:00
657e769c8c
chore: add go_package to management protos ( #2126 )
2021-07-27 13:11:17 +00:00
3ea84c6be4
feat: expose null_counts in system.chunk_columns ( #2105 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-27 11:05:23 +00:00
201aead49d
Merge pull request #2120 from influxdata/devnull
...
feat: Add '/dev/null' sink
2021-07-27 10:04:15 +00:00
5551dd3a87
Merge branch 'main' into devnull
2021-07-27 09:57:16 +00:00
225650b98c
Merge pull request #2110 from influxdata/crepererum/improve_replay_tests
...
refactor: isolate replay code and improve tests
2021-07-27 07:34:47 +00:00
119b913fa3
Merge branch 'main' into crepererum/improve_replay_tests
2021-07-27 07:27:58 +00:00
7415fa0d05
fix: Convert panic --> `warn` on statistics mismatch ( #2125 )
2021-07-26 22:11:10 +00:00
6ae1ba57b9
Merge pull request #2106 from influxdata/jg/shorter-metrics-test-failures
...
test: Improve formatting of failures from the metrics AssertionBuilder
2021-07-26 20:34:16 +00:00
57ef52073f
Merge branch 'main' into jg/shorter-metrics-test-failures
2021-07-26 20:27:02 +00:00
5fb3e00f2a
fix: Properly record total_count and null_count in statistics ( #2103 )
...
* fix: Properly record total_count and null_count in statistics
* fix: fix statistics calculation in mutable_buffer
* refactor: expose null counts in read_buffer
* refactor: expose null_count in parquet_file
* fix: update server crate tests
* fix: update query_tests tests
* docs: tweak comments
* refactor: Use storage_stats rather than adding `null_count`
* refactor: rename test data field for clarity
* fix: fixup merge conflicts
* refactor: rename initial_non_null_count to initial_total_count
* refactor: caculate null_count as row_count - to_add
2021-07-26 18:13:36 +00:00
b6583f2edf
Merge pull request #2116 from influxdata/removedeprecated
...
refactor: Remove deprecated target field in RoutingConfig
2021-07-26 17:42:20 +00:00
fef67309bf
Merge branch 'main' into removedeprecated
2021-07-26 17:34:51 +00:00
094945a72d
feat: Add '/dev/null' sink
2021-07-26 19:19:11 +02:00
6b9d180ebc
Merge pull request #2119 from influxdata/er/chore/roaringivy
...
chore: target architecture with avx2
2021-07-26 16:52:24 +00:00
6528cab16f
Merge branch 'main' into er/chore/roaringivy
2021-07-26 17:38:18 +01:00
fd29d5ae05
chore: target architecture with avx2
2021-07-26 17:36:44 +01:00
d9e536bbe3
Merge pull request #2117 from influxdata/fixprintcpu
...
fix: Fix typo in print_cpu command name
2021-07-26 16:31:01 +00:00
16f867272d
fix: Fix typo in print_cpu command name
2021-07-26 17:55:52 +02:00
d7e0b03064
refactor: use `drop` instead of `Option`
2021-07-26 17:43:03 +02:00
2d5a095d2d
refactor: rename `ActionOrTest` to `Step`
2021-07-26 17:34:13 +02:00
5787fbdb21
refactor: rename framework tests
2021-07-26 17:32:46 +02:00
aa61eb2732
refactor: improve replay test naming and add more docs
2021-07-26 17:31:13 +02:00
2478547ad7
refactor: Remove deprecated target field in RoutingConfig
2021-07-26 17:29:39 +02:00
4def5bd816
chore: Add print_cpu command line to perf build ( #2114 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-07-26 15:26:34 +00:00
43cb148566
fix: docstring
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-07-26 17:14:01 +02:00
Marco Neumann
kodiakhq[bot]
Andrew Lamb
Raphael Taylor-Davies
Carol (Nichols || Goulding)
Marko Mikulicic
Jacob Marble
Dom
Edd Robinson