e5bfa08910
feat: disallow unsequenced deletes when reading from write buffer
...
Similar to how writes to a databases that reads from a write buffer are
forbidden deletes should be rejected as well.
2021-11-26 11:40:08 +01:00
22936abb23
refactor: remove connection manager and resolver from `Server`
2021-11-26 11:00:19 +01:00
0e06026fbd
refactor: remove write routing logic from `Server`
...
API users should use `Database` instead, there's no need any longer to mirror
this API in `Server`. Note that `Database` is better than `Db` in this
case, because the former can also check if we're writing from a write
buffer and can easily reject unsequenced writes. The `pub` modifiers
were adjusted to make it impossible to write through `Db` directly.
2021-11-26 09:26:43 +01:00
4e7e9f6fc9
chore: Merge branch 'ntran/compact_os_blocks' of https://github.com/influxdata/influxdb_iox into ntran/compact_os_blocks
2021-11-23 16:56:59 -05:00
b2b033f00c
chore: rerun fmt after merging
2021-11-23 16:56:38 -05:00
1d1622efa3
Merge branch 'main' into ntran/compact_os_blocks
2021-11-23 21:47:05 +00:00
ade7ea6cfb
chore: Merge branch 'ntran/compact_os_blocks' of https://github.com/influxdata/influxdb_iox into ntran/compact_os_blocks
2021-11-23 16:44:48 -05:00
a0fb6a4758
chore: cleanup
2021-11-23 16:44:30 -05:00
4fc09484ed
chore: Apply suggestions from code review
...
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2021-11-23 16:43:12 -05:00
4e28b4c43b
refactor: address review comments
2021-11-23 16:39:45 -05:00
e64ac10c40
refactor: address review comments and compute max checkpoints
2021-11-23 15:32:46 -05:00
42e3a41825
fix: flaky test_chunk_access_time ( #3197 ) ( #3200 )
...
* fix: flaky test_chunk_access_time (#3197 )
* chore: fix lint
Co-authored-by: Edd Robinson <me@edd.io>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-23 17:39:57 +00:00
bfa4bfe735
refactor: lifecycle observability cleanup ( #2286 ) ( #3189 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-23 15:42:24 +00:00
f9110eecad
test: migrate `DistibutedTest` to use proper router
2021-11-23 15:39:53 +01:00
124f5bb4c5
chore: make comments clearer
2021-11-22 23:30:18 -05:00
8788dd6d39
chore: fix comment
2021-11-22 23:24:28 -05:00
3182e935ed
chore: cleanup
2021-11-22 23:22:34 -05:00
06aba60068
feat: another piece: tests for contiguous chunks and read IOx metadata to get checkpoints
2021-11-22 23:15:20 -05:00
29aaafe808
Merge branch 'main' into ntran/compact_os_catalog
2021-11-22 19:19:57 +00:00
5e45c5a349
refactor: add meessage to assert
2021-11-22 13:28:08 -05:00
731dee4e91
refactor: address review comments
2021-11-22 13:18:54 -05:00
d16a7759ca
Merge branch 'main' into cn/workspace-hack
2021-11-22 17:05:31 +00:00
b5d6e201e6
Merge branch 'main' into ntran/compact_os_framework
2021-11-22 15:17:13 +00:00
09fd25d28e
refactor: address to cleanup-lock issue
2021-11-22 10:15:43 -05:00
0b55cee5f2
feat: skip applying deletes to persisted chunks during replay ( #3125 ) ( #3153 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-22 10:38:25 +00:00
73d60539ad
refactor: use ChunkGenerator in parquet_catalog ( #2209 ) ( #3167 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-22 10:29:33 +00:00
3b2e5c445b
chore: Merge branch 'main' into ntran/compact_os_framework
2021-11-19 16:18:24 -05:00
40ddcf2a2f
refactor: address review comments
2021-11-19 16:08:01 -05:00
ff78f5a4f5
feat: reduce cardinality of job metrics ( #3169 )
...
* feat: reduce cardinality of job metrics
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-19 19:05:49 +00:00
76d02deb4c
refactor: form `system.column_chunks` column by column rather than row by row ( #3155 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-19 18:34:29 +00:00
9fd4a560f5
feat: Results of running cargo hakari manage-deps
2021-11-19 09:21:57 -05:00
25d55cd08a
feat: Move server config paths beneath 'nodes' ( #3144 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-19 09:54:32 +00:00
e32d367e85
feat: flush delete mailbox on persist ( #3126 ) ( #3147 )
...
* feat: flush delete mailbox on persist (#3126 )
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-19 09:45:29 +00:00
c148251dcb
feat: implement step2: compact and persist os chunks
2021-11-18 18:18:55 -05:00
a2454b542d
fix: Small cleanups in Cargo.tomls ( #3160 )
...
* fix: Add tokio rt-multi-thread feature so cargo test -p client_util compiles
* fix: Alphabetize dependencies
* fix: Add the data_types_conversions feature to get tests passing
* fix: Remove dev dependencies already listed under normal dependencies
* fix: Make sure the workspace is using the new resolver
2021-11-18 22:26:33 +00:00
c9f02f83e7
Merge branch 'main' into cn/alias-db-commands
2021-11-18 15:13:43 +00:00
ccef3b535a
feat: clean up and add comments for next steps
2021-11-18 10:11:51 -05:00
714fc85c8d
refactor: extract Mailbox type ( #3126 ) ( #3142 )
...
* refactor: extract Mailbox type (#3126 )
* fix: doc
* chore: review feedback
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-11-18 09:34:06 +00:00
a5c04e5fe4
feat: framework for compact os chunks
2021-11-17 18:12:51 -05:00
f69d37e9a8
fix: Remove database delete/restore entirely
2021-11-17 12:03:11 -05:00
7783e4a7ff
fix: Make delete/restore aliases for release/claim; remove tombstone
...
Fixes #2680
2021-11-17 11:41:08 -05:00
8155747735
feat: add write buffer delete encoding ( #2731 ) ( #3127 )
...
* feat: add write buffer delete encoding (#2731 )
* chore: fix doc
* chore: review feedback
* chore: review feedback
* chore: fmt
* chore: review feedback
2021-11-17 16:12:19 +00:00
47acd181c5
chore: Update datafusion + arrow/parquet/arrow-flight 6.2.0 ( #3136 )
...
* chore: Update datafusion and arrow
* chore: update arrow/parquet/arrow-flight to 6.2.0
* refactor: Add table_exists to SchemaProvider impl
* fix: clippy
* fix: clippy 2
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-17 14:04:49 +00:00
e6fdd79a0f
feat: emit Kafka stats as metrics instead of logs
...
This maps a subset of Kafka stats as metrics. The set can -- of course
-- be changed in the future depending on our needs.
Fixes #3100 .
2021-11-16 17:18:41 +01:00
553e412226
refactor: DMLOperation write path ( #2731 ) ( #3121 )
...
* refactor: DMLOperation write path (#2731 )
* chore: fmt
* chore: review feedback
2021-11-16 12:42:19 +00:00
bc11244828
feat: Rename database disown/adopt to release/claim ( #3111 )
...
* fix: Rename 'disown' to 'release' database
Connects to #3110
* fix: Rename 'adopt' to 'claim' database
Fixes #3110 .
2021-11-15 20:28:09 +00:00
af28cfa2a6
feat: Add an adopt database API
...
Fixes #2679 .
2021-11-15 09:26:06 -05:00
3d091208af
refactor: move delete predicate into data_types ( #2731 ) ( #3094 )
...
* refactor: move delete predicate into dml (#2731 )
* refactor: move DeletePredicate to data_types
* chore: fix doc
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-15 10:28:58 +00:00
a6d83a3026
feat: WriteBufferReader use DmlOperation ( #2731 ) ( #3096 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-15 10:19:54 +00:00
48f36fab1f
fix: Box an error so the enum variants don't differ greatly in size
2021-11-12 14:53:07 -05:00
Marco Neumann
Nga Tran
kodiakhq[bot]
Raphael Taylor-Davies
Andrew Lamb
Carol (Nichols || Goulding)
Carol (Nichols || Goulding)
Jake Goulding