bd6a1c558e
Merge pull request #1773 from influxdata/crepererum/lifecycle_lint
...
chore: lint `lifecycle` crate
2021-06-22 09:10:50 +00:00
7f188c3c94
chore: lint `lifecycle` crate
2021-06-22 11:05:55 +02:00
d1db0dfaeb
refactor: remove type parameter from preserved catalog
...
For #1740 .
2021-06-22 10:53:10 +02:00
f79349bce0
Merge pull request #1766 from influxdata/crepererum/issue1740-a
...
refactor: decouple preserved and in-mem catalog (part 1)
2021-06-22 07:24:17 +00:00
799e2caa34
Merge branch 'main' into crepererum/issue1740-a
2021-06-22 07:19:27 +00:00
5362c7c924
feat: enable query deduplication ( #1762 )
2021-06-21 18:49:04 +00:00
ff60627500
refactor: make preserved catalog NOT own the in-mem catalog
...
Works towards #1740 .
2021-06-21 18:39:43 +02:00
881729bd23
refactor: make caller responsible to create checkpoint data
...
This decouples the in-mem and preserved catalog a bit and works
towards #1740 .
2021-06-21 18:33:23 +02:00
9191a1a9d1
Merge pull request #1769 from influxdata/report_the_damn_error
...
fix: Report error to stderr in git-log-prs
2021-06-21 16:30:18 +00:00
b77f054a5f
fix: Report error to stderr in git-log-prs
2021-06-21 18:18:50 +02:00
bed6ec8c31
feat: Handle merging chunks that have different schemas ( #1761 )
...
* feat: Handle merging chunks that have different schemas
* test: print out original (non deduplicated) data in tests
2021-06-21 15:52:13 +00:00
2785b72e70
Merge pull request #1765 from influxdata/er/refactor/single_table_chunk
...
refactor: remove multiple tables from Read Buffer Chunk
2021-06-21 15:05:12 +00:00
7e3df17896
test: update benchmarks
2021-06-21 15:29:23 +01:00
ac54320821
refactor: update server with new chunk API
2021-06-21 15:12:17 +01:00
2ff80162d3
refactor: one table per chunk
2021-06-21 15:08:38 +01:00
15416ca223
refactor: enable empty table init
2021-06-21 15:08:38 +01:00
15aaf235b6
Merge pull request #1675 from influxdata/cn/kafka-docker-working
...
test: Starting Kafka Write Buffer integration tests
2021-06-21 13:59:06 +00:00
31ad5c85f9
fix: Consistently refer to docker-compose
2021-06-21 09:41:37 -04:00
4191300a41
fix: Move environment variables to ENV declarations in Dockerfile
2021-06-21 09:41:36 -04:00
485d8cddc4
docs: Remove outdated comment
2021-06-21 09:41:36 -04:00
44c2c0c763
docs: Recommend pulling latest docker image first
2021-06-21 09:41:36 -04:00
135d885ca5
docs: Clarify the differences between the two ways to run the Kafka integration tests
2021-06-21 09:41:36 -04:00
4ba6d8cd4f
chore: Add a dockerignore file to not send the target directory
2021-06-21 09:41:36 -04:00
b4644e6108
test: Start of Kafka Write Buffer integration tests
2021-06-21 09:41:35 -04:00
a0583381a1
chore: Run kafka integration tests using docker-compose
...
And, importantly, using the CircleCI machine image to avoid running
Docker-in-Docker.
2021-06-21 09:36:35 -04:00
ea04ce40dc
feat: transactional lifecycle API ( #1753 )
...
* feat: transactional lifecycle API
* chore: remove redundant upgrade
* feat: lifecycle error propagation
* chore: add usage doctest
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-21 13:09:53 +00:00
40dfdbf1fb
Merge pull request #1572 from influxdata/crepererum/catalog_cli
...
feat: wire catalog wiping all the way to the CLI
2021-06-21 11:49:35 +00:00
47f8310a27
docs: clarify wipe behavior
2021-06-21 13:27:18 +02:00
0d7c3ff279
docs: fix typos
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-06-21 13:18:20 +02:00
cb09762067
docs: document server startup and error recovery
2021-06-21 10:26:52 +02:00
4d3432a1e0
docs: improve `server::config` docs
2021-06-21 10:06:50 +02:00
a153f841d8
feat: add `--force` flag to CLI wipe command
2021-06-21 09:31:23 +02:00
29bbc9a384
refactor: recoverable DB init
...
- store read and parsed DB rules even the the catalog is broken
- allow wiping the catalog for DBs w/ init failures
- try to bring the DB back online after successful wipes
Note that this does yet allow to update rules for broken DBs or to fix
DBs w/ broken rule files. However this can be implemented easily on top
of this.
2021-06-21 09:31:23 +02:00
c0766f1c26
feat: catalog wiping CLI
2021-06-21 09:31:23 +02:00
8e69202270
feat: catalog wiping gRPC
2021-06-21 09:31:23 +02:00
d17b5710a8
feat: add server functionality to wipe preserved catalogs
2021-06-21 09:31:23 +02:00
aba973a6e1
refactor: make catalog `wipe` a freestanding function
...
It does not interact with the `CatalogState` so users can call this
function without that type.
2021-06-21 09:31:23 +02:00
634c9b4c66
refactor: delete unused code ( #1759 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-19 08:15:33 +00:00
258a6b1956
chore: remove more dead code ( #1760 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-18 21:28:22 +00:00
6559a9e997
refactor: use Schema to compute InfluxDB primary keys ( #1757 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-18 21:15:31 +00:00
ab052c0501
fix: fix flaky test by updating datafusion dep ( #1758 )
...
* chore: update DataFusion dependencies
* fix: Re-enable previously flaking tests
This reverts commit c63ad0ea31
2021-06-18 20:17:18 +00:00
b855c6317e
Merge pull request #1751 from influxdata/smaller-cache
...
chore: Switch to smaller cache dep
2021-06-18 18:54:40 +00:00
1d8469951f
Merge branch 'main' into smaller-cache
2021-06-18 18:50:10 +00:00
de67bd3efe
refactor: Remove PartitionChunk::table_schema ( #1756 )
...
* refactor: Remove PartitionChunk::table_schema
* docs: update comments
2021-06-18 16:13:16 +00:00
9beeca3e7c
refactor: Unify schema handling in query crate ( #1755 )
...
* refactor: Unify schema handling in query crate
* fix: doclink
2021-06-18 14:10:57 +00:00
1c13d676b4
refactor: Rename query::PartitionChunk --> query::QueryChunk ( #1754 )
2021-06-18 13:24:09 +00:00
b612c3af4e
chore: Switch to smaller cache dep
2021-06-18 09:43:28 +02:00
ec43a87909
chore: Update itertools deps ( #1750 )
2021-06-17 17:56:44 +00:00
c63ad0ea31
chore: Ignore flaky test ( #1749 )
2021-06-17 14:51:19 +00:00
c5eea9af6a
feat: Implement DeduplicateExec ( #1733 )
...
* feat: Implement DeduplicateExec
* fix: Doc comments
* fix: fix comment
* fix: Update with arrow ticket references and use datafusion coalsce batches impl
* refactor: rename inner.rs to algo.rs
* docs: Add additional documentation on rationale for last field value
* docs: Apply suggestions from code review
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* docs: Update query/src/provider/deduplicate/algo.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* docs: Apply suggestions from code review
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* refactor: do not use pub(crate)
* docs: fix test comments
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
2021-06-17 14:17:52 +00:00
kodiakhq[bot]
Marco Neumann
Andrew Lamb
Marko Mikulicic
Edd Robinson
Carol (Nichols || Goulding)
Raphael Taylor-Davies