3942622a93
Merge pull request #1778 from influxdata/crepererum/issue1740-c
...
refactor: decouple preserved and in-mem catalog (part 3)
2021-06-23 08:35:55 +00:00
e36b6f9c7a
docs: fix intra-doc link
2021-06-23 10:25:05 +02:00
67508094b4
fix: double ref
...
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2021-06-23 10:25:05 +02:00
d2be641864
refactor: make checkpointing easier to use
...
Don't mix commit+checkpoint in a single call so that the caller has to
reason about the error type and which of the two operations has failed.
Splitting it also makes it easier to create the correct checkpoint data.
2021-06-23 10:25:05 +02:00
4a961694ec
refactor: make caller sync mem<>OS view during catalog transactions
...
This is for #1740 . Greatly simplifies the integration of the persisted
catalog into the DB.
2021-06-23 10:25:05 +02:00
c52410b3d9
Merge pull request #1781 from influxdata/crepererum/fix_server_startup
...
feat: eagerly check object store during CLI run
2021-06-23 07:24:58 +00:00
3fd45d987e
Merge branch 'main' into crepererum/fix_server_startup
2021-06-23 07:17:19 +00:00
9d1fd3dd37
refactor: reduce potential IO during startup store checking
2021-06-23 09:16:38 +02:00
23614d4b0d
Merge pull request #1782 from influxdata/rustdoc
...
chore: Store generated rustdoc as circleci artifacts
2021-06-22 22:33:07 +00:00
60c1b68644
chore: Store generated rustdoc as circleci artifacts
2021-06-23 00:20:55 +02:00
4c5007f961
fix: Select the correct timestamp for min/max selectors ( #1771 )
...
* test: Reproducer showing that the min/max selectors are order dependent
* fix: pick correct timestamp for first/last selectors
* refactor: remove println
* docs: Fixup comments and add to link to arrow-datafusion/issues/600
* fix: Add debug if timestamp is null
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-22 17:53:54 +00:00
763ade390c
refactor: rename deduplicate --> overlap ( #1779 )
2021-06-22 17:07:53 +00:00
55c546baff
feat: eagerly check object store during CLI `run`
...
Instead of waiting for the server ID to be set and then mark the server
as errored, directly check the object store on startup. This is
important so that we fail fast when Istio isn't up and running yet.
2021-06-22 18:21:30 +02:00
24b249ad7b
fix: do not silence all IO errors in disk-based LIST
2021-06-22 18:20:36 +02:00
0024f933df
Merge pull request #1775 from influxdata/crepererum/fix_auto_wipe
...
fix: auto-wipe should still be enabled
2021-06-22 13:55:25 +00:00
c3dbe4c571
Merge branch 'main' into crepererum/fix_auto_wipe
2021-06-22 13:50:53 +00:00
a98b10745f
fix: auto-wipe should still be enabled
...
Auto-wipe broken catalogs should be enabled until #1522 is closed.
2021-06-22 15:45:32 +02:00
8b09a02136
Merge pull request #1772 from influxdata/crepererum/issue1740-b
...
refactor: decouple preserved and in-mem catalog (part 2)
2021-06-22 13:31:37 +00:00
b77bff449b
Merge branch 'main' into crepererum/issue1740-b
2021-06-22 13:27:26 +00:00
01b0fdabb7
feat: make lifecycle partition-aware ( #1767 )
...
* feat: make lifecycle partition-aware
* chore: further docs
* chore: rename to maybe_free_memory
* chore: fix logical conflicts
* chore: ensure only drops unpersisted chunks
* chore: clippy lints
* chore: fix doc
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-22 09:24:15 +00:00
bd6a1c558e
Merge pull request #1773 from influxdata/crepererum/lifecycle_lint
...
chore: lint `lifecycle` crate
2021-06-22 09:10:50 +00:00
7f188c3c94
chore: lint `lifecycle` crate
2021-06-22 11:05:55 +02:00
d1db0dfaeb
refactor: remove type parameter from preserved catalog
...
For #1740 .
2021-06-22 10:53:10 +02:00
f79349bce0
Merge pull request #1766 from influxdata/crepererum/issue1740-a
...
refactor: decouple preserved and in-mem catalog (part 1)
2021-06-22 07:24:17 +00:00
799e2caa34
Merge branch 'main' into crepererum/issue1740-a
2021-06-22 07:19:27 +00:00
5362c7c924
feat: enable query deduplication ( #1762 )
2021-06-21 18:49:04 +00:00
ff60627500
refactor: make preserved catalog NOT own the in-mem catalog
...
Works towards #1740 .
2021-06-21 18:39:43 +02:00
881729bd23
refactor: make caller responsible to create checkpoint data
...
This decouples the in-mem and preserved catalog a bit and works
towards #1740 .
2021-06-21 18:33:23 +02:00
9191a1a9d1
Merge pull request #1769 from influxdata/report_the_damn_error
...
fix: Report error to stderr in git-log-prs
2021-06-21 16:30:18 +00:00
b77f054a5f
fix: Report error to stderr in git-log-prs
2021-06-21 18:18:50 +02:00
bed6ec8c31
feat: Handle merging chunks that have different schemas ( #1761 )
...
* feat: Handle merging chunks that have different schemas
* test: print out original (non deduplicated) data in tests
2021-06-21 15:52:13 +00:00
2785b72e70
Merge pull request #1765 from influxdata/er/refactor/single_table_chunk
...
refactor: remove multiple tables from Read Buffer Chunk
2021-06-21 15:05:12 +00:00
7e3df17896
test: update benchmarks
2021-06-21 15:29:23 +01:00
ac54320821
refactor: update server with new chunk API
2021-06-21 15:12:17 +01:00
2ff80162d3
refactor: one table per chunk
2021-06-21 15:08:38 +01:00
15416ca223
refactor: enable empty table init
2021-06-21 15:08:38 +01:00
15aaf235b6
Merge pull request #1675 from influxdata/cn/kafka-docker-working
...
test: Starting Kafka Write Buffer integration tests
2021-06-21 13:59:06 +00:00
31ad5c85f9
fix: Consistently refer to docker-compose
2021-06-21 09:41:37 -04:00
4191300a41
fix: Move environment variables to ENV declarations in Dockerfile
2021-06-21 09:41:36 -04:00
485d8cddc4
docs: Remove outdated comment
2021-06-21 09:41:36 -04:00
44c2c0c763
docs: Recommend pulling latest docker image first
2021-06-21 09:41:36 -04:00
135d885ca5
docs: Clarify the differences between the two ways to run the Kafka integration tests
2021-06-21 09:41:36 -04:00
4ba6d8cd4f
chore: Add a dockerignore file to not send the target directory
2021-06-21 09:41:36 -04:00
b4644e6108
test: Start of Kafka Write Buffer integration tests
2021-06-21 09:41:35 -04:00
a0583381a1
chore: Run kafka integration tests using docker-compose
...
And, importantly, using the CircleCI machine image to avoid running
Docker-in-Docker.
2021-06-21 09:36:35 -04:00
ea04ce40dc
feat: transactional lifecycle API ( #1753 )
...
* feat: transactional lifecycle API
* chore: remove redundant upgrade
* feat: lifecycle error propagation
* chore: add usage doctest
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-21 13:09:53 +00:00
40dfdbf1fb
Merge pull request #1572 from influxdata/crepererum/catalog_cli
...
feat: wire catalog wiping all the way to the CLI
2021-06-21 11:49:35 +00:00
47f8310a27
docs: clarify wipe behavior
2021-06-21 13:27:18 +02:00
0d7c3ff279
docs: fix typos
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-06-21 13:18:20 +02:00
cb09762067
docs: document server startup and error recovery
2021-06-21 10:26:52 +02:00
kodiakhq[bot]
Marco Neumann
Marko Mikulicic
Andrew Lamb
Raphael Taylor-Davies
Edd Robinson
Carol (Nichols || Goulding)