influxdb/docker/integration_test.sh

#!/bin/bash

set -euxo pipefail

cargo test -p write_buffer kafka -- --nocapture
cargo test -p influxdb_iox --test end_to_end skip_replay -- --nocapture
cargo test -p influxdb_iox --test end_to_end write_buffer -- --nocapture
refactor: write buffer testing + better mocking This refactors the write buffer a bit for: - Testing: Add generic tests for the Kafka and the mocking implementation. The same interface can be used easily add new implementations (e.g. via Redis, filesystem, ...). - Partition on Write: The caller of the writer operation must now specify the partition/sequencer ID. The implicit partitioning of the Kafka writer would have lead to broken data since we must never spill entries w/ the same primary key over multiple partitions. At the moment we will only use partition 0 but we can easily implement better logic in the future. - Improved Mocking: The mocked implementation now simulates a system that feels more real. Especially the handling around multiple streams and "write while read" has been improved. This will be helpful for testing and for new features like seeking (during replay). A solid realistic mock also helps us to ensure that the tests using the mock do not rely on unrealistic behavior too much. 2021-07-15 12:02:49 +00:00			`#!/bin/bash`

			`set -euxo pipefail`

			`cargo test -p write_buffer kafka -- --nocapture`
test: end2end for skip replay 2021-08-13 08:46:05 +00:00			`cargo test -p influxdb_iox --test end_to_end skip_replay -- --nocapture`
refactor: write buffer testing + better mocking This refactors the write buffer a bit for: - Testing: Add generic tests for the Kafka and the mocking implementation. The same interface can be used easily add new implementations (e.g. via Redis, filesystem, ...). - Partition on Write: The caller of the writer operation must now specify the partition/sequencer ID. The implicit partitioning of the Kafka writer would have lead to broken data since we must never spill entries w/ the same primary key over multiple partitions. At the moment we will only use partition 0 but we can easily implement better logic in the future. - Improved Mocking: The mocked implementation now simulates a system that feels more real. Especially the handling around multiple streams and "write while read" has been improved. This will be helpful for testing and for new features like seeking (during replay). A solid realistic mock also helps us to ensure that the tests using the mock do not rely on unrealistic behavior too much. 2021-07-15 12:02:49 +00:00			`cargo test -p influxdb_iox --test end_to_end write_buffer -- --nocapture`