b5ca99a3d5
I'm spending way too long with the wrong number of arguments to CompactorConfig::new and not a lot of help from the compiler. If these struct fields are pub, they can be set directly and destructured, etc, which the compiler gives way more help on. This also reduces duplication and boilerplate that has to be updated when the config fields change. |
||
|---|---|---|
| .. | ||
| src | ||
| Cargo.toml | ||
| README.md | ||
README.md
After a partition of a table has not received any writes for some amount of time, the compactor will ensure it is stored in object store as N parquet files which:
- have non overlapping time ranges
- each does not exceed a size specified by config param max_desired_file_size_bytes.