Influxdata
/
influxdb
mirror of https://github.com/influxdata/influxdb.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
influxdb/compactor
History
Dom Dwyer adc6fcfb04
feat(catalog): linearise sort key updates 
Updating the sort key is not commutative and MUST be serialised. The
correctness of the current catalog interface relies on the caller
serialising updates globally, something it cannot reasonably assert in a
distributed system.

This change of the catalog interface pushes this responsibility to the
catalog itself where it can be effectively enforced, and allows a caller
to detect parallel updates to the sort key.
 		2022-12-20 12:31:00 +01:00
..
src feat(catalog): linearise sort key updates 2022-12-20 12:31:00 +01:00
Cargo.toml chore(deps): Bump async-trait from 0.1.59 to 0.1.60 (#6433) 2022-12-19 10:09:23 +00:00
README.md docs: add consensus for the desired final output of the compactor (#5069) 2022-07-07 19:11:16 +00:00

README.md

After a partition of a table has not received any writes for some amount of time, the compactor will ensure it is stored in object store as N parquet files which:

  • have non overlapping time ranges
  • each does not exceed a size specified by config param max_desired_file_size_bytes.