bc44d33108
feat: Implement a snapshot method on DataBuffer ( #3518 )
...
* feat: Implement a snapshot method on DataBuffer
Fixes #3510 .
* test: Add a test snapshotting batches with different but compatible schemas
* fix: Simplify min/max sequencer number collection
The first batch should always have the min sequencer number. The last
batch should always have the max sequencer number. The min should always
be less than (or equal to, in case there's only one batch) the max.
2022-01-26 15:22:51 +00:00
52866fe6a9
fix: merge record batches into one batch ( #3535 )
...
* fix: merge record batches into one batch
refactor: address review comments
* chore: update test output
2022-01-25 23:29:16 +00:00
797ba459b9
chore: merge main to branch
2022-01-24 12:06:23 -05:00
939ea536d4
feat: add but ignore a few compaction tests
2022-01-24 12:00:23 -05:00
bb893510a0
feat: Add scaffolding for ingester server
...
* Adds a new ingester command to start an ingester server
* Moves previous ingester server over to handler
* Skeleton for gRPC and HTTP handlers
2022-01-21 18:02:19 -05:00
cd01b141f3
refactor: for paul
2022-01-21 16:49:02 -05:00
191adc9fc7
feat: initial implementation for ingester's compaction
2022-01-20 18:22:41 -05:00
edb97f51cf
refactor: add persisting struct
2022-01-19 12:36:18 -05:00
8a17e1c132
refactor: address review comments
2022-01-19 11:20:20 -05:00
fe9a41ee9a
chore: remove non-longer needed dependency
2022-01-18 21:45:20 -05:00
b57f027e35
refactor: address review comments
2022-01-18 20:57:13 -05:00
367a9fb812
fix: add workspace-hack
2022-01-18 18:10:42 -05:00
125285ae9a
feat: commit in order to pull and merge new commit from main
2022-01-18 16:11:25 -05:00
23290fd2ff
fix: new data structures suggested by reviewers
2022-01-18 14:04:07 -05:00
ef336b4659
feat: add ingester crate and a few basic data structures for its data lifecycle
2022-01-17 15:38:03 -05:00
Carol (Nichols || Goulding)
Nga Tran
NGA-TRAN
Paul Dix