History

Bingyi Sun b8c5239784 Add compaction retention config (#11793 ) Signed-off-by: sunby <bingyi.sun@zilliz.com> Co-authored-by: sunby <bingyi.sun@zilliz.com>		2021-11-16 11:47:10 +08:00
..
OWNERS	…
README.md	…
allocator.go	…
allocator_test.go	…
channel_manager.go	[skip ci]Remove redundancy log (#11732 )	2021-11-15 10:25:09 +08:00
channel_manager_factory.go	…
channel_manager_test.go	…
channel_store.go	…
channel_store_test.go	…
cluster.go	…
cluster_test.go	…
compaction.go	…
compaction_policy.go	Skip single compaction if there's no delta log in a segment (#11806 )	2021-11-16 11:23:11 +08:00
compaction_policy_test.go	Skip single compaction if there's no delta log in a segment (#11806 )	2021-11-16 11:23:11 +08:00
compaction_test.go	Add triggerInfo in compactionTask (#11517 )	2021-11-11 15:54:42 +08:00
compaction_trigger.go	Add compaction retention config (#11793 )	2021-11-16 11:47:10 +08:00
compaction_trigger_test.go	…
datanode_helper.go	Filter with partition id in GetVChanPosition (#11746 )	2021-11-13 08:45:09 +08:00
errors.go	…
errors_test.go	…
garbage_collector.go	…
garbage_collector_test.go	…
meta.go	…
meta_test.go	…
metrics_info.go	…
metrics_info_test.go	…
mock_test.go	…
param_table.go	Add compaction retention config (#11793 )	2021-11-16 11:47:10 +08:00
param_table_test.go	…
policy.go	…
policy_test.go	…
segment_allocation_policy.go	…
segment_allocation_policy_test.go	…
segment_info.go	…
segment_manager.go	…
segment_manager_test.go	…
server.go	Filter with partition id in GetVChanPosition (#11746 )	2021-11-13 08:45:09 +08:00
server_test.go	Filter with partition id in GetVChanPosition (#11746 )	2021-11-13 08:45:09 +08:00
services.go	Filter with partition id in GetVChanPosition (#11746 )	2021-11-13 08:45:09 +08:00
session.go	…
session_manager.go	…
util.go	Add compaction retention config (#11793 )	2021-11-16 11:47:10 +08:00
util_test.go	Add compaction retention config (#11793 )	2021-11-16 11:47:10 +08:00

README.md

Data Coordinator

Data cooridnator(datacoord for short) is the component to organize DataNodes and segments allocations.

Dependency

KV store: a kv store has all the meta info datacoord needs to operate. (etcd)
Message stream: a message stream to communicate statistics information with data nodes. (Pulsar)
Root Coordinator: timestamp, id and meta source.
Data Node(s): could be an instance or a cluster, actual worker group handles data modification operations.