History

SimFG f070af67f7 fix: deny to set the mmap param for the alter index api when enable auto index (#39518 ) - issue: #39517 Signed-off-by: SimFG <bang.fu@zilliz.com>		2025-01-23 10:01:04 +08:00
..
allocator	…
broker	…
session	…
OWNERS	…
README.md	…
analyze_meta.go	…
analyze_meta_test.go	…
build_index_policy.go	…
channel.go	…
channel_manager.go	…
channel_manager_factory.go	…
channel_manager_test.go	…
channel_store.go	…
channel_store_test.go	…
cluster.go	…
cluster_test.go	…
compaction.go	enhance: Add configs for compaction schedule (#39010 )	2025-01-22 16:31:10 +08:00
compaction_l0_view.go	…
compaction_l0_view_test.go	…
compaction_policy_clustering.go	…
compaction_policy_clustering_test.go	…
compaction_policy_l0.go	…
compaction_policy_l0_test.go	…
compaction_policy_single.go	…
compaction_policy_single_test.go	…
compaction_queue.go	…
compaction_queue_test.go	…
compaction_task.go	…
compaction_task_clustering.go	…
compaction_task_clustering_test.go	…
compaction_task_l0.go	…
compaction_task_l0_test.go	…
compaction_task_meta.go	…
compaction_task_meta_test.go	…
compaction_task_mix.go	…
compaction_task_mix_test.go	…
compaction_test.go	…
compaction_trigger.go	…
compaction_trigger_test.go	…
compaction_trigger_v2.go	…
compaction_trigger_v2_test.go	…
compaction_view.go	…
const.go	…
errors.go	…
errors_test.go	…
garbage_collector.go	…
garbage_collector_test.go	…
go_channel_singleton.go	…
handler.go	…
handler_test.go	…
import_checker.go	enhance: Limit number of segments restored and promptly terminate the job (#39344 )	2025-01-21 15:13:13 +08:00
import_checker_test.go	enhance: Limit number of segments restored and promptly terminate the job (#39344 )	2025-01-21 15:13:13 +08:00
import_job.go	…
import_meta.go	…
import_meta_test.go	…
import_scheduler.go	enhance: Limit number of segments restored and promptly terminate the job (#39344 )	2025-01-21 15:13:13 +08:00
import_scheduler_test.go	…
import_task.go	…
import_util.go	…
import_util_test.go	…
index_engine_version_manager.go	…
index_engine_version_manager_test.go	…
index_meta.go	enhance: Skip update index metrics if index dropped (#39458 )	2025-01-22 11:19:04 +08:00
index_meta_test.go	…
index_service.go	fix: deny to set the mmap param for the alter index api when enable auto index (#39518 )	2025-01-23 10:01:04 +08:00
index_service_test.go	fix: deny to set the mmap param for the alter index api when enable auto index (#39518 )	2025-01-23 10:01:04 +08:00
job_manager.go	…
job_manager_test.go	…
knapsack.go	…
knapsack_test.go	…
meta.go	fix: bm25 import segment without bm25 stats meta (#38855 )	2025-01-21 11:09:04 +08:00
meta_test.go	fix: bm25 import segment without bm25 stats meta (#38855 )	2025-01-21 11:09:04 +08:00
meta_util.go	…
metrics_info.go	…
metrics_info_test.go	…
mock_channel_store.go	…
mock_channelmanager.go	…
mock_cluster.go	…
mock_compaction_meta.go	…
mock_compaction_plan_context.go	…
mock_handler.go	…
mock_index_engine_version_manager.go	…
mock_job_manager.go	…
mock_segment_manager.go	…
mock_subcluster.go	…
mock_test.go	…
mock_trigger_manager.go	…
partition_stats_meta.go	…
partition_stats_meta_test.go	…
policy.go	…
policy_test.go	…
segment_allocation_policy.go	…
segment_allocation_policy_test.go	…
segment_info.go	…
segment_info_test.go	…
segment_manager.go	…
segment_manager_test.go	…
segment_operator.go	…
segment_operator_test.go	…
server.go	…
server_test.go	…
services.go	enhance: Limit number of segments restored and promptly terminate the job (#39344 )	2025-01-21 15:13:13 +08:00
services_test.go	…
stats_task_meta.go	…
stats_task_meta_test.go	…
sync_segments_scheduler.go	…
sync_segments_scheduler_test.go	…
task_analyze.go	…
task_index.go	…
task_scheduler.go	…
task_scheduler_test.go	…
task_stats.go	…
task_stats_test.go	…
types.go	…
util.go	…
util_test.go	…

README.md

Data Coordinator

Data cooridnator(datacoord for short) is the component to organize DataNodes and segments allocations.

Dependency

KV store: a kv store has all the meta info datacoord needs to operate. (etcd)
Message stream: a message stream to communicate statistics information with data nodes. (Pulsar)
Root Coordinator: timestamp, id and meta source.
Data Node(s): could be an instance or a cluster, actual worker group handles data modification operations.