milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

[skip ci]Add comment on flowgraph ddNode (#9358) 

Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
pull/9361/head
XuanYang-cn 2021-10-06 22:51:58 +08:00 committed by GitHub
parent d23f9a6d82
commit 27143c6095
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 14 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

14
internal/datanode/flow_graph_dd_node.go
View File

@ -25,6 +25,20 @@ import (
"github.com/opentracing/opentracing-go" "github.com/opentracing/opentracing-go"
) )
// ddNode filter messages from message streams.
//
// ddNode recives all the messages from message stream dml channels, including insert messages,
// delete messages and ddl messages like CreateCollectionMsg.
//
// ddNode filters insert messages according to the `flushedSegment` and `FilterThreshold`.
// If the timestamp of the insert message is earlier than `FilterThreshold`, ddNode will
// filter out the insert message for those who belong to `flushedSegment`
//
// When receiving a `DropCollection` message, ddNode will send a signal to DataNode `BackgroundGC`
// goroutinue, telling DataNode to release the resources of this perticular flow graph.
//
// After the filtering process, ddNode passes all the valid insert messages and delete message
// to the following flow graph node, which in DataNode is `insertBufferNode`
type ddNode struct { type ddNode struct {
BaseNode BaseNode