milvus/internal/flushcommon/writebuffer
yihao.dai ec2e77b5d7
enhance: Reduce memory usage of BF in DataNode and QueryNode (#38129)
1. DataNode: Skip generating BF during the insert phase (BF will be
regenerated during the sync phase).
2. QueryNode: Skip generating or maintaining BF for growing segments;
deletion checks will be handled in the segcore.

issue: https://github.com/milvus-io/milvus/issues/37630

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2025-01-15 01:59:01 +08:00
..
delta_buffer.go enhance: Organize the common modules of streamingNode and dataNode (#34773) 2024-07-22 11:33:51 +08:00
delta_buffer_test.go fix: Correct varchar primarykey size calculation (#37617) 2024-11-14 14:16:38 +08:00
insert_buffer.go feat: support embedding bm25 sparse vector and flush bm25 stats log (#36036) 2024-09-19 10:57:12 +08:00
insert_buffer_test.go feat: support embedding bm25 sparse vector and flush bm25 stats log (#36036) 2024-09-19 10:57:12 +08:00
l0_write_buffer.go enhance: Reduce memory usage of BF in DataNode and QueryNode (#38129) 2025-01-15 01:59:01 +08:00
l0_write_buffer_test.go enhance: Reduce memory usage of BF in DataNode and QueryNode (#38129) 2025-01-15 01:59:01 +08:00
manager.go fix: Datanode stop progress stuck at writer buffer memory check (#38274) 2024-12-06 18:20:39 +08:00
manager_test.go fix: Datanode stop progress stuck at writer buffer memory check (#38274) 2024-12-06 18:20:39 +08:00
mock_manager.go enhance: add create segment message, enable empty segment flush (#37407) 2024-11-08 10:16:34 +08:00
mock_write_buffer.go enhance: add create segment message, enable empty segment flush (#37407) 2024-11-08 10:16:34 +08:00
options.go fix: Remove enableLevelZeroSegment config (#36535) 2024-10-17 11:59:24 +08:00
segment_buffer.go feat: support embedding bm25 sparse vector and flush bm25 stats log (#36036) 2024-09-19 10:57:12 +08:00
stats_buffer.go feat: support embedding bm25 sparse vector and flush bm25 stats log (#36036) 2024-09-19 10:57:12 +08:00
sync_policy.go enhance: Organize the common modules of streamingNode and dataNode (#34773) 2024-07-22 11:33:51 +08:00
sync_policy_test.go enhance: Organize the common modules of streamingNode and dataNode (#34773) 2024-07-22 11:33:51 +08:00
write_buffer.go enhance: make new go package to manage proto (#39114) 2025-01-10 10:49:01 +08:00
write_buffer_test.go enhance: make new go package to manage proto (#39114) 2025-01-10 10:49:01 +08:00