wayblink
|
c62bf8a0b0
|
fix: [Cherry-pick]Pick major compaction fixs and optimizations (#34360)
This PR cherry-picks the following commits:
- fix: sync partitiion stats blocking balance task #33742
- fix: Fix meta prefix overlap bug #33830
- fix: Small fixs of major compaction #33929
- fix: Fix memory buffer error & some renaming #33850
- fix: sync part stats task cannot be finished #34027
- Add an option to enable/disable vector field clustering key #34097
- fix: fix error ignore in compactor #34169
- fix:load major compaction partial result #34052
- Use new stream segment reader in clustering compaction #34232
issue: #30633
pr: #33742 #33830 #33929 #33850 #34027 #34097 #34169 #34052 #34232
---------
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: Chun Han <116052805+MrPresent-Han@users.noreply.github.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
|
2024-07-03 09:53:37 +08:00 |
XuanYang-cn
|
a33b68678d
|
enhance: [cherry-pick] Move compactor into sub package (#34098)
This PR consists of the following commits:
- enhance: Tidy compactor and remove dup codes (#32198)
- fix: Fix l0 compactor may cause DN from OOM (#33554)
- enhance: Add deltaRowCount in l0 compaction (#33997)
- enhance: enable stream writer in compactions (#32612)
- fix: turn on compression on stream writers (#34067)
- fix: adding blob memory size in binlog serde (#33324)
See also: #32451, #33547, #33998, #31679
pr: #32198, #33554, #33997, #32612
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
Co-authored-by: Ted Xu <ted.xu@zilliz.com>
|
2024-06-25 11:16:02 +08:00 |
congqixia
|
e2626c7b9e
|
fix: [2.4]Allocate new slice for each batch in streaming reader (#33360)
Cherry-pick from master
pr: #33359
Related to #33268
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2024-05-24 18:59:42 +08:00 |
Ted Xu
|
dc5ea6f17c
|
feat: adding binlog streaming writer (#31537)
See #31679
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
|
2024-04-11 10:33:20 +08:00 |
Buqian Zheng
|
d7dbc3c9d8
|
fix: [sparse float vector] support the new streaming deserialize reader (#31325)
issue: https://github.com/milvus-io/milvus/issues/31324
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
|
2024-03-17 13:59:04 +08:00 |
|
Ted Xu
|
987d9023a5
|
enhance: Enable binlog deserialize reader in datanode compaction (#31036)
See #30863
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
|
2024-03-08 18:25:02 +08:00 |
|
Ted Xu
|
71adafa933
|
enhance: adding a streaming deserialize reader for binlogs (#30860)
See #30863
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
|
2024-03-04 19:31:09 +08:00 |