Commit Graph

30 Commits (hotfix-2.2.5)

Author SHA1 Message Date
SimFG 1e8c8f9f1c
Fix the `segment not found` error (#22739)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-03-14 18:57:55 +08:00
aoiasd 40878a8656
Update datacoord compaction plan after datanode update plan to ensure consistency (#22143) (#22329)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-22 18:19:45 +08:00
xige-16 50739e6c6a
Add more metrics (#21975)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-02-09 16:06:33 +08:00
congqixia 738861e807
Fix Alloc timstamp failure blocks compaction queue forever (#22039) (#22046)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-08 10:10:32 +08:00
congqixia 9692f4ed0e
Fix compaction handler may double release and block forever (#21015) (#21019)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-07 14:31:26 +08:00
Ten Thousand Leaves 790d6c324d
Fix segment_num, stored_rows_num and stored_rows_count metrics (#21028)
TODO: better track segment with state other than flushed and dropped.

/kind bug

issue: #20146, #20145
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 14:27:20 +08:00
Bingyi Sun c65306bc9b
Fix load uses compacted segments' binlogs (#20655) (#20695)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>

Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-11-17 22:01:09 +08:00
Ten Thousand Leaves 5708352a80
Improve DataCoord and DataNode logs (#20265)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-03 12:15:35 +08:00
Xiaofan 11efa0bb5f
Fix compacted segment not dropped (#20128)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-27 17:15:32 +08:00
jaime d8ca56e084
Fix empty segment handoff fails (#20073)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-10-26 16:49:31 +08:00
Xiaofan 192151bc11
Refine Data Log (#19996)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-25 19:31:30 +08:00
yah01 e8ca754dca
Fix compaction produces empty segment (#19936)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-20 22:49:28 +08:00
SimFG a55f739608
Separate public proto files (#19782)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
XuanYang-cn a0ce533727
Add a SyncSegments to sync meta between DN and DC (#19298)
See also: #19072

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-09-27 16:02:53 +08:00
SimFG d7f38a803d
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
jaime 362c663b22
Remove deprecated inner compaction type (#19024)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-09-07 19:16:34 +08:00
Enwei Jiao 096149e33f
fix GetCompactionState hang (#18829)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-08-26 14:22:55 +08:00
cai.zhang c924f73105
Refactor for IndexCoord to support cloud (#18643)
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
2022-08-25 15:48:54 +08:00
Enwei Jiao d9c7519107
refactor compaction concurency logic (#18660)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-08-23 15:50:52 +08:00
cai.zhang ed94ecf847
Segments can't be compacted when they have reference lock (#17649)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-20 21:56:12 +08:00
Xiaofan 54aeb077e9
Refine compaction selection poliy (#17486)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-15 23:14:10 +08:00
congqixia 5751759c85
Implement mix compaction logic (#15542)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-02-18 14:51:49 +08:00
godchen 88f4c1ce38
[skip e2e]Sort imports (#14816)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-05 14:18:08 +08:00
godchen 11b1a13835
[skip e2e]Sort imports (#14319)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-30 16:51:54 +08:00
godchen d59647bb3f
[skip ci]Fix datanode compaction comment typo (#13631)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-21 09:19:10 +08:00
godchen e36f7287ae
[skip e2e]Fix datanode compaction variable typo error (#13630)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 19:14:59 +08:00
edward.zeng 5db458a44e
[skip ci] Add license for data coord compaction (#12561)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-01 19:33:32 +08:00
Bingyi Sun 5574a104c9
Add triggerInfo in compactionTask (#11517)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-11 15:54:42 +08:00
Bingyi Sun c3f0c5a3ff
Add compaction interfaces in proxy (#11431)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-09 14:47:02 +08:00
sunby c26cd79532
Add compaction (#9906)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-05 22:25:00 +08:00