Commit Graph

184 Commits (hotfix-2.2.5)

Author SHA1 Message Date
zhenshan.cao b0b7e5ba4d
Revert "Restrain gc files by collection (#22504) (#22518)" (#23383)
This reverts commit a58abe1665.

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-04-12 23:18:29 +08:00
yihao.dai a92109735e
Fix DescribeCollection failed with undefined msg type (#23298)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-07 20:58:28 +08:00
yah01 2a02803392
Fix DataCoord's meta may be broken with DataNode of prior version (#23031)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-28 11:30:00 +08:00
yah01 158c4ec24e
Fix not fill timestamp when use collection created ts (#22629) (#22634)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-09 10:21:52 +08:00
yah01 09593ad13b
Fix segment not found if forward delete to empty segment (#22551)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-03 20:49:49 +08:00
congqixia a58abe1665
Restrain gc files by collection (#22504) (#22518)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-02 16:55:49 +08:00
MrPresent-Han b01b467bf9
support channel balancer on datacoord (#22324) (#22377)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-02-27 18:27:48 +08:00
cai.zhang 7aab677023
Gracefully stop session (#22386)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-27 16:05:48 +08:00
Xiaofan 63c57db28d
Fix row number mismatch (#22306)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-02-27 10:47:47 +08:00
jaime dac6b7ec8b
Support rename collection function (#22208)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-17 16:52:25 +08:00
cai.zhang dd63c71bd0
Fix ut about disconnect etcd (#22238)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-16 23:50:37 +08:00
cai.zhang 31de6cfb3c
Update component state to healthy after start (#22084)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-10 15:36:33 +08:00
yah01 ced4112ce5
Fix activate standby server ignores all errors (#22073) (#22091)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-02-09 17:26:32 +08:00
xige-16 50739e6c6a
Add more metrics (#21975)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-02-09 16:06:33 +08:00
cai.zhang 03ce5c2656
Register after start to prevent there are tow coordinator at the same time (#21641)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-12 12:01:39 +08:00
Jiquan Long bd50e1e0e2
Fix collection not exist when tried to do recovery (#21471) (#21628)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-01-12 09:55:42 +08:00
jaime c704037991
Make the subName unique for the datanode tt channel (#21616)
Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: SimFG <bang.fu@zilliz.com>
2023-01-10 17:59:39 +08:00
jaime 780fbc5ed7
Improve ListSegments performance for Datacoord catalog (#21600)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-01-10 15:29:39 +08:00
zhenshan.cao 61592cdecc
Fix start of DataCoord (#20581) (#21079)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-12-08 20:03:19 +08:00
Bingyi Sun c65306bc9b
Fix load uses compacted segments' binlogs (#20655) (#20695)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>

Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-11-17 22:01:09 +08:00
jaime cb294d1441
Add some msgstream metrics (#20601)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-15 19:41:16 +08:00
bigsheeper d1ee0bb43b
Add channel level checkpoint [#20350] (#20542)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-15 14:07:07 +08:00
Xiaofan 11efa0bb5f
Fix compacted segment not dropped (#20128)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-27 17:15:32 +08:00
Xiaofan def5972e01
fix duplicated handoff request (#20108)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-27 15:15:32 +08:00
Xiaofan 192151bc11
Refine Data Log (#19996)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-25 19:31:30 +08:00
Xiaofan 1f170ce1ba
Refine kafka consumer (#19846)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-25 13:23:30 +08:00
congqixia 2e6ddd7f2a
Add datanode&channel match check for Flush (#19985)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-22 12:09:28 +08:00
smellthemoon 581e1d8c35
Fill MsgBase ALL (#19912)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-10-21 15:57:28 +08:00
SimFG a55f739608
Separate public proto files (#19782)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
yah01 89c9cb3680
Fix scan may break GC limitation (#19670)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-15 15:13:24 +08:00
Ten Thousand Leaves be4b0189b1
Fix potential long log (#19757)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-10-13 19:21:23 +08:00
congqixia 2a2d32c4fc
Fix datacoord panics when collection info not found (#19706)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-11 21:39:24 +08:00
jaime 31db01b6ae
Support TTL for collection level (#19383)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-10-10 20:31:22 +08:00
wayblink 85e04d845c
Move GetComponentStates to milvus.proto, make it an external interface (#19594)
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-10-10 15:55:22 +08:00
wayblink 54e2c079c4
MEP-30:Support basic coordinators active-standby mechanism #16901 (#19166)
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-09-29 18:35:02 +08:00
yah01 2dca3688a0
Fix data race in DataCoord unit test (#19469)
Refine the DataCoord initialization

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-27 18:04:53 +08:00
Ten Thousand Leaves b30c9d4f60
Support Bulk Load in Milvus 2.2 (#18982)
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-09-26 18:06:54 +08:00
jaime 91df8f2d6a
Use log id instead of log path of the binlog in metastore (#19123)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-09-25 15:56:51 +08:00
Xiaofan 928a213e31
Fix Chunk Manager Path mis use (#19141)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-09-23 14:40:51 +08:00
SimFG d7f38a803d
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
yah01 11b352c3ae
Guarantee flushed segments are all indexed (#19062)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-16 11:32:48 +08:00
congqixia 29c72cad15
Use segment statslog instead of separate statslog (#18775)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-02 10:34:59 +08:00
cai.zhang c924f73105
Refactor for IndexCoord to support cloud (#18643)
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
2022-08-25 15:48:54 +08:00
codeman 70254c3ec5
Unified catalog interface for segment (#18289) (#18290)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Signed-off-by: kejiang <ke.jiang@zilliz.com>
Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-08-20 10:24:51 +08:00
Ten Thousand Leaves fc42ee5bb3
Fix # of rows of recovering segment (#18736)
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-08-19 19:50:50 +08:00
xing.zhao d90313a1a8
Use chunkManager rather than minio.Client in datanode garbage collection (#18092)
Signed-off-by: xingzhao <xing.zhao@zilliz.com>

Co-authored-by: xingzhao <xing.zhao@zilliz.com>
2022-07-22 22:10:28 +08:00
cai.zhang 0ad15a22c8
IndexCoord handle events correctly (#17878)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-07 14:44:21 +08:00
Ten Thousand Leaves d4a1e94f32
Fix flush failure caused by empty stale segments (#18097)
/bug

issue: #18096
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-07-06 18:10:21 +08:00
zhenshan.cao 0baeb609dc
Fix bugs in monitoring metrics (#17894)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-06-30 17:26:19 +08:00
Ten Thousand Leaves f0b036a35a
Move bulk load segment lock happen early (#17612)
issue: #17600
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-06-27 13:56:17 +08:00