milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
16,476 Commits
170 Branches
155 Tags
589 MiB
Commit Graph

148 Commits (hotfix-2.2.5)

Author SHA1 Message Date
yihao.dai 47e28fbe08
Add FlushAll (#23088) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-03-29 13:50:02 +08:00
cai.zhang cb96314fe7
Support get segment info without binlog path (#22741) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-03-14 21:47:55 +08:00
congqixia 0cdbf0ec71
Make datacoord handle GetIndexedSegment error from indexcoord (#22673) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-10 10:57:53 +08:00
yah01 6f85aeaf29
Fix DataCoord panic while reading timestamp of empty segment (#22598) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-07 18:11:51 +08:00
yah01 09593ad13b
Fix segment not found if forward delete to empty segment (#22551) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-03 20:49:49 +08:00
aoiasd 56ad2017d1
Fix create index finish early because compaction (#22509) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-03-03 19:05:50 +08:00
Xiaofan 63c57db28d
Fix row number mismatch (#22306) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-02-27 10:47:47 +08:00
SimFG 8123161738
Add the retry op for all server (#22274) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: jaime <yun.zhang@zilliz.com>
 2023-02-24 17:51:47 +08:00
cai.zhang dd63c71bd0
Fix ut about disconnect etcd (#22238) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-02-16 23:50:37 +08:00
cai.zhang c333ee8d17
Exit component process when session key is deleted (#21658) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-02-14 11:04:35 +08:00
cai.zhang af8f7acb7b
Remove contraint that compaction based on indexed segment (#22145) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-02-14 09:56:33 +08:00
cai.zhang 31de6cfb3c
Update component state to healthy after start (#22084) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-02-10 15:36:33 +08:00
cai.zhang 6313a45524
Revert #22057 (#22115) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-02-10 15:24:33 +08:00
cai.zhang dbdb7e7d92
Remove contraint that compaction based on indexed segment (#22057) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-02-09 19:52:32 +08:00
Ten Thousand Leaves 423c1c65a9
Verify and adjust segment # of rows before saving and passing SegmentInfo (#21200) 
issue: #18120

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2023-02-03 14:19:52 +08:00
Xiaofan 789cf5c48b
Fix BulkInsert may seal a failed segment (#21779) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-01-31 12:41:53 +08:00
Jiquan Long bd50e1e0e2
Fix collection not exist when tried to do recovery (#21471) (#21628) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-01-12 09:55:42 +08:00
bigsheeper 2823d23db0
Use channel-cp as seekPosition when FromDmlCPLoadDelete (#21150) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-12-12 17:47:22 +08:00
Enwei Jiao 802f512161
Etcd config source support TLS (#20874) (#20910) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-01 14:19:16 +08:00
SimFG 925fa9d41d
Make sure that the segment path matches the segment id (#20696) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
(cherry picked from commit 764f178900)
 2022-11-24 10:51:12 +08:00
bigsheeper 6c651d25a4
Ensure compatibility of channel seek position and move syncPeriod to config (#20504) (#20597) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-11-15 19:39:18 +08:00
bigsheeper d1ee0bb43b
Add channel level checkpoint [#20350] (#20542) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-11-15 14:07:07 +08:00
XuanYang-cn 22fb1d3b93
Remove dup mock_kv.go and mock_txn_kv.go (#20267) 
Replace them with mockery generated mocks in kv/mocks

See also: #19289

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-11-03 14:41:35 +08:00
Xiaofan 11efa0bb5f
Fix compacted segment not dropped (#20128) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-10-27 17:15:32 +08:00
jaime 59bcbf0cf6
Support check health for the service level (#19779) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-10-18 13:39:26 +08:00
SimFG a55f739608
Separate public proto files (#19782) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-10-16 20:49:27 +08:00
Enwei Jiao 667982a239
Fix static-check (#19707) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-10-11 17:59:22 +08:00
XuanYang-cn 28e949cf31
Add GetDataVChanPositions (#19657) 
The original GetVChanPositions are specialized for QueryCoord,
the recovery info needed by DataNode shouldn't take `indexed` state
into account.

This PR splits GetVChanPositions into GetDataVChanPositions and
GetQueryVChanPositions.

See also: #19653

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-10-11 16:51:22 +08:00
jaime 31db01b6ae
Support TTL for collection level (#19383) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-10-10 20:31:22 +08:00
wayblink 85e04d845c
Move GetComponentStates to milvus.proto, make it an external interface (#19594) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2022-10-10 15:55:22 +08:00
wayblink e7c2500c71
Implement GetPersistentSegmentInfo through datacoord (#19205) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2022-10-08 11:51:02 +08:00
wayblink 54e2c079c4
MEP-30:Support basic coordinators active-standby mechanism #16901 (#19166) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2022-09-29 18:35:02 +08:00
yah01 2dca3688a0
Fix data race in DataCoord unit test (#19469) 
Refine the DataCoord initialization

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-09-27 18:04:53 +08:00
Ten Thousand Leaves b30c9d4f60
Support Bulk Load in Milvus 2.2 (#18982) 
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-09-26 18:06:54 +08:00
jaime 91df8f2d6a
Use log id instead of log path of the binlog in metastore (#19123) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-09-25 15:56:51 +08:00
yah01 ee9d634a43
Compaction requires the source segments indexed (#19368) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-09-22 18:34:50 +08:00
SimFG d7f38a803d
Separate some proto files (#19218) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-09-16 16:56:49 +08:00
yah01 11b352c3ae
Guarantee flushed segments are all indexed (#19062) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-09-16 11:32:48 +08:00
cai.zhang c924f73105
Refactor for IndexCoord to support cloud (#18643) 
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
 2022-08-25 15:48:54 +08:00
Enwei Jiao d9c7519107
refactor compaction concurency logic (#18660) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-08-23 15:50:52 +08:00
Jiquan Long 641afae22f
Watch channels with start positions (#18744) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-08-22 14:42:52 +08:00
codeman 70254c3ec5
Unified catalog interface for segment (#18289) (#18290) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Signed-off-by: kejiang <ke.jiang@zilliz.com>
Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-08-20 10:24:51 +08:00
aoiasd 8a70f2badb
Add ShowConfigurations for all remaining session (#18594) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2022-08-12 13:20:39 +08:00
xing.zhao d90313a1a8
Use chunkManager rather than minio.Client in datanode garbage collection (#18092) 
Signed-off-by: xingzhao <xing.zhao@zilliz.com>

Co-authored-by: xingzhao <xing.zhao@zilliz.com>
 2022-07-22 22:10:28 +08:00
Jeng.Gwan 638f6c36e9
Support to get real row count of segment (#18115) 
Signed-off-by: xaxys <zheng.guan@zilliz.com>
 2022-07-18 09:58:28 +08:00
zhenshan.cao 72910d65e0
Fix inconsistency in DataCoord (#18170) (#18171) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-07-08 13:48:21 +08:00
cai.zhang 0ad15a22c8
IndexCoord handle events correctly (#17878) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-07-07 14:44:21 +08:00
Ten Thousand Leaves f0b036a35a
Move bulk load segment lock happen early (#17612) 
issue: #17600
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-06-27 13:56:17 +08:00
wayblink 074ec3060a
Support return dropped segments info in GetSegmentInfo rpc (#17617) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2022-06-17 18:24:12 +08:00
wayblink eb5b0b7fc8
Move SegmentInfo out of VchannelInfo, leave Id only to decrease kv size. Get complete SegmentInfo through RPC (#17441) 
Resolves: #17233 #16047

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2022-06-16 12:00:10 +08:00