milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
14,616 Commits
136 Branches
115 Tags
566 MiB
Commit Graph

92 Commits (8c004fa9810098455671bfe2c9e79bdee63b264a)

Author SHA1 Message Date
xige-16 515d0369de
Support string type in segcore (#16546) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-29 13:35:49 +08:00
jaime 68b1b82faf
Remove DataKV interface (#16692) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-04-28 21:03:47 +08:00
yah01 80ae6de323
Add comments for concurrency package (#16654) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-04-26 11:33:45 +08:00
yah01 7af02fa531
Improve load performance, load binlogs concurrently per file, deserialize binlogs concurrently per field/segment (#16514) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-04-25 15:57:47 +08:00
Xiaofan 89b4a34892
Fix Data race in NodeID (#16603) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-04-24 22:03:44 +08:00
xige-16 99984b88e1
Support delete varChar value (#16229) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-04-02 17:43:29 +08:00
Jiquan Long ba37531456
Add support for loading multiple indexes (#16138) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-30 21:11:28 +08:00
bigsheeper 7fee4743f5
Improve log print in OOM error info (#16170) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-03-24 20:17:25 +08:00
yah01 63a71e247a
Loading segments concurrency level fallbacks to the value that won't cause OOM (#16172) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-03-24 13:39:25 +08:00
godchen 78557ca6d7
Replace minio kv with minio chunk manager (#15936) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-03-17 18:03:23 +08:00
zhenshan.cao f3eeecf146
Reduce the number of metrics (#16030) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-03-15 21:51:21 +08:00
jaime 97b1ed7bca
Remove reader API from Mqstream and replace it with consumer API (#15971) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-03-15 14:45:22 +08:00
yah01 4f3d5fb6eb
Make load operation parallel improve performance (#15928) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-03-11 14:28:01 +08:00
顾炎 4f8c08f912
fix checkSegmentSize overflows int64 (#15858) 
Signed-off-by: guyan <632722781@qq.com>
 2022-03-09 13:29:58 +08:00
jaime 7a3a721380
Reconstruct mqstream module (#15784) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-03-03 21:57:56 +08:00
bigsheeper 12eb8c3da5
Add prometheus metrics for QueryNode (#15649) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-03-02 14:49:55 +08:00
bigsheeper 6a48071a5c
Set BaseMsg for LoadSegmentRequest, prevent crashing in log printing (#15725) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-02-26 20:09:54 +08:00
xige-16 55cdc5aa35
Get indexInfo and segment size by queryCoord (#14207) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-02-08 21:57:46 +08:00
Cai Yudong b6a48817b0
Add MinioConfig in GlobalParams for all components (#15099) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-10 17:29:34 +08:00
godchen 9e51591b3a
Fix pulsar reader not close (#14543) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-01-04 14:45:19 +08:00
XuanYang-cn 3d24007efa
Add more logs for load sealed segment (#14079) 
Add logs before&after flowgraph_ddnode forwarding delete msg

See also: #13879

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-24 10:50:07 +08:00
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-23 18:39:11 +08:00
congqixia 1dcd06cc78
Add log file info for all kind of segment binlogs (#13606) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-19 20:00:42 +08:00
bigsheeper 5e5787ddd2
Update memory util in metricinfo (#13320) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-16 17:25:13 +08:00
XuanYang-cn b1ec235644
[skip ci]Update license for qn segment (#13193) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-10 20:59:42 +08:00
xige-16 8b2cd271c7
Improve querynode log (#13158) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-10 18:51:08 +08:00
congqixia 8f87cc7ef1
Fix JoinIDPath logic problem (#13039) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-09 12:05:04 +08:00
Cai Yudong 1a806a174a
Support load collection with multiple vector column (#12630) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-03 11:29:33 +08:00
godchen c4f0837d84
Fix insert pks overwrite (#12365) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-29 22:01:41 +08:00
godchen f31ed089b5
Add timeout for reader next (#12308) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-26 22:45:24 +08:00
godchen e3f49858c5
Add subscription prefix (#12251) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-24 17:47:15 +08:00
godchen 3fa5b4a9ce
Delete for segment indexing (#12197) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-23 17:17:16 +08:00
godchen 9d5bcd3e3a
Close event and binlog reader (#12173) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-22 17:27:14 +08:00
godchen 02bf77aabf
Close reader stream (#12167) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-22 16:17:14 +08:00
godchen 116a503b4a
From dml cp load delete msg (#12144) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-21 07:33:14 +08:00
Xiaofan f654621650
Remove the etcd deletion of segment data path on querynode (#11863) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-17 12:13:10 +08:00
xige-16 d857577a7b
Postpone the execution of handoff until index creation is complete (#11648) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-12 18:49:10 +08:00
bigsheeper 93149c5ad9
Load growing segment in query node (#11664) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-12 18:27:10 +08:00
godchen 863f1bb34e
Fix multi delete data not effect (#11422) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-09 15:01:17 +08:00
cai.zhang 5b42a3223c
Increase compatibility for EstimateMemorySize interface (#10603) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-26 15:34:21 +08:00
yukun 6949350b8b
Call segmentLoadDeletedRecord in segment_loader (#10472) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-23 09:31:10 +08:00
bigsheeper 5c58924420
Add cgroups to get container memory and check index memory in segment loader (#10363) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-22 20:49:10 +08:00
xige-16 8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel (#10084) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-10-22 19:07:15 +08:00
godchen ffc0c07610
Change delete data primary key to int64 (#10438) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-22 15:37:12 +08:00
godchen d6bf0c928f
Get stats delta path from datacoord (#10362) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-22 14:31:13 +08:00
congqixia f39e06b24e
Filters out nil BF stats (#10279) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-20 16:14:36 +08:00
sunby db53eccec9
Add binlog iterators (#10173) 
issue: #9530
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-20 11:52:35 +08:00
godchen 8daeb0d519
Change bloom filter use pk (#10193) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-19 20:18:47 +08:00
godchen 24a6fc096b
Update query node bloom filter (#10109) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-18 20:08:42 +08:00
bigsheeper e7d92e4e79
Add streaming segments memory to used memory when checkLoadMemory (#8940) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-30 21:54:08 +08:00