Commit Graph

14898 Commits (dfaed5acddaada0bec2512b76187f7338c030481)

Author SHA1 Message Date
Letian Jiang dfaed5acdd
Add QueryServiceAvailable field in ShowCollections (#17456)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-06-09 18:20:07 +08:00
yah01 a38790f586
Predict the loading memory usage more accurate (#17451)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-09 18:16:07 +08:00
Jiquan Long 2ca81620ea
Reduce lock operations when get dml stream (#17468)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-09 17:34:09 +08:00
groot 9210299706
Fix bulkload OOM issue (#17461)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-06-09 16:52:07 +08:00
edward.zeng 3b0ea77382
Add weekly release for milvus 2.1 (#17459)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-06-09 11:04:06 +08:00
yanliang567 2de9fa2053
Add verify entities and fields after bulk load (#17422)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2022-06-09 10:28:07 +08:00
sre-ci-robot 7830ae8fb8
Update Pytest image changes (#17413)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-06-09 10:26:10 +08:00
zhuwenxing 24a1a013a2
[skip e2e]Add timeout for some stage (#17454)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-08 20:36:06 +08:00
xige-16 6d078ebe7a
Print more information when loading fields with different lines (#17448)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-08 20:16:06 +08:00
sre-ci-robot 2a5151f047 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-06-08 12:01:01 +00:00
wayblink 25883840b2
Remove delete log in datanode because it may influence datanode performance (#17415)
Resolves #16984

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-06-08 19:10:07 +08:00
jaime dbef4c6ec2
Align kafka consume from latest with puslar and rocksmq (#17433)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-06-08 19:00:07 +08:00
zhuwenxing a32f1da293
[test]Set flush timeout as 180s (#17442)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-08 17:58:06 +08:00
zhuwenxing 545d62f31b
[skip e2e]Display the log of proxy after test (#17447)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-08 17:52:06 +08:00
zhuwenxing 0358950683
[skip e2e]Decrease the timeout time of second test (#17446)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-08 17:42:06 +08:00
XuanYang-cn 4f66bcbb22
Fix DataNode processes event out of order (#17440)
The probability is low so very unlikly to reproduce

See also: #15966

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-06-08 17:24:07 +08:00
ThreadDao a0854210b7
[test] Update scale replica case as issue fixed (#17390)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-06-08 17:02:07 +08:00
Xiaofan 6426e3d037
Split Etcd save operation into small txns (#17386)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-08 15:08:07 +08:00
yah01 70f8bea4b4
Avoid growing slice as deserializing binlogs (#17421)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-08 11:46:06 +08:00
XuanYang-cn 1dbfebf827
Add debug log in removing assignment (#17427)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-06-08 10:44:06 +08:00
zhuwenxing 11fa3e24dd
[skip e2e]Fix log path for deploy test (#17391)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-08 10:16:06 +08:00
bigsheeper af108b5bda
Add malloc_trim after reduce search result (#17423)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-08 00:12:05 +08:00
sre-ci-robot 71a00f0551 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-06-07 12:00:57 +00:00
Ji Bin 572cd0277f
[skip e2e] Lock msys package's versions (#17414)
Signed-off-by: Ji Bin <matrixji@live.com>
2022-06-07 19:56:05 +08:00
groot f31be941bb
Fix bulkload row count bug for multi datanodes (#17384)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-06-07 16:56:07 +08:00
xige-16 b5c11a216d
Alter varChar type params's name to max_length (#17409)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-07 15:58:06 +08:00
Xiaofan a9ec1f8864
Fix compatibility of upgrade (#17406)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-07 14:52:06 +08:00
congqixia de8f2f76c5
Fix shardLeader cache with ErrConnect check (#17402)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-07 12:20:06 +08:00
jaime 218326bafe
Use unified catalog interface to reconstruct metastore (#17042)
Co-authored-by: kejiang ke.jiang@zilliz.com
Co-authored-by: yun.zhang yun.zhang@zilliz.com

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-06-07 12:00:07 +08:00
sre-ci-robot 5cb9c429f6
Update Builder image changes (#17380)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-06-06 22:24:05 +08:00
zhuwenxing 916cd23efa
[skip e2e]Update the image of etcd for chaos and deploy test (#17399)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-06 22:12:05 +08:00
bigsheeper f38637c227
Pass PlaceholderGroup pointer to prevent memory copy in SegCore (#17389)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-06 21:34:05 +08:00
zhenshan.cao 98e95275fe
Fix several code issues caused by carelessness (#17385)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-06-06 18:58:05 +08:00
bigsheeper 9f786dd752
Remove unnecessary bitset flip in Search and Query (#17387)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-06 17:38:05 +08:00
yah01 a2d2ad88bd
Make assigning segments faster (#17377)
This improve the Load performance,
and let the LoadBalance fails fast, which allows us to retry it timely

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-06 16:52:05 +08:00
congqixia ac6394d0fd
Fix container/list removal in iteration (#17382)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-06 16:34:05 +08:00
Xiaofan af994b5e1c
Fix etcd watch error (#17364)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-06 16:26:06 +08:00
bigsheeper 45febac298
Extract lease of cProto in QueryNode (#17373)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-06 15:56:05 +08:00
shaoyue 679820c8e7
Fix typo in publish builder (#17336)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-06-06 15:24:06 +08:00
XuanYang-cn c70af73005
Fix datacoord set wrong state for node registering (#17376)
Fix datacoord datarace

See also: #17335

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-06-06 15:10:05 +08:00
Jenny Li a4a699164c
[skip e2e] Disable daily release when repo is not milvus-io/milvus (#17374)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-06-06 11:50:05 +08:00
zhuwenxing 99cbaccdf1
[skip e2e]Update the method to check health for deploy (#17359)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-03 17:14:04 +08:00
bigsheeper 48cf63a2d7
Wait for flow graph to exit (#17341)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-02 19:48:04 +08:00
shaoyue 76eaa3fc50
Support access s3 through AWS IAM role (#17292)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-06-02 19:42:03 +08:00
SimFG 0986c29d7f
proxy tls support one-way authentication (#17348)
Signed-off-by: xiyichan <2863768433@qq.com>

Co-authored-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>

Co-authored-by: xiyichan <2863768433@qq.com>
2022-06-02 18:56:04 +08:00
Ten Thousand Leaves f5e63177d2
Fix an issue with bulk load with multiple DataNodes (#17324)
issue: #17300
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-06-02 18:54:04 +08:00
yah01 4e83f37899
Improve load performance (#17273)
Load segment's fields concurrently

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-02 17:56:03 +08:00
shaoyue 7c52a8c535
Add RESTful API for new methods, fix err when receive empty boy (#17260)
create collection schema use struct instead of protobuf

Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-06-02 17:40:04 +08:00
xige-16 8c69790383
Fix lost delete msg caused by loadSegment after watchDeltaChannel (#17308)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-02 16:56:04 +08:00
zhenshan.cao 5f44e45480
Add metrics on QueryNode and Proxy (#17328)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-06-02 16:06:03 +08:00