Commit Graph

4971 Commits (4f3d5fb6eb647d7864273eb3176f5e1fb8b35363)

Author SHA1 Message Date
yah01 4f3d5fb6eb
Make load operation parallel improve performance (#15928)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-11 14:28:01 +08:00
Letian Jiang 8f52e5b6c7
Add unit tests in segcore (#15960)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-03-10 16:33:59 +08:00
Ten Thousand Leaves d5bae6710f
Make all logs configurable for standalone/embedded Milvus. (#15926)
Resolves: #15919, #15708
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-10 10:35:59 +08:00
groot 5fdef607d5
Add rpc interfaces for import (#15930)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-09 18:33:59 +08:00
Xiaofan d013134b44
Enhance error message when coordinator not healthy (#15950)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-03-09 15:57:58 +08:00
XuanYang-cn c2fe12bc97
Handle error in topic creation of rocksmq (#15922)
Reopen for: #14429

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-09 15:47:59 +08:00
congqixia 6513be5c44
Extend watch/release channel logic in DataNode (#15925)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-09 15:39:58 +08:00
bigsheeper 9ad5c14a4a
Return error when create message stream failed in QueryNode (#15317)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-09 15:17:59 +08:00
顾炎 4f8c08f912
fix checkSegmentSize overflows int64 (#15858)
Signed-off-by: guyan <632722781@qq.com>
2022-03-09 13:29:58 +08:00
yah01 565524ed3c
Add zstd compressor in util (#15779)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-08 18:17:58 +08:00
zhenshan.cao dff08dbf47
Refactor querynode unittest (#15929)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-08 17:39:58 +08:00
Letian Jiang 74f66dce3b
Fix passing empty binlog content in compaction (#15909) (#15927)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-03-08 16:34:01 +08:00
bigsheeper 6fec7ed6fb
Add search benchmark in QueryNode (#15854)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-08 10:15:59 +08:00
yah01 7124e91d53
Refactor assigning loading segments task in QueryCoord (#15895)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-07 19:23:58 +08:00
congqixia a5c3f4eef4
Add CompareFailErr for CAS operation error check (#15893)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-07 18:01:58 +08:00
cai.zhang 2512dff261
Fix misuse of timerecord (#15868)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-04 15:45:56 +08:00
Letian Jiang 08d12e62f3
Add ByteSlice Method for embed etcd (#15844)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-03-04 15:14:01 +08:00
Jiquan Long f71651e294
Support column-based insert data in message stream (#15802)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-04 15:09:56 +08:00
Cai Yudong 3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig (#15843)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-04 11:17:56 +08:00
Cai Yudong 57b97ccb9c
Let search fail as if one query_node return error result (#15855)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-04 10:43:56 +08:00
jaime 7a3a721380
Reconstruct mqstream module (#15784)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
congqixia 54862a31b0
Extend ChannelWatchState in protobuf (#15847)
Related #15846
/kind enhancement

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-03 18:43:56 +08:00
Letian Jiang 2be217bcf4
Specify appropriate timestamp in initPKBloomFilter (#15823) (#15826)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-03-03 17:33:56 +08:00
congqixia 3f34bc1ab7
Ban DataType_String in CreateCollection (#15838)
Fix #15836
/kind enhancement

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-03 16:57:56 +08:00
cai.zhang 88527fc0a9
Fix metrics label conflict (#15839)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-03 16:05:57 +08:00
朱亚光 27a7875a15
add array hashKeys empty check (#15796)
fix #15791 https://github.com/milvus-io/milvus/issues/15791
Signed-off-by: zhuyaguang <zhuyaguang1368@163.com>
2022-03-03 00:33:56 +08:00
cai.zhang 9f4c59e621
Add prometheus metrics for RootCoord (#15684)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-02 21:11:57 +08:00
cai.zhang 09a27d1620
Add prometheus metrics for indexnode (#15640)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-02 20:49:56 +08:00
Cai Yudong 92c8e32ebd
Let MemoryKV.Load return error when key not exist (#15814)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-02 18:51:55 +08:00
Letian Jiang 442e791128
Add ByteSlice Method for memkv (#15774)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-03-02 17:29:56 +08:00
XuanYang-cn 63eec7ffc8
Refactor logs in binlog_io to reduce output (#15827)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-02 16:49:55 +08:00
cai.zhang d183748484
Add some prometheus metrics for proxy (#15582)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-02 16:23:55 +08:00
Xiaofan bd7d294c6d
Refine log level in data (#15821)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-03-02 15:35:55 +08:00
bigsheeper 12eb8c3da5
Add prometheus metrics for QueryNode (#15649)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-02 14:49:55 +08:00
Xiaofan 827389c704
Refine tso log print (#15813)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-03-02 14:31:55 +08:00
zhenshan.cao f1aec49a74
Fixbug: building index return nil by mistake when error not occur (#15809)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-02 09:41:56 +08:00
XuanYang-cn e394ba8c88
Refactor rocksmq comments and logs for readability (#15801)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-01 18:55:55 +08:00
Cai Yudong 529098fd87
[skip ci] Update knowhere/CMakeLists.txt (#15804)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-01 17:55:55 +08:00
Jiquan Long 001567640e
Fix shallow copy of typeutil.AppendFieldData (#15790)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-01 15:13:54 +08:00
Cai Yudong 503724be19
Optimize CMakeLists.txt under internal/core (#15770)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-01 10:31:55 +08:00
Nemo a77e0562b2
Make C++ log level configurable and add log configuration while building embedded milvus. (#15743)
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-01 10:15:55 +08:00
godchen 2e4391e6c5
Add lru cache (#15733)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-02-28 21:43:55 +08:00
bigsheeper 13177a90af
Add prometheus metrics for DataNode (#15650)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2022-02-28 19:11:55 +08:00
Bingyi Sun d6857f4b24
Remove globalZapWrapper in logutil.go (#15726)
issue: #15720

Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-02-28 17:23:54 +08:00
bigsheeper e1bfd14db1
Add Prometheus metrics for QueryCoord (#15606)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: jingkl <34296482+jingkl@users.noreply.github.com>
2022-02-28 16:51:55 +08:00
Bingyi Sun b41992eda1
Fix querycoord ut bug (#15752)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-02-28 11:27:54 +08:00
yah01 0cfb6a85be
Make compaction not generate empty segment (#15707)
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2022-02-28 10:17:54 +08:00
XuanYang-cn e8edaa02fa
Refine code of DataNode binlogIO (#15759)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-02-28 10:09:54 +08:00
yah01 867cf620ee
Add Extract() method to take out C pointer from BytesConverter without releasing it (#15614)
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2022-02-27 09:47:53 +08:00
bigsheeper 6a48071a5c
Set BaseMsg for LoadSegmentRequest, prevent crashing in log printing (#15725)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-02-26 20:09:54 +08:00