milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
11,011 Commits
130 Branches
115 Tags
556 MiB
Commit Graph

553 Commits (c3f0c5a3ff9f618ed4c8b7033bada0041e8ab320)

Author SHA1 Message Date
godchen 3c98adfe41
Handle util funcutil returned error (#9170) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-04 17:18:56 +08:00
godchen fd6eb5d187
[skip ci]Add util healthz comment (#9171) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-04 08:14:31 +08:00
zhenshan.cao 057317f8b2
[skip ci] Fix golint error in pulsar_client.go (#9155) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-03 20:54:13 +08:00
zhenshan.cao 906a9bd37c
[skip ci] fix golint error in metrics_info.go (#9127) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-03 19:49:55 +08:00
dragondriver 7d87f0368f
[skip ci] Add desc comments for ProcessFuncParallel (#9130) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-03 10:37:59 +08:00
dragondriver 9b095843e4
[skip ci] Add desc comments for GetUsedMemoryCount (#9129) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-03 10:36:08 +08:00
dragondriver d13ae5f336
[skip ci] Add desc comments for NewMetricsCacheManager (#9128) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-03 10:34:18 +08:00
Xiangyu Wang 71b7e768e7
[skip ci]Fix golint warnings in timerecord (#9104) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-03 00:53:55 +08:00
Xiangyu Wang f93981ca71
[skip ci]Fix golint warnings in trace (#9100) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-03 00:50:08 +08:00
Xiangyu Wang 9664554129
[skip ci]Fix golint warnings in tsoutil (#9099) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-03 00:48:17 +08:00
Xiangyu Wang f8fd416b4d
[skip ci]Fix golint warnings in uniquegenerator (#9098) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-03 00:46:22 +08:00
Xiangyu Wang 1659a9ac03
[skip ci]Fix golint warnings in distance (#9097) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-03 00:44:31 +08:00
Xiangyu Wang f05127e415
[skip ci]Fix golint warnings in dabloom (#9096) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-03 00:42:38 +08:00
zhenshan.cao 395d44e55a
[skip ci] Fix golint error in options.go (#9086) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-02 20:03:56 +08:00
dragondriver 1d5062b63a
[skip ci] Add desc comments for GetCPUUsage (#9066) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-02 12:07:56 +08:00
dragondriver 2e47e38b9d
[skip ci] Add desc comments for MetricsCacheManager (#9065) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-02 12:06:05 +08:00
Xiaofan 2c2b800ff4
Change Log Name with NodeId (#8721) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-01 08:52:50 +08:00
yukun 9303a6414d
Format rocksmq code (#8955) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-30 21:27:55 +08:00
yukun c486007796
Rocksmq support SubscriptionPositionLatest (#8947) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-30 20:51:40 +08:00
congqixia 6bbf0a8f8f
Read datanode insertbuf from env (#8942) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-30 17:45:07 +08:00
dragondriver 3636ade689
Use runtime.CallersFrames to get more detailed stack information (#8868) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-29 22:02:00 +08:00
yukun 7094722fb0
Normalize rocksmq comment (#8886) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-29 20:54:00 +08:00
yukun 0edb2db331
Destroy write batch and write options in DeleteMessages (#8884) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-29 20:46:09 +08:00
congqixia db944cd09c
Refactor flowgraph and related invocation (#8770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-29 20:19:59 +08:00
yukun e85cbea18d
Set CacheIndexAndFilterBlocks to true for rocksdb (#8851) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-29 18:45:59 +08:00
dragondriver fa7e622f93
Fix trace wrapper StartSpanFromContext (#8826) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-29 14:22:00 +08:00
dragondriver 803d9ae8ca
Fix trace wrapper to catch the correct file name and line number (#8760) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-28 22:14:03 +08:00
yukun 1eb3168254
Unset max open files in rocksdb (#8799) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-28 21:20:03 +08:00
godchen e236a1ccf9
[skip ci]Add retry comment (#8776) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-28 20:44:03 +08:00
congqixia 788844698e
Add implementation check for ConsumerMessage interface (#8781) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-28 19:24:04 +08:00
congqixia 01b4253a74
Fix mqconsumer data race (#8752) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-28 17:04:04 +08:00
ZhiShen 0e767f0e1b
Change cmake version (#8666) 
Change cmake version from 3.16 to 3.18

1. Change the CMakeList's minimum require version.

2. Change the describtion document of cmake version.

Resolves: milvus-io#8407

Signed-off-by: Shen Zhi <m13120163046@163.com>
 2021-09-28 14:00:03 +08:00
dragondriver 6065bb50c4
Fix golint warning of funcutil (#8652) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-27 23:18:02 +08:00
Xiaofan 93fc10f8a6
Remove channel&&common.yaml (#8716) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-27 22:32:02 +08:00
yukun dcf1c27d66
Fix go lint in mqclient (#8685) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-27 20:32:13 +08:00
zhenshan.cao b71bffe26f
Replace ChannelID with ShardName in DML Request (#8539) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-27 10:01:59 +08:00
Xiaofan d38adda8c2
Rename log file based on node id (#8517) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-26 21:18:11 +08:00
godchen d0074c3641
[skip ci]Fix trace comment (#8611) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-26 21:15:56 +08:00
godchen 5eb1a449d2
Make retry config private (#8613) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-26 20:13:58 +08:00
Xiaofan 31ec399edb
Move channel configuration from channel.yaml to milvus.yaml (#8420) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-26 19:46:17 +08:00
yukun 174c6275ca
golint rocksmq client (#8604) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-26 19:35:57 +08:00
yukun c4c89a639a
Fix go lint in rocksmq (#8559) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-26 18:29:56 +08:00
congqixia 353eeab8b9
Add MessageID return value in producers (#8586) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-26 17:38:07 +08:00
yukun 075d6880a4
Fix rocksmq memleak (#8564) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-26 15:31:56 +08:00
groot 6168c0b9c7
Reduce go unittest time cost (#8555) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-26 12:42:14 +08:00
zhenshan.cao 54331f4aac
[skip ci] Add comments for utility function CompareIndexParams (#8525) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-24 22:05:55 +08:00
yukun 5e25041254
Add rocksmq comments (#8474) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-24 21:45:56 +08:00
jingkl 12fb8290b9
add log to produce.go (#8489) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-09-24 20:48:22 +08:00
dragondriver 82c28d225c
Fix golint warning of metrics info (#8501) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-24 20:35:56 +08:00
yukun a8a0ae27ae
Add rocksmq client comments (#8475) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-24 16:05:55 +08:00
congqixia a182326c60
Fix liveness check not quit after canceled (#8454) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-24 12:47:54 +08:00
dragondriver 208f32547f
[skip ci] Fix healthz router path (#8446) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-24 11:29:54 +08:00
Cai Yudong 74d5bb3eef
Update comments for indexparamcheck/utils.go (#8437) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-24 09:41:54 +08:00
zhenshan.cao 98c423480e
[skip ci] Add comments for indexparamcheck (#8436) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-23 22:37:54 +08:00
NotRyan e3d3834243
Fix debug typos in sesion_util (#8020) 
Signed-off-by: NotRyan <ryan.chan@zilliz.com>

Co-authored-by: NotRyan <ryan.chan@zilliz.com>
 2021-09-23 21:54:03 +08:00
congqixia da6d93527d
Add session liveness check (#8408) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-23 18:29:55 +08:00
yukun f34e5205f7
Fix some memleak in rocksmq (#8405) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-23 17:21:54 +08:00
yukun 78e8e4aa22
Add rocksmq comments (#8362) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-23 16:59:54 +08:00
dragondriver fb98f06de8
Expose simd type to index node metrics (#8300) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-23 11:29:54 +08:00
dragondriver b3f6bd2088
Expose simd type to query node metrics (#8299) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-23 11:27:54 +08:00
yukun 9e17fdb598
Improve rocksmq codecov (#8328) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-22 20:16:04 +08:00
godchen 75672abab4
Add lease time (#8064) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-22 17:50:00 +08:00
yukun 06c9f03c59
Refactor rocksmq close logic and improve codecov (#8278) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-22 17:21:00 +08:00
dragondriver 85a6953330
Support healthz check api (#8228) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-22 16:18:21 +08:00
congqixia bdfb8768d4
Enable gosec (#8202) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-18 14:45:50 +08:00
godchen b3f965c7d4
Add unrecoverable error for retry. (#7828) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-18 10:49:51 +08:00
Cai Yudong d10c6abc9e
Apply for msgstream from pool when creating collection (#7738) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-18 09:13:50 +08:00
godchen 9e1b4dcd6f
Make init private (#8104) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-17 16:29:51 +08:00
godchen 295ee49472
Add trace comment (#7994) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-17 11:17:57 +08:00
yukun e0761271dd
[skip ci]Add rocksmq_retention comment (#8016) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-15 23:29:48 +08:00
godchen 863444cc45
Delete performance (#8000) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-15 20:29:48 +08:00
XuanYang-cn ff8fef6ad0
Upgrade pulsar-client-go to 0.6.0 (#7909) 
MessageID interface of pulsar-client-go adds
4 more methods. So I add these methods into
`MessageID` interface.

Resolves: #7770

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-15 18:13:49 +08:00
yukun 13f9b32452
Improve global_rmq code coverage (#7928) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-15 17:31:49 +08:00
groot 2398dafbca
Add unittest for distributed proxy (#7976) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-15 17:29:49 +08:00
congqixia 06d4faf771
Fix G109 from gosec, prevents overflow (#7896) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-14 18:35:48 +08:00
yukun 4bf3c6889c
Support bool field filter in search and query expression (#7814) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-14 16:15:47 +08:00
yukun f1366b9451
Rename rocksmq unittests (#7846) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-14 09:55:00 +08:00
groot c242b8bb25
Rename unittest for flowgraph (#7794) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-13 16:34:26 +08:00
groot 203010524d
Rename unittest for metricsinfo (#7795) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-13 16:33:27 +08:00
Cai Yudong 27dcf698d3
Support set segcore chunk_size via config file (#7635) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-11 14:40:01 +08:00
dragondriver a872a4357c
Add more test cases for proxy implementation (#7685) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-11 11:36:22 +08:00
yukun 92295b77a1
Add DestroyTopic and DestroyConsumerGroup for CloseRocksMQ (#7730) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-10 20:54:01 +08:00
yukun d60ea8bc21
Change prefix length to FixedChannelNameLen + 1 (#7717) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-10 17:42:10 +08:00
Cai Yudong 4e23ed9a18
Revert apply physical channels from pool (d5f7e358 and 3b960969) (#7687) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-10 13:00:00 +08:00
yukun 5a303e7672
Fix rocksmq load with prefix (#7678) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-10 10:22:01 +08:00
yukun 34228eb74b
Add topic lock for DestroyConsumerGroup (#7636) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-10 10:20:00 +08:00
dragondriver 596357dc85
Add more data definition test cases (#7623) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-09 19:02:08 +08:00
congqixia 8e814a2972
Make flowgraph Close only once (#7631) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-09 17:12:38 +08:00
zhenshan.cao 89358ad91e
Deep copy rocksdb data to byte slice (#7605) 
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-09 10:56:00 +08:00
dragondriver 9b21b3b5fd
Initialize test framework of proxy (#7563) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-09 10:06:29 +08:00
godchen 3c2821e5e2
Add rmq consumer close (#7596) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-08 21:49:59 +08:00
groot 159d3702a0
Rename unittest for indexparamcheck (#7580) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-08 19:10:03 +08:00
groot ae3a43cf37
Rename unittest for funcutil (#7581) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-08 16:53:30 +08:00
groot 618fef0a43
Add unittest for mqclient (#7578) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-08 16:52:35 +08:00
groot 58700dedbc
Update unittest name of distance (#7537) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-08 11:28:25 +08:00
yukun fbc352263c
Improve rocksmq client code coverage (#7540) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-08 11:03:59 +08:00
groot 89815a64d7
Update unittest name of paramtable (#7526) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-07 15:20:40 +08:00
groot 1401ed516d
Add unittest for flowgraph (#7512) 2021-09-07 09:39:47 +08:00
dragondriver 42b687bf48
Add unittest for task scheduler (#7508) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-06 20:49:04 +08:00
yukun 7025a6e925
Improve rocksmq code coverage (#7483) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-06 19:36:42 +08:00
groot af7b7537f0
Update unittest for calc_distance (#7488) 2021-09-06 11:35:02 +08:00
groot ccfb350bd1
Unittest for funcutil (#7473) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-04 12:13:25 +08:00
Cai Yudong 5a16236768
Improve codecov for paramtable and typeutil (#7471) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-04 10:22:41 +08:00
dragondriver 960741ee16
Support more detailed metrics information (#7472) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 19:35:47 +08:00
dragondriver 1db573731b
Cache the system information metrics (#7436) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 17:15:26 +08:00
godchen db8067d61c
Add trace ut (#7445) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-03 15:41:25 +08:00
groot 229965a9bb
Unittest for indexparamcheck (#7464) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-03 14:22:17 +08:00
Cai Yudong 7edd96989f
Improve codecov for paramtable and typeutil (#7451) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-02 22:18:10 +08:00
yukun d5d73833b2
Add some logs in rocksmq retention (#7403) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-02 20:04:10 +08:00
dragondriver 3721cbfea1
Proxy metrics integrates with other coordinators (#7400) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-01 17:35:00 +08:00
yukun 71aa300499
Fix rocksmq retention panic when delete by message size (#7393) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-01 12:03:58 +08:00
dragondriver 89748ac639
Expose metrics of data cluster (#7177) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-01 10:13:15 +08:00
Cai Yudong 3b9609692b
Apply for msgstream from pool when creating collection (#7377) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-31 18:35:58 +08:00
dragondriver f0dbdd7f13
Expose metrics of root coordinator (#7228) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-31 11:45:59 +08:00
Cai Yudong f4b53df727
Revert "Apply for msgstream from pool when creating collection (#7323)" (#7376) 
This reverts commit e6de86a433.
 2021-08-31 11:07:58 +08:00
Cai Yudong e6de86a433
Apply for msgstream from pool when creating collection (#7323) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-31 09:47:58 +08:00
congqixia 1c88c8b0a5
Clean fmt.Println in util/flowgraph (#7355) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-30 15:29:57 +08:00
godchen c333af0dcf
Add query node segment filter (#7303) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-28 10:12:00 +08:00
congqixia 0281bd8d22
Change context to correct package (#7331) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-27 15:37:56 +08:00
Xiaofan 58b2089692
Import Embedded Etcd Kv Part 1(#7112) (#7174) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-08-24 09:45:51 +08:00
wt 780a4d2c8e
Update script of run_go_codecov (#7248) 
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2021-08-23 22:01:51 +08:00
godchen db25550fd0
Add segment filter interface (#7231) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-23 17:49:50 +08:00
紫晴 7233b62dad
Enable 70% of delta condition judgment for codecov (#7160) 
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2021-08-19 15:50:12 +08:00
dragondriver 648d22ee40
Expose metrics of IndexCoord and IndexNodes (#7157) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-19 10:28:10 +08:00
紫晴 09525f5723
Update file of codecov (#7144) 
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2021-08-18 14:48:11 +08:00
groot b4eb20f2c0
Fix calc_distance TANIMOTO bug (#7140) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-08-18 11:16:10 +08:00
dragondriver e45cb6c644
Expose system topology information by proxy (#7137) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-18 10:12:10 +08:00
紫晴 1b4231b4e8
Add yaml file of codecov (#7124) 
* Add yaml file of codecov

Signed-off-by: wangting0128 <ting.wang@zilliz.com>

* Update code of codecov

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2021-08-17 11:56:11 +08:00
dragondriver 7eb8a665b2
Expose metrics of QueryCoord and QueryNodes (#7113) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-17 10:06:11 +08:00
congqixia fb22d122e5
Add EarliestMessageID patch logic (#7119) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-16 19:08:09 +08:00
yukun 847586eb95
Add rocksmq retention (#6617) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-08-16 18:46:10 +08:00
XuanYang-cn 6c5be83ea1
Refactor NewEtcdKV API (#7075) 
This PR mainly did the following 3 things:

- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision

The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.

Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.

Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.

Resolves: #6955

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-08-13 11:04:09 +08:00
Xiangyu Wang 5e78fd6a97
[skip ci]Update approvers (#7063) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-12 19:36:09 +08:00
dragondriver b3f10ae5cc
Fix 6990, enhance the log when parsing grpc recv/send parameters (#6993) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-12 16:16:09 +08:00
congqixia 9eb35996b5
Fix pulsar consumer goroutine leakage (#7004) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-06 09:45:24 +08:00
dragondriver ad77a6e0d4
Fix #6859, increase the MaxCallRecvMsgSize and MaxCallSendMsgSize of grpc client (#6861) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-04 13:03:24 +08:00
bigsheeper 07cc449fbf
Fix data race in flow graph (#6946) 
* Fix data race in flow graph

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* add cancel func to flowgraph

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-08-03 22:43:25 +08:00
Xiaofan aba234fa3f
Fix Msgstream exponential retry (#6807) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-08-03 10:39:24 +08:00
godchen db94d7771f
Read vector from disk (#6707) 
* Read vector from disk

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix git action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix test error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix caculate error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change var name

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix len error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused code

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change bytes to float method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change float to bytes method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-07-24 09:25:22 +08:00
bigsheeper 21bc5810c0
remove redundant log of query node (#6768) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-07-23 20:09:33 +08:00
dragondriver 67c1fdd2c0
Show/Describe collections/partitions with created timestamp (#6700) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-21 18:00:14 +08:00
bigsheeper 7b9f0d398f
update flowgraph unittest (#6537) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-07-15 14:51:55 +08:00
cai.zhang f469a315d6
Refactor the logic of assign tasks in IndexCoord (#6328) 
* Refactor the logic of assign tasks in IndexCoord

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bugs

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for unittest

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Add lock for map

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Improve code

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix unittest bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reduce duriation for timetick

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Update orm version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset sdk version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset orm version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset test ip

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for unissued

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Rename some variables

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Use break instead of continue in select::case

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
 2021-07-14 14:15:55 +08:00
neza2017 8b89744c6b
search with exp (#6409) 
* process float vector and binary vector field
on the search result

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add more debug info on etcd

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add debug info when grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-10 10:21:52 +08:00
groot 19fc42c9eb
calc_distance typo (#6380) 
* calc_distance typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc_distance typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-07-09 14:53:52 +08:00
FluorineDog 97b1426666
fix benchmark, add support for primary key in schemaHelper (#6281) 
* fix benchmark

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* fix tests

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-07-06 09:50:01 +08:00
groot a364d7303b
Implement calculate vectors distance in server (#6219) 
* calc distance stage 3

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 5

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 6

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* code style

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-07-01 18:56:17 +08:00
godchen 49a0528d53
Fix trace (#6218) 
* Fix trace

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-30 16:18:13 +08:00
neza2017 4e4ab4adc6
check if etcd is health before register session (#6215) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-30 14:12:15 +08:00
neza2017 6d7edc6015
fix typo (#6142) 
* fix typo

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add log

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-26 18:04:12 +08:00
neza2017 2e37fca214
add log in session (#6136) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-26 14:14:11 +08:00
yukun e94a27856e
Mkdir rocksmq_path if not exist (#6134) 
Signed-off-by: kun yu <kun.yu@zilliz.com>
 2021-06-26 12:28:07 +08:00
yukun 39614aa8eb
Add rocksmq_path in config and paramtable (#6099) 
* Add rocksmq_path in config and paramtable

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add rocksdbPath in NewRmsFactory

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change rdb default path to /vat/lib/milvus/rdb_data

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-25 19:44:11 +08:00
yukun eb818d05ab
Remove vector fields from output fields (#6112) 
* Remove vector fields from output fields

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add empty_collection error_code

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-25 16:52:11 +08:00
yukun 0f409da136
Fix standalone seek hang after restart (#6073) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-24 16:44:07 +08:00
dragondriver 133814be8e
Fix pq params check when creating index (#6052) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-06-24 15:40:10 +08:00
godchen 17303bf4d3
Change session doc (#6022) 
* change session doc

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-23 17:14:10 +08:00
Cai Yudong a09a3a1905
rename service to coord (#6020) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-23 16:14:08 +08:00
godchen 99be4c09a5
change retry (#5996) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-23 09:24:10 +08:00
Cai Yudong 7dbf33b788
Update component names in config files (#5989) 
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 19:08:03 +08:00
xige-16 2af1c27811
Rename queryservice to querycoordinator (#5931) 
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-22 16:44:09 +08:00
yukun 282d2624e0
Not remove rocksdb folder when close and init (#5974) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-22 16:20:10 +08:00
dragondriver fd57554d32
Add index params check in proxy (#5958) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-06-22 15:28:04 +08:00
Cai Yudong 2926a78968
Rename proxynode to proxy (#5961) 
* rename package name from proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/proxynode to distributed/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/proxynode to internal/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 14:40:07 +08:00
sunby 7f2d7c1da3
Rename dataservice to datacoordinator (#5912) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-21 18:22:13 +08:00
Cai Yudong 92e429d812
Rename IndexService to IndexCoord (#5932) 
* rename package indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix queryservice static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/indexservice to distributed/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/indexservice to internal/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename MasterComponent to RootCoordComponent

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for queryservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for dataservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for datanode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for proxynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for querynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix rebase issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-21 17:28:03 +08:00
godchen fbcd754e52
Add new retry (#5911) 
* Add new retry

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix gofmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-21 13:52:05 +08:00
sunby da1f9f9241
Rename dataservice to datacoordinator (#5904) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-21 11:40:15 +08:00
XuanYang-cn ab7f642740
Add alias in paramtable (#5878) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-06-19 12:38:06 +08:00
Cai Yudong 3b0951e3e6
Combine standalone binary into milvus (#5866) 
* rename service to coord for cmd

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update docs

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update variable name

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize roles.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* support milvus run standalone

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove cmd/standalone

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord for compoments

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add comments for codacy check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* set helm chart branch

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-18 15:20:08 +08:00
Cai Yudong ae3daff5e4
Rename Master to RootCoord (#5830) 
* rename master_service.go to root_coordinator.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coordinator under cmd

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord under cmd

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord for metrics

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord for masterservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix metrics unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* roll back cmd

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-17 16:47:57 +08:00
godchen b7bf26b486
Update grpc trace (#5817) 
* Update grpc trace

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove useless code in mod

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-17 14:17:56 +08:00
yukun e9a8d1c404
Add vChannels in proxy for query results (#5802) 
* Fix proxynode for new retrieve logic

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove querynodenum from proxynode and querynode

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove QueryNodeIDList from proxy

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-16 20:15:59 +08:00
Cai Yudong f28403b99b
clean proxy service (#5812) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-16 18:19:57 +08:00
neza2017 71ed21f9bf
Pass smoke test (#5797) 
* pass smoke test

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-16 16:59:50 +08:00
godchen c2ecce61c0
Make pulsar client singleton (#5782) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-15 19:03:56 +08:00
neza2017 96cb24e566
fix session util (#5780) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-15 18:53:55 +08:00
zhenshan.cao 5c69c6902d Refactor proxy channelTimeTick and fix search timeout (#5760) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-15 16:36:36 +08:00
Cai Yudong 0f4bd50ce3 Support ETCD endpoints array (#5755) 2021-06-15 16:36:36 +08:00
zhenshan.cao f74ea3beee [skip ci] Remove ProxyService (#5738) 
* [skip ci] Remove ProxyService

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Change helm branch

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fix bug: paramstable crashed

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-15 16:36:35 +08:00
neza2017 ac9dde7352 fix seek on pulsar msgstream (#5726) 
* fix seek on pulsar msgstream

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* test seek on pulsar msgstream

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* msg-seek test test

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add pure pulsar client seek test

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-15 16:14:29 +08:00
Cai Yudong fd07d544c3 [skip ci]add timerecord for debug (#5729) 
* add timerecord for debug

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update comments

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-15 16:14:29 +08:00
sunby 189ac881f3 Fix bugs (#5676) 
* Remove redundant session startup

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Register datanode after start success

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* fix meta snap shot

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* fix datanode message stream channel

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* Fix bugs when drop empty collection

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Fix bug of getting pchan statistics from task scheduler

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* Fix i/dist/dataservice test code

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* Fix epoch lifetime not applied

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* fix datanode flowgraph dd node

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* Fix handle datanode timetick bug

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Remove repack function of dml stream

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* fix proxynode

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* Apply extended seal policy

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* add check for time tick

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* fix check

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* Fix the repack function of dml stream

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* Fix the bug when send statistics of pchan

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* Fix the repack function when craete dml stream

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* fix bugs

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* fix describe collection

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* Fix bug when send timestamp statistics

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* fix data node

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* Add length check before flush request

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* add log for data node

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* Fix SaveBinlog bugs

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Add more log in datanode

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* Put SegmentState.Flushing as the last one in enum to fit the client

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Fix params in GetInsertBinlogPaths

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Rename policy

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Remove unused ddl functions and fields

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* Remove pchan when drop collection

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* Add balanced assignment policy

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* fix master ut

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* Add lock in session manager

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* add log for debug

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* Fix some logic bug and typo

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

* Fix recover bugs

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Get collection scheme of a specific timestamp

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* Change CheckPoint to SegmentInfo in VchannelInfo

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* Recover Unflushed segment numOfRows

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* Fix dataservice unit tests

Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-06-15 16:06:11 +08:00
godchen 91ef35bad4 Change receive msg logic (#5605) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-15 16:04:48 +08:00
neza2017 cb6ae3678a fix master service ut (#5555) 
* fix master unitttest

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* tt

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* fix master ut

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-15 15:59:04 +08:00
sunby f1ccbb8f9a Fix init session in dataservice (#5522) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-15 15:59:04 +08:00
bigsheeper 8aae0f7cc9
Refactor flow graph and load/watchDML in query node (#5682) 
* Refactor flow graph and load/watchDML in query node

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-06-09 11:37:55 +08:00
Cai Yudong d5cd561449
Add metrics for master (#5515) 
* metric

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* metric

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add MasterDDChannelTimeTick for metrics

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add metrics for all master grpc

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* register metrics

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add metrics register

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add comments for codacy check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix format issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-01 11:04:31 +08:00
Xiangyu Wang ca0993c274 Update OWNERS 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-05-30 18:58:47 +08:00
yukun c63524deb9
Add dablooms (#5440) 
* Add dablooms cwrapper

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix undefined reference bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add cwrapper_dablooms_build shell script

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-05-28 10:23:30 +08:00
neza2017 f80dbab6ec
watch proxynode (#5424) 
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

Resolves: #5423
 2021-05-26 12:14:30 +00:00
yukun a3fb1356de
Fix rocksmq seek error (#5432) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>

In milvus-standalone, when seek is called, rocksmq won't put a
mutex in MsgMutex channel, which cause that the consume
process hang. So the seek function in rocksmq needs to 
notify the consumer to consume.
 2021-05-26 09:31:09 +00:00
godchen 200801271d
Fix GetSession error (#5401) 
Fix GetSession error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-25 12:15:46 +00:00
godchen 042a061123
Fix session util error (#5370) 
Fix session util error.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-24 08:31:06 +00:00
godchen dd736ee8ba
Change session doc (#5355) 
Change session doc

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-24 03:53:07 +00:00
zhenshan.cao 4e1b12269b
Fix bug: rand.Seed reset and generate duplicate number (#5361) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-05-24 02:50:37 +00:00
neza2017 e326eaad1e
master client,reconnect if grpc failed (#5360) 
master client,reconnect if grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-05-24 01:44:49 +00:00
godchen d189bf4d33
Change pulsar version (#5352) 
Change pulsar version.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-22 03:36:49 +00:00
godchen 0eee7e5252
Change session (#5329) 
Change session.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-21 11:28:52 +00:00
godchen 913712fbea
Improve session manager (#5310) 
Improve session manager.
Issue #5174

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-20 07:07:25 +00:00