milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
13,554 Commits
149 Branches
120 Tags
577 MiB
Commit Graph

781 Commits (f96cd84efb0ce2a65fff46b97f04619874b59ec2)

Author SHA1 Message Date
congqixia dddf84b194
Add unit test for pulsarClient Seek (#11107) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-03 16:34:12 +08:00
zhenshan.cao b768fb2e07
[skip ci]Fix golint error in indexparamcheck (#11046) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-02 21:18:55 +08:00
dragondriver 7f00753074
[skip ci] Fix golint warning of time.go (#11025) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-02 21:05:45 +08:00
godchen a0a3a889e7
Add common endian for global use (#11092) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-02 18:16:32 +08:00
yukun 82e5d21317
Fix MB const size (#11088) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-02 18:06:28 +08:00
yukun ea6cd7d27c
Move topic lock to the front of final delete in retention expired cleanup (#11076) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-02 17:28:31 +08:00
yukun a8722797fe
Add topic lock for rocksmq Seek (#11083) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-02 17:00:31 +08:00
Xiaofan ca56290e85
Fix rocksdb retention ts not set (#11081) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-02 16:50:31 +08:00
Ji Bin c63b804606
Windows dummy metrics for container. (#10625) 
In windows we do not have cgroups.
This changes for return a dummy metrics under windows.

Signed-off-by: Ji Bin <matrixji@live.com>
 2021-11-02 16:36:31 +08:00
congqixia 7d671b14ff
Fix SeekToLatest memory leakage and remove redundant logic (#11057) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-02 14:14:40 +08:00
yukun af7a5ca50f
[skip ci]Add rocksmq client comments (#11052) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-01 23:02:33 +08:00
dragondriver 66c255c02e
[skip ci] Fix golint warning of conf_adapter_mgr.go (#11026) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-01 22:43:48 +08:00
congqixia be0daafdb0
Fix rocksmq SeekToLatest (#11029) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-01 19:35:51 +08:00
XuanYang-cn ca857d922c
Fix session util using the same context (#10981) 
Before this PR, session_util used the same context for new session,
keepalive check, and etcd keep alive. So if we cancel this context
by ourselves, half the chances will the etcd keep-alive-channel be
closed by etcd, which will make session utils `think` there's something
wrong in connecting to etcd, and half the chances will our keepalive check
exit as expected.

To solve this problem, this PR seperates 2 contexts: etcd keep alive
channel context and our liveness check context. So that when we cancel
this liveness check context, session util will exit as expected.

Resolves: #10881

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-01 18:25:58 +08:00
groot a6160bc79e
[skip ci] Add comment (#10991) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-11-01 15:48:02 +08:00
groot 815d67375a
[skip ci] Add comment (#10990) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-11-01 15:46:12 +08:00
Cai Yudong 0fe88c0571
Update schema_test (#10932) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-30 15:16:39 +08:00
yukun 9016bd7e33
[skip ci]Add rocksmq comments (#10925) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-29 21:45:01 +08:00
congqixia 390fad4eb7
Fix LatestPosition option conflict with earliest patch (#10907) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-29 21:30:49 +08:00
Cai Yudong 0049837dc4
Add utils API AppendFieldData (#10910) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-29 18:06:43 +08:00
dragondriver 42ff76d379
[skip ci] Fix golint warning of indexparamcheck (#10912) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-29 17:49:28 +08:00
dragondriver 614e95fbf8
[skip ci] Fix golint warning of metrics (#10911) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-29 17:47:39 +08:00
groot 104c16fd1b
[skip ci] Typo (#10886) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-29 12:01:16 +08:00
BIKI DAS c41bc0dede
Combined function params (#10868) 
Signed-off-by: Biki-das <bikid475@gmail.com>
 2021-10-29 11:06:37 +08:00
BIKI DAS b1d6d52c36
Combined appends into a single call (#10865) 
Signed-off-by: Biki-das <bikid475@gmail.com>
 2021-10-29 10:58:38 +08:00
Xiaofan 93f205b49e
Rename param names (#10853) 
* Rename param names

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

* Rename configs

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-28 23:16:40 +08:00
Xiaofan fce23538a8
Remote Common yaml (#10616) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-28 21:24:41 +08:00
dragondriver 0334a1c3e8
[skip ci] Fix golint warning of container.go (#10819) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-28 20:21:09 +08:00
bigsheeper d264e150cf
Use TotalInactiveFile in GetContainerMemUsed (#10800) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-28 16:40:25 +08:00
BIKI DAS 1f2f76789e
Combined function params (#10786) 
Signed-off-by: Biki-das <bikid475@gmail.com>
 2021-10-28 15:58:29 +08:00
bigsheeper 9a0d1d1e74
Fix get container mem usage (#10796) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-28 14:22:23 +08:00
Xiaofan 6fddcb3925
Fix Session checker for proxy (#10737) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-27 21:58:33 +08:00
XuanYang-cn bb7e3d3e70
Fix ParseHybridTs return type to int64 (#10583) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-27 16:30:28 +08:00
BIKI DAS d55d3d63eb
Improved empty string tests (#10429) 
Signed-off-by: Biki-das <bikid475@gmail.com>
 2021-10-27 14:44:24 +08:00
zhenshan.cao 49e23ebc85
[skip ci]Fix golint error in basetable (#10698) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-26 22:35:05 +08:00
yukun 552efd4b7b
[skip ci]Add comments for rocksmq producer_impl Send (#10696) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-26 21:40:24 +08:00
yukun e8651a1cd9
[skip ci]Add comments for rocksmq producer_impl (#10695) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-26 21:38:29 +08:00
cai.zhang aff5cd9598
Supprot to read the configuration of minio from environment variables (#10534) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-26 15:10:03 +08:00
yukun 5f5949cf2f
[skip ci]Remove unused code (#10597) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-25 20:30:48 +08:00
bigsheeper 5c58924420
Add cgroups to get container memory and check index memory in segment loader (#10363) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-22 20:49:10 +08:00
congqixia 76b64a9d01
Remove not needed ctx from rocksmq client (#10416) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-22 17:25:12 +08:00
Xiangyu Wang d9abce6764
Fix unittest failed in schema_test.go (#10401) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-21 22:47:11 +08:00
yukun 319b3282d9
[skip ci]Add comments for rocksmq consumer_impl (#10389) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-21 22:45:22 +08:00
yukun 4a8619619b
[skip ci]Add comments for rocksmq (#10388) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-21 22:43:21 +08:00
edward.zeng 39b204374b
[skip ci] Fix rocksmq retention typo (#10376) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-10-21 19:56:10 +08:00
congqixia c2c2036154
Stop retention gracefully (#10367) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-21 19:50:26 +08:00
Xiangyu Wang ff71f53877
[skip ci]Improve error message in schema (#10354) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-21 19:44:19 +08:00
Xiangyu Wang c3e8903dc2
[skip ci]Improve error message in schema (#10353) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-21 19:42:26 +08:00
Xiangyu Wang bbd558f509
[skip ci]Improve error messages in convension (#10352) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-21 19:40:35 +08:00
BIKI DAS 0120068d92
returning nill explicitly (#10349) 
Signed-off-by: Biki-das <bikid475@gmail.com>
 2021-10-21 13:46:35 +08:00
godchen cfe2546b0d
Fix retry error missed (#10318) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-21 12:20:35 +08:00
congqixia 0c6d5098a0
Fix fieldID typo in typeutil (#10335) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-21 11:06:43 +08:00
yukun f15dc150f1
[skip ci]Add comments for retention (#10316) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-21 10:59:01 +08:00
bigsheeper c18fa9b785
Watch changeInfo in query node (#10045) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-20 17:54:43 +08:00
Xiangyu Wang cd6a4a6704
[skip ci]Improve error message in mqclient (#10241) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-20 10:56:35 +08:00
Xiangyu Wang a2b8add4e2
[skip ci]Improve error message in mqclient (#10240) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-20 10:54:43 +08:00
Xiangyu Wang 1493aa1f65
[skip ci]Improve comments in mqclient (#10242) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-20 10:52:35 +08:00
yukun 81190c573a
[skip ci]Add comments for UpdateAckedInfo (#10213) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-19 20:34:50 +08:00
yukun 7c7a66df6d
[skip ci]Add comments for rocksmq Notify (#10212) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-19 20:32:48 +08:00
Xiangyu Wang 736a2cc358
[skip ci]Improve error message in rocksmq (#10196) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-19 17:54:37 +08:00
Xiangyu Wang 88a2b2b07c
[skip ci]Improve error message in rocksmq (#10195) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-19 17:52:42 +08:00
Xiangyu Wang afa6eeecd7
[skip ci]Improve error message in rocksmq (#10194) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-19 17:50:49 +08:00
yukun 401753dea0
[skip ci]Add comments for rocksmq SeekToLatest (#10120) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-18 19:52:49 +08:00
yukun ec667846f4
[skip ci]Add comments for rocksmq Seek (#10119) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-18 19:50:59 +08:00
yukun 8dccd0ca70
[skip ci]Add comments for rocksmq Consume (#10118) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-18 19:48:40 +08:00
yukun 65a1ae0210
[skip ci]Add comments for rocksmq produce (#10030) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-16 22:05:04 +08:00
yukun e8d5a1ee5f
[skip ci]Add comments for DestroyConsumerGroup (#10029) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-16 22:03:09 +08:00
yukun 241acadce9
Remove error return when seek invalid messages in seekToLatest (#9967) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-16 21:49:40 +08:00
dragondriver 977e98d21b
[skip ci] Fix golint warning of paramtable (#9991) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-15 20:38:58 +08:00
Xiaofan d845153de4
Add Buffer for consumer channel (#9578) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-15 20:31:16 +08:00
Xiangyu Wang f8c52dd5bb
Fix golint warning in indexparamcheck (#9947) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-15 20:23:16 +08:00
Xiangyu Wang 7ab109e57d
Fix golint warning in indexparamcheck (#9946) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-15 16:36:37 +08:00
yukun 2cfdf22897
Change retention ticker time to 10 minutes (#9933) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-15 15:44:35 +08:00
yukun 83f1b75293
[skip ci]Add comments for RegisterConsumer (#9912) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-14 20:02:37 +08:00
yukun a0d9991d6f
[skip ci]Add comments for CreateConsumerGroup (#9911) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-14 20:00:35 +08:00
congqixia 6b8ff60de3
Close event channel when watch event found error (#9819) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-14 19:20:35 +08:00
congqixia ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order (#9860) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-14 16:40:35 +08:00
zhenshan.cao bbafd05911
[skip ci]Fix golint error in paramtable (#9851) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-14 14:04:34 +08:00
Xiangyu Wang 478daeaeea
Fix golint warnings in indexparamcheck (#9863) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-14 12:02:40 +08:00
Xiangyu Wang 274dd03a10
Fix golint warnings in indexparamcheck (#9861) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-14 11:52:40 +08:00
Xiangyu Wang 41bd393fe6
Fix golint warnings in indexparamcheck (#9862) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-14 11:30:39 +08:00
dragondriver 72d3d470ba
Use the server id as identifier in system topology graph (#9825) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-14 11:12:38 +08:00
yukun d2e2e0a63c
[skip ci]Add comments for ExistConsumerGroup (#9832) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-13 20:44:33 +08:00
yukun 67d38d6cf1
Fix retention datarace (#9828) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-13 20:38:33 +08:00
zhenshan.cao e97b62cf67
Change RocksDBLRUCache size to 0 (#9820) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-13 20:28:34 +08:00
dragondriver 395a122678
[skip ci] Fix golint warning of metric_type.go (#9829) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-13 20:14:33 +08:00
godchen 31c3942ca7
[skip ci]Fix mqclient producer fmt (#9774) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-13 12:44:33 +08:00
jingkl 66e8583f86
[skip ci] Add producer.go description (#8748) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-10-13 11:14:39 +08:00
yukun e3ce1696e7
[skip ci]Add comments for rocksmq DestroyTopic (#9735) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-12 19:37:20 +08:00
yukun 55c615b4e2
[skip ci]Add comments for rocksmq CreateTopic (#9733) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-12 19:33:24 +08:00
yukun cdeb64d90a
Delete messages before delete meta data in rocksmq retention (#9694) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-12 19:09:22 +08:00
yukun b6b4b784cc
Delete end key after rocksdb DeleteRange (#9572) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-10 21:50:33 +08:00
yukun 12b985c32e
Add resource free in err process (#9564) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-09 19:39:16 +08:00
dragondriver 6eb2fe6993
[skip ci] Fix go lint warning of hardware_info.go (#9589) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-09 19:35:02 +08:00
yukun b6ec1783e4
Remove acked infos in memory for retention (#8735) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-09 17:24:55 +08:00
yukun a6e97e0d44
Change LRUCache size of rocksdb to 512MB (#9509) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-09 11:08:56 +08:00
yukun 969c78e79d
[skip ci]Add comments for rocksmq close (#9519) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-09 00:11:36 +08:00
yukun 97a6bde82a
[skip ci]Add comments for StringToMsgID (#9518) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-09 00:07:52 +08:00
yukun 1ec153ad9b
[skip ci]Add comments for CreateProducer (#9517) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-09 00:03:51 +08:00
godchen f4e0736e01
Handle util rocksmq returned error (#9169) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-08 19:07:21 +08:00
Xiaofan fdbfa62b27
Add log for rocksmq (#8889) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-07 22:18:56 +08:00
dragondriver 057834fa57
[skip ci] Add desc comments for BaseConfAdapter (#9414) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-07 22:10:42 +08:00
yukun f89f2ded88
[skip ci]Add comments for rmq client subscribe (#9422) 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-10-07 21:21:05 +08:00
yukun 3dcfff3a70
[skip ci]Add comments for rmq client method (#9423) 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-10-07 21:18:52 +08:00
yukun a4cffb7f1c
[skip ci]Add comments for rmqMessage (#9420) 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-10-07 21:10:55 +08:00
yukun 24bf834fe8
[skip ci]Add comments for rmqID (#9419) 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-10-07 21:09:02 +08:00
dragondriver b9e956f742
[skip ci] Add desc comments for ConfAdapterImpl (#9413) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-07 20:26:59 +08:00
godchen 9454f3529d
[skip ci]Fix conf adapter go fmt (#9376) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2021-10-07 10:30:18 +08:00
godchen 0ebc9e2064
[skip ci]Fix trace comment type (#9362) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2021-10-06 23:28:06 +08:00
godchen b0b3a5c137
[skip ci]Fix calc distance comment lint error (#9360) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2021-10-06 23:04:00 +08:00
dragondriver 1fb02f87f0
[skip ci] Add desc comments for CheckTrain (#9341) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-06 19:34:05 +08:00
dragondriver 434c587c4e
[skip ci] Add desc comments for GetDiskCount (#9340) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-06 19:32:16 +08:00
dragondriver 5f309f64ee
[skip ci] Add desc comments for GetSystemInfoMetrics (#9339) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-06 19:30:37 +08:00
congqixia 1d5d0903e8
[skip ci] Fix golint for sessionutil (#9335) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-06 19:21:17 +08:00
Xiangyu Wang 4722f5991b
[skip ci]Fix golint warnings in typeutil (#9302) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-06 07:10:36 +08:00
godchen a3c2fb3ffb
Remove error in trace log err return (#9058) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-06 07:04:02 +08:00
zhenshan.cao 3705232178
[skip ci] Fix golint error in typeutil (#9285) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-05 21:16:05 +08:00
dragondriver 1502239dae
[skip ci] Add desc comments for SystemTopologyNode (#9276) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-05 20:44:42 +08:00
dragondriver 1758227cfc
[skip ci] Add desc comments for InvalidateSystemInfoMetrics (#9275) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-05 20:43:01 +08:00
dragondriver 4bac5b1f4d
[skip ci] Add desc comments for GetMemoryCount (#9274) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-05 20:41:05 +08:00
Xiangyu Wang b6617a295a
[skip ci]Fix golint warnings in mqclient (#9239) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-04 23:48:10 +08:00
Xiangyu Wang f3c538a86a
[skip ci]Fix golint warnings in errors (#9237) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-04 23:44:26 +08:00
Xiangyu Wang 0c899deb50
[skip ci]Fix golint warning in healthz (#9236) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-04 23:42:18 +08:00
Xiangyu Wang 7e611e8799
[skip ci]Fix golint warnings in funcutil (#9235) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-04 23:40:01 +08:00
Xiangyu Wang a5daaf0755
[skip ci]Fix golint warnings in flowgraph (#9234) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-04 22:38:02 +08:00
dragondriver e70722968c
[skip ci] Add desc comments for GetCPUCoreCount (#9219) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-04 19:30:02 +08:00
dragondriver f68425cbf6
[skip ci] Add desc comments for GenRandomStr (#9218) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-04 19:28:12 +08:00
dragondriver fb22186c72
[skip ci] Add desc comments for SliceContain (#9217) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-04 19:26:18 +08:00
godchen 3c98adfe41
Handle util funcutil returned error (#9170) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-04 17:18:56 +08:00
godchen fd6eb5d187
[skip ci]Add util healthz comment (#9171) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-04 08:14:31 +08:00
zhenshan.cao 057317f8b2
[skip ci] Fix golint error in pulsar_client.go (#9155) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-03 20:54:13 +08:00
zhenshan.cao 906a9bd37c
[skip ci] fix golint error in metrics_info.go (#9127) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-03 19:49:55 +08:00
dragondriver 7d87f0368f
[skip ci] Add desc comments for ProcessFuncParallel (#9130) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-03 10:37:59 +08:00
dragondriver 9b095843e4
[skip ci] Add desc comments for GetUsedMemoryCount (#9129) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-03 10:36:08 +08:00
dragondriver d13ae5f336
[skip ci] Add desc comments for NewMetricsCacheManager (#9128) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-03 10:34:18 +08:00
Xiangyu Wang 71b7e768e7
[skip ci]Fix golint warnings in timerecord (#9104) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-03 00:53:55 +08:00
Xiangyu Wang f93981ca71
[skip ci]Fix golint warnings in trace (#9100) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-03 00:50:08 +08:00
Xiangyu Wang 9664554129
[skip ci]Fix golint warnings in tsoutil (#9099) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-03 00:48:17 +08:00
Xiangyu Wang f8fd416b4d
[skip ci]Fix golint warnings in uniquegenerator (#9098) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-03 00:46:22 +08:00
Xiangyu Wang 1659a9ac03
[skip ci]Fix golint warnings in distance (#9097) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-03 00:44:31 +08:00
Xiangyu Wang f05127e415
[skip ci]Fix golint warnings in dabloom (#9096) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-03 00:42:38 +08:00
zhenshan.cao 395d44e55a
[skip ci] Fix golint error in options.go (#9086) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-02 20:03:56 +08:00
dragondriver 1d5062b63a
[skip ci] Add desc comments for GetCPUUsage (#9066) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-02 12:07:56 +08:00
dragondriver 2e47e38b9d
[skip ci] Add desc comments for MetricsCacheManager (#9065) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-02 12:06:05 +08:00
Xiaofan 2c2b800ff4
Change Log Name with NodeId (#8721) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-01 08:52:50 +08:00
yukun 9303a6414d
Format rocksmq code (#8955) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-30 21:27:55 +08:00
yukun c486007796
Rocksmq support SubscriptionPositionLatest (#8947) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-30 20:51:40 +08:00
congqixia 6bbf0a8f8f
Read datanode insertbuf from env (#8942) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-30 17:45:07 +08:00
dragondriver 3636ade689
Use runtime.CallersFrames to get more detailed stack information (#8868) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-29 22:02:00 +08:00
yukun 7094722fb0
Normalize rocksmq comment (#8886) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-29 20:54:00 +08:00
yukun 0edb2db331
Destroy write batch and write options in DeleteMessages (#8884) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-29 20:46:09 +08:00
congqixia db944cd09c
Refactor flowgraph and related invocation (#8770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-29 20:19:59 +08:00
yukun e85cbea18d
Set CacheIndexAndFilterBlocks to true for rocksdb (#8851) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-29 18:45:59 +08:00
dragondriver fa7e622f93
Fix trace wrapper StartSpanFromContext (#8826) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-29 14:22:00 +08:00
dragondriver 803d9ae8ca
Fix trace wrapper to catch the correct file name and line number (#8760) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-28 22:14:03 +08:00
yukun 1eb3168254
Unset max open files in rocksdb (#8799) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-28 21:20:03 +08:00
godchen e236a1ccf9
[skip ci]Add retry comment (#8776) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-28 20:44:03 +08:00
congqixia 788844698e
Add implementation check for ConsumerMessage interface (#8781) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-28 19:24:04 +08:00
congqixia 01b4253a74
Fix mqconsumer data race (#8752) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-28 17:04:04 +08:00
ZhiShen 0e767f0e1b
Change cmake version (#8666) 
Change cmake version from 3.16 to 3.18

1. Change the CMakeList's minimum require version.

2. Change the describtion document of cmake version.

Resolves: milvus-io#8407

Signed-off-by: Shen Zhi <m13120163046@163.com>
 2021-09-28 14:00:03 +08:00
dragondriver 6065bb50c4
Fix golint warning of funcutil (#8652) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-27 23:18:02 +08:00
Xiaofan 93fc10f8a6
Remove channel&&common.yaml (#8716) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-27 22:32:02 +08:00
yukun dcf1c27d66
Fix go lint in mqclient (#8685) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-27 20:32:13 +08:00
zhenshan.cao b71bffe26f
Replace ChannelID with ShardName in DML Request (#8539) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-27 10:01:59 +08:00
Xiaofan d38adda8c2
Rename log file based on node id (#8517) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-26 21:18:11 +08:00
godchen d0074c3641
[skip ci]Fix trace comment (#8611) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-26 21:15:56 +08:00
godchen 5eb1a449d2
Make retry config private (#8613) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-26 20:13:58 +08:00
Xiaofan 31ec399edb
Move channel configuration from channel.yaml to milvus.yaml (#8420) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-26 19:46:17 +08:00
yukun 174c6275ca
golint rocksmq client (#8604) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-26 19:35:57 +08:00
yukun c4c89a639a
Fix go lint in rocksmq (#8559) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-26 18:29:56 +08:00
congqixia 353eeab8b9
Add MessageID return value in producers (#8586) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-26 17:38:07 +08:00
yukun 075d6880a4
Fix rocksmq memleak (#8564) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-26 15:31:56 +08:00
groot 6168c0b9c7
Reduce go unittest time cost (#8555) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-26 12:42:14 +08:00
zhenshan.cao 54331f4aac
[skip ci] Add comments for utility function CompareIndexParams (#8525) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-24 22:05:55 +08:00
yukun 5e25041254
Add rocksmq comments (#8474) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-24 21:45:56 +08:00
jingkl 12fb8290b9
add log to produce.go (#8489) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2021-09-24 20:48:22 +08:00
dragondriver 82c28d225c
Fix golint warning of metrics info (#8501) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-24 20:35:56 +08:00
yukun a8a0ae27ae
Add rocksmq client comments (#8475) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-24 16:05:55 +08:00
congqixia a182326c60
Fix liveness check not quit after canceled (#8454) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-24 12:47:54 +08:00
dragondriver 208f32547f
[skip ci] Fix healthz router path (#8446) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-24 11:29:54 +08:00
Cai Yudong 74d5bb3eef
Update comments for indexparamcheck/utils.go (#8437) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-24 09:41:54 +08:00
zhenshan.cao 98c423480e
[skip ci] Add comments for indexparamcheck (#8436) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-23 22:37:54 +08:00
NotRyan e3d3834243
Fix debug typos in sesion_util (#8020) 
Signed-off-by: NotRyan <ryan.chan@zilliz.com>

Co-authored-by: NotRyan <ryan.chan@zilliz.com>
 2021-09-23 21:54:03 +08:00
congqixia da6d93527d
Add session liveness check (#8408) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-23 18:29:55 +08:00
yukun f34e5205f7
Fix some memleak in rocksmq (#8405) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-23 17:21:54 +08:00
yukun 78e8e4aa22
Add rocksmq comments (#8362) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-23 16:59:54 +08:00
dragondriver fb98f06de8
Expose simd type to index node metrics (#8300) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-23 11:29:54 +08:00
dragondriver b3f6bd2088
Expose simd type to query node metrics (#8299) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-23 11:27:54 +08:00
yukun 9e17fdb598
Improve rocksmq codecov (#8328) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-22 20:16:04 +08:00
godchen 75672abab4
Add lease time (#8064) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-22 17:50:00 +08:00
yukun 06c9f03c59
Refactor rocksmq close logic and improve codecov (#8278) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-22 17:21:00 +08:00
dragondriver 85a6953330
Support healthz check api (#8228) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-22 16:18:21 +08:00
congqixia bdfb8768d4
Enable gosec (#8202) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-18 14:45:50 +08:00
godchen b3f965c7d4
Add unrecoverable error for retry. (#7828) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-18 10:49:51 +08:00
Cai Yudong d10c6abc9e
Apply for msgstream from pool when creating collection (#7738) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-18 09:13:50 +08:00
godchen 9e1b4dcd6f
Make init private (#8104) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-17 16:29:51 +08:00
godchen 295ee49472
Add trace comment (#7994) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-17 11:17:57 +08:00
yukun e0761271dd
[skip ci]Add rocksmq_retention comment (#8016) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-15 23:29:48 +08:00
godchen 863444cc45
Delete performance (#8000) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-15 20:29:48 +08:00
XuanYang-cn ff8fef6ad0
Upgrade pulsar-client-go to 0.6.0 (#7909) 
MessageID interface of pulsar-client-go adds
4 more methods. So I add these methods into
`MessageID` interface.

Resolves: #7770

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-15 18:13:49 +08:00
yukun 13f9b32452
Improve global_rmq code coverage (#7928) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-15 17:31:49 +08:00
groot 2398dafbca
Add unittest for distributed proxy (#7976) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-15 17:29:49 +08:00
congqixia 06d4faf771
Fix G109 from gosec, prevents overflow (#7896) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-14 18:35:48 +08:00
yukun 4bf3c6889c
Support bool field filter in search and query expression (#7814) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-14 16:15:47 +08:00
yukun f1366b9451
Rename rocksmq unittests (#7846) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-14 09:55:00 +08:00
groot c242b8bb25
Rename unittest for flowgraph (#7794) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-13 16:34:26 +08:00
groot 203010524d
Rename unittest for metricsinfo (#7795) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-13 16:33:27 +08:00
Cai Yudong 27dcf698d3
Support set segcore chunk_size via config file (#7635) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-11 14:40:01 +08:00
dragondriver a872a4357c
Add more test cases for proxy implementation (#7685) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-11 11:36:22 +08:00
yukun 92295b77a1
Add DestroyTopic and DestroyConsumerGroup for CloseRocksMQ (#7730) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-10 20:54:01 +08:00
yukun d60ea8bc21
Change prefix length to FixedChannelNameLen + 1 (#7717) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-10 17:42:10 +08:00
Cai Yudong 4e23ed9a18
Revert apply physical channels from pool (d5f7e358 and 3b960969) (#7687) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-10 13:00:00 +08:00
yukun 5a303e7672
Fix rocksmq load with prefix (#7678) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-10 10:22:01 +08:00
yukun 34228eb74b
Add topic lock for DestroyConsumerGroup (#7636) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-10 10:20:00 +08:00
dragondriver 596357dc85
Add more data definition test cases (#7623) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-09 19:02:08 +08:00
congqixia 8e814a2972
Make flowgraph Close only once (#7631) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-09 17:12:38 +08:00
zhenshan.cao 89358ad91e
Deep copy rocksdb data to byte slice (#7605) 
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-09 10:56:00 +08:00
dragondriver 9b21b3b5fd
Initialize test framework of proxy (#7563) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-09 10:06:29 +08:00
godchen 3c2821e5e2
Add rmq consumer close (#7596) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-08 21:49:59 +08:00
groot 159d3702a0
Rename unittest for indexparamcheck (#7580) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-08 19:10:03 +08:00
groot ae3a43cf37
Rename unittest for funcutil (#7581) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-08 16:53:30 +08:00
groot 618fef0a43
Add unittest for mqclient (#7578) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-08 16:52:35 +08:00
groot 58700dedbc
Update unittest name of distance (#7537) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-08 11:28:25 +08:00
yukun fbc352263c
Improve rocksmq client code coverage (#7540) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-08 11:03:59 +08:00
groot 89815a64d7
Update unittest name of paramtable (#7526) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-07 15:20:40 +08:00
groot 1401ed516d
Add unittest for flowgraph (#7512) 2021-09-07 09:39:47 +08:00
dragondriver 42b687bf48
Add unittest for task scheduler (#7508) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-06 20:49:04 +08:00
yukun 7025a6e925
Improve rocksmq code coverage (#7483) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-06 19:36:42 +08:00
groot af7b7537f0
Update unittest for calc_distance (#7488) 2021-09-06 11:35:02 +08:00
groot ccfb350bd1
Unittest for funcutil (#7473) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-04 12:13:25 +08:00
Cai Yudong 5a16236768
Improve codecov for paramtable and typeutil (#7471) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-04 10:22:41 +08:00
dragondriver 960741ee16
Support more detailed metrics information (#7472) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 19:35:47 +08:00
dragondriver 1db573731b
Cache the system information metrics (#7436) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 17:15:26 +08:00
godchen db8067d61c
Add trace ut (#7445) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-03 15:41:25 +08:00
groot 229965a9bb
Unittest for indexparamcheck (#7464) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-03 14:22:17 +08:00
Cai Yudong 7edd96989f
Improve codecov for paramtable and typeutil (#7451) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-02 22:18:10 +08:00
yukun d5d73833b2
Add some logs in rocksmq retention (#7403) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-02 20:04:10 +08:00
dragondriver 3721cbfea1
Proxy metrics integrates with other coordinators (#7400) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-01 17:35:00 +08:00
yukun 71aa300499
Fix rocksmq retention panic when delete by message size (#7393) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-01 12:03:58 +08:00
dragondriver 89748ac639
Expose metrics of data cluster (#7177) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-01 10:13:15 +08:00
Cai Yudong 3b9609692b
Apply for msgstream from pool when creating collection (#7377) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-31 18:35:58 +08:00
dragondriver f0dbdd7f13
Expose metrics of root coordinator (#7228) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-31 11:45:59 +08:00
Cai Yudong f4b53df727
Revert "Apply for msgstream from pool when creating collection (#7323)" (#7376) 
This reverts commit e6de86a433.
 2021-08-31 11:07:58 +08:00
Cai Yudong e6de86a433
Apply for msgstream from pool when creating collection (#7323) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-31 09:47:58 +08:00
congqixia 1c88c8b0a5
Clean fmt.Println in util/flowgraph (#7355) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-30 15:29:57 +08:00
godchen c333af0dcf
Add query node segment filter (#7303) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-28 10:12:00 +08:00
congqixia 0281bd8d22
Change context to correct package (#7331) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-27 15:37:56 +08:00
Xiaofan 58b2089692
Import Embedded Etcd Kv Part 1(#7112) (#7174) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-08-24 09:45:51 +08:00
wt 780a4d2c8e
Update script of run_go_codecov (#7248) 
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2021-08-23 22:01:51 +08:00
godchen db25550fd0
Add segment filter interface (#7231) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-23 17:49:50 +08:00
紫晴 7233b62dad
Enable 70% of delta condition judgment for codecov (#7160) 
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2021-08-19 15:50:12 +08:00
dragondriver 648d22ee40
Expose metrics of IndexCoord and IndexNodes (#7157) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-19 10:28:10 +08:00
紫晴 09525f5723
Update file of codecov (#7144) 
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2021-08-18 14:48:11 +08:00
groot b4eb20f2c0
Fix calc_distance TANIMOTO bug (#7140) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-08-18 11:16:10 +08:00
dragondriver e45cb6c644
Expose system topology information by proxy (#7137) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-18 10:12:10 +08:00
紫晴 1b4231b4e8
Add yaml file of codecov (#7124) 
* Add yaml file of codecov

Signed-off-by: wangting0128 <ting.wang@zilliz.com>

* Update code of codecov

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2021-08-17 11:56:11 +08:00
dragondriver 7eb8a665b2
Expose metrics of QueryCoord and QueryNodes (#7113) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-17 10:06:11 +08:00
congqixia fb22d122e5
Add EarliestMessageID patch logic (#7119) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-16 19:08:09 +08:00
yukun 847586eb95
Add rocksmq retention (#6617) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-08-16 18:46:10 +08:00
XuanYang-cn 6c5be83ea1
Refactor NewEtcdKV API (#7075) 
This PR mainly did the following 3 things:

- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision

The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.

Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.

Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.

Resolves: #6955

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-08-13 11:04:09 +08:00
Xiangyu Wang 5e78fd6a97
[skip ci]Update approvers (#7063) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-12 19:36:09 +08:00
dragondriver b3f10ae5cc
Fix 6990, enhance the log when parsing grpc recv/send parameters (#6993) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-12 16:16:09 +08:00
congqixia 9eb35996b5
Fix pulsar consumer goroutine leakage (#7004) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-06 09:45:24 +08:00
dragondriver ad77a6e0d4
Fix #6859, increase the MaxCallRecvMsgSize and MaxCallSendMsgSize of grpc client (#6861) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-04 13:03:24 +08:00
bigsheeper 07cc449fbf
Fix data race in flow graph (#6946) 
* Fix data race in flow graph

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* add cancel func to flowgraph

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-08-03 22:43:25 +08:00
Xiaofan aba234fa3f
Fix Msgstream exponential retry (#6807) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-08-03 10:39:24 +08:00
godchen db94d7771f
Read vector from disk (#6707) 
* Read vector from disk

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix git action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix test error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix caculate error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change var name

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix len error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused code

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change bytes to float method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change float to bytes method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-07-24 09:25:22 +08:00
bigsheeper 21bc5810c0
remove redundant log of query node (#6768) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-07-23 20:09:33 +08:00
dragondriver 67c1fdd2c0
Show/Describe collections/partitions with created timestamp (#6700) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-21 18:00:14 +08:00
bigsheeper 7b9f0d398f
update flowgraph unittest (#6537) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-07-15 14:51:55 +08:00
cai.zhang f469a315d6
Refactor the logic of assign tasks in IndexCoord (#6328) 
* Refactor the logic of assign tasks in IndexCoord

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bugs

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for unittest

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Add lock for map

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Improve code

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix unittest bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reduce duriation for timetick

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Update orm version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset sdk version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset orm version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset test ip

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for unissued

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Rename some variables

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Use break instead of continue in select::case

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
 2021-07-14 14:15:55 +08:00
neza2017 8b89744c6b
search with exp (#6409) 
* process float vector and binary vector field
on the search result

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add more debug info on etcd

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add debug info when grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-10 10:21:52 +08:00
groot 19fc42c9eb
calc_distance typo (#6380) 
* calc_distance typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc_distance typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-07-09 14:53:52 +08:00
FluorineDog 97b1426666
fix benchmark, add support for primary key in schemaHelper (#6281) 
* fix benchmark

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* fix tests

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-07-06 09:50:01 +08:00
groot a364d7303b
Implement calculate vectors distance in server (#6219) 
* calc distance stage 3

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 5

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 6

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* code style

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-07-01 18:56:17 +08:00
godchen 49a0528d53
Fix trace (#6218) 
* Fix trace

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-30 16:18:13 +08:00
neza2017 4e4ab4adc6
check if etcd is health before register session (#6215) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-30 14:12:15 +08:00
neza2017 6d7edc6015
fix typo (#6142) 
* fix typo

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add log

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-26 18:04:12 +08:00
neza2017 2e37fca214
add log in session (#6136) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-26 14:14:11 +08:00
yukun e94a27856e
Mkdir rocksmq_path if not exist (#6134) 
Signed-off-by: kun yu <kun.yu@zilliz.com>
 2021-06-26 12:28:07 +08:00
yukun 39614aa8eb
Add rocksmq_path in config and paramtable (#6099) 
* Add rocksmq_path in config and paramtable

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add rocksdbPath in NewRmsFactory

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change rdb default path to /vat/lib/milvus/rdb_data

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-25 19:44:11 +08:00
yukun eb818d05ab
Remove vector fields from output fields (#6112) 
* Remove vector fields from output fields

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add empty_collection error_code

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-25 16:52:11 +08:00
yukun 0f409da136
Fix standalone seek hang after restart (#6073) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-24 16:44:07 +08:00
dragondriver 133814be8e
Fix pq params check when creating index (#6052) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-06-24 15:40:10 +08:00
godchen 17303bf4d3
Change session doc (#6022) 
* change session doc

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-23 17:14:10 +08:00
Cai Yudong a09a3a1905
rename service to coord (#6020) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-23 16:14:08 +08:00
godchen 99be4c09a5
change retry (#5996) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-23 09:24:10 +08:00
Cai Yudong 7dbf33b788
Update component names in config files (#5989) 
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 19:08:03 +08:00
xige-16 2af1c27811
Rename queryservice to querycoordinator (#5931) 
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-22 16:44:09 +08:00
yukun 282d2624e0
Not remove rocksdb folder when close and init (#5974) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-22 16:20:10 +08:00
dragondriver fd57554d32
Add index params check in proxy (#5958) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-06-22 15:28:04 +08:00
Cai Yudong 2926a78968
Rename proxynode to proxy (#5961) 
* rename package name from proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/proxynode to distributed/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/proxynode to internal/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 14:40:07 +08:00
sunby 7f2d7c1da3
Rename dataservice to datacoordinator (#5912) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-21 18:22:13 +08:00
Cai Yudong 92e429d812
Rename IndexService to IndexCoord (#5932) 
* rename package indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix queryservice static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/indexservice to distributed/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/indexservice to internal/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename MasterComponent to RootCoordComponent

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for queryservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for dataservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for datanode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for proxynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for querynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix rebase issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-21 17:28:03 +08:00
godchen fbcd754e52
Add new retry (#5911) 
* Add new retry

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix gofmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-21 13:52:05 +08:00
sunby da1f9f9241
Rename dataservice to datacoordinator (#5904) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-21 11:40:15 +08:00
XuanYang-cn ab7f642740
Add alias in paramtable (#5878) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-06-19 12:38:06 +08:00
Cai Yudong 3b0951e3e6
Combine standalone binary into milvus (#5866) 
* rename service to coord for cmd

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update docs

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update variable name

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize roles.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* support milvus run standalone

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove cmd/standalone

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord for compoments

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add comments for codacy check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* set helm chart branch

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-18 15:20:08 +08:00
Cai Yudong ae3daff5e4
Rename Master to RootCoord (#5830) 
* rename master_service.go to root_coordinator.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coordinator under cmd

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord under cmd

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord for metrics

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord for masterservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix metrics unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* roll back cmd

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-17 16:47:57 +08:00
godchen b7bf26b486
Update grpc trace (#5817) 
* Update grpc trace

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove useless code in mod

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-17 14:17:56 +08:00