Commit Graph

579 Commits (fc6bc48e3b88881213e8e0c9891ab7c2b2531527)

Author SHA1 Message Date
dragondriver 7f00753074
[skip ci] Fix golint warning of time.go (#11025)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-02 21:05:45 +08:00
godchen a0a3a889e7
Add common endian for global use (#11092)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 18:16:32 +08:00
yukun 82e5d21317
Fix MB const size (#11088)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-02 18:06:28 +08:00
yukun ea6cd7d27c
Move topic lock to the front of final delete in retention expired cleanup (#11076)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-02 17:28:31 +08:00
yukun a8722797fe
Add topic lock for rocksmq Seek (#11083)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-02 17:00:31 +08:00
Xiaofan ca56290e85
Fix rocksdb retention ts not set (#11081)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-02 16:50:31 +08:00
Ji Bin c63b804606
Windows dummy metrics for container. (#10625)
In windows we do not have cgroups.
This changes for return a dummy metrics under windows.

Signed-off-by: Ji Bin <matrixji@live.com>
2021-11-02 16:36:31 +08:00
congqixia 7d671b14ff
Fix SeekToLatest memory leakage and remove redundant logic (#11057)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-02 14:14:40 +08:00
yukun af7a5ca50f
[skip ci]Add rocksmq client comments (#11052)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-01 23:02:33 +08:00
dragondriver 66c255c02e
[skip ci] Fix golint warning of conf_adapter_mgr.go (#11026)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-01 22:43:48 +08:00
congqixia be0daafdb0
Fix rocksmq SeekToLatest (#11029)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-01 19:35:51 +08:00
XuanYang-cn ca857d922c
Fix session util using the same context (#10981)
Before this PR, session_util used the same context for new session,
keepalive check, and etcd keep alive. So if we cancel this context
by ourselves, half the chances will the etcd keep-alive-channel be
closed by etcd, which will make session utils `think` there's something
wrong in connecting to etcd, and half the chances will our keepalive check
exit as expected.

To solve this problem, this PR seperates 2 contexts: etcd keep alive
channel context and our liveness check context. So that when we cancel
this liveness check context, session util will exit as expected.

Resolves: #10881

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-01 18:25:58 +08:00
groot a6160bc79e
[skip ci] Add comment (#10991)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-11-01 15:48:02 +08:00
groot 815d67375a
[skip ci] Add comment (#10990)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-11-01 15:46:12 +08:00
Cai Yudong 0fe88c0571
Update schema_test (#10932)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-30 15:16:39 +08:00
yukun 9016bd7e33
[skip ci]Add rocksmq comments (#10925)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-29 21:45:01 +08:00
congqixia 390fad4eb7
Fix LatestPosition option conflict with earliest patch (#10907)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-29 21:30:49 +08:00
Cai Yudong 0049837dc4
Add utils API AppendFieldData (#10910)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-29 18:06:43 +08:00
dragondriver 42ff76d379
[skip ci] Fix golint warning of indexparamcheck (#10912)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-29 17:49:28 +08:00
dragondriver 614e95fbf8
[skip ci] Fix golint warning of metrics (#10911)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-29 17:47:39 +08:00
groot 104c16fd1b
[skip ci] Typo (#10886)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-29 12:01:16 +08:00
BIKI DAS c41bc0dede
Combined function params (#10868)
Signed-off-by: Biki-das <bikid475@gmail.com>
2021-10-29 11:06:37 +08:00
BIKI DAS b1d6d52c36
Combined appends into a single call (#10865)
Signed-off-by: Biki-das <bikid475@gmail.com>
2021-10-29 10:58:38 +08:00
Xiaofan 93f205b49e
Rename param names (#10853)
* Rename param names

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

* Rename configs

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-28 23:16:40 +08:00
Xiaofan fce23538a8
Remote Common yaml (#10616)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-28 21:24:41 +08:00
dragondriver 0334a1c3e8
[skip ci] Fix golint warning of container.go (#10819)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-28 20:21:09 +08:00
bigsheeper d264e150cf
Use TotalInactiveFile in GetContainerMemUsed (#10800)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-28 16:40:25 +08:00
BIKI DAS 1f2f76789e
Combined function params (#10786)
Signed-off-by: Biki-das <bikid475@gmail.com>
2021-10-28 15:58:29 +08:00
bigsheeper 9a0d1d1e74
Fix get container mem usage (#10796)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-28 14:22:23 +08:00
Xiaofan 6fddcb3925
Fix Session checker for proxy (#10737)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-27 21:58:33 +08:00
XuanYang-cn bb7e3d3e70
Fix ParseHybridTs return type to int64 (#10583)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 16:30:28 +08:00
BIKI DAS d55d3d63eb
Improved empty string tests (#10429)
Signed-off-by: Biki-das <bikid475@gmail.com>
2021-10-27 14:44:24 +08:00
zhenshan.cao 49e23ebc85
[skip ci]Fix golint error in basetable (#10698)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-26 22:35:05 +08:00
yukun 552efd4b7b
[skip ci]Add comments for rocksmq producer_impl Send (#10696)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-26 21:40:24 +08:00
yukun e8651a1cd9
[skip ci]Add comments for rocksmq producer_impl (#10695)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-26 21:38:29 +08:00
cai.zhang aff5cd9598
Supprot to read the configuration of minio from environment variables (#10534)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-26 15:10:03 +08:00
yukun 5f5949cf2f
[skip ci]Remove unused code (#10597)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-25 20:30:48 +08:00
bigsheeper 5c58924420
Add cgroups to get container memory and check index memory in segment loader (#10363)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 20:49:10 +08:00
congqixia 76b64a9d01
Remove not needed ctx from rocksmq client (#10416)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-22 17:25:12 +08:00
Xiangyu Wang d9abce6764
Fix unittest failed in schema_test.go (#10401)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-21 22:47:11 +08:00
yukun 319b3282d9
[skip ci]Add comments for rocksmq consumer_impl (#10389)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 22:45:22 +08:00
yukun 4a8619619b
[skip ci]Add comments for rocksmq (#10388)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 22:43:21 +08:00
edward.zeng 39b204374b
[skip ci] Fix rocksmq retention typo (#10376)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-10-21 19:56:10 +08:00
congqixia c2c2036154
Stop retention gracefully (#10367)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-21 19:50:26 +08:00
Xiangyu Wang ff71f53877
[skip ci]Improve error message in schema (#10354)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-21 19:44:19 +08:00
Xiangyu Wang c3e8903dc2
[skip ci]Improve error message in schema (#10353)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-21 19:42:26 +08:00
Xiangyu Wang bbd558f509
[skip ci]Improve error messages in convension (#10352)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-21 19:40:35 +08:00
BIKI DAS 0120068d92
returning nill explicitly (#10349)
Signed-off-by: Biki-das <bikid475@gmail.com>
2021-10-21 13:46:35 +08:00
godchen cfe2546b0d
Fix retry error missed (#10318)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-21 12:20:35 +08:00
congqixia 0c6d5098a0
Fix fieldID typo in typeutil (#10335)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-21 11:06:43 +08:00
yukun f15dc150f1
[skip ci]Add comments for retention (#10316)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 10:59:01 +08:00
bigsheeper c18fa9b785
Watch changeInfo in query node (#10045)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-20 17:54:43 +08:00
Xiangyu Wang cd6a4a6704
[skip ci]Improve error message in mqclient (#10241)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-20 10:56:35 +08:00
Xiangyu Wang a2b8add4e2
[skip ci]Improve error message in mqclient (#10240)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-20 10:54:43 +08:00
Xiangyu Wang 1493aa1f65
[skip ci]Improve comments in mqclient (#10242)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-20 10:52:35 +08:00
yukun 81190c573a
[skip ci]Add comments for UpdateAckedInfo (#10213)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-19 20:34:50 +08:00
yukun 7c7a66df6d
[skip ci]Add comments for rocksmq Notify (#10212)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-19 20:32:48 +08:00
Xiangyu Wang 736a2cc358
[skip ci]Improve error message in rocksmq (#10196)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-19 17:54:37 +08:00
Xiangyu Wang 88a2b2b07c
[skip ci]Improve error message in rocksmq (#10195)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-19 17:52:42 +08:00
Xiangyu Wang afa6eeecd7
[skip ci]Improve error message in rocksmq (#10194)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-19 17:50:49 +08:00
yukun 401753dea0
[skip ci]Add comments for rocksmq SeekToLatest (#10120)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-18 19:52:49 +08:00
yukun ec667846f4
[skip ci]Add comments for rocksmq Seek (#10119)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-18 19:50:59 +08:00
yukun 8dccd0ca70
[skip ci]Add comments for rocksmq Consume (#10118)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-18 19:48:40 +08:00
yukun 65a1ae0210
[skip ci]Add comments for rocksmq produce (#10030)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-16 22:05:04 +08:00
yukun e8d5a1ee5f
[skip ci]Add comments for DestroyConsumerGroup (#10029)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-16 22:03:09 +08:00
yukun 241acadce9
Remove error return when seek invalid messages in seekToLatest (#9967)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-16 21:49:40 +08:00
dragondriver 977e98d21b
[skip ci] Fix golint warning of paramtable (#9991)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-15 20:38:58 +08:00
Xiaofan d845153de4
Add Buffer for consumer channel (#9578)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-15 20:31:16 +08:00
Xiangyu Wang f8c52dd5bb
Fix golint warning in indexparamcheck (#9947)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-15 20:23:16 +08:00
Xiangyu Wang 7ab109e57d
Fix golint warning in indexparamcheck (#9946)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-15 16:36:37 +08:00
yukun 2cfdf22897
Change retention ticker time to 10 minutes (#9933)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-15 15:44:35 +08:00
yukun 83f1b75293
[skip ci]Add comments for RegisterConsumer (#9912)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-14 20:02:37 +08:00
yukun a0d9991d6f
[skip ci]Add comments for CreateConsumerGroup (#9911)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-14 20:00:35 +08:00
congqixia 6b8ff60de3
Close event channel when watch event found error (#9819)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 19:20:35 +08:00
congqixia ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order (#9860)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 16:40:35 +08:00
zhenshan.cao bbafd05911
[skip ci]Fix golint error in paramtable (#9851)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-14 14:04:34 +08:00
Xiangyu Wang 478daeaeea
Fix golint warnings in indexparamcheck (#9863)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-14 12:02:40 +08:00
Xiangyu Wang 274dd03a10
Fix golint warnings in indexparamcheck (#9861)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-14 11:52:40 +08:00
Xiangyu Wang 41bd393fe6
Fix golint warnings in indexparamcheck (#9862)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-14 11:30:39 +08:00
dragondriver 72d3d470ba
Use the server id as identifier in system topology graph (#9825)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-14 11:12:38 +08:00
yukun d2e2e0a63c
[skip ci]Add comments for ExistConsumerGroup (#9832)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-13 20:44:33 +08:00
yukun 67d38d6cf1
Fix retention datarace (#9828)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-13 20:38:33 +08:00
zhenshan.cao e97b62cf67
Change RocksDBLRUCache size to 0 (#9820)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-13 20:28:34 +08:00
dragondriver 395a122678
[skip ci] Fix golint warning of metric_type.go (#9829)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-13 20:14:33 +08:00
godchen 31c3942ca7
[skip ci]Fix mqclient producer fmt (#9774)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-13 12:44:33 +08:00
jingkl 66e8583f86
[skip ci] Add producer.go description (#8748)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-10-13 11:14:39 +08:00
yukun e3ce1696e7
[skip ci]Add comments for rocksmq DestroyTopic (#9735)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-12 19:37:20 +08:00
yukun 55c615b4e2
[skip ci]Add comments for rocksmq CreateTopic (#9733)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-12 19:33:24 +08:00
yukun cdeb64d90a
Delete messages before delete meta data in rocksmq retention (#9694)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-12 19:09:22 +08:00
yukun b6b4b784cc
Delete end key after rocksdb DeleteRange (#9572)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-10 21:50:33 +08:00
yukun 12b985c32e
Add resource free in err process (#9564)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-09 19:39:16 +08:00
dragondriver 6eb2fe6993
[skip ci] Fix go lint warning of hardware_info.go (#9589)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 19:35:02 +08:00
yukun b6ec1783e4
Remove acked infos in memory for retention (#8735)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-09 17:24:55 +08:00
yukun a6e97e0d44
Change LRUCache size of rocksdb to 512MB (#9509)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-09 11:08:56 +08:00
yukun 969c78e79d
[skip ci]Add comments for rocksmq close (#9519)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-09 00:11:36 +08:00
yukun 97a6bde82a
[skip ci]Add comments for StringToMsgID (#9518)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-09 00:07:52 +08:00
yukun 1ec153ad9b
[skip ci]Add comments for CreateProducer (#9517)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-09 00:03:51 +08:00
godchen f4e0736e01
Handle util rocksmq returned error (#9169)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-08 19:07:21 +08:00
Xiaofan fdbfa62b27
Add log for rocksmq (#8889)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-07 22:18:56 +08:00
dragondriver 057834fa57
[skip ci] Add desc comments for BaseConfAdapter (#9414)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-07 22:10:42 +08:00