milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
11,932 Commits
149 Branches
122 Tags
581 MiB
Commit Graph

621 Commits (8bbaae04ff63f22573cfc2bd32fb53bb511aca3c)

Author SHA1 Message Date
yukun 79fc84f3db
Optimize updatePageInfo in rocksmq (#11711) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-16 17:13:10 +08:00
yukun da9228ab37
Add topic lock for DestroyTopic (#11786) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-16 17:07:10 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files (#11898) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-16 15:41:11 +08:00
yukun 897d6b5fc8
Check rmq retention only by page (#11508) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-16 14:49:11 +08:00
Xiangyu Wang f26ab5c29a
[skip ci]Improve import statements (#11635) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-15 19:24:52 +08:00
Xiangyu Wang ad09fb70ba
[skip ci]Improve import statements (#11634) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-15 19:22:45 +08:00
Xiangyu Wang 537e302e22
[skip ci]Improve import statements (#11633) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-15 19:20:34 +08:00
congqixia 304bbd3e71
Add ConsumeAfterSeek interface (#11818) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-15 18:17:10 +08:00
Xiaofan 71e814f796
Remove common.yaml and component.yaml (#11661) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-12 21:25:08 +08:00
Xiaofan 3cd47cd89e
Remove common.yaml and component.yaml (#11662) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-12 18:53:11 +08:00
yukun f51ef71b51
Change default retentionSizeInMB to 8192(8GB) (#11436) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-11 17:18:43 +08:00
Xiangyu Wang 47ff1a45fe
Improve log messages in rocksmq (#11230) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-10 22:10:47 +08:00
yukun 4c6d77201f
[skip ci]Add rmq consumer impl getExistedConsumer comment (#11594) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-10 21:50:45 +08:00
yukun 9bc7393913
[skip ci]Add rmq consumer impl Subscription comment (#11593) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-10 21:48:53 +08:00
yukun 1e86bd3038
[skip ci]Add rmq consumer impl topic comment (#11533) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-10 19:21:44 +08:00
Xiaofan 5f08b67156
Move node.yaml to component.yaml (#11363) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-10 14:27:37 +08:00
yukun 5ec895fedc
[skip ci]Add rmq consumer impl MsgMutex comment (#11532) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-09 21:13:37 +08:00
yukun 2073ae497b
[skip ci]Add rmq consumer impl chan comment (#11531) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-09 21:11:41 +08:00
yukun 11e6a8ea50
[skip ci]Add rmq_client comment (#11458) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-08 21:09:07 +08:00
congqixia 6d3952c9bf
Fix msgs consumed before seek appear in output after seek (#11419) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-08 20:57:57 +08:00
congqixia d50543a030
Batch consume msg in rockmq internal loop (#11373) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-08 20:56:07 +08:00
yukun dfbb4c33b4
Rename newExpiredCleanUp to expiredCleanUp (#11433) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-08 19:25:00 +08:00
yukun 3a65a4517c
[skip ci]Add retention comment (#11432) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-08 18:45:14 +08:00
yukun 8ec040a35c
Add rocksmqPageSize to config (#11113) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-08 10:17:18 +08:00
yukun 2c215a0be3
[skip ci]Add rmq_producer comment (#11346) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-05 21:59:10 +08:00
yukun ab00fe90de
[skip ci]Add rmq_producer comment (#11345) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-05 21:57:21 +08:00
yukun 425c7e09d4
[skip ci]Add rmq retention comment (#11344) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-05 21:53:22 +08:00
zhenshan.cao 9885838593
Add extra methods to convert between uint64 and big-endian bytes slice (#11338) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-05 19:10:59 +08:00
Xiaofan a4715996ef
Fix Pulsar seek to latest may block forever (#11128) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-05 14:55:44 +08:00
godchen 9bf68ac3eb
Fix timestamp endian error (#11220) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-05 13:56:58 +08:00
Xiangyu Wang 60848029e1
Improve warning message in rocksmq (#11227) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-05 10:58:55 +08:00
bigsheeper c99d1a56bf
Refactor proxy ticker to fix guarantee_time not work (#11248) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-05 09:14:02 +08:00
yukun c05ed4c365
[skip ci]Add rmq_imple seek comments (#11273) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-04 20:51:10 +08:00
yukun 872f6f8a04
[skip ci]Add rmq client comments (#11271) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-04 20:49:20 +08:00
yukun eda65381c2
[skip ci]Add rmq producer comments (#11272) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-04 20:45:17 +08:00
Xiangyu Wang e8c858b545
Improve error message in util (#11137) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-04 13:36:35 +08:00
Xiangyu Wang 508f560527
Improve error message in util (#11135) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-04 13:34:45 +08:00
Xiangyu Wang cc6a08f097
Improve error message in util (#11136) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-04 13:32:46 +08:00
xige-16 b567a8e5b5
Add SystemInfo msgType for getMetricRequest (#11151) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-04 10:58:11 +08:00
yukun e817cfbae6
[skip ci]Add pulsar client comments (#11197) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-03 23:20:46 +08:00
congqixia dddf84b194
Add unit test for pulsarClient Seek (#11107) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-03 16:34:12 +08:00
zhenshan.cao b768fb2e07
[skip ci]Fix golint error in indexparamcheck (#11046) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-02 21:18:55 +08:00
dragondriver 7f00753074
[skip ci] Fix golint warning of time.go (#11025) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-02 21:05:45 +08:00
godchen a0a3a889e7
Add common endian for global use (#11092) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-02 18:16:32 +08:00
yukun 82e5d21317
Fix MB const size (#11088) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-02 18:06:28 +08:00
yukun ea6cd7d27c
Move topic lock to the front of final delete in retention expired cleanup (#11076) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-02 17:28:31 +08:00
yukun a8722797fe
Add topic lock for rocksmq Seek (#11083) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-02 17:00:31 +08:00
Xiaofan ca56290e85
Fix rocksdb retention ts not set (#11081) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-02 16:50:31 +08:00
Ji Bin c63b804606
Windows dummy metrics for container. (#10625) 
In windows we do not have cgroups.
This changes for return a dummy metrics under windows.

Signed-off-by: Ji Bin <matrixji@live.com>
 2021-11-02 16:36:31 +08:00
congqixia 7d671b14ff
Fix SeekToLatest memory leakage and remove redundant logic (#11057) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-02 14:14:40 +08:00
yukun af7a5ca50f
[skip ci]Add rocksmq client comments (#11052) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-01 23:02:33 +08:00
dragondriver 66c255c02e
[skip ci] Fix golint warning of conf_adapter_mgr.go (#11026) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-01 22:43:48 +08:00
congqixia be0daafdb0
Fix rocksmq SeekToLatest (#11029) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-01 19:35:51 +08:00
XuanYang-cn ca857d922c
Fix session util using the same context (#10981) 
Before this PR, session_util used the same context for new session,
keepalive check, and etcd keep alive. So if we cancel this context
by ourselves, half the chances will the etcd keep-alive-channel be
closed by etcd, which will make session utils `think` there's something
wrong in connecting to etcd, and half the chances will our keepalive check
exit as expected.

To solve this problem, this PR seperates 2 contexts: etcd keep alive
channel context and our liveness check context. So that when we cancel
this liveness check context, session util will exit as expected.

Resolves: #10881

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-01 18:25:58 +08:00
groot a6160bc79e
[skip ci] Add comment (#10991) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-11-01 15:48:02 +08:00
groot 815d67375a
[skip ci] Add comment (#10990) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-11-01 15:46:12 +08:00
Cai Yudong 0fe88c0571
Update schema_test (#10932) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-30 15:16:39 +08:00
yukun 9016bd7e33
[skip ci]Add rocksmq comments (#10925) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-29 21:45:01 +08:00
congqixia 390fad4eb7
Fix LatestPosition option conflict with earliest patch (#10907) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-29 21:30:49 +08:00
Cai Yudong 0049837dc4
Add utils API AppendFieldData (#10910) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-29 18:06:43 +08:00
dragondriver 42ff76d379
[skip ci] Fix golint warning of indexparamcheck (#10912) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-29 17:49:28 +08:00
dragondriver 614e95fbf8
[skip ci] Fix golint warning of metrics (#10911) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-29 17:47:39 +08:00
groot 104c16fd1b
[skip ci] Typo (#10886) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-29 12:01:16 +08:00
BIKI DAS c41bc0dede
Combined function params (#10868) 
Signed-off-by: Biki-das <bikid475@gmail.com>
 2021-10-29 11:06:37 +08:00
BIKI DAS b1d6d52c36
Combined appends into a single call (#10865) 
Signed-off-by: Biki-das <bikid475@gmail.com>
 2021-10-29 10:58:38 +08:00
Xiaofan 93f205b49e
Rename param names (#10853) 
* Rename param names

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

* Rename configs

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-28 23:16:40 +08:00
Xiaofan fce23538a8
Remote Common yaml (#10616) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-28 21:24:41 +08:00
dragondriver 0334a1c3e8
[skip ci] Fix golint warning of container.go (#10819) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-28 20:21:09 +08:00
bigsheeper d264e150cf
Use TotalInactiveFile in GetContainerMemUsed (#10800) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-28 16:40:25 +08:00
BIKI DAS 1f2f76789e
Combined function params (#10786) 
Signed-off-by: Biki-das <bikid475@gmail.com>
 2021-10-28 15:58:29 +08:00
bigsheeper 9a0d1d1e74
Fix get container mem usage (#10796) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-28 14:22:23 +08:00
Xiaofan 6fddcb3925
Fix Session checker for proxy (#10737) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-27 21:58:33 +08:00
XuanYang-cn bb7e3d3e70
Fix ParseHybridTs return type to int64 (#10583) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-27 16:30:28 +08:00
BIKI DAS d55d3d63eb
Improved empty string tests (#10429) 
Signed-off-by: Biki-das <bikid475@gmail.com>
 2021-10-27 14:44:24 +08:00
zhenshan.cao 49e23ebc85
[skip ci]Fix golint error in basetable (#10698) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-26 22:35:05 +08:00
yukun 552efd4b7b
[skip ci]Add comments for rocksmq producer_impl Send (#10696) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-26 21:40:24 +08:00
yukun e8651a1cd9
[skip ci]Add comments for rocksmq producer_impl (#10695) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-26 21:38:29 +08:00
cai.zhang aff5cd9598
Supprot to read the configuration of minio from environment variables (#10534) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-26 15:10:03 +08:00
yukun 5f5949cf2f
[skip ci]Remove unused code (#10597) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-25 20:30:48 +08:00
bigsheeper 5c58924420
Add cgroups to get container memory and check index memory in segment loader (#10363) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-22 20:49:10 +08:00
congqixia 76b64a9d01
Remove not needed ctx from rocksmq client (#10416) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-22 17:25:12 +08:00
Xiangyu Wang d9abce6764
Fix unittest failed in schema_test.go (#10401) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-21 22:47:11 +08:00
yukun 319b3282d9
[skip ci]Add comments for rocksmq consumer_impl (#10389) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-21 22:45:22 +08:00
yukun 4a8619619b
[skip ci]Add comments for rocksmq (#10388) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-21 22:43:21 +08:00
edward.zeng 39b204374b
[skip ci] Fix rocksmq retention typo (#10376) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-10-21 19:56:10 +08:00
congqixia c2c2036154
Stop retention gracefully (#10367) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-21 19:50:26 +08:00
Xiangyu Wang ff71f53877
[skip ci]Improve error message in schema (#10354) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-21 19:44:19 +08:00
Xiangyu Wang c3e8903dc2
[skip ci]Improve error message in schema (#10353) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-21 19:42:26 +08:00
Xiangyu Wang bbd558f509
[skip ci]Improve error messages in convension (#10352) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-21 19:40:35 +08:00
BIKI DAS 0120068d92
returning nill explicitly (#10349) 
Signed-off-by: Biki-das <bikid475@gmail.com>
 2021-10-21 13:46:35 +08:00
godchen cfe2546b0d
Fix retry error missed (#10318) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-21 12:20:35 +08:00
congqixia 0c6d5098a0
Fix fieldID typo in typeutil (#10335) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-21 11:06:43 +08:00
yukun f15dc150f1
[skip ci]Add comments for retention (#10316) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-21 10:59:01 +08:00
bigsheeper c18fa9b785
Watch changeInfo in query node (#10045) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-20 17:54:43 +08:00
Xiangyu Wang cd6a4a6704
[skip ci]Improve error message in mqclient (#10241) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-20 10:56:35 +08:00
Xiangyu Wang a2b8add4e2
[skip ci]Improve error message in mqclient (#10240) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-20 10:54:43 +08:00
Xiangyu Wang 1493aa1f65
[skip ci]Improve comments in mqclient (#10242) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-20 10:52:35 +08:00
yukun 81190c573a
[skip ci]Add comments for UpdateAckedInfo (#10213) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-19 20:34:50 +08:00
yukun 7c7a66df6d
[skip ci]Add comments for rocksmq Notify (#10212) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-19 20:32:48 +08:00
Xiangyu Wang 736a2cc358
[skip ci]Improve error message in rocksmq (#10196) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-19 17:54:37 +08:00