milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
12,352 Commits
141 Branches
117 Tags
562 MiB
Commit Graph

650 Commits (9ccbffc4b10641efb9c7f6bc5d072c3fd6bfa49f)

Author SHA1 Message Date
shaoyue f796bce1ed
[skip ci] Fix golint for rocketsmq_impl.go (#12363) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-29 23:15:41 +08:00
yukun 9ae7e19b82
[skip ci]Add comment for rocksmq reader seek (#12405) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-29 21:10:01 +08:00
dragondriver 3850979308
Show stack trace info when rpc fail (#12290) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-29 14:29:24 +08:00
godchen 8cd1fccfb1
Return rocksdb reader timeout error (#12317) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-29 13:27:17 +08:00
yukun 080eaa9a5c
Add isClosed for rocksmq (#12267) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-26 11:27:16 +08:00
godchen e3f49858c5
Add subscription prefix (#12251) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-24 17:47:15 +08:00
dragondriver 6c4c0ef6b5
Add more deploy metrics (#12248) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-24 15:43:15 +08:00
Xiaofan 0aaa87a79a
Fix MsgStream inconsistent seek (#12042) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-24 10:25:15 +08:00
yukun 6a167f8579
Fix rocksmq produce hang when do search repeatedly (#12225) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-23 19:15:22 +08:00
yukun 835451e331
Update rocksmq consume slowly log (#12179) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-22 18:51:14 +08:00
yukun f5bb180adb
Support multiple readers on one topic (#12155) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-22 10:35:14 +08:00
yukun ac175b6f00
Add rocksmq produce slowly hint log (#12156) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-21 15:33:13 +08:00
godchen 116a503b4a
From dml cp load delete msg (#12144) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-21 07:33:14 +08:00
dragondriver bf391f2449
Make indexparamcheck thread-safe (#11916) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-21 00:39:13 +08:00
yukun 2147507e89
Add reader implementation in rocksmq (#12137) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-20 20:57:13 +08:00
yukun 8c947109a9
Add log in rocksmq (#12138) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-20 00:11:13 +08:00
shaoyue cec1b0cb77
[skip ci] Add comments for exported items (#12127) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-19 18:07:18 +08:00
shaoyue 888aad120c
[skip ci] Fix comment typo (#12122) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-19 17:59:39 +08:00
godchen 51b353b52c
Add msgstream reader (#12130) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-19 15:57:12 +08:00
dragondriver ee0f753f7a
Fix datarace between GetComponentStates and Register (#11935) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-19 13:57:12 +08:00
shaoyue acef6b9750
[skip ci] Add comments for exported item in calc_distance.go (#12088) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-18 19:21:27 +08:00
zhenshan.cao 543c4891b3
Prevent the client from closing grpc connection by mistake (#11918) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-18 11:17:12 +08:00
godchen f91e9c6dda
Add pulsar reader implementation (#11990) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-17 23:47:11 +08:00
yukun d482f8aa9f
[skip ci]Add license in reader.go (#12032) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-17 21:59:38 +08:00
Xiaofan d37fdf9379
Remove component.yaml (#11959) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-17 14:35:10 +08:00
godchen a1d1b3d0b6
Add reader interface (#11973) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-17 14:11:11 +08:00
Xiaofan f654621650
Remove the etcd deletion of segment data path on querynode (#11863) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-17 12:13:10 +08:00
congqixia 5edbb82610
Add session revoke (#11908) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-16 22:31:14 +08:00
dragondriver 8c951217ee
Fix wrong distances caused by metric type (#11901) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-16 19:11:10 +08:00
yukun 79fc84f3db
Optimize updatePageInfo in rocksmq (#11711) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-16 17:13:10 +08:00
yukun da9228ab37
Add topic lock for DestroyTopic (#11786) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-16 17:07:10 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files (#11898) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-16 15:41:11 +08:00
yukun 897d6b5fc8
Check rmq retention only by page (#11508) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-16 14:49:11 +08:00
Xiangyu Wang f26ab5c29a
[skip ci]Improve import statements (#11635) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-15 19:24:52 +08:00
Xiangyu Wang ad09fb70ba
[skip ci]Improve import statements (#11634) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-15 19:22:45 +08:00
Xiangyu Wang 537e302e22
[skip ci]Improve import statements (#11633) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-15 19:20:34 +08:00
congqixia 304bbd3e71
Add ConsumeAfterSeek interface (#11818) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-15 18:17:10 +08:00
Xiaofan 71e814f796
Remove common.yaml and component.yaml (#11661) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-12 21:25:08 +08:00
Xiaofan 3cd47cd89e
Remove common.yaml and component.yaml (#11662) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-12 18:53:11 +08:00
yukun f51ef71b51
Change default retentionSizeInMB to 8192(8GB) (#11436) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-11 17:18:43 +08:00
Xiangyu Wang 47ff1a45fe
Improve log messages in rocksmq (#11230) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-10 22:10:47 +08:00
yukun 4c6d77201f
[skip ci]Add rmq consumer impl getExistedConsumer comment (#11594) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-10 21:50:45 +08:00
yukun 9bc7393913
[skip ci]Add rmq consumer impl Subscription comment (#11593) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-10 21:48:53 +08:00
yukun 1e86bd3038
[skip ci]Add rmq consumer impl topic comment (#11533) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-10 19:21:44 +08:00
Xiaofan 5f08b67156
Move node.yaml to component.yaml (#11363) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-10 14:27:37 +08:00
yukun 5ec895fedc
[skip ci]Add rmq consumer impl MsgMutex comment (#11532) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-09 21:13:37 +08:00
yukun 2073ae497b
[skip ci]Add rmq consumer impl chan comment (#11531) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-09 21:11:41 +08:00
yukun 11e6a8ea50
[skip ci]Add rmq_client comment (#11458) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-08 21:09:07 +08:00
congqixia 6d3952c9bf
Fix msgs consumed before seek appear in output after seek (#11419) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-08 20:57:57 +08:00
congqixia d50543a030
Batch consume msg in rockmq internal loop (#11373) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-08 20:56:07 +08:00
yukun dfbb4c33b4
Rename newExpiredCleanUp to expiredCleanUp (#11433) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-08 19:25:00 +08:00
yukun 3a65a4517c
[skip ci]Add retention comment (#11432) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-08 18:45:14 +08:00
yukun 8ec040a35c
Add rocksmqPageSize to config (#11113) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-08 10:17:18 +08:00
yukun 2c215a0be3
[skip ci]Add rmq_producer comment (#11346) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-05 21:59:10 +08:00
yukun ab00fe90de
[skip ci]Add rmq_producer comment (#11345) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-05 21:57:21 +08:00
yukun 425c7e09d4
[skip ci]Add rmq retention comment (#11344) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-05 21:53:22 +08:00
zhenshan.cao 9885838593
Add extra methods to convert between uint64 and big-endian bytes slice (#11338) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-05 19:10:59 +08:00
Xiaofan a4715996ef
Fix Pulsar seek to latest may block forever (#11128) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-05 14:55:44 +08:00
godchen 9bf68ac3eb
Fix timestamp endian error (#11220) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-05 13:56:58 +08:00
Xiangyu Wang 60848029e1
Improve warning message in rocksmq (#11227) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-05 10:58:55 +08:00
bigsheeper c99d1a56bf
Refactor proxy ticker to fix guarantee_time not work (#11248) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-05 09:14:02 +08:00
yukun c05ed4c365
[skip ci]Add rmq_imple seek comments (#11273) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-04 20:51:10 +08:00
yukun 872f6f8a04
[skip ci]Add rmq client comments (#11271) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-04 20:49:20 +08:00
yukun eda65381c2
[skip ci]Add rmq producer comments (#11272) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-04 20:45:17 +08:00
Xiangyu Wang e8c858b545
Improve error message in util (#11137) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-04 13:36:35 +08:00
Xiangyu Wang 508f560527
Improve error message in util (#11135) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-04 13:34:45 +08:00
Xiangyu Wang cc6a08f097
Improve error message in util (#11136) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-04 13:32:46 +08:00
xige-16 b567a8e5b5
Add SystemInfo msgType for getMetricRequest (#11151) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-04 10:58:11 +08:00
yukun e817cfbae6
[skip ci]Add pulsar client comments (#11197) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-03 23:20:46 +08:00
congqixia dddf84b194
Add unit test for pulsarClient Seek (#11107) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-03 16:34:12 +08:00
zhenshan.cao b768fb2e07
[skip ci]Fix golint error in indexparamcheck (#11046) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-02 21:18:55 +08:00
dragondriver 7f00753074
[skip ci] Fix golint warning of time.go (#11025) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-02 21:05:45 +08:00
godchen a0a3a889e7
Add common endian for global use (#11092) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-02 18:16:32 +08:00
yukun 82e5d21317
Fix MB const size (#11088) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-02 18:06:28 +08:00
yukun ea6cd7d27c
Move topic lock to the front of final delete in retention expired cleanup (#11076) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-02 17:28:31 +08:00
yukun a8722797fe
Add topic lock for rocksmq Seek (#11083) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-02 17:00:31 +08:00
Xiaofan ca56290e85
Fix rocksdb retention ts not set (#11081) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-02 16:50:31 +08:00
Ji Bin c63b804606
Windows dummy metrics for container. (#10625) 
In windows we do not have cgroups.
This changes for return a dummy metrics under windows.

Signed-off-by: Ji Bin <matrixji@live.com>
 2021-11-02 16:36:31 +08:00
congqixia 7d671b14ff
Fix SeekToLatest memory leakage and remove redundant logic (#11057) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-02 14:14:40 +08:00
yukun af7a5ca50f
[skip ci]Add rocksmq client comments (#11052) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-01 23:02:33 +08:00
dragondriver 66c255c02e
[skip ci] Fix golint warning of conf_adapter_mgr.go (#11026) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-01 22:43:48 +08:00
congqixia be0daafdb0
Fix rocksmq SeekToLatest (#11029) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-01 19:35:51 +08:00
XuanYang-cn ca857d922c
Fix session util using the same context (#10981) 
Before this PR, session_util used the same context for new session,
keepalive check, and etcd keep alive. So if we cancel this context
by ourselves, half the chances will the etcd keep-alive-channel be
closed by etcd, which will make session utils `think` there's something
wrong in connecting to etcd, and half the chances will our keepalive check
exit as expected.

To solve this problem, this PR seperates 2 contexts: etcd keep alive
channel context and our liveness check context. So that when we cancel
this liveness check context, session util will exit as expected.

Resolves: #10881

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-01 18:25:58 +08:00
groot a6160bc79e
[skip ci] Add comment (#10991) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-11-01 15:48:02 +08:00
groot 815d67375a
[skip ci] Add comment (#10990) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-11-01 15:46:12 +08:00
Cai Yudong 0fe88c0571
Update schema_test (#10932) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-30 15:16:39 +08:00
yukun 9016bd7e33
[skip ci]Add rocksmq comments (#10925) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-29 21:45:01 +08:00
congqixia 390fad4eb7
Fix LatestPosition option conflict with earliest patch (#10907) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-29 21:30:49 +08:00
Cai Yudong 0049837dc4
Add utils API AppendFieldData (#10910) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-29 18:06:43 +08:00
dragondriver 42ff76d379
[skip ci] Fix golint warning of indexparamcheck (#10912) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-29 17:49:28 +08:00
dragondriver 614e95fbf8
[skip ci] Fix golint warning of metrics (#10911) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-29 17:47:39 +08:00
groot 104c16fd1b
[skip ci] Typo (#10886) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-29 12:01:16 +08:00
BIKI DAS c41bc0dede
Combined function params (#10868) 
Signed-off-by: Biki-das <bikid475@gmail.com>
 2021-10-29 11:06:37 +08:00
BIKI DAS b1d6d52c36
Combined appends into a single call (#10865) 
Signed-off-by: Biki-das <bikid475@gmail.com>
 2021-10-29 10:58:38 +08:00
Xiaofan 93f205b49e
Rename param names (#10853) 
* Rename param names

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

* Rename configs

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-28 23:16:40 +08:00
Xiaofan fce23538a8
Remote Common yaml (#10616) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-28 21:24:41 +08:00
dragondriver 0334a1c3e8
[skip ci] Fix golint warning of container.go (#10819) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-28 20:21:09 +08:00
bigsheeper d264e150cf
Use TotalInactiveFile in GetContainerMemUsed (#10800) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-28 16:40:25 +08:00
BIKI DAS 1f2f76789e
Combined function params (#10786) 
Signed-off-by: Biki-das <bikid475@gmail.com>
 2021-10-28 15:58:29 +08:00
bigsheeper 9a0d1d1e74
Fix get container mem usage (#10796) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-28 14:22:23 +08:00