Commit Graph

26 Commits (10kcp)

Author SHA1 Message Date
jaime 6423b6c718
enhance: move rocksmq from internal to pkg (#34165)
pr:  https://github.com/milvus-io/milvus/pull/33881
issue:  https://github.com/milvus-io/milvus/issues/33956

Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-06-26 13:36:05 +08:00
Aldrin ff9bb17cc5
fix: Masked kafka credentials getting printed in logs (#33747)
Cherry-pick from master
pr: #33730 
issue: https://github.com/milvus-io/milvus/issues/33727

Signed-off-by: Aldrin <imagesai32@gmail.com>
2024-06-11 15:59:54 +08:00
groot ba6d33cd57
fix: Support TLS for kafka connection (#30468)
#27977

Add extra configurations in milvus.yaml to pass certificates for kafka.

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2024-02-28 18:43:07 +08:00
wei liu 1f759837c4
fix: remove Unnecessary lock in config manager (#29836)
issue: #29709 #291712
to avoid concurrent recursive RLock and Lock cause deadlock, This PR
remove the unnecessary lock in config manager

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-01-11 13:48:49 +08:00
smellthemoon 1c1f2a1371
enhance:change some logs (#29579)
related #29588

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-01-05 16:12:48 +08:00
Enwei Jiao 3c3a57cb92
fix: Fix kafka config type error (#28642)
issue https://github.com/milvus-io/milvus/issues/28588

---------

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-11-23 14:36:22 +08:00
smellthemoon a9982aa7c6
Remove topic empty restriction when preCreated topic (#27351)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-10-10 18:53:32 +08:00
congqixia 5d558623fe
Add revive sub-lints and fix existing problems (#27495)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-10-07 20:53:38 +08:00
jaime 7119cb29ca
Fix kafka consumer connection leak (#27224)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-09-26 10:31:27 +08:00
SimFG 26f06dd732
Format the code (#27275)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-09-21 09:45:27 +08:00
yihao.dai fe01d54eca
Set kafka read timeout to 10s and make it configurable (#27238)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-09-20 22:01:27 +08:00
yah01 45d9fb5929
Fix wrong error codes & names (#26904)
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-09-12 14:41:18 +08:00
XuanYang-cn 7f1ae35e72
Add timeout in dispatcher, AsConsumer and Seek (#26686)
See also: #25309

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-09-08 09:51:17 +08:00
Enwei Jiao fb0705df1b
Decouple basetable and componentparam (#26725)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-09-05 10:31:48 +08:00
congqixia d343888f3c
Fix pkg codecov & static-check script (#26720)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-08-31 09:59:01 +08:00
Enwei Jiao a3c176045d
Fix kafka producer init many times (#26314)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-13 16:59:30 +08:00
congqixia 767955ec6b
Reduce MQ buffer length and flowgraph wait queue length to 16 (#26179)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-08-09 10:05:14 +08:00
Enwei Jiao 9fe62cb5f3
Fix kafka producer panic by nil (#25691)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-07-18 18:24:57 +08:00
wei liu 3a222e976d
fix consumer close may block forever (#25120)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-06-27 14:04:45 +08:00
SimFG a1e6428bc7
Fix the kafka panic when sending the message to a closed channel (#25116) (#25117)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-06-27 10:42:44 +08:00
xige-16 33c2012675
Add more metrics (#25081)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-06-26 17:52:44 +08:00
congqixia 6a1eff3487
Fix kafka consumer double close (#25051)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-25 14:16:44 +08:00
congqixia 00f8f236d7
Revert close kafka internal producer (#25072)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-25 12:38:43 +08:00
congqixia 4fda4f3951
Close kafka internal consumer&producer properly (#24998)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-20 21:14:41 +08:00
yah01 ebd0279d3f
Check error by Error() and NoError() for better report message (#24736)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-06-08 15:36:36 +08:00
jaime c9d0c157ec
Move some modules from internal to public package (#22572)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-04-06 19:14:32 +08:00