milvus

Commit Graph

Author	SHA1	Message	Date
Zhen Ye	b18a3cfce2	fix: kafka use shared channel to receive produce result (#38532 ) issue: #38531 --------- Signed-off-by: chyezh <chyezh@outlook.com>	2024-12-17 23:10:45 +08:00
tinswzy	27229f7907	enhance: refine exists log print with ctx (#38080 ) issue: #35917 Refines exists log print with ctx Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>	2024-12-14 22:36:44 +08:00
jaime	edabfa8fa6	enhance: Remove pool from produer and consumer in kafka client (#38264 ) issue: #38263 Revert "fix: Move init kafka pool into once (#37786)" Revert "enhance: Use pool to limit kafka cgo thread number (#37744)" Signed-off-by: jaime <yun.zhang@zilliz.com>	2024-12-06 14:08:40 +08:00
tinswzy	5768dbbb5d	enhance: refine pular related mq interfaces (#38007 ) issue: #35917 Refines the pulsar-related mq APIs to allow the ctx to be passed down Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>	2024-12-04 20:50:39 +08:00
congqixia	97b7ebbc08	fix: Move init kafka pool into once (#37786 ) Introduced by #37744 Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>	2024-11-18 21:24:48 +08:00
congqixia	3743fc2b00	enhance: Use pool to limit kafka cgo thread number (#37744 ) Related to #37665 Thread number went rocket high when there is lots of kafka consumers on datanode. Since the internal implementation is CGO, using which directly will make cgo thread leaked. This PR add a worker pool for kafka API utilzing CGO calls to limit thread number. Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>	2024-11-18 10:42:31 +08:00
jaime	4746f47282	feat: management WebUI homepage (#36822 ) issue: #36784 1. Implement an embedded web server for WebUI access. 2. Complete the homepage development. Home page demo: <img width="2177" alt="iShot_2024-10-10_17 57 34" src="https://github.com/user-attachments/assets/38539917-ce09-4e54-a5b5-7f4f7eaac353"> Signed-off-by: jaime <yun.zhang@zilliz.com>	2024-10-23 11:29:28 +08:00
jaime	9630974fbb	enhance: move rocksmq from internal to pkg module (#33881 ) issue: #33956 Signed-off-by: jaime <yun.zhang@zilliz.com>	2024-06-25 21:18:15 +08:00
Aldrin	8a4ef1b836	fix: Masked kafka credentials getting printed in logs (#33730 ) issue: https://github.com/milvus-io/milvus/issues/33727 Signed-off-by: Aldrin <imagesai32@gmail.com>	2024-06-10 00:05:54 +08:00
groot	ba6d33cd57	fix: Support TLS for kafka connection (#30468 ) #27977 Add extra configurations in milvus.yaml to pass certificates for kafka. Signed-off-by: yhmo <yihua.mo@zilliz.com>	2024-02-28 18:43:07 +08:00
wei liu	1f759837c4	fix: remove Unnecessary lock in config manager (#29836 ) issue: #29709 #291712 to avoid concurrent recursive RLock and Lock cause deadlock, This PR remove the unnecessary lock in config manager --------- Signed-off-by: Wei Liu <wei.liu@zilliz.com>	2024-01-11 13:48:49 +08:00
smellthemoon	1c1f2a1371	enhance:change some logs (#29579 ) related #29588 Signed-off-by: lixinguo <xinguo.li@zilliz.com> Co-authored-by: lixinguo <xinguo.li@zilliz.com>	2024-01-05 16:12:48 +08:00
Enwei Jiao	3c3a57cb92	fix: Fix kafka config type error (#28642 ) issue https://github.com/milvus-io/milvus/issues/28588 --------- Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>	2023-11-23 14:36:22 +08:00
smellthemoon	a9982aa7c6	Remove topic empty restriction when preCreated topic (#27351 ) Signed-off-by: lixinguo <xinguo.li@zilliz.com> Co-authored-by: lixinguo <xinguo.li@zilliz.com>	2023-10-10 18:53:32 +08:00
congqixia	5d558623fe	Add revive sub-lints and fix existing problems (#27495 ) Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>	2023-10-07 20:53:38 +08:00
jaime	7119cb29ca	Fix kafka consumer connection leak (#27224 ) Signed-off-by: jaime <yun.zhang@zilliz.com>	2023-09-26 10:31:27 +08:00
SimFG	26f06dd732	Format the code (#27275 ) Signed-off-by: SimFG <bang.fu@zilliz.com>	2023-09-21 09:45:27 +08:00
yihao.dai	fe01d54eca	Set kafka read timeout to 10s and make it configurable (#27238 ) Signed-off-by: bigsheeper <yihao.dai@zilliz.com>	2023-09-20 22:01:27 +08:00
yah01	45d9fb5929	Fix wrong error codes & names (#26904 ) Signed-off-by: yah01 <yah2er0ne@outlook.com>	2023-09-12 14:41:18 +08:00
XuanYang-cn	7f1ae35e72	Add timeout in dispatcher, AsConsumer and Seek (#26686 ) See also: #25309 Signed-off-by: yangxuan <xuan.yang@zilliz.com>	2023-09-08 09:51:17 +08:00
Enwei Jiao	fb0705df1b	Decouple basetable and componentparam (#26725 ) Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>	2023-09-05 10:31:48 +08:00
congqixia	d343888f3c	Fix pkg codecov & static-check script (#26720 ) Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>	2023-08-31 09:59:01 +08:00
Enwei Jiao	a3c176045d	Fix kafka producer init many times (#26314 ) Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>	2023-08-13 16:59:30 +08:00
congqixia	767955ec6b	Reduce MQ buffer length and flowgraph wait queue length to 16 (#26179 ) Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>	2023-08-09 10:05:14 +08:00
Enwei Jiao	9fe62cb5f3	Fix kafka producer panic by nil (#25691 ) Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>	2023-07-18 18:24:57 +08:00
wei liu	3a222e976d	fix consumer close may block forever (#25120 ) Signed-off-by: Wei Liu <wei.liu@zilliz.com>	2023-06-27 14:04:45 +08:00
SimFG	a1e6428bc7	Fix the kafka panic when sending the message to a closed channel (#25116 ) (#25117 ) Signed-off-by: SimFG <bang.fu@zilliz.com>	2023-06-27 10:42:44 +08:00
xige-16	33c2012675	Add more metrics (#25081 ) Signed-off-by: xige-16 <xi.ge@zilliz.com>	2023-06-26 17:52:44 +08:00
congqixia	6a1eff3487	Fix kafka consumer double close (#25051 ) Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>	2023-06-25 14:16:44 +08:00
congqixia	00f8f236d7	Revert close kafka internal producer (#25072 ) Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>	2023-06-25 12:38:43 +08:00
congqixia	4fda4f3951	Close kafka internal consumer&producer properly (#24998 ) Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>	2023-06-20 21:14:41 +08:00
yah01	ebd0279d3f	Check error by Error() and NoError() for better report message (#24736 ) Signed-off-by: yah01 <yang.cen@zilliz.com>	2023-06-08 15:36:36 +08:00
jaime	c9d0c157ec	Move some modules from internal to public package (#22572 ) Signed-off-by: jaime <yun.zhang@zilliz.com>	2023-04-06 19:14:32 +08:00

33 Commits (2.5_cloud_pre)