d126f06946
Decouple mq module from internal proto definition ( #22536 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-03-04 23:21:50 +08:00
697dedac7e
Use cockroachdb/errors to replace other error pkg ( #22390 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-26 11:31:49 +08:00
f4e7b246f2
Fix msgdispatcher concurrency issue and add prometheus metrics ( #22174 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-02-16 14:58:34 +08:00
d2667064bb
Add msgDispatcher to support sharing msgs for different vChannel ( #21917 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-02-13 16:38:33 +08:00
fb42466c65
Use opentelemetry ( #21509 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-01-12 16:09:39 +08:00
4b4944ecee
Support sync all segments while close ( #21421 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-01-06 14:49:36 +08:00
264f08953d
Refactor Rocksmq's config ( #21304 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-26 19:11:30 +08:00
039e9ce4bb
Refine msgstream interface ( #20832 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-12-05 20:55:17 +08:00
709a0a94e9
Add some msgstream metrics ( #20296 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-07 10:15:02 +08:00
1f170ce1ba
Refine kafka consumer ( #19846 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-25 13:23:30 +08:00
1b5e765307
Block Flowgraph before handle compacted segments ( #19988 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-24 15:09:29 +08:00
a55f739608
Separate public proto files ( #19782 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
438790744d
test: use `T.Setenv` to set env vars in tests ( #19649 )
...
This commit replaces `os.Setenv` with `t.Setenv` in tests. The
environment variable is automatically restored to its original value
when the test and all its subtests complete.
Reference: https://pkg.go.dev/testing#T.Setenv
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2022-10-11 18:43:23 +08:00
db3f4be49d
Simplify flow graph node to pipeline mode ( #19667 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-10 22:15:22 +08:00
d7f38a803d
Separate some proto files ( #19218 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
65fffa6d7d
Make sure that closing the graph is more secure ( #19178 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-14 10:32:33 +08:00
ceea04c274
Improve the `close` method in the graph ( #19100 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-09 10:00:36 +08:00
50d5d04552
Refine some codes about the datanode ( #17720 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-06-23 09:58:14 +08:00
48cf63a2d7
Wait for flow graph to exit ( #17341 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-02 19:48:04 +08:00
bb7a0766fe
Add dependency factory ( #16204 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-04-07 22:05:32 +08:00
ca129d4308
Support configurable msgstream ( #16131 )
...
Signed-off-by: xiyichan <2863768433@qq.com>
2022-03-24 10:15:25 +08:00
29975a7a26
Remove Consume() API from mqstream interface ( #15886 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-11 20:09:59 +08:00
7a3a721380
Reconstruct mqstream module ( #15784 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
da4182a90f
Use GroupChecker for flowgraph node input check ( #14916 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-06 19:27:25 +08:00
c9e58da5d4
[skip e2e] Update license ( #14794 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2022-01-04 22:41:21 +08:00
b0c2c6ef2a
[skip e2e] Update license ( #14557 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-30 10:07:46 +08:00
bc5e7a4519
[skip e2e] Update license ( #14556 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-30 10:06:06 +08:00
89982c0ca3
[skip e2e] Update license ( #14555 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-30 10:04:15 +08:00
ecf3b6c262
Fix flowgraph when there are multiple upstreams ( #14345 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-29 14:57:24 +08:00
00b3fcb98b
Add log for flowgraph ( #14441 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-29 14:55:21 +08:00
5821fe1a0d
[skip e2e] Update license ( #14473 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-28 21:58:47 +08:00
0f2788b25e
[skip e2e] Update license ( #14472 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-28 21:56:57 +08:00
307b599a84
[skip e2e] Update license ( #14471 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-28 21:55:07 +08:00
0fcd66e0b6
[skip e2e] Update license ( #14370 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-27 22:16:31 +08:00
950d154747
[skip e2e] Update license ( #14369 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-27 22:14:41 +08:00
9094a4ee27
Improve import statements ( #13544 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-17 10:31:18 +08:00
3cf12b3ea7
Remove zere len slice declaration in flow_graph.go ( #13474 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-16 09:21:24 +08:00
405b3cd932
Use the same lint rules with golint in revive ( #13324 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
f834e220c1
Fix zero length slice declaration in flowgraph/node.go ( #12393 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-30 09:51:51 +08:00
537e302e22
[skip ci]Improve import statements ( #11633 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-15 19:20:34 +08:00
104c16fd1b
[skip ci] Typo ( #10886 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-29 12:01:16 +08:00
a5daaf0755
[skip ci]Fix golint warnings in flowgraph ( #9234 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-04 22:38:02 +08:00
db944cd09c
Refactor flowgraph and related invocation ( #8770 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-29 20:19:59 +08:00
c242b8bb25
Rename unittest for flowgraph ( #7794 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-13 16:34:26 +08:00
596357dc85
Add more data definition test cases ( #7623 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-09 19:02:08 +08:00
8e814a2972
Make flowgraph Close only once ( #7631 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-09 17:12:38 +08:00
1401ed516d
Add unittest for flowgraph ( #7512 )
2021-09-07 09:39:47 +08:00
1c88c8b0a5
Clean fmt.Println in util/flowgraph ( #7355 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-30 15:29:57 +08:00
07cc449fbf
Fix data race in flow graph ( #6946 )
...
* Fix data race in flow graph
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* add cancel func to flowgraph
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-03 22:43:25 +08:00
21bc5810c0
remove redundant log of query node ( #6768 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-07-23 20:09:33 +08:00
jaime
Enwei Jiao
bigsheeper
Xiaofan
SimFG
Eng Zer Jun
godchen
xiyichan
congqixia
jaime
Jiquan Long
Xiangyu Wang
groot