Commit Graph

39 Commits (3936d126614de6cefe52b9d061ef4007cd94ae3c)

Author SHA1 Message Date
chyezh 5ee9f734c1
fix: Use determined order to lock in BlockAll to avoid deadlock (#29246)
issue: #29104

Signed-off-by: chyezh <ye.zhen@zilliz.com>
2024-01-22 14:50:56 +08:00
smellthemoon 0aa90de141
Reduce the goroutine in flowgraph to 2 (#28233)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-11-13 10:50:17 +08:00
XuanYang-cn 5c5f9aa05e
Enhance newDataSyncService (#27277)
- Add flowgraph.Assemble assembles nodes in flowgraph.go
- remove fgCtx in newDataSyncService
- Add newServiceWithEtcdTickler func, reduce param numbers to 3
- Remove unnecessary params
  - config.maxQueueLength, config.maxParallelish

See also: #27207

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-09-27 11:07:25 +08:00
XuanYang-cn 08fd28b30b
Only do gracefully stop when DN Stop (#26399)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-08-21 11:16:20 +08:00
Enwei Jiao 697dedac7e
Use cockroachdb/errors to replace other error pkg (#22390)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-26 11:31:49 +08:00
Xiaofan 1b5e765307
Block Flowgraph before handle compacted segments (#19988)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-24 15:09:29 +08:00
Xiaofan db3f4be49d
Simplify flow graph node to pipeline mode (#19667)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-10 22:15:22 +08:00
SimFG 65fffa6d7d
Make sure that closing the graph is more secure (#19178)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-14 10:32:33 +08:00
SimFG ceea04c274
Improve the `close` method in the graph (#19100)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-09 10:00:36 +08:00
SimFG 50d5d04552
Refine some codes about the datanode (#17720)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-06-23 09:58:14 +08:00
bigsheeper 48cf63a2d7
Wait for flow graph to exit (#17341)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-02 19:48:04 +08:00
jaime 950d154747
[skip e2e] Update license (#14369)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-27 22:14:41 +08:00
congqixia 3cf12b3ea7
Remove zere len slice declaration in flow_graph.go (#13474)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-16 09:21:24 +08:00
Xiangyu Wang 537e302e22
[skip ci]Improve import statements (#11633)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-15 19:20:34 +08:00
congqixia db944cd09c
Refactor flowgraph and related invocation (#8770)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-29 20:19:59 +08:00
congqixia 8e814a2972
Make flowgraph Close only once (#7631)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-09 17:12:38 +08:00
bigsheeper 07cc449fbf
Fix data race in flow graph (#6946)
* Fix data race in flow graph

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* add cancel func to flowgraph

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-03 22:43:25 +08:00
Xiangyu Wang c731e2df78 Add license header in util
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-19 13:42:47 +08:00
xige-16 7e60460aee close timeTickStream in flow graph when the collection is released
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-26 18:40:04 +08:00
quicksilver 7ad9b36207 Update reviewdog/action-hadolint github action version to v1.16.1
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-25 14:41:46 +08:00
zhenshan.cao c2734fa55f Fix bug and enchance system
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
sunby ddddd65d10 Delete internal/errors package
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-05 10:15:27 +08:00
Cai Yudong 84110d2684 Add tests/benchmark and tests/python_test using new python SDK
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-02-25 17:35:36 +08:00
bigsheeper 41fb2d2991 fix lock usage
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-24 16:12:39 +08:00
bigsheeper 8ec7e4576e Add dropPartition and createPartition
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-24 15:59:51 +08:00
neza2017 ad0078c07a Load grpc port of proxy from config
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-24 11:50:21 +08:00
dragondriver b32e55d5f0 Add timeout logic to task in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-17 20:00:23 +08:00
quicksilver 72ed65d7f8 Check builder images
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-17 18:36:03 +08:00
bigsheeper e117a6097a Fix pulsar url
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-17 16:32:34 +08:00
cai.zhang 1cd2fd9954 Add the standard of golangci-lint
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-12 12:04:12 +08:00
godchen 4a11a6431b Add time sync producer
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-12 11:21:21 +08:00
bigsheeper c9c8fb9def Close pulsar channel
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-12 11:18:23 +08:00
bigsheeper b441685635 Refactor segment, partition and collection, refactor search and services
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-09 16:27:11 +08:00
bigsheeper 88a3fa31fa Refactor query node and services
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-05 10:52:50 +08:00
neza2017 d18c17e786 Add Meta table implementation
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-04 16:28:14 +08:00
godchen bade037fb2 Add meta_table implementation
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-04 16:01:28 +08:00
bigsheeper d6fe379143 Add insertNode and serviceTimeNode
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-03 17:09:51 +08:00
zhenshan.cao e962b57fbb Add timestamp allocator
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-03 14:53:36 +08:00
bigsheeper 8020dc2256 Add flow graph
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-02 16:44:54 +08:00