Commit Graph

105 Commits (273890a91e778e7894d310861a74122fa31b7fe2)

Author SHA1 Message Date
Bingyi Sun 3987574448
Unsubscribe topic in DataCoord (#15353)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-01-24 19:47:38 +08:00
Cai Yudong b6a48817b0
Add MinioConfig in GlobalParams for all components (#15099)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-10 17:29:34 +08:00
Cai Yudong 7efb02a4c5
Use PulsarConfig in GlobalParams for all components (#15046)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-09 23:45:33 +08:00
Cai Yudong f8f61fb116
Use BaseParams etcd configuration for all components (#15012)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
godchen b0357360d2
[skip e2e]Sort imports (#14807)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-05 14:04:46 +08:00
Bingyi Sun 37c9419707
Use logutil in DataCoord (#14737)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-01-04 17:31:23 +08:00
Bingyi Sun 75b0e9935b
[skip e2e]Use logutil in DataCoord (#14739)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-01-04 13:53:39 +08:00
Jiquan Long 00b3fcb98b
Add log for flowgraph (#14441)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-29 14:55:21 +08:00
Xiaofan 69087ff8dd
Support embedded etcd (#14333)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
Bingyi Sun 02e568603b
Add log with context in DataCoord (#14431)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-28 19:42:19 +08:00
Bingyi Sun 098516f3d7
Improve log (#13696)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-27 16:52:06 +08:00
congqixia 7c83b52de0
Add retry logic for DataCoord GC minio bucket (#14095)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-23 21:48:25 +08:00
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
Bingyi Sun ca71e134d1
[skip e2e]Improve log (#13700)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-22 15:15:05 +08:00
Xiangyu Wang 1341dcd3f8
Improve import statement (#13730)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-21 15:21:25 +08:00
Bingyi Sun 9d44ea034c
[skip e2e]Improve log (#13704)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-21 09:17:00 +08:00
edward.zeng 38add97685
[skip e2e] Refine datacoord server comment (#13797)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-20 19:54:58 +08:00
Bingyi Sun 7ee0a2bf9f
[skip e2e]Improve log (#13707)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-20 11:18:49 +08:00
Bingyi Sun 229a727b3a
[skip e2e]Improve log (#13706)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-20 11:16:52 +08:00
Bingyi Sun 9e0219ec3f
[skip e2e]Improve log (#13702)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-20 11:14:51 +08:00
Bingyi Sun 06c4662e97
[skip e2e]Improve log (#13705)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-20 11:06:43 +08:00
Bingyi Sun 279316e09b
[skip e2e]Improve log (#13701)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-20 11:02:45 +08:00
cai.zhang 9f23fc7f2a
Register the service when the component state is healthy (#13248)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
Bingyi Sun 0c39e0370c
Move segment statistics update to datanode tt loop (#13233)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-15 10:53:16 +08:00
congqixia 3b4d114b71
Add comment for DataCoord startFlushLoop (#13379)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-15 09:45:09 +08:00
Bingyi Sun a78b2010e9
[skip ci]Improve log style (#13008)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-08 20:27:06 +08:00
Bingyi Sun 48c5632277
[skip ci]Improve log style (#13007)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-08 20:25:15 +08:00
Bingyi Sun 320cfbb606
[skip ci]Improve log style (#13006)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-08 20:19:26 +08:00
congqixia de454956fe
Refactor session WatchSessions to allow rewatch when Rev Compacted (#12880)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 10:11:04 +08:00
congqixia 4121e31df1
Send SIGINT to runner goroutine after etcd disconnects (#12163)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 16:23:17 +08:00
congqixia b99164f43d
Add datacoord GC configuration (#12061)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-18 22:29:40 +08:00
Bingyi Sun 175a656ff1
Unwatch dropped channel when init channel manager (#11986)
issue: #11558
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-17 23:25:12 +08:00
congqixia 5edbb82610
Add session revoke (#11908)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-16 22:31:14 +08:00
Bingyi Sun e3e4dc7153
Improve GetVChanPosistion and fix unit tests (#11888)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-16 21:41:50 +08:00
congqixia d38043f235
Filter with partition id in GetVChanPosition (#11746)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-13 08:45:09 +08:00
Xiaofan 71e814f796
Remove common.yaml and component.yaml (#11661)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-12 21:25:08 +08:00
bigsheeper 93149c5ad9
Load growing segment in query node (#11664)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 18:27:10 +08:00
Bingyi Sun 54b40da4c5
Add segment drop logic (#11621)
issue: #11558
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-12 00:22:42 +08:00
Bingyi Sun 7a3873960b
Fix watch channel with nil seek position (#11650)
issue: #11649
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-11 19:32:43 +08:00
congqixia 3c9610cb1b
Add garbage collector for DataCoord (#11554)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-10 19:03:38 +08:00
congqixia 0c4e09e341
Add comment for datacoord Server.startDataNodeTtLoop (#11033)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-05 23:01:02 +08:00
sunby c26cd79532
Add compaction (#9906)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-05 22:25:00 +08:00
sunby a55019825b
Fix stale segments selector (#11051)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-01 22:30:04 +08:00
Xiaofan 2df2d488e1
Fix Unit test fatal fail (#10933)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-30 10:24:38 +08:00
congqixia 390fad4eb7
Fix LatestPosition option conflict with earliest patch (#10907)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-29 21:30:49 +08:00
congqixia c019e80dbb
Change SeekPosition to earliest of all segments (#10771)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-28 14:30:26 +08:00
Xiaofan 6fddcb3925
Fix Session checker for proxy (#10737)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-27 21:58:33 +08:00
XuanYang-cn 548634ff05
[skip ci]Update license for dc segmentinfo (#10588)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:44:37 +08:00
congqixia 285c3f63e3
Trim segmentinfo binlog for VChaninfo usage (#10425)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-22 14:35:13 +08:00
congqixia 7ce7cb7a5e
Add a timed flush trigger mechanism (#10197)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-20 15:02:36 +08:00