Commit Graph

417 Commits (e2bf0ce787cffdc189a9c0fbbeaca92b83871e67)

Author SHA1 Message Date
Cai Yudong f8f61fb116
Use BaseParams etcd configuration for all components (#15012)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
Xieql 8b06aac7a9
[skip e2e] Improve annotation (#14976)
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2022-01-07 13:57:49 +08:00
zhenshan.cao a5f8bdeb42
Fix bug: data race in MsgFactory (#14839)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-01-06 14:57:20 +08:00
Xieql 25b00230c8
[skip e2e] Improve annotation (#14908)
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2022-01-06 14:15:20 +08:00
Xieql c488c41dfb
[skip e2e] Improve annotation (#14912)
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2022-01-06 13:38:08 +08:00
congqixia ecdc3f7bf7
[skip e2e] Improve comment for DataNode delete node (#14825)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-05 14:29:35 +08:00
godchen 98232b4942
[skip e2e]Sort imports (#14820)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-05 14:25:48 +08:00
godchen e1eb721532
[skip e2e]Sort imports (#14819)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-05 14:23:52 +08:00
godchen 7031a511ce
[skip e2e]Sort imports (#14806)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-05 14:00:38 +08:00
zhenshan.cao b10c361822
Fix bug: should use Lock instead of RLock (#14797)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-01-04 23:33:24 +08:00
zhenshan.cao 76a9687310
Adjust usage of lock in datanode (#14631)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2022-01-04 19:35:32 +08:00
zhenshan.cao 7abebe576c
Add more logs on write path (#14600)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-01-04 15:47:18 +08:00
XuanYang-cn f0a40f1569
Make FieldBinlog in a segment unique for a field (#14632)
See also: #14620

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-30 20:29:22 +08:00
Jiquan Long ebb9b24b47
Improve name of flowgraph node (#14538)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-30 10:33:46 +08:00
XuanYang-cn 9d0bc136e0
Add vChannelName in IBN timetick log (#14527)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-30 10:09:48 +08:00
Xiaofan 69087ff8dd
Support embedded etcd (#14333)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
congqixia a8c7e0c827
[skip e2e] Add comment for Compaction of DataNode (#14350)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-28 09:38:07 +08:00
XuanYang-cn 3cfa88d6f2
Fix delete node not aware of merged segments error (#14190)
This PR made merge gracefully remove merged segment by moving
them into `compactedSegments`

And everytime when delete_node operates, if compactedSegments
have contents, delete_node will replace the latest segment in delBuf
merged from the merged segments, and truely remove the compactedSegments

Fixes: #14085

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-27 11:02:18 +08:00
zhenshan.cao 9a2c91d326
Fix bug: refresh config after session init (#14194)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-24 22:22:17 +08:00
XuanYang-cn 3d24007efa
Add more logs for load sealed segment (#14079)
Add logs before&after flowgraph_ddnode forwarding delete msg

See also: #13879

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 10:50:07 +08:00
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
Jiquan Long 0871bd3d63
Add log when update pk range (#14006)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-23 11:57:08 +08:00
Bingyi Sun 6b91e5e9d1
Add warning log to trace old messages (#13939)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-22 16:59:05 +08:00
congqixia 2b352bcde5
Fix compact result segment log size always zero (#13953)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-22 14:27:06 +08:00
Xiangyu Wang 2a6168e937
Improve import statement (#13734)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-21 19:15:32 +08:00
JackLCL 87071f3f41
[skip e2e]Fix error log output format in segment_replica.go (#13806)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-20 22:51:25 +08:00
Xiangyu Wang 5d4c4f38c8
Improve import statement (#13735)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-20 15:49:06 +08:00
Xiangyu Wang cabc40cb09
Improve import statement (#13737)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-20 14:39:12 +08:00
Xiangyu Wang a7dfd53f53
Improve import statement (#13736)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-20 14:38:25 +08:00
Xiangyu Wang 08be6888d5
Improve import statement (#13733)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-20 14:33:47 +08:00
congqixia 2de5cf7762
[skip e2e] Improve log in flush manager (#13689)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-20 12:22:43 +08:00
congqixia d4afc812d1
Normalize DataNode term in errors.go (#13688)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-20 12:20:50 +08:00
congqixia 1dcd06cc78
Add log file info for all kind of segment binlogs (#13606)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-19 20:00:42 +08:00
JackLCL 20c956b675
[skip e2e]Fix error log output format in segment_replica.go (#13676)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-19 12:32:42 +08:00
godchen 154f11e3a1
[skip e2e]Fix redundant conversion (#13648)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 22:28:50 +08:00
godchen e191b23249
[skip e2e]Fix error string (#13647)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 19:22:42 +08:00
godchen fefeaa2e1d
[skip e2e]Fix compaction executor typo (#13646)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 19:20:46 +08:00
cai.zhang 9f23fc7f2a
Register the service when the component state is healthy (#13248)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
Bingyi Sun 0c39e0370c
Move segment statistics update to datanode tt loop (#13233)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-15 10:53:16 +08:00
JackLCL 30afcf2311
[skip ci]Fix error log output format in segment_replica.go (#13350)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-14 16:51:09 +08:00
JackLCL 5f02a3738a
[skip ci]Fix error log output format in meta_service.go (#13349)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-14 16:43:25 +08:00
Xiangyu Wang 405b3cd932
Use the same lint rules with golint in revive (#13324)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
congqixia 8f87cc7ef1
Fix JoinIDPath logic problem (#13039)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-09 12:05:04 +08:00
XuanYang-cn dbf757e08b
Change genKey into JoinIDPath (#12959)
1. Simplify genKey(), make genKey a rpc call
2. Unify the usage of JoinIDPath

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-09 11:09:06 +08:00
XuanYang-cn a9a332dbcf
Fix empty segment compact and load (#12710)
1. Fix compaction save empty segment bug
2. Fix load empty segment bug
3. Add UT for dmlchannels to 100%

Resolves: #12450

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-09 11:03:08 +08:00
congqixia 1195f441b2
Update DataNode state before stop (#12946)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 14:19:04 +08:00
JackLCL 73b63b9a02
[skip ci]Fix error log output format in segment_replica.go (#12929)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-08 13:55:04 +08:00
JackLCL a6ce7d7f53
[skip ci]Fix error log output format in meta_service.go (#12928)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-08 13:51:09 +08:00
JackLCL e51ef53632
[skip ci]Fix error log output format in flush_manager.go (#12857)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-07 14:38:15 +08:00
congqixia b20a238c38
Fix newDataSyncService panicking with normal segment has no dml pos (#12771)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-06 16:21:35 +08:00