Commit Graph

197 Commits (b0baff2249b84f6069c9aadf1196f282d22cfbc6)

Author SHA1 Message Date
godchen 9576ec4dcb
[skip e2e]Fix binlog writer comment (#13576)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 19:42:50 +08:00
godchen ecd3dc5830
[skip e2e]Remove useless event header check func (#13573)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 19:00:14 +08:00
shaoyue 43fbb0fd16
[skip e2d] Fix typo in StatsReader comment (#13623)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-17 18:47:56 +08:00
godchen 7e56f08747
Add payload bytes interface. (#13467)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-16 16:35:42 +08:00
shaoyue 1f2c098fe7
[skip ci]Add comment for PayloadReader (#13486)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-16 09:37:22 +08:00
shaoyue 0e24520192
[skip ci] Add comment for index codec (#13464)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-15 21:13:23 +08:00
jaime a91d2118b6
[skip ci] Fix grammar mistake in event_data (#13419)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 12:03:58 +08:00
jaime dec2eba610
[skip ci] Fix grammar mistake in local_chunk_manager (#13418)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 11:56:07 +08:00
jaime 0aa8e65501
[skip ci] Fix grammar mistake in minio_chunk_manager (#13417)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 11:53:47 +08:00
congqixia 89a26b2679
Fix redundant init declaration in storage/util.go (#13381)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-15 11:13:10 +08:00
shaoyue a54d1ec674
[skip ci]add comment for EventWriter (#13369)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-14 20:05:09 +08:00
shaoyue 18fbc167f8
[skip ci] Add comment for payload (#13367)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-14 20:03:20 +08:00
shaoyue 41190c23f1
[skip ci] Add comment for EventTypeCode (#13368)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-14 19:55:17 +08:00
Xiangyu Wang 405b3cd932
Use the same lint rules with golint in revive (#13324)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
JackLCL 5b9282fdc3
[skip ci]Fix error log output format in data_ciodec.go (#13226)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-13 13:22:14 +08:00
godchen cec42cb19a
Make arrow use jemalloc (#13029)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-09 14:17:36 +08:00
godchen febdda90f4
Change binlog writer close behavior (#13046)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-09 12:37:06 +08:00
godchen 5c44ee8c0f
Close binlog event when error occur (#12995)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 21:11:39 +08:00
XuanYang-cn 383f14999d
Make Arrow compilation easier (#13005)
replace all the bundled libraries with arrow_bundled_dependencies

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-08 20:55:05 +08:00
godchen 0c60df4b3b
[skip ci]Fix comment typo (#13017)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:51:06 +08:00
godchen 6845b0e986
[skip ci]Fix comment typo (#13016)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:49:14 +08:00
godchen 9363dbf7b2
[skip ci]Fix comment typo (#13015)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:47:24 +08:00
zhenshan.cao 69259d9294
Call ReleaseUnused of memorypool in arrow (#12893)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-08 15:53:05 +08:00
shaoyue 5045ba208e
[skip ci] Add comment for storage.StatsWriter (#12965)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-08 15:13:32 +08:00
shaoyue d5aa125c49
[skip ci] Add comment for StatsReader (#12870)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-07 14:53:13 +08:00
shaoyue ccf957e1a8
[skip ci] Add comment for PayloadReader (#12869)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-07 14:51:21 +08:00
godchen 513afd9e42
Update arrow version (#12644)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-03 18:59:33 +08:00
congqixia 21a6ce8647
Remove redundant conversion in event_writer.go (#12590)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-02 19:15:33 +08:00
shaoyue 490f81b932
[skip ci] Add comment for DataDefinitionCodec (#12616)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-02 18:57:32 +08:00
shaoyue ffda2e5945
[skip ci] Fix comment for PayloadReader (#12621)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-02 18:07:33 +08:00
shaoyue 0d92f61d56
[skip ci] Add comment for storage.ChunManger methods (#12524)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-01 15:45:40 +08:00
shaoyue ee89ca83e1
[skip ci] Add comment for internal/storage/data_codec.go (#12520)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-01 15:39:57 +08:00
congqixia 001752eb91
Fix zero length slice declaration in storage/util.go (#12412)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-30 09:57:44 +08:00
XuanYang-cn 48b45d82e5
Add ut for binlog_io to 100 coverage (#12283)
Make DN ut coverage upto 90%
Resolves: #8058

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-26 17:43:17 +08:00
XuanYang-cn 6bf0c4326d
Fix compaction generates wrong insert binlogs (#12204)
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug

Fixes: #12146

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-23 17:09:15 +08:00
congqixia 8c107ab15f
Set segment DroppedAt when compacted (#12182)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 20:11:14 +08:00
godchen 9d5bcd3e3a
Close event and binlog reader (#12173)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-22 17:27:14 +08:00
Bingyi Sun a3d4cbdd4c
Convert c array to a golang slice (#12066)
issue: #11974
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-22 10:05:14 +08:00
shaoyue 1587214676
[skip ci] Add comment for exported items in data_codec.go (#12089)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-18 19:15:27 +08:00
XuanYang-cn 9bd3664672
Fix compaction bug (#11816)
This PR fixes:
- timeout in compaction
- BinlogIterator using rawID as PKField bug

See also: #11757

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 10:07:13 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files (#11898)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00
Cai Yudong b3d85adb6e
Use API HandleCStatus to handle CStatus returned by CGo in storage (#11782)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 13:27:09 +08:00
bigsheeper 93149c5ad9
Load growing segment in query node (#11664)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 18:27:10 +08:00
Xiangyu Wang 95ac530f5c
[skip ci]Improve import statements (#11715)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-12 11:14:44 +08:00
Xiangyu Wang b8dcaa31bb
[skip ci]Improve import statements (#11714)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-12 11:12:47 +08:00
Xiangyu Wang 0b4d7dc7f6
[skip ci]Improve import statements (#11713)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-12 11:10:47 +08:00
godchen 863f1bb34e
Fix multi delete data not effect (#11422)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 15:01:17 +08:00
shaoyue e00a4242df
[skip ci] Add comments (#11408)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-08 11:31:00 +08:00
dragondriver 82b510eda2
[skip ci] Fix golint warning of binlog_iterator.go (#11091)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-02 21:45:53 +08:00
godchen a0a3a889e7
Add common endian for global use (#11092)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 18:16:32 +08:00