Commit Graph

341 Commits (ef82e0f1a4f5d0561aa1546a0555e9cccc2b454a)

Author SHA1 Message Date
XuanYang-cn 3afe467d86
[skip e2e]Update license for cwrapper parquet (#14625)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-04 09:09:22 +08:00
XuanYang-cn c7c147b26c
[skip e2e]Update license for cwrapper cmake (#14627)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-30 20:05:26 +08:00
shaoyue f9dc87ba6c
[skip e2e] Add comment for data_codec (#14571)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-30 10:44:05 +08:00
XuanYang-cn 7bfde0aa73
[skip e2e]Update license for storage vector chunk m (#14540)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-29 22:42:14 +08:00
Xiaofan 029b153259
Remove data directory for test (#14363)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 10:08:47 +08:00
XuanYang-cn dd860a76cf
[skip e2e]Update license for storage util (#14453)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 20:11:55 +08:00
XuanYang-cn 758dc8b70f
[skip e2e]Update license for storage unsafe (#14452)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 20:03:56 +08:00
XuanYang-cn 647307ea64
[skip e2e]Update license for storage types (#14451)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 19:57:10 +08:00
XuanYang-cn 9b335e74a2
[skip e2e]Update license for storage stats (#14349)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 09:44:06 +08:00
XuanYang-cn e4ae7a6bef
[skip e2e]Update license for storage print binlog (#14348)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 09:43:49 +08:00
XuanYang-cn 1567aa3f53
[skip e2e]Update license for storage payload (#14347)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 09:43:26 +08:00
congqixia 20cc6843a4
[skip e2e] Add comment for FieldData interface (#14351)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-28 09:34:15 +08:00
edward.zeng 57ec25c246
[skip e2e] Refine storage binlog iterator comment (#14309)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-27 15:46:03 +08:00
edward.zeng 94e65eaaa5
[skip e2e] Refine storage binlog writer comment (#14312)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-27 15:42:03 +08:00
jaime 28dfccb6ea
[skip e2e] Fix golint in data_codec (#14212)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-24 19:56:28 +08:00
XuanYang-cn 7ce71870ce
[skip e2e]Update license for storage event test (#14191)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 17:34:21 +08:00
XuanYang-cn effd4cc461
[skip e2e]Update license for storage miniochunk (#14193)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 17:32:20 +08:00
XuanYang-cn c29cf1bc21
[skip e2e]Update license for storage localchunck (#14192)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 17:30:32 +08:00
shaoyue e0a2f1ce82
[skip e2e] Add comment for IndexCodec (#14139)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-24 13:31:30 +08:00
shaoyue 94265639fe
[skip e2e] Add comment for PayloadWriter (#14138)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-24 13:29:03 +08:00
XuanYang-cn 107e3f8971
[skip e2e]Update license for storage reader (#14041)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 13:08:05 +08:00
jaime d623ea5c37
[skip e2e] Fix goint error in payload (#14109)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-23 22:07:38 +08:00
jaime 0114708c95
[skip e2e] Fix grammar mistake in data_codec (#14108)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-23 22:05:51 +08:00
jaime 846e86b478
[skip e2e] Fix grammar mistake in event_data (#14107)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-23 22:03:56 +08:00
shaoyue d4f9365a3d
[skip e2e] Add comment for internal/storage/data_codec.go (#14030)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-23 14:30:34 +08:00
XuanYang-cn e580bb9ccb
[skip e2e]Update license for storage event writer (#14043)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:07:10 +08:00
XuanYang-cn 78c7ec7300
[skip e2e]Update license for storage event (#14042)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:05:21 +08:00
XuanYang-cn 6eb0de1640
[skip e2e]Update license for storage writer (#14040)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:03:28 +08:00
XuanYang-cn bccf65ec67
[skip e2e]Update license for storage datacodec (#14039)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:01:36 +08:00
XuanYang-cn a666cb4f76
[skip e2e]Update license for storage sorter (#14038)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 11:59:21 +08:00
shaoyue cd410c6069
[skip e2e] Add comment for internal/storage.PayloadWriter (#13993)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-22 19:33:39 +08:00
shaoyue ec91866a5c
[skip e2e] Add comment for internal/storage.Int8FieldData (#13992)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-22 19:31:51 +08:00
shaoyue 770adc17ae
Support library link in centos7 (#13974)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-22 19:22:19 +08:00
JackLCL b79d751977
[skip ci]Fix error log output format in data_codec.go (#13382)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-22 09:59:04 +08:00
shaoyue 8998e1d29b
[skip e2e] Add comment for PayloadReader (#13899)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-21 21:06:28 +08:00
XuanYang-cn d2c83c24f4
[skip e2e]Update license for storage iterator (#13890)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-21 18:48:57 +08:00
shaoyue bcb951b0de
[skip e2e] Add comment for event writer (#13800)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-20 23:18:53 +08:00
jaime 40a0c76e73
[skip e2e] Fix grammar mistake in event_data (#13805)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-20 22:49:00 +08:00
jaime 99737d30e2
[skip e2e] Fix golint in data_codec (#13804)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-20 22:47:07 +08:00
jaime 7723d7b571
[skip e2e] Fix golint in payload (#13803)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-20 22:45:15 +08:00
shaoyue 83a59d2545
[skip e2e]Add comment for payload (#13799)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-20 20:00:53 +08:00
Xieql 35ab21372b
[skip e2e] Improve annotation (#13722)
Signed-off-by: Xieql <727092844@qq.com>
2021-12-20 19:08:38 +08:00
congqixia 65faf03923
[skip e2e] Add comment for Int64Stats (#13663)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-17 22:04:43 +08:00
congqixia 0e30ec25f3
[skip e2e] Add comment for descriptorEvent (#13662)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-17 22:02:42 +08:00
godchen 9576ec4dcb
[skip e2e]Fix binlog writer comment (#13576)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 19:42:50 +08:00
godchen ecd3dc5830
[skip e2e]Remove useless event header check func (#13573)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 19:00:14 +08:00
shaoyue 43fbb0fd16
[skip e2d] Fix typo in StatsReader comment (#13623)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-17 18:47:56 +08:00
godchen 7e56f08747
Add payload bytes interface. (#13467)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-16 16:35:42 +08:00
shaoyue 1f2c098fe7
[skip ci]Add comment for PayloadReader (#13486)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-16 09:37:22 +08:00
shaoyue 0e24520192
[skip ci] Add comment for index codec (#13464)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-15 21:13:23 +08:00
jaime a91d2118b6
[skip ci] Fix grammar mistake in event_data (#13419)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 12:03:58 +08:00
jaime dec2eba610
[skip ci] Fix grammar mistake in local_chunk_manager (#13418)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 11:56:07 +08:00
jaime 0aa8e65501
[skip ci] Fix grammar mistake in minio_chunk_manager (#13417)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 11:53:47 +08:00
congqixia 89a26b2679
Fix redundant init declaration in storage/util.go (#13381)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-15 11:13:10 +08:00
shaoyue a54d1ec674
[skip ci]add comment for EventWriter (#13369)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-14 20:05:09 +08:00
shaoyue 18fbc167f8
[skip ci] Add comment for payload (#13367)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-14 20:03:20 +08:00
shaoyue 41190c23f1
[skip ci] Add comment for EventTypeCode (#13368)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-14 19:55:17 +08:00
Xiangyu Wang 405b3cd932
Use the same lint rules with golint in revive (#13324)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
JackLCL 5b9282fdc3
[skip ci]Fix error log output format in data_ciodec.go (#13226)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-13 13:22:14 +08:00
godchen cec42cb19a
Make arrow use jemalloc (#13029)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-09 14:17:36 +08:00
godchen febdda90f4
Change binlog writer close behavior (#13046)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-09 12:37:06 +08:00
godchen 5c44ee8c0f
Close binlog event when error occur (#12995)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 21:11:39 +08:00
XuanYang-cn 383f14999d
Make Arrow compilation easier (#13005)
replace all the bundled libraries with arrow_bundled_dependencies

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-08 20:55:05 +08:00
godchen 0c60df4b3b
[skip ci]Fix comment typo (#13017)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:51:06 +08:00
godchen 6845b0e986
[skip ci]Fix comment typo (#13016)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:49:14 +08:00
godchen 9363dbf7b2
[skip ci]Fix comment typo (#13015)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:47:24 +08:00
zhenshan.cao 69259d9294
Call ReleaseUnused of memorypool in arrow (#12893)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-08 15:53:05 +08:00
shaoyue 5045ba208e
[skip ci] Add comment for storage.StatsWriter (#12965)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-08 15:13:32 +08:00
shaoyue d5aa125c49
[skip ci] Add comment for StatsReader (#12870)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-07 14:53:13 +08:00
shaoyue ccf957e1a8
[skip ci] Add comment for PayloadReader (#12869)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-07 14:51:21 +08:00
godchen 513afd9e42
Update arrow version (#12644)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-03 18:59:33 +08:00
congqixia 21a6ce8647
Remove redundant conversion in event_writer.go (#12590)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-02 19:15:33 +08:00
shaoyue 490f81b932
[skip ci] Add comment for DataDefinitionCodec (#12616)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-02 18:57:32 +08:00
shaoyue ffda2e5945
[skip ci] Fix comment for PayloadReader (#12621)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-02 18:07:33 +08:00
shaoyue 0d92f61d56
[skip ci] Add comment for storage.ChunManger methods (#12524)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-01 15:45:40 +08:00
shaoyue ee89ca83e1
[skip ci] Add comment for internal/storage/data_codec.go (#12520)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-01 15:39:57 +08:00
congqixia 001752eb91
Fix zero length slice declaration in storage/util.go (#12412)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-30 09:57:44 +08:00
XuanYang-cn 48b45d82e5
Add ut for binlog_io to 100 coverage (#12283)
Make DN ut coverage upto 90%
Resolves: #8058

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-26 17:43:17 +08:00
XuanYang-cn 6bf0c4326d
Fix compaction generates wrong insert binlogs (#12204)
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug

Fixes: #12146

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-23 17:09:15 +08:00
congqixia 8c107ab15f
Set segment DroppedAt when compacted (#12182)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 20:11:14 +08:00
godchen 9d5bcd3e3a
Close event and binlog reader (#12173)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-22 17:27:14 +08:00
Bingyi Sun a3d4cbdd4c
Convert c array to a golang slice (#12066)
issue: #11974
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-22 10:05:14 +08:00
shaoyue 1587214676
[skip ci] Add comment for exported items in data_codec.go (#12089)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-18 19:15:27 +08:00
XuanYang-cn 9bd3664672
Fix compaction bug (#11816)
This PR fixes:
- timeout in compaction
- BinlogIterator using rawID as PKField bug

See also: #11757

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 10:07:13 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files (#11898)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00
Cai Yudong b3d85adb6e
Use API HandleCStatus to handle CStatus returned by CGo in storage (#11782)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 13:27:09 +08:00
bigsheeper 93149c5ad9
Load growing segment in query node (#11664)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 18:27:10 +08:00
Xiangyu Wang 95ac530f5c
[skip ci]Improve import statements (#11715)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-12 11:14:44 +08:00
Xiangyu Wang b8dcaa31bb
[skip ci]Improve import statements (#11714)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-12 11:12:47 +08:00
Xiangyu Wang 0b4d7dc7f6
[skip ci]Improve import statements (#11713)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-12 11:10:47 +08:00
godchen 863f1bb34e
Fix multi delete data not effect (#11422)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 15:01:17 +08:00
shaoyue e00a4242df
[skip ci] Add comments (#11408)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-08 11:31:00 +08:00
dragondriver 82b510eda2
[skip ci] Fix golint warning of binlog_iterator.go (#11091)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-02 21:45:53 +08:00
godchen a0a3a889e7
Add common endian for global use (#11092)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 18:16:32 +08:00
XuanYang-cn 8704293215
Fix storage Value not exposed problem (#10755)
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 22:32:23 +08:00
zhenshan.cao 373a4684b9
[skip ci]Fix golint error in data_codec (#10697)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-26 22:32:44 +08:00
cai.zhang 5b42a3223c
Increase compatibility for EstimateMemorySize interface (#10603)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-26 15:34:21 +08:00
XuanYang-cn cd06f50645
Remove schema in delete codec (#10517)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-24 09:59:10 +08:00
Xiangyu Wang 99ca6e4ba2
Improve comment in storage (#10448)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 20:45:12 +08:00
Xiangyu Wang 99d57beff8
Improve comment in storage (#10447)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 17:29:11 +08:00
godchen ffc0c07610
Change delete data primary key to int64 (#10438)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 15:37:12 +08:00
godchen e7738243b9
Fix stats log nil when not int64 field (#10417)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 12:51:11 +08:00
congqixia c3518b8c81
Fix nil stats from DeserializeStats (#10255)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-20 14:26:35 +08:00
sunby db53eccec9
Add binlog iterators (#10173)
issue: #9530
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 11:52:35 +08:00
godchen 8daeb0d519
Change bloom filter use pk (#10193)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-19 20:18:47 +08:00
XuanYang-cn 2255fe0b45
Change deserialize deltelog from 1 blob to blobs (#10085)
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-19 10:28:35 +08:00
XuanYang-cn 75dccad4fa
[skip ci]Fix const golint in data_codec (#9793)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 18:59:26 +08:00
XuanYang-cn 2659807826
[skip ci]Fix golint in data_codec (#9792)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 18:57:44 +08:00
Cai Yudong a63ef91c74
Fix static-check (#9776)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 13:22:33 +08:00
godchen 59ab0e441c
Add bloom filter for stats (#9630)
* Add bloom filter for stats

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* trigger GitHub actions

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-13 10:22:33 +08:00
dragondriver 1f224c4b2e
Optimize the ut of storage utils (#9740)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 19:47:08 +08:00
dragondriver f85271cf3f
Estimate memory size by descriptor event (#9688)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 17:00:34 +08:00
dragondriver abb8c2b9ed
Fix the way that binlog store the original size (#9681)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 21:02:37 +08:00
dragondriver 7daa319dc2
[skip ci] Rename EstimateMemorySize to GetBinlogSize (#9651)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 18:20:30 +08:00
dragondriver 9a7a060484
Store original memory size of binlog file to extra information (#9628)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 17:28:30 +08:00
dragondriver 1bc4b36617
Estimate the memory size of binlog file (#9612)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 14:10:48 +08:00
dragondriver dedf745b76
Rename IndexParamsFile to IndexParamsKey (#9563)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 19:27:02 +08:00
dragondriver 28a90f9e7a
Store index parameters to descriptor event (#9451)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 16:08:56 +08:00
congqixia 74233fcfd8
[skip ci] Fix golint for binlog_writer.go (#9388)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-07 22:13:09 +08:00
zhenshan.cao b76e9de5ab
[skip ci] Fix golint error in event_reader.go (#9156)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-03 20:56:05 +08:00
zhenshan.cao 6d2efe13b6
[skip ci] fix golint error in binlog_reader.go (#9114)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-03 08:53:55 +08:00
zhenshan.cao 5e78500519
[skip ci] Fix golint error in print_binlog (#9042)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-01 23:41:23 +08:00
dragondriver 818cf3ffa0
Split blob into several string rows when index file is large (#8919)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-30 17:57:01 +08:00
dragondriver ca5e9ebe55
Binlog parser tool supports index file (#8914)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-30 15:47:32 +08:00
dragondriver cf8600077f
Refactor the index file format (#8514)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-29 09:52:12 +08:00
godchen c23236c50e
Fix chunk manager ci lint (#8779)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-28 20:46:04 +08:00
godchen af173dd2a0
Add delete codec (#8736)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-28 14:30:02 +08:00
ZhiShen 0e767f0e1b
Change cmake version (#8666)
Change cmake version from 3.16 to 3.18

1. Change the CMakeList's minimum require version.

2. Change the describtion document of cmake version.

Resolves: milvus-io#8407

Signed-off-by: Shen Zhi <m13120163046@163.com>
2021-09-28 14:00:03 +08:00
dragondriver 7a76022f3b
[skip ci] Update doc of descriptor event format (#8487)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-24 18:17:56 +08:00
godchen 10c07a3041
Add description event extras. (#8264)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-23 17:23:54 +08:00
godchen b47ff1f97f
[skip ci]Add chunk manager interface comment (#8350)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-23 17:13:56 +08:00
Xiaofan acfd7c7911
[skip ci] Fix typo in binlog writer (#8255)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-18 22:55:51 +08:00
yukun 269e041e34
[skip ci]Fix typo (#8251)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-18 19:53:51 +08:00
godchen d1d3993689
[skip ci]Add binlog reader comment (#8230)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:57:51 +08:00
godchen 3f5e876188
[skip ci]Add binlog writer comment (#8231)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:39:56 +08:00
godchen 0cf0217ed5
[skip ci]Add event data comment (#8232)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:37:56 +08:00
congqixia bdfb8768d4
Enable gosec (#8202)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-18 14:45:50 +08:00
godchen 31df0faaf5
[skip ci]Add chunk manager comment (#7833)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 14:49:50 +08:00
godchen 96539f02d8
Add data codec comment (#7998)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 11:05:49 +08:00
sunby 095b7c12c1
Add insert codec comment (#7891)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-15 10:47:48 +08:00
groot 314eed2172
Update storage unittest (#7637)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-09 17:12:55 +08:00
groot a3666c843f
Add unittest for chunk manager (#7628)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-09 17:12:15 +08:00
groot dbd2a02462
Add unittest for VectorChunkManager (#7610)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-09 14:34:00 +08:00
XuanYang-cn 4785e452be
Fix Arrow unable to find Boost error (#7552)
Resolve: #7549

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-08 10:59:59 +08:00
Cai Yudong 7edd96989f
Improve codecov for paramtable and typeutil (#7451)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-02 22:18:10 +08:00
Xiangyu Wang c62f23e201
[skip ci]Remove neza2017 from reviewers (#7324)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-27 00:27:36 +08:00
godchen 8cc24e09c9
Make users get vectors without using local storage (#7134)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-18 16:30:11 +08:00
Cai Yudong e771bda92f
optimize retrieve output vector code structure (#7102)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-14 11:18:10 +08:00
Xiangyu Wang 5e78fd6a97
[skip ci]Update approvers (#7063)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-12 19:36:09 +08:00
bigsheeper 7307332fab
Add nil check (#6832)
* add nil check

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* use grpc functions

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* use grpc functions

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix indexCoord crash

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-07-29 20:11:23 +08:00