a55f739608
Separate public proto files ( #19782 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
d7f38a803d
Separate some proto files ( #19218 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
4de1bfe5bc
Add cpp data codec ( #18538 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: zhagnlu lu.zhang@zilliz.com
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-09-09 22:12:34 +08:00
e40061b864
Update binlog event format ( #18347 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-08-11 14:06:38 +08:00
70f8bea4b4
Avoid growing slice as deserializing binlogs ( #17421 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-08 11:46:06 +08:00
7af02fa531
Improve load performance, load binlogs concurrently per file, deserialize binlogs concurrently per field/segment ( #16514 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-25 15:57:47 +08:00
bb7a0766fe
Add dependency factory ( #16204 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-04-07 22:05:32 +08:00
99984b88e1
Support delete varChar value ( #16229 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-04-02 17:43:29 +08:00
ba37531456
Add support for loading multiple indexes ( #16138 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-30 21:11:28 +08:00
801eeffbcc
Replace cgo parquet reader to go parquet reader ( #16199 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-03-30 15:21:28 +08:00
205c92e54b
Support insert string data ( #15993 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-03-25 14:27:25 +08:00
384ceea223
Close payload writer when error occurs ( #15013 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-07 18:27:23 +08:00
b22e945513
[skip e2e] Add comment for NewInsertCodec ( #14907 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-06 18:04:03 +08:00
f9dc87ba6c
[skip e2e] Add comment for data_codec ( #14571 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-30 10:44:05 +08:00
20cc6843a4
[skip e2e] Add comment for FieldData interface ( #14351 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-28 09:34:15 +08:00
28dfccb6ea
[skip e2e] Fix golint in data_codec ( #14212 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-24 19:56:28 +08:00
e0a2f1ce82
[skip e2e] Add comment for IndexCodec ( #14139 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-24 13:31:30 +08:00
0114708c95
[skip e2e] Fix grammar mistake in data_codec ( #14108 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-23 22:05:51 +08:00
d4f9365a3d
[skip e2e] Add comment for internal/storage/data_codec.go ( #14030 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-23 14:30:34 +08:00
bccf65ec67
[skip e2e]Update license for storage datacodec ( #14039 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:01:36 +08:00
ec91866a5c
[skip e2e] Add comment for internal/storage.Int8FieldData ( #13992 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-22 19:31:51 +08:00
b79d751977
[skip ci]Fix error log output format in data_codec.go ( #13382 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-22 09:59:04 +08:00
99737d30e2
[skip e2e] Fix golint in data_codec ( #13804 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-20 22:47:07 +08:00
35ab21372b
[skip e2e] Improve annotation ( #13722 )
...
Signed-off-by: Xieql <727092844@qq.com>
2021-12-20 19:08:38 +08:00
7e56f08747
Add payload bytes interface. ( #13467 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-16 16:35:42 +08:00
0e24520192
[skip ci] Add comment for index codec ( #13464 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-15 21:13:23 +08:00
5b9282fdc3
[skip ci]Fix error log output format in data_ciodec.go ( #13226 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-13 13:22:14 +08:00
febdda90f4
Change binlog writer close behavior ( #13046 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-09 12:37:06 +08:00
5c44ee8c0f
Close binlog event when error occur ( #12995 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 21:11:39 +08:00
490f81b932
[skip ci] Add comment for DataDefinitionCodec ( #12616 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-02 18:57:32 +08:00
ee89ca83e1
[skip ci] Add comment for internal/storage/data_codec.go ( #12520 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-01 15:39:57 +08:00
48b45d82e5
Add ut for binlog_io to 100 coverage ( #12283 )
...
Make DN ut coverage upto 90%
Resolves : #8058
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-26 17:43:17 +08:00
6bf0c4326d
Fix compaction generates wrong insert binlogs ( #12204 )
...
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug
Fixes : #12146
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-23 17:09:15 +08:00
9d5bcd3e3a
Close event and binlog reader ( #12173 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-22 17:27:14 +08:00
1587214676
[skip ci] Add comment for exported items in data_codec.go ( #12089 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-18 19:15:27 +08:00
93149c5ad9
Load growing segment in query node ( #11664 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 18:27:10 +08:00
863f1bb34e
Fix multi delete data not effect ( #11422 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 15:01:17 +08:00
373a4684b9
[skip ci]Fix golint error in data_codec ( #10697 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-26 22:32:44 +08:00
cd06f50645
Remove schema in delete codec ( #10517 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-24 09:59:10 +08:00
ffc0c07610
Change delete data primary key to int64 ( #10438 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 15:37:12 +08:00
e7738243b9
Fix stats log nil when not int64 field ( #10417 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 12:51:11 +08:00
db53eccec9
Add binlog iterators ( #10173 )
...
issue: #9530
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 11:52:35 +08:00
8daeb0d519
Change bloom filter use pk ( #10193 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-19 20:18:47 +08:00
2255fe0b45
Change deserialize deltelog from 1 blob to blobs ( #10085 )
...
See also: #9530
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-19 10:28:35 +08:00
75dccad4fa
[skip ci]Fix const golint in data_codec ( #9793 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 18:59:26 +08:00
2659807826
[skip ci]Fix golint in data_codec ( #9792 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 18:57:44 +08:00
59ab0e441c
Add bloom filter for stats ( #9630 )
...
* Add bloom filter for stats
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* trigger GitHub actions
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-13 10:22:33 +08:00
abb8c2b9ed
Fix the way that binlog store the original size ( #9681 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 21:02:37 +08:00
9a7a060484
Store original memory size of binlog file to extra information ( #9628 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 17:28:30 +08:00
dedf745b76
Rename IndexParamsFile to IndexParamsKey ( #9563 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 19:27:02 +08:00
SimFG
xige-16
yah01
godchen
Jiquan Long
Xiaofan
congqixia
shaoyue
jaime
XuanYang-cn
JackLCL
Xieql
bigsheeper
zhenshan.cao
sunby