milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
11,677 Commits
139 Branches
115 Tags
577 MiB
Commit Graph

164 Commits (9af7e179f21da574675631d67ef102dcd5bf7d0d)

Author SHA1 Message Date
XuanYang-cn 48b45d82e5
Add ut for binlog_io to 100 coverage (#12283) 
Make DN ut coverage upto 90%
Resolves: #8058

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-26 17:43:17 +08:00
XuanYang-cn 6bf0c4326d
Fix compaction generates wrong insert binlogs (#12204) 
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug

Fixes: #12146

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-23 17:09:15 +08:00
congqixia 8c107ab15f
Set segment DroppedAt when compacted (#12182) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-22 20:11:14 +08:00
godchen 9d5bcd3e3a
Close event and binlog reader (#12173) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-22 17:27:14 +08:00
Bingyi Sun a3d4cbdd4c
Convert c array to a golang slice (#12066) 
issue: #11974
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-22 10:05:14 +08:00
shaoyue 1587214676
[skip ci] Add comment for exported items in data_codec.go (#12089) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-18 19:15:27 +08:00
XuanYang-cn 9bd3664672
Fix compaction bug (#11816) 
This PR fixes:
- timeout in compaction
- BinlogIterator using rawID as PKField bug

See also: #11757

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-17 10:07:13 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files (#11898) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-16 15:41:11 +08:00
Cai Yudong b3d85adb6e
Use API HandleCStatus to handle CStatus returned by CGo in storage (#11782) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-15 13:27:09 +08:00
bigsheeper 93149c5ad9
Load growing segment in query node (#11664) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-12 18:27:10 +08:00
Xiangyu Wang 95ac530f5c
[skip ci]Improve import statements (#11715) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-12 11:14:44 +08:00
Xiangyu Wang b8dcaa31bb
[skip ci]Improve import statements (#11714) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-12 11:12:47 +08:00
Xiangyu Wang 0b4d7dc7f6
[skip ci]Improve import statements (#11713) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-12 11:10:47 +08:00
godchen 863f1bb34e
Fix multi delete data not effect (#11422) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-09 15:01:17 +08:00
shaoyue e00a4242df
[skip ci] Add comments (#11408) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-08 11:31:00 +08:00
dragondriver 82b510eda2
[skip ci] Fix golint warning of binlog_iterator.go (#11091) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-02 21:45:53 +08:00
godchen a0a3a889e7
Add common endian for global use (#11092) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-02 18:16:32 +08:00
XuanYang-cn 8704293215
Fix storage Value not exposed problem (#10755) 
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-27 22:32:23 +08:00
zhenshan.cao 373a4684b9
[skip ci]Fix golint error in data_codec (#10697) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-26 22:32:44 +08:00
cai.zhang 5b42a3223c
Increase compatibility for EstimateMemorySize interface (#10603) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-26 15:34:21 +08:00
XuanYang-cn cd06f50645
Remove schema in delete codec (#10517) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-24 09:59:10 +08:00
Xiangyu Wang 99ca6e4ba2
Improve comment in storage (#10448) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-22 20:45:12 +08:00
Xiangyu Wang 99d57beff8
Improve comment in storage (#10447) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-22 17:29:11 +08:00
godchen ffc0c07610
Change delete data primary key to int64 (#10438) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-22 15:37:12 +08:00
godchen e7738243b9
Fix stats log nil when not int64 field (#10417) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-22 12:51:11 +08:00
congqixia c3518b8c81
Fix nil stats from DeserializeStats (#10255) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-20 14:26:35 +08:00
sunby db53eccec9
Add binlog iterators (#10173) 
issue: #9530
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-20 11:52:35 +08:00
godchen 8daeb0d519
Change bloom filter use pk (#10193) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-19 20:18:47 +08:00
XuanYang-cn 2255fe0b45
Change deserialize deltelog from 1 blob to blobs (#10085) 
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-19 10:28:35 +08:00
XuanYang-cn 75dccad4fa
[skip ci]Fix const golint in data_codec (#9793) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-13 18:59:26 +08:00
XuanYang-cn 2659807826
[skip ci]Fix golint in data_codec (#9792) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-13 18:57:44 +08:00
Cai Yudong a63ef91c74
Fix static-check (#9776) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 13:22:33 +08:00
godchen 59ab0e441c
Add bloom filter for stats (#9630) 
* Add bloom filter for stats

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* trigger GitHub actions

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-13 10:22:33 +08:00
dragondriver 1f224c4b2e
Optimize the ut of storage utils (#9740) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-12 19:47:08 +08:00
dragondriver f85271cf3f
Estimate memory size by descriptor event (#9688) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-12 17:00:34 +08:00
dragondriver abb8c2b9ed
Fix the way that binlog store the original size (#9681) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-11 21:02:37 +08:00
dragondriver 7daa319dc2
[skip ci] Rename EstimateMemorySize to GetBinlogSize (#9651) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-11 18:20:30 +08:00
dragondriver 9a7a060484
Store original memory size of binlog file to extra information (#9628) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-11 17:28:30 +08:00
dragondriver 1bc4b36617
Estimate the memory size of binlog file (#9612) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-11 14:10:48 +08:00
dragondriver dedf745b76
Rename IndexParamsFile to IndexParamsKey (#9563) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-09 19:27:02 +08:00
dragondriver 28a90f9e7a
Store index parameters to descriptor event (#9451) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-09 16:08:56 +08:00
congqixia 74233fcfd8
[skip ci] Fix golint for binlog_writer.go (#9388) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-07 22:13:09 +08:00
zhenshan.cao b76e9de5ab
[skip ci] Fix golint error in event_reader.go (#9156) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-03 20:56:05 +08:00
zhenshan.cao 6d2efe13b6
[skip ci] fix golint error in binlog_reader.go (#9114) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-03 08:53:55 +08:00
zhenshan.cao 5e78500519
[skip ci] Fix golint error in print_binlog (#9042) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-01 23:41:23 +08:00
dragondriver 818cf3ffa0
Split blob into several string rows when index file is large (#8919) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-30 17:57:01 +08:00
dragondriver ca5e9ebe55
Binlog parser tool supports index file (#8914) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-30 15:47:32 +08:00
dragondriver cf8600077f
Refactor the index file format (#8514) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-29 09:52:12 +08:00
godchen c23236c50e
Fix chunk manager ci lint (#8779) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-28 20:46:04 +08:00
godchen af173dd2a0
Add delete codec (#8736) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-28 14:30:02 +08:00