9166011c4a
Add float16 vector ( #25852 )
...
Signed-off-by: Writer-X <1256866856@qq.com>
2023-09-08 10:03:16 +08:00
fb0705df1b
Decouple basetable and componentparam ( #26725 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-09-05 10:31:48 +08:00
1b1bafaff1
Bulkinsert read varchar by batch ( #26199 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-08-30 14:23:06 +08:00
c2693ea284
Fix a crash bug of bulkinsert for dynamic field ( #25982 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-07-28 15:25:03 +08:00
a6808e6484
Fix bulkinsert row count error ( #25869 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-07-25 11:29:00 +08:00
96c987ed62
Bulkinsert supports partition keys ( #25284 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-07-11 15:18:28 +08:00
41af0a98fa
Use go-api/v2 for milvus-proto ( #24770 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-09 01:28:37 +08:00
ebd0279d3f
Check error by Error() and NoError() for better report message ( #24736 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-06-08 15:36:36 +08:00
3022e37298
Fix bug of bulkinsert for dynamic field ( #24569 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-06-01 14:14:31 +08:00
5358da2a10
Fix a crash bug for backup/restore ( #24529 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-05-31 14:45:30 +08:00
0d0e97ab7f
Fix crash issue of bulkinsert by invalid numpy array file ( #24480 ) ( #24528 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-05-31 14:43:39 +08:00
3cb75997a3
Fix a bug of bulkinsert dynamic schema ( #24405 ) ( #24527 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-05-31 14:41:41 +08:00
97cd0409e4
Support dynamic field for bulkinsert ( #24265 ) ( #24304 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-05-23 14:17:25 +08:00
7744573d3d
support parms for import maxfilesize( #24191 ) ( #24192 )
...
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
2023-05-18 18:59:27 +08:00
b89f06dd19
Support JSON for bulkinsert ( #24130 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-05-18 16:33:23 +08:00
73a181d226
Fix get vector it timeout and improve some string const usage ( #24141 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-16 17:41:22 +08:00
c9d0c157ec
Move some modules from internal to public package ( #22572 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-04-06 19:14:32 +08:00
6f6bd98c27
Verify vector float data for bulkinsert and insert ( #22728 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-03-14 14:03:58 +08:00
697dedac7e
Use cockroachdb/errors to replace other error pkg ( #22390 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-26 11:31:49 +08:00
b7c0d12d82
Skip file with prefix '.' may exist in filesystem ( #22138 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-02-21 10:54:29 +08:00
f2575e5fa8
Add unconvert & durationcheck linters and fix issues ( #22161 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-15 17:22:34 +08:00
c21e11eb8a
Fix datanode crash bug for bulkinsert ( #22041 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-02-08 14:06:31 +08:00
949d5d078f
Fix memory calculation in dataCodec ( #21800 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-01-28 11:09:52 +08:00
c0e7a122d4
Fix bulkinsert progress bug ( #21680 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2023-01-13 16:25:40 +08:00
9f8095996b
Report bulkinsert progress ( #21612 ) ( #21638 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2023-01-11 17:37:44 +08:00
aab20a4031
Streaming read numpy ( #21579 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-01-10 14:53:38 +08:00
b3da554705
Increase bulk insert file size limit ( #21526 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-01-06 13:09:36 +08:00
33a102c6fc
Refine bulkinsert ( #20986 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-12-07 14:53:18 +08:00
bf2107ecf5
Fix a regression of local storage ( #20653 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-21 10:19:10 +08:00
8da44638ac
Refine json parser for import ( #20545 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-16 19:05:08 +08:00
e217b951ee
Fix bulkinsert bug for int64 value ( #20491 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-14 10:15:10 +08:00
53850e340c
Dont expire pending import tasks ( #20431 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-10 10:25:08 +08:00
a7bed1c927
Pass backup flag through Import request options ( #20334 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-11-08 11:33:03 +08:00
b847c425e1
Fix listImportTasks bug ( #20301 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-07 17:11:02 +08:00
cd3b3d3da6
Only allow one file for row-based import ( #20234 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-02 10:23:35 +08:00
c6151ad351
Parse utf32 string of numpy file ( #20176 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-10-31 17:39:34 +08:00
bee66631e3
Refine bulkload ( #19671 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-10-27 16:21:34 +08:00
dbd60757c9
Support pass start_ts and end_ts through Import API ( #19810 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-10-20 12:15:27 +08:00
a55f739608
Separate public proto files ( #19782 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
8b8df0a5e9
Do not use DataCoord context when DataNode is handling import task ( #19732 )
...
So that when DataCoord is done, DataNode can still proceed.
/kind bug
issue: #19730
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-10-14 15:15:24 +08:00
a561614d48
Fix bulkload failed bug ( #19702 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-10-12 10:27:23 +08:00
746e9ece5a
Fix a random failure of unittest ( #19643 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-10-09 14:22:57 +08:00
bbedd4a852
Fix a bug of backup/restore ( #19585 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-09-30 17:42:57 +08:00
2599a3ece0
Import native binlog files ( #19447 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-09-30 10:32:54 +08:00
838a633584
Add ctx parameter for ChunkManager methods ( #19546 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-29 16:18:56 +08:00
b30c9d4f60
Support Bulk Load in Milvus 2.2 ( #18982 )
...
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-09-26 18:06:54 +08:00
928a213e31
Fix Chunk Manager Path mis use ( #19141 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-09-23 14:40:51 +08:00
d7f38a803d
Separate some proto files ( #19218 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
c91bb0b015
Unify rootPath in configs and ChunkManager ( #18808 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-25 19:32:53 +08:00
d90313a1a8
Use chunkManager rather than minio.Client in datanode garbage collection ( #18092 )
...
Signed-off-by: xingzhao <xing.zhao@zilliz.com>
Co-authored-by: xingzhao <xing.zhao@zilliz.com>
2022-07-22 22:10:28 +08:00
Xu Tong
Enwei Jiao
groot
congqixia
yah01
MrPresent-Han
jaime
wayblink
Xiaofan
Ten Thousand Leaves
SimFG
xing.zhao