b9f5949680
Add vector chunk manager ( #6613 )
...
* add file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* add file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* add vector file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* rename
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix ut error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix memory error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-20 15:06:09 +08:00
a992dcf6a8
Support query return vector output field ( #6570 )
...
* improve code readibility
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add offset in RetrieveResults
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add VectorFieldInfo into Segment struct
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add new interface for query vector
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update load vector field logic
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update load vector field logic
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fill in field name in query result
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add FieldId into FieldData
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add fillVectorOutputFieldsIfNeeded
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update data_codec_test.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add DeserializeFieldData
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* realize query return vector output field
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* disable query vector case
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-16 17:19:55 +08:00
bc15b74244
Handle datasorter edge cases ( #6465 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-07-13 14:37:54 +08:00
7d920e9c9c
Fix compile error on CentOS ( #6359 )
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-08 15:43:45 +08:00
3387b07dfd
Optimize code under storage ( #6335 )
...
* rename AddOneStringToPayload/GetOneStringFromPayload to AddStringToPayload/GetStringFromPayload
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code optimize
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename print_binglog_test to print_binlog_test
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update chap08_binlog.md
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* use SetEventTimestamp() to replace SetStartTimestamp() and SetEndTimestamp()
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code optimize
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename AddStringToPayload/GetStringFromPayload to AddOneStringToPayload/GetOneStringFromPayload
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-07 19:10:07 +08:00
5a1f7e4feb
rename masterservice to rootcoord ( #5875 )
...
* rename masterservice to rootcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix build error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename package
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename masterservice to rootcoord under distributed
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update scripts
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* enable more unittests
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-18 21:30:08 +08:00
1c6786f85c
Add blob info ( #5792 )
...
* Add blob info
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-16 12:03:57 +08:00
ca0993c274
Update OWNERS
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-30 18:58:47 +08:00
23c4de0eb8
Flush statistics for all int64 fields ( #5318 )
...
Resolves : #5262
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-20 10:38:45 +00:00
4e6e502df1
Add data sorter in storage ( #5200 )
...
GetEntityByID needs the flushed segment to be sorted by RowID field,
then do binary search to get the target id and entities.
See also: #5177
Signed-off-by: fishpenguin kun.yu@zilliz.com
2021-05-14 02:59:49 +00:00
82ccd4cec0
Rename module ( #4988 )
...
* Rename module
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
0dfcb90881
Add storage copyright
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-19 11:32:24 +08:00
a5ad70a5ab
Add unittest for storage
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-19 10:36:19 +08:00
ce7a5ea699
Support segcoreinit
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-16 14:02:49 +08:00
8204546bcd
Add unit test for binlog module
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-12 14:07:46 +08:00
f3649f0419
Refactor interface and proto
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
7dd531d159
Fix release collection bug
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-11 18:42:25 +08:00
09ae985daa
Fix wrong error code in master_service_test.go
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-10 22:06:22 +08:00
455cc59dbb
Update publish-test-images.yaml
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-09 13:55:35 +08:00
ddddd65d10
Delete internal/errors package
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-05 10:15:27 +08:00
01e9dc8e3f
Remove collection name
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 11:52:19 +08:00
5e781b9370
Remove field name in query node and segCore
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 10:10:07 +08:00
45b99c0cf3
Save indexName and indexID in IndexCodec
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-02 19:56:11 +08:00
854accf95b
Remove master and writenode
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-30 16:41:47 +08:00
73d2b6a101
Get index param from minio and filter by vector fields
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-29 15:22:24 +08:00
3a866dab3d
Update proto
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-28 17:25:43 +08:00
2ebeade25e
Fix get component states
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-28 17:13:00 +08:00
2be8cc1c4b
Add index params serde to IndexCodec
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-28 16:41:24 +08:00
d22c2cd203
Add proto for query service loading collection
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-18 19:32:08 +08:00
4015d7245d
Merge operation
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-06 14:45:50 +08:00
1cfc2ff0a5
Add make clean in Makefile
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-06 13:50:48 +08:00
b06e01f523
Initmate querynode collection manager
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-06 11:31:36 +08:00
1c87faf8b3
Add insert request opentracing
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-06 11:17:35 +08:00
e16a7478da
Add verifier
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-01-05 20:13:54 +08:00
05f1350e19
Add writenode to ci
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-05 15:14:59 +08:00
ca89ece576
Fix go format bug
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-05 14:20:45 +08:00
fa77783ad7
Fix print ddl binlog bug
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-05 12:20:30 +08:00
95b162ccfd
Refactor flush scheduler
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-05 10:57:59 +08:00
7ce0f27ebc
Add buffer to minIO for binlogs
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-23 18:06:04 +08:00
e7ebfcb05a
Save index meta to meta table
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-23 15:13:45 +08:00
e52b130ba6
Refactor data codec code
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-23 15:46:16 +08:00
0b9cffaf87
Remove index_name in IndexRequest and remove indexType in FieldIndexMeta
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-23 11:34:35 +08:00
adfb5187cf
Dock build index task with storage & indexbuilder
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-22 00:14:36 +00:00
87521adfbd
Add logic of deserilize rawData into InsertData
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-21 16:27:03 +08:00
e65cfe1e3d
Enable complex dsl parser
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-19 10:36:49 +08:00
0d75840ed6
Fix missing file
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-18 18:35:03 +08:00
0110ba6bd2
List events of binlog
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-12 16:52:09 +08:00
da9ea7d2b9
Add cgo wrapper to index builder
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-18 15:44:27 +08:00
475d36a2c9
Add data codec
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-18 15:21:25 +08:00
54f2b79f1b
Add indexbuilder client
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-12 17:10:42 +08:00
godchen
Cai Yudong
congqixia
quicksilver
Xiangyu Wang
yukun
FluorineDog
XuanYang-cn
xige-16
sunby
bigsheeper
neza2017
cai.zhang
zhenshan.cao
dragondriver