44622622f6
[skip ci] Add comment for getSegmentsMemSize ( #9433 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-08 06:43:26 +08:00
9d6c95bf25
Add cacheSize to prevent OOM in query node ( #8765 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-28 22:24:03 +08:00
11c65dc2b3
Add comment for collection replica ( #8147 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-18 18:15:51 +08:00
bc1f39bb55
Remove deprecated replica interface in query node ( #7908 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-15 10:09:53 +08:00
691e4c5bc9
Use definitional type instead of raw type ( #7797 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-14 10:25:26 +08:00
4123deef9e
Return error message in grpc.LoadSegment in query node ( #6908 )
...
* return load error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* init streaming meta in loadSegment
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* fix excluded init
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* improve impl
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-03 22:01:27 +08:00
e8ea8b51d5
improve query node log ( #6897 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-07-31 10:47:22 +08:00
a992dcf6a8
Support query return vector output field ( #6570 )
...
* improve code readibility
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add offset in RetrieveResults
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add VectorFieldInfo into Segment struct
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add new interface for query vector
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update load vector field logic
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update load vector field logic
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fill in field name in query result
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add FieldId into FieldData
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add fillVectorOutputFieldsIfNeeded
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update data_codec_test.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add DeserializeFieldData
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* realize query return vector output field
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* disable query vector case
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-16 17:19:55 +08:00
7039fb7c82
Fix the problem of stuck after loadBalance and loadFieldData error ( #5960 )
...
* delete nodeInfo after nodeDown
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix load balance can's stop
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix load field data error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* contiue task loop after error in queryService
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 14:10:09 +08:00
bbd8a7e13a
Add released partitions and fix search error in empty partition ( #5893 )
...
* rename flowgraphType to loadType
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* add load type and released partitions
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* filter released partition
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-19 18:38:07 +08:00
e4c51aae36
Add recovery logic for querynode and queryservice ( #5843 )
...
* merge milvus/recovery2
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add recovery logic in queryservice
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* debug smoke case
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add etcd to querynode
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix release partition error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix load balance error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* debug querynode down and recovery
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add log
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix showCollection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* skip smoke test search without insert
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-19 11:45:09 +08:00
97049ce293
use dataservice's getRecoveryInfo to get load and watch info ( #5790 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-16 11:09:56 +08:00
58bf92a407
Add vChannel,pChannel in query node and get vChannel from master in query service ( #5784 )
...
* add vChannel,pChannel in query node and get vChannel from master in query service
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-15 20:06:10 +08:00
cdbc6d2c94
Refactor query node and query service ( #5751 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-15 12:41:40 +08:00
8aae0f7cc9
Refactor flow graph and load/watchDML in query node ( #5682 )
...
* Refactor flow graph and load/watchDML in query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-09 11:37:55 +08:00
03f90ff28c
refactor collection replica and add tsafe replica in querynode ( #5475 )
...
* refactor collection replica and add tsafe replica in querynode
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* static check
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* static check2
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* code format
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 15:40:32 +08:00
fce792b8bf
Add historical and streaming module in querynode ( #5469 )
...
* add historical and streaming
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* fix GetSegmentInfo
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* pass regression test
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 10:26:30 +08:00
82ccd4cec0
Rename module ( #4988 )
...
* Rename module
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
71b8f309b2
Add licence to query node and query service
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-19 13:47:10 +08:00
332b14c915
Delete querynode’s redundant load IO
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-07 18:29:19 +08:00
dfb68a7e46
Remove unused segment
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-25 16:08:08 -05:00
f39dcdb8f3
Support error code in segcore
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-26 16:18:30 +08:00
c2734fa55f
Fix bug and enchance system
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
8a5c039137
Fix search error when running single node
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-12 19:23:06 +08:00
f3649f0419
Refactor interface and proto
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
09ae985daa
Fix wrong error code in master_service_test.go
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-10 22:06:22 +08:00
8567679888
Check enableIndex before load index
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-10 14:51:00 +08:00
74154a11a4
Fix deploy error during regression stage
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-05 16:52:45 +08:00
ddddd65d10
Delete internal/errors package
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-05 10:15:27 +08:00
447a15207e
Add zap log to query node
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-05 09:21:35 +08:00
08a020798e
Release collection and partitions
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-24 17:24:51 +08:00
d5379a82a8
Fix load binlog error when segment not flushed
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-23 14:13:33 +08:00
f62078c027
Fix crash error when search
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-20 10:14:03 +08:00
5769c000a1
Find failed python tests and add skip mark "r0.3-test"
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-19 15:37:04 +08:00
d8f41db823
Fix search crash error
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-19 13:56:01 +08:00
12b2eaf196
Rename apis
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-07 21:26:03 +08:00
1ba8e2448f
Add tsLoop for indexservice
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-07 18:38:58 +08:00
a64c831ed9
Fix segment replacement bug
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-07 18:37:18 +08:00
b07b2484dc
Fix error when loading
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-07 10:29:58 +08:00
e9ee9a273e
Refactor load service and check insertion binLog periodically
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-06 11:35:35 +08:00
1578c13224
Refactor collection replica
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-05 10:53:11 +08:00
f12a0490bb
Do not drop collections or partitions in flow graph
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 18:12:48 +08:00
fd9e42d3ed
Update msgstream/unmarshal interface
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-03 17:30:10 +08:00
abffdbff62
Remove partition tag
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 16:44:38 +08:00
01e9dc8e3f
Remove collection name
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 11:52:19 +08:00
f3aad3a71c
Change SegmentInfo
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-02 18:53:10 +08:00
5e781b9370
Remove field name in query node and segCore
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 10:10:07 +08:00
66d5189601
Add get collection statistics implemetation
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-02 19:54:31 +08:00
e4e3ec88d1
Add usage count of insert channels
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-02 15:49:13 +08:00
09bdbee944
Refactor load service, remove seg manager
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-02 15:13:08 +08:00
bigsheeper
Cai Yudong
xige-16
Xiangyu Wang
FluorineDog
zhenshan.cao
godchen
XuanYang-cn
quicksilver
sunby
dragondriver