626854cf0c
Refactor QueryCoord ( #18836 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-15 18:48:32 +08:00
1527aee019
fix watch dml channel remove offline node ( #18835 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-08-29 16:32:57 +08:00
c924f73105
Refactor for IndexCoord to support cloud ( #18643 )
...
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
2022-08-25 15:48:54 +08:00
8a70f2badb
Add ShowConfigurations for all remaining session ( #18594 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-08-12 13:20:39 +08:00
b427450593
Remove Load Delta Channel Request ( #18497 )
...
Fix #18393
remove watch delta channel task related logic
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-04 17:50:37 +08:00
a7ce0eb6f6
Add ShowConfigurations to QueryNode ( #18426 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-08-03 01:12:33 +08:00
638f6c36e9
Support to get real row count of segment ( #18115 )
...
Signed-off-by: xaxys <zheng.guan@zilliz.com>
2022-07-18 09:58:28 +08:00
1c9647ff31
Merging multiple shard query/search requests into one rpc request if QueryNode is the leader of multiple shards of Collection ( #17588 )
...
Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>
2022-07-06 15:06:21 +08:00
ef6859a4d6
Refactor handoff handler ( #17806 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-29 23:26:19 +08:00
785a5a757f
Use segment version instead of ref cnt ( #17609 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-17 17:38:12 +08:00
eb5b0b7fc8
Move SegmentInfo out of VchannelInfo, leave Id only to decrease kv size. Get complete SegmentInfo through RPC ( #17441 )
...
Resolves : #17233 #16047
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-06-16 12:00:10 +08:00
dfaed5acdd
Add QueryServiceAvailable field in ShowCollections ( #17456 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-06-09 18:20:07 +08:00
8c69790383
Fix lost delete msg caused by loadSegment after watchDeltaChannel ( #17308 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-02 16:56:04 +08:00
c88514bc49
Remove not used QueryChannel in Proxy and Query Cluster ( #16856 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-30 19:50:04 +08:00
08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks ( #17022 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-23 16:41:58 +08:00
7746a5b742
Add NodeIds field for QuerySegmentInfo ( #17121 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-20 18:03:58 +08:00
b0053b7a45
Add isShardLeader field in search/query request ( #16798 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-05-06 16:55:51 +08:00
8c004fa981
Fix replicaID is allow zero from watch channel task ( #16788 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-05 18:11:51 +08:00
415a0e5978
Fix miss segments/DmChannel when query by nodeID ( #16719 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-29 14:11:47 +08:00
0bf176a7e1
Add SyncReplicaSegments interface for QueryNode ( #16672 )
...
Add SyncReplicaSegments for LoadCollection/LoadPartition child task
This API notifies related ShardCluster to record segment Loaded
Preventing the Etcd events is delayed, which will cause some segment not search
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-27 10:41:46 +08:00
69252f812d
Implement memory replica in Proxy, QueryNode and QueryCoord ( #16470 )
...
Related to #16298 #16291 #16154
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-20 16:15:41 +08:00
78200009a3
Impl GetReplicas in Proxy ( #16390 )
...
See also: #16298
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-04-06 14:57:31 +08:00
028c5cb882
Modify grpc interface for replica Search/Query in QueryNode ( #16326 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-04-02 14:15:31 +08:00
c005f07ccc
Modify proto to add GetReplicas() interface ( #16328 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-01 16:15:29 +08:00
58addbf9f4
Add GetShardLeaders rpc in querycoord proto ( #16299 )
...
See also: #16298
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-31 16:39:29 +08:00
ba37531456
Add support for loading multiple indexes ( #16138 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-30 21:11:28 +08:00
0f53989f17
Modify proto to support replicas ( #16289 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-30 17:57:28 +08:00
18a3e9f265
Add grpc interface for replica Search/Query in QueryNode ( #16197 )
...
Resolves #16195
Add Search and Query grpc interface in query proto and types/types.go
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-30 12:03:27 +08:00
178eb8cce1
Modify proto to support replicas ( #16218 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-28 16:43:27 +08:00
0d16ecf0dd
Add protobuf messages to support multi memory replica ( #16153 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-25 11:13:25 +08:00
6a66faa2fb
Explictly specify Load operation meta ( #16027 )
...
Fix #15996
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-14 09:50:01 +08:00
dfc6670f0f
Unsubscribe channel after query node down ( #15230 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-17 17:37:37 +08:00
b063bfda8f
Add index info in loadSegmentRequest ( #14524 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-30 19:09:33 +08:00
4e4ff54d98
Watch query channel to near the latest position ( #13682 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 13:50:54 +08:00
11c8461c11
Refactor dmChannelWatchInfo to queryCoord meta ( #13543 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 11:57:39 +08:00
1dcd06cc78
Add log file info for all kind of segment binlogs ( #13606 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-19 20:00:42 +08:00
1ca08d9138
Simplify flow graph in QueryNode ( #13613 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-17 20:12:42 +08:00
97d5231a0a
Reorganize querycoord proto ( #13181 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 16:53:12 +08:00
8a0ee27799
Estimate segment size according index and binlog file header ( #11875 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 09:47:12 +08:00
fcbe46ba75
Remove sealed segemnt from query node after compaction ( #11430 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-08 21:00:02 +08:00
38375ee1d3
Add LoadBalance ( #9945 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-06 16:54:59 +08:00
82c199227c
Add execute logic for balancing sealed segments ( #11343 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-06 15:22:56 +08:00
09f8fa1040
Add query coord watch delta channel ( #11218 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 14:47:19 +08:00
80215eb2f0
Retruen segment state when get query segment info ( #10730 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-27 19:28:21 +08:00
0cedd9d47e
Compaction multiSegmentChangeInfo to a single info ( #10587 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-26 15:18:22 +08:00
98be39bada
Add compaction field in querycoord segment info ( #10565 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 18:09:15 +08:00
9ebabdac79
Add handoffTask ( #10330 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-24 22:39:09 +08:00
8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel ( #10084 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-22 19:07:15 +08:00
d6bf0c928f
Get stats delta path from datacoord ( #10362 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 14:31:13 +08:00
2d984ba0d1
Fix getSegmentInfo in query node ( #9549 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-20 19:47:35 +08:00
Bingyi Sun
wei liu
cai.zhang
aoiasd
Xiaofan
Jeng.Gwan
Zach
yah01
congqixia
wayblink
Letian Jiang
xige-16
zhenshan.cao
XuanYang-cn
Jiquan Long
bigsheeper
godchen
sunby