08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks ( #17022 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-23 16:41:58 +08:00
94f0951f0d
Fix query lock logic in query shard ( #17034 )
...
Previously query shard locks the querylock in collectionReplica before any search/query
The lock range is too large and easy to cause dead lock
This PR makes following changes:
- Rename collectionReplica to metaReplica which is more reasonable
- Make release collection operation cancels waiting search/query request
- Reduce the queryLock to collection level
- Add some unit tests for timeout & released case
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-16 18:23:55 +08:00
43b36b4e5f
Make proxy update cache with NotShardLeader status code ( #16940 )
...
See also: #16926
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-05-13 11:35:53 +08:00
a8b81e215b
Fix deadlock in release replica ( #16925 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-11 21:57:53 +08:00
92b6293be4
Fix QueryNode log level ( #16604 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-07 10:27:51 +08:00
0bf176a7e1
Add SyncReplicaSegments interface for QueryNode ( #16672 )
...
Add SyncReplicaSegments for LoadCollection/LoadPartition child task
This API notifies related ShardCluster to record segment Loaded
Preventing the Etcd events is delayed, which will cause some segment not search
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-27 10:41:46 +08:00
89b4a34892
Fix Data race in NodeID ( #16603 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-24 22:03:44 +08:00
69252f812d
Implement memory replica in Proxy, QueryNode and QueryCoord ( #16470 )
...
Related to #16298 #16291 #16154
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-20 16:15:41 +08:00
028c5cb882
Modify grpc interface for replica Search/Query in QueryNode ( #16326 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-04-02 14:15:31 +08:00
18a3e9f265
Add grpc interface for replica Search/Query in QueryNode ( #16197 )
...
Resolves #16195
Add Search and Query grpc interface in query proto and types/types.go
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-30 12:03:27 +08:00
3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig ( #15843 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-04 11:17:56 +08:00
d830791e4f
Respect SegmentIDs in querynode.GetSegmentInfo ( #15455 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-02-07 15:35:44 +08:00
4bccc85534
Use MsgChannelConfig in GlobalParams for all components ( #15163 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-02 00:35:43 +08:00
f617c8887b
Time Tick Failed need log ( #15225 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-14 23:55:34 +08:00
f7368e35a4
Add log for LoadSegmentsTask ( #14703 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-06 23:26:18 +08:00
0004238669
[skip e2e]Improve AddQueryChannel log ( #14962 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-06 23:17:26 +08:00
851794598e
[skip e2e]Improve log format ( #14886 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-05 21:17:21 +08:00
b3d33a78f5
[skip e2e]Improve log format ( #14887 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-05 21:15:20 +08:00
d751357be1
[skip e2e]Improve log format ( #14885 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-05 21:13:20 +08:00
abf1f58abe
Add log for watchDeltaChannelTask's nodeID ( #14702 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-04 20:45:24 +08:00
8b919f50c1
[skip e2e] Add debug log for watchDmChannelReq ( #14551 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-29 21:51:45 +08:00
0415618f81
[skip e2e] Add comment for isHealthy ( #14519 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-29 17:37:25 +08:00
1408926cd9
Remove logs without enough info ( #14440 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 10:06:47 +08:00
08102b8945
[skip e2e]Fix comment typo ( #14178 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:28:20 +08:00
acd792515d
[skip e2e]Fix comment typo ( #14177 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:16:41 +08:00
8a2c3ecefd
[skip e2e]Fix comment typo ( #14176 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:14:52 +08:00
85094a99fa
[skip e2e]Fix comment typo ( #14175 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:13:10 +08:00
4660edaaf4
[skip e2e] Refine querynode impl comment ( #14137 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-24 13:26:30 +08:00
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
b16bbb1ed2
Add log for GetComponentStates in querynode ( #12713 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-06 15:25:35 +08:00
5071035701
[skip ci]Update license for qn impl ( #12726 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-03 19:25:45 +08:00
3f060f4028
Remove querynode grpc error ( #12532 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-01 22:13:37 +08:00
496f3d0009
Move AddQueryChannel to taskScheduler in query node ( #12294 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-30 10:29:43 +08:00
db3ad2bc5f
Disable log print in GetSgementInfo ( #12139 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 17:49:19 +08:00
d2dae89f4c
Return success if query node is unhealthy in GetComponentStates ( #12202 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 15:03:16 +08:00
0aaa87a79a
Fix MsgStream inconsistent seek ( #12042 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-24 10:25:15 +08:00
f654621650
Remove the etcd deletion of segment data path on querynode ( #11863 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-17 12:13:10 +08:00
98ad823666
[skip ci] Fix golint for GetMetrics ( #11596 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-10 23:56:10 +08:00
639800241d
Make flow graph for delta channel ( #11379 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 09:27:04 +08:00
82c199227c
Add execute logic for balancing sealed segments ( #11343 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-06 15:22:56 +08:00
b7644c0c03
[skip ci] Add comments for GetMetrics ( #11347 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 22:01:03 +08:00
9fcfbde368
Add getNodeInfoByID and getSegmentInfoByNode function for cluster ( #11247 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 16:00:55 +08:00
d81b15163f
Seek Query/Query Result channel to Latest ( #10985 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-05 14:57:44 +08:00
09f8fa1040
Add query coord watch delta channel ( #11218 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 14:47:19 +08:00
48fb8174fa
[skip ci] Add comments for ReleaseSegments ( #11192 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-03 23:13:26 +08:00
4df2c23780
[skip ci] Add comments for WatchDmChannels ( #11119 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-02 22:00:38 +08:00
7c588e5652
[skip ci] Add comments for LoadSegments ( #11118 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-02 21:58:22 +08:00
aa64b64214
[skip ci] Add comments for GetSegmentInfo ( #11117 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-02 21:56:34 +08:00
90ceca8bb5
[skip ci] Add comments for ReleasePartitions ( #11049 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-01 22:58:53 +08:00
4f8083c48d
[skip ci] Add comments for RemoveQueryChannel ( #11048 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-01 22:57:07 +08:00
zhenshan.cao
congqixia
XuanYang-cn
Xiaofan
Letian Jiang
Cai Yudong
xige-16
bigsheeper
godchen
edward.zeng
cai.zhang