8cf54137cf
Add nil check in reduce and add collection rwmutex when release segments ( #17698 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-22 16:12:14 +08:00
785a5a757f
Use segment version instead of ref cnt ( #17609 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-17 17:38:12 +08:00
98b32f3eba
Improve time record log in search/query ( #17545 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-15 20:48:10 +08:00
16f0815184
Add time record log on search/query execution path ( #17497 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-13 11:42:09 +08:00
5f44e45480
Add metrics on QueryNode and Proxy ( #17328 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-06-02 16:06:03 +08:00
c76b4ade01
Fix data race in LoadSegmentsTask ( #17342 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-02 12:52:03 +08:00
63a31ccb38
Remove error return value when removeSegment ( #17310 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-01 13:18:02 +08:00
f55fe6be3c
Merge historical replica and streaming replica in QueryNode ( #17217 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-31 13:42:03 +08:00
c88514bc49
Remove not used QueryChannel in Proxy and Query Cluster ( #16856 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-30 19:50:04 +08:00
11834a0948
Improve query log in QueryNode ( #17268 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-30 17:18:03 +08:00
ad9276a440
Add metrics for proxy and querynode ( #17205 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-05-27 14:12:01 +08:00
08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks ( #17022 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-23 16:41:58 +08:00
94f0951f0d
Fix query lock logic in query shard ( #17034 )
...
Previously query shard locks the querylock in collectionReplica before any search/query
The lock range is too large and easy to cause dead lock
This PR makes following changes:
- Rename collectionReplica to metaReplica which is more reasonable
- Make release collection operation cancels waiting search/query request
- Reduce the queryLock to collection level
- Add some unit tests for timeout & released case
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-16 18:23:55 +08:00
43b36b4e5f
Make proxy update cache with NotShardLeader status code ( #16940 )
...
See also: #16926
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-05-13 11:35:53 +08:00
a8b81e215b
Fix deadlock in release replica ( #16925 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-11 21:57:53 +08:00
92b6293be4
Fix QueryNode log level ( #16604 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-07 10:27:51 +08:00
0bf176a7e1
Add SyncReplicaSegments interface for QueryNode ( #16672 )
...
Add SyncReplicaSegments for LoadCollection/LoadPartition child task
This API notifies related ShardCluster to record segment Loaded
Preventing the Etcd events is delayed, which will cause some segment not search
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-27 10:41:46 +08:00
89b4a34892
Fix Data race in NodeID ( #16603 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-24 22:03:44 +08:00
69252f812d
Implement memory replica in Proxy, QueryNode and QueryCoord ( #16470 )
...
Related to #16298 #16291 #16154
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-20 16:15:41 +08:00
028c5cb882
Modify grpc interface for replica Search/Query in QueryNode ( #16326 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-04-02 14:15:31 +08:00
18a3e9f265
Add grpc interface for replica Search/Query in QueryNode ( #16197 )
...
Resolves #16195
Add Search and Query grpc interface in query proto and types/types.go
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-30 12:03:27 +08:00
3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig ( #15843 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-04 11:17:56 +08:00
d830791e4f
Respect SegmentIDs in querynode.GetSegmentInfo ( #15455 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-02-07 15:35:44 +08:00
4bccc85534
Use MsgChannelConfig in GlobalParams for all components ( #15163 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-02 00:35:43 +08:00
f617c8887b
Time Tick Failed need log ( #15225 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-14 23:55:34 +08:00
f7368e35a4
Add log for LoadSegmentsTask ( #14703 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-06 23:26:18 +08:00
0004238669
[skip e2e]Improve AddQueryChannel log ( #14962 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-06 23:17:26 +08:00
851794598e
[skip e2e]Improve log format ( #14886 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-05 21:17:21 +08:00
b3d33a78f5
[skip e2e]Improve log format ( #14887 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-05 21:15:20 +08:00
d751357be1
[skip e2e]Improve log format ( #14885 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-05 21:13:20 +08:00
abf1f58abe
Add log for watchDeltaChannelTask's nodeID ( #14702 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-04 20:45:24 +08:00
8b919f50c1
[skip e2e] Add debug log for watchDmChannelReq ( #14551 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-29 21:51:45 +08:00
0415618f81
[skip e2e] Add comment for isHealthy ( #14519 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-29 17:37:25 +08:00
1408926cd9
Remove logs without enough info ( #14440 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 10:06:47 +08:00
08102b8945
[skip e2e]Fix comment typo ( #14178 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:28:20 +08:00
acd792515d
[skip e2e]Fix comment typo ( #14177 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:16:41 +08:00
8a2c3ecefd
[skip e2e]Fix comment typo ( #14176 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:14:52 +08:00
85094a99fa
[skip e2e]Fix comment typo ( #14175 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:13:10 +08:00
4660edaaf4
[skip e2e] Refine querynode impl comment ( #14137 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-24 13:26:30 +08:00
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
b16bbb1ed2
Add log for GetComponentStates in querynode ( #12713 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-06 15:25:35 +08:00
5071035701
[skip ci]Update license for qn impl ( #12726 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-03 19:25:45 +08:00
3f060f4028
Remove querynode grpc error ( #12532 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-01 22:13:37 +08:00
496f3d0009
Move AddQueryChannel to taskScheduler in query node ( #12294 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-30 10:29:43 +08:00
db3ad2bc5f
Disable log print in GetSgementInfo ( #12139 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 17:49:19 +08:00
d2dae89f4c
Return success if query node is unhealthy in GetComponentStates ( #12202 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 15:03:16 +08:00
0aaa87a79a
Fix MsgStream inconsistent seek ( #12042 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-24 10:25:15 +08:00
f654621650
Remove the etcd deletion of segment data path on querynode ( #11863 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-17 12:13:10 +08:00
98ad823666
[skip ci] Fix golint for GetMetrics ( #11596 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-10 23:56:10 +08:00
639800241d
Make flow graph for delta channel ( #11379 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 09:27:04 +08:00
bigsheeper
congqixia
xige-16
zhenshan.cao
XuanYang-cn
Xiaofan
Letian Jiang
Cai Yudong
godchen
edward.zeng
cai.zhang