2aed48c433
Fix query node panic when watching dm channels ( #21402 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-12-28 10:19:31 +08:00
f8cff79804
Support the graceful stop for the query node ( #20851 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-12-06 22:59:19 +08:00
25a3b9ae19
Check target node ID for query/search ( #20967 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-04 20:05:17 +08:00
2ecdb4ba4a
Etcd config source support TLS ( #20874 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-30 18:23:15 +08:00
c05b9ad539
Add event dispatcher for config ( #20393 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-17 18:59:09 +08:00
e6831d5029
Stop querynode for unit tests ( #20665 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-17 14:23:08 +08:00
ac9a993a39
Fix querynode panics when watch/unsub runs concurrently ( #20606 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 19:03:08 +08:00
2d806788fb
Add version for subscribed channel ( #20585 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 13:21:07 +08:00
3de74165ac
Fix SyncSegment generate source ( #19929 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-20 16:35:28 +08:00
a55f739608
Separate public proto files ( #19782 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
85e04d845c
Move GetComponentStates to milvus.proto, make it an external interface ( #19594 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-10-10 15:55:22 +08:00
8c1c8000ac
Add TargetID in MsgBase and querynode v2 API check ( #19627 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-08 20:26:57 +08:00
377f856833
Fix balance may confuse leader observer ( #19435 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-28 12:10:54 +08:00
384e7c3169
Fix force release segment logic ( #19471 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-27 19:22:54 +08:00
c4761100a7
Fix SyncDistribution set Action ( #19360 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-22 13:18:50 +08:00
d7f38a803d
Separate some proto files ( #19218 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
626854cf0c
Refactor QueryCoord ( #18836 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-15 18:48:32 +08:00
6ea0fb82ab
Add InvalidNodeID logic to remove segments from offline segments ( #18975 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-02 10:42:59 +08:00
8a70f2badb
Add ShowConfigurations for all remaining session ( #18594 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-08-12 13:20:39 +08:00
a7ce0eb6f6
Add ShowConfigurations to QueryNode ( #18426 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-08-03 01:12:33 +08:00
638f6c36e9
Support to get real row count of segment ( #18115 )
...
Signed-off-by: xaxys <zheng.guan@zilliz.com>
2022-07-18 09:58:28 +08:00
1c9647ff31
Merging multiple shard query/search requests into one rpc request if QueryNode is the leader of multiple shards of Collection ( #17588 )
...
Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>
2022-07-06 15:06:21 +08:00
8cf54137cf
Add nil check in reduce and add collection rwmutex when release segments ( #17698 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-22 16:12:14 +08:00
785a5a757f
Use segment version instead of ref cnt ( #17609 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-17 17:38:12 +08:00
63a31ccb38
Remove error return value when removeSegment ( #17310 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-01 13:18:02 +08:00
f55fe6be3c
Merge historical replica and streaming replica in QueryNode ( #17217 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-31 13:42:03 +08:00
c88514bc49
Remove not used QueryChannel in Proxy and Query Cluster ( #16856 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-30 19:50:04 +08:00
08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks ( #17022 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-23 16:41:58 +08:00
94f0951f0d
Fix query lock logic in query shard ( #17034 )
...
Previously query shard locks the querylock in collectionReplica before any search/query
The lock range is too large and easy to cause dead lock
This PR makes following changes:
- Rename collectionReplica to metaReplica which is more reasonable
- Make release collection operation cancels waiting search/query request
- Reduce the queryLock to collection level
- Add some unit tests for timeout & released case
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-16 18:23:55 +08:00
b0053b7a45
Add isShardLeader field in search/query request ( #16798 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-05-06 16:55:51 +08:00
515d0369de
Support string type in segcore ( #16546 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
2022-04-29 13:35:49 +08:00
0bf176a7e1
Add SyncReplicaSegments interface for QueryNode ( #16672 )
...
Add SyncReplicaSegments for LoadCollection/LoadPartition child task
This API notifies related ShardCluster to record segment Loaded
Preventing the Etcd events is delayed, which will cause some segment not search
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-27 10:41:46 +08:00
69252f812d
Implement memory replica in Proxy, QueryNode and QueryCoord ( #16470 )
...
Related to #16298 #16291 #16154
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-20 16:15:41 +08:00
ba37531456
Add support for loading multiple indexes ( #16138 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-30 21:11:28 +08:00
18a3e9f265
Add grpc interface for replica Search/Query in QueryNode ( #16197 )
...
Resolves #16195
Add Search and Query grpc interface in query proto and types/types.go
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-30 12:03:27 +08:00
55cdc5aa35
Get indexInfo and segment size by queryCoord ( #14207 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-02-08 21:57:46 +08:00
d830791e4f
Respect SegmentIDs in querynode.GetSegmentInfo ( #15455 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-02-07 15:35:44 +08:00
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable ( #15434 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
f8f61fb116
Use BaseParams etcd configuration for all components ( #15012 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
69087ff8dd
Support embedded etcd ( #14333 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
1ca08d9138
Simplify flow graph in QueryNode ( #13613 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-17 20:12:42 +08:00
97d5231a0a
Reorganize querycoord proto ( #13181 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 16:53:12 +08:00
5071035701
[skip ci]Update license for qn impl ( #12726 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-03 19:25:45 +08:00
1a806a174a
Support load collection with multiple vector column ( #12630 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-03 11:29:33 +08:00
3f060f4028
Remove querynode grpc error ( #12532 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-01 22:13:37 +08:00
496f3d0009
Move AddQueryChannel to taskScheduler in query node ( #12294 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-30 10:29:43 +08:00
d2dae89f4c
Return success if query node is unhealthy in GetComponentStates ( #12202 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 15:03:16 +08:00
639800241d
Make flow graph for delta channel ( #11379 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 09:27:04 +08:00
38375ee1d3
Add LoadBalance ( #9945 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-06 16:54:59 +08:00
SimFG
yah01
Enwei Jiao
congqixia
wayblink
Bingyi Sun
aoiasd
Jeng.Gwan
Zach
bigsheeper
xige-16
zhenshan.cao
Letian Jiang
Jiquan Long
Cai Yudong
Xiaofan
XuanYang-cn
godchen