milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
15,025 Commits
133 Branches
115 Tags
561 MiB
Commit Graph

39 Commits (7385770014fd4862860cd4fa471da778d8e365bd)

Author SHA1 Message Date
bigsheeper 8cf54137cf
Add nil check in reduce and add collection rwmutex when release segments (#17698) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-06-22 16:12:14 +08:00
congqixia 785a5a757f
Use segment version instead of ref cnt (#17609) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-06-17 17:38:12 +08:00
xige-16 63a31ccb38
Remove error return value when removeSegment (#17310) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-06-01 13:18:02 +08:00
bigsheeper f55fe6be3c
Merge historical replica and streaming replica in QueryNode (#17217) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-05-31 13:42:03 +08:00
congqixia c88514bc49
Remove not used QueryChannel in Proxy and Query Cluster (#16856) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-30 19:50:04 +08:00
zhenshan.cao 08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks (#17022) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
 2022-05-23 16:41:58 +08:00
congqixia 94f0951f0d
Fix query lock logic in query shard (#17034) 
Previously query shard locks the querylock in collectionReplica before any search/query
The lock range is too large and easy to cause dead lock

This PR makes following changes:
- Rename collectionReplica to metaReplica which is more reasonable
- Make release collection operation cancels waiting search/query request
- Reduce the queryLock to collection level
- Add some unit tests for timeout & released case

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-16 18:23:55 +08:00
Letian Jiang b0053b7a45
Add isShardLeader field in search/query request (#16798) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-05-06 16:55:51 +08:00
xige-16 515d0369de
Support string type in segcore (#16546) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-29 13:35:49 +08:00
congqixia 0bf176a7e1
Add SyncReplicaSegments interface for QueryNode (#16672) 
Add SyncReplicaSegments for LoadCollection/LoadPartition child task
This API notifies related ShardCluster to record segment Loaded
Preventing the Etcd events is delayed, which will cause some segment not search

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-04-27 10:41:46 +08:00
congqixia 69252f812d
Implement memory replica in Proxy, QueryNode and QueryCoord (#16470) 
Related to #16298 #16291 #16154
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-04-20 16:15:41 +08:00
Jiquan Long ba37531456
Add support for loading multiple indexes (#16138) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-30 21:11:28 +08:00
congqixia 18a3e9f265
Add grpc interface for replica Search/Query in QueryNode (#16197) 
Resolves #16195
Add Search and Query grpc interface in query proto and types/types.go

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-03-30 12:03:27 +08:00
xige-16 55cdc5aa35
Get indexInfo and segment size by queryCoord (#14207) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-02-08 21:57:46 +08:00
congqixia d830791e4f
Respect SegmentIDs in querynode.GetSegmentInfo (#15455) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-02-07 15:35:44 +08:00
Cai Yudong f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-07 10:09:45 +08:00
Cai Yudong f8f61fb116
Use BaseParams etcd configuration for all components (#15012) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-07 16:15:26 +08:00
Xiaofan 69087ff8dd
Support embedded etcd (#14333) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-12-29 14:35:21 +08:00
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-23 18:39:11 +08:00
bigsheeper 1ca08d9138
Simplify flow graph in QueryNode (#13613) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-17 20:12:42 +08:00
xige-16 97d5231a0a
Reorganize querycoord proto (#13181) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-15 16:53:12 +08:00
XuanYang-cn 5071035701
[skip ci]Update license for qn impl (#12726) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-03 19:25:45 +08:00
Cai Yudong 1a806a174a
Support load collection with multiple vector column (#12630) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-03 11:29:33 +08:00
godchen 3f060f4028
Remove querynode grpc error (#12532) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-01 22:13:37 +08:00
bigsheeper 496f3d0009
Move AddQueryChannel to taskScheduler in query node (#12294) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-30 10:29:43 +08:00
bigsheeper d2dae89f4c
Return success if query node is unhealthy in GetComponentStates (#12202) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-25 15:03:16 +08:00
godchen 639800241d
Make flow graph for delta channel (#11379) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-09 09:27:04 +08:00
bigsheeper 38375ee1d3
Add LoadBalance (#9945) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-06 16:54:59 +08:00
yukun 4e5c8811da
Add flow_graph for delta channel in querynode (#11293) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-06 11:02:58 +08:00
xige-16 9fcfbde368
Add getNodeInfoByID and getSegmentInfoByNode function for cluster (#11247) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-05 16:00:55 +08:00
xige-16 80215eb2f0
Retruen segment state when get query segment info (#10730) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-10-27 19:28:21 +08:00
xige-16 8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel (#10084) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-10-22 19:07:15 +08:00
bigsheeper 2d984ba0d1
Fix getSegmentInfo in query node (#9549) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-20 19:47:35 +08:00
bigsheeper ae5d2ee9ba
Init global sealed segments and seek query channel when AddQueryChannel (#9543) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-15 20:35:05 +08:00
bigsheeper 52126f2d5a
Dynamic add tSafe watcher, use sync.Cond instead of selectCase, add ref count (#8050) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-24 13:57:54 +08:00
bigsheeper b465e8f9a4
Remove redundant check and add addQueryChannel unittest for query node (#7944) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-16 09:47:48 +08:00
bigsheeper dfc2535aaa
Use different schema generation functions (#7884) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-15 10:07:56 +08:00
bigsheeper 3c01839d0d
Add impl and plan unittests for query node (#7712) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-11 17:22:01 +08:00
bigsheeper bcccd767ac
Add unittests for querynode (#7510) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-07 15:45:59 +08:00