milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
15,025 Commits
136 Branches
115 Tags
566 MiB
Commit Graph

38 Commits (7385770014fd4862860cd4fa471da778d8e365bd)

Author SHA1 Message Date
codeman 294f7e4408
fix: log datapb.SegmentInfo is too large #17685 (#17727) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-06-23 14:36:13 +08:00
wayblink eb5b0b7fc8
Move SegmentInfo out of VchannelInfo, leave Id only to decrease kv size. Get complete SegmentInfo through RPC (#17441) 
Resolves: #17233 #16047

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2022-06-16 12:00:10 +08:00
xige-16 8c69790383
Fix lost delete msg caused by loadSegment after watchDeltaChannel (#17308) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-06-02 16:56:04 +08:00
bigsheeper f55fe6be3c
Merge historical replica and streaming replica in QueryNode (#17217) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-05-31 13:42:03 +08:00
congqixia c88514bc49
Remove not used QueryChannel in Proxy and Query Cluster (#16856) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-30 19:50:04 +08:00
bigsheeper a4ea2fb18a
Handle errors in DataNode and QueryNode flow graph (#17096) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-05-24 21:11:59 +08:00
zhenshan.cao 08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks (#17022) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
 2022-05-23 16:41:58 +08:00
Letian Jiang 70825a35cf
Make querynode LoadSegments interface idempotent (#17109) 
This PR makes the following changes:
* separate LoadSegmentsTask into two phases: PreExecute and Execute
* filters out segments that are already loaded in PreExecute phase

Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-05-20 09:15:57 +08:00
xige-16 515d0369de
Support string type in segcore (#16546) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-29 13:35:49 +08:00
congqixia 69252f812d
Implement memory replica in Proxy, QueryNode and QueryCoord (#16470) 
Related to #16298 #16291 #16154
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-04-20 16:15:41 +08:00
godchen bb7a0766fe
Add dependency factory (#16204) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-04-07 22:05:32 +08:00
yah01 31c5b286da
Fix wrong unittest, check whether loading collection will cause OOM (#16068) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-03-18 13:17:22 +08:00
jaime 97b1ed7bca
Remove reader API from Mqstream and replace it with consumer API (#15971) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-03-15 14:45:22 +08:00
bigsheeper caf9cbfcd4
Fix load failure and remove parition release related code (#16038) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-03-14 23:18:02 +08:00
bigsheeper 9ad5c14a4a
Return error when create message stream failed in QueryNode (#15317) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-03-09 15:17:59 +08:00
jaime 7a3a721380
Reconstruct mqstream module (#15784) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-03-03 21:57:56 +08:00
xige-16 1cd2363bd8
Delete usless params SkipQueryChannelRecovery (#15289) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-21 21:43:40 +08:00
godchen 9e51591b3a
Fix pulsar reader not close (#14543) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-01-04 14:45:19 +08:00
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-23 18:39:11 +08:00
xige-16 11c8461c11
Refactor dmChannelWatchInfo to queryCoord meta (#13543) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-21 11:57:39 +08:00
bigsheeper 1ca08d9138
Simplify flow graph in QueryNode (#13613) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-17 20:12:42 +08:00
xige-16 97d5231a0a
Reorganize querycoord proto (#13181) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-15 16:53:12 +08:00
XuanYang-cn 91842e347f
[skip ci]Update license for qn task scheduler (#13415) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-15 11:51:57 +08:00
bigsheeper 496f3d0009
Move AddQueryChannel to taskScheduler in query node (#12294) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-30 10:29:43 +08:00
bigsheeper 58964621a5
Remove tSafeWatcher and vChannel when release (#12264) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-26 01:33:16 +08:00
bigsheeper e245ba87a9
Add excluded segments for dropped segemnts (#12247) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-25 14:25:15 +08:00
bigsheeper 62bbc9cd1d
Add excluded segments for flushed segments in query node (#12188) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-24 11:27:15 +08:00
godchen 639800241d
Make flow graph for delta channel (#11379) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-09 09:27:04 +08:00
yukun 4e5c8811da
Add flow_graph for delta channel in querynode (#11293) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-06 11:02:58 +08:00
xige-16 8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel (#10084) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-10-22 19:07:15 +08:00
bigsheeper e7d92e4e79
Add streaming segments memory to used memory when checkLoadMemory (#8940) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-30 21:54:08 +08:00
bigsheeper c9b6a92366
Add release failed case unittest for query node (#7971) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-17 11:35:49 +08:00
bigsheeper dfc2535aaa
Use different schema generation functions (#7884) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-15 10:07:56 +08:00
bigsheeper 27beb033de
Add task unittest for query node (#7820) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-14 10:24:48 +08:00
bigsheeper 73ab06c628
Decrease unittests execution time in query node (#7791) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-13 16:37:01 +08:00
bigsheeper cb5cd1cf12
Add index unittests for query node (#7674) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-10 17:11:09 +08:00
bigsheeper 5906551f41
Add task unittest for query node (#7599) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-09 10:10:00 +08:00
bigsheeper bcccd767ac
Add unittests for querynode (#7510) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-07 15:45:59 +08:00