dfc6670f0f
Unsubscribe channel after query node down ( #15230 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-17 17:37:37 +08:00
675e6d352b
QueryNodes send search/query results by rpc ( #15223 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-01-17 14:41:35 +08:00
0c98f21d4d
Remove global sealed segments in historical ( #15177 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-12 17:01:38 +08:00
9e51591b3a
Fix pulsar reader not close ( #14543 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-04 14:45:19 +08:00
148dad23ac
Format watchDmChannel's log ( #14633 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-30 20:27:20 +08:00
8a3a1b556a
Free OS memory in QueryNode and IndexNode ( #14305 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-30 20:03:29 +08:00
c62457a6ea
Add channel name check before querynode seek ( #14169 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-24 15:38:17 +08:00
3d24007efa
Add more logs for load sealed segment ( #14079 )
...
Add logs before&after flowgraph_ddnode forwarding delete msg
See also: #13879
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 10:50:07 +08:00
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
1ca08d9138
Simplify flow graph in QueryNode ( #13613 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-17 20:12:42 +08:00
bf6405ca93
Simplify tSafe in query node ( #13241 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-17 14:41:33 +08:00
dcba2f38ee
[skip ci] Fix grammar mistake in task ( #13542 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-16 22:31:49 +08:00
97d5231a0a
Reorganize querycoord proto ( #13181 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 16:53:12 +08:00
bf8d245043
[skip ci]Update license for task ( #13284 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-13 19:49:20 +08:00
ee4d15aada
Fix log concat in querynode task execute ( #13152 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-10 14:43:18 +08:00
772771bd85
Stop queryCollection before releasing replica ( #12982 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-09 14:31:28 +08:00
496f3d0009
Move AddQueryChannel to taskScheduler in query node ( #12294 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-30 10:29:43 +08:00
65608836e6
Remove vChannel for collection in historical ( #12359 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-29 20:11:49 +08:00
58964621a5
Remove tSafeWatcher and vChannel when release ( #12264 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-26 01:33:16 +08:00
88012acb86
Clear useless segments info. ( #12262 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-25 17:37:15 +08:00
e245ba87a9
Add excluded segments for dropped segemnts ( #12247 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 14:25:15 +08:00
62bbc9cd1d
Add excluded segments for flushed segments in query node ( #12188 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-24 11:27:15 +08:00
116a503b4a
From dml cp load delete msg ( #12144 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-21 07:33:14 +08:00
e3e4dc7153
Improve GetVChanPosistion and fix unit tests ( #11888 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-16 21:41:50 +08:00
4cd7680f87
Reschedule load segments ( #11391 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-13 08:49:08 +08:00
93149c5ad9
Load growing segment in query node ( #11664 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 18:27:10 +08:00
5357e301f4
Fix retrieve search error ( #11501 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
639800241d
Make flow graph for delta channel ( #11379 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 09:27:04 +08:00
4e5c8811da
Add flow_graph for delta channel in querynode ( #11293 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-06 11:02:58 +08:00
5c58924420
Add cgroups to get container memory and check index memory in segment loader ( #10363 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 20:49:10 +08:00
8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel ( #10084 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-22 19:07:15 +08:00
70eb275ef4
[skip ci] Fix typo ( #10412 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-22 14:11:52 +08:00
4c420dac21
Update excluded segments info when receive changeInfo ( #10011 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-16 17:00:33 +08:00
e7d92e4e79
Add streaming segments memory to used memory when checkLoadMemory ( #8940 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-30 21:54:08 +08:00
977d55b66c
[skip ci] Add comment for task ( #8497 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-24 20:53:49 +08:00
52126f2d5a
Dynamic add tSafe watcher, use sync.Cond instead of selectCase, add ref count ( #8050 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-24 13:57:54 +08:00
c9b6a92366
Add release failed case unittest for query node ( #7971 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-17 11:35:49 +08:00
14391fe9a2
Release flowgraphs properly ( #7266 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-27 17:03:56 +08:00
4123deef9e
Return error message in grpc.LoadSegment in query node ( #6908 )
...
* return load error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* init streaming meta in loadSegment
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* fix excluded init
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* improve impl
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-03 22:01:27 +08:00
e8ea8b51d5
improve query node log ( #6897 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-07-31 10:47:22 +08:00
e50d39dfe1
Query result get global sealed segments from ETCD ( #6377 )
...
* get global sealed segments from ETCD
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* fix race error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-07-14 11:15:54 +08:00
6b65529086
Fix search error after releasePartition ( #6135 )
...
* fix search error after releasePartition
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* code format
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-26 16:08:11 +08:00
e87372761a
Remove tSafe in release partition task and return max timestamp ( #6078 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-24 19:06:34 +08:00
b72e4c6372
Merge search_collection and retrieve_colletion into query_collection ( #6037 )
...
* Merge search_collection and retrieve_colletion into query_collection
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix static-check
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-23 20:26:10 +08:00
dca24f313a
fix search timeout error ( #6027 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-23 18:04:22 +08:00
47d89abaa0
get channels by static converting ( #6015 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-23 17:26:09 +08:00
92e429d812
Rename IndexService to IndexCoord ( #5932 )
...
* rename package indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix queryservice static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move distributed/indexservice to distributed/indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move internal/indexservice to internal/indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename MasterComponent to RootCoordComponent
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for queryservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for dataservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for datanode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for proxynode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for querynode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename IndexService to IndexCoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename IndexService to IndexCoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix rebase issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-21 17:28:03 +08:00
bbd8a7e13a
Add released partitions and fix search error in empty partition ( #5893 )
...
* rename flowgraphType to loadType
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* add load type and released partitions
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* filter released partition
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-19 18:38:07 +08:00
46151d203f
Fix tSafe cannot update correctly ( #5820 )
...
* Fix tSafe cannot update correctly
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* skip test_load_partitions_release_collection
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* skip test_release_collection_during_searching
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-17 16:56:04 +08:00
d6f7fbf19f
release collection synchronously ( #5798 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-16 15:31:57 +08:00
xige-16
Jiquan Long
bigsheeper
godchen
congqixia
XuanYang-cn
Cai Yudong
jaime
Bingyi Sun
yukun
groot