e196caf604
Force reclamation of memory after loading ( #17244 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-27 12:50:00 +08:00
3a63d6c98e
Fix load timeout in chaos ( #17241 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-26 22:28:03 +08:00
f2a27e0e64
Retry GetShardLeaders until service available or timeout ( #17183 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-05-26 20:28:02 +08:00
5872c5afb6
Fix updating shard leaders may lost some modifications ( #17218 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-26 17:14:02 +08:00
56778787be
Reverse data from scalar index ( #17145 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-26 14:58:01 +08:00
3928da6493
Refine calc distance function ( #17161 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-05-26 14:34:01 +08:00
7d810ac159
Fix query empty when insert same pk after deletion ( #17222 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-25 22:06:00 +08:00
e44afc7aa3
Fix ut: wait service ready after run Proxy server ( #17208 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-05-25 18:56:00 +08:00
7409bfc56d
Make allocateNode run async in case of block offline event ( #17185 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-25 18:53:59 +08:00
c12ee2f5cb
Fix flow_graph_insert_buffer_node.go code style ( #17216 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-05-25 17:03:59 +08:00
e06d6d7cc6
Returns collection instead of copy to make leaderMutex work ( #17206 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-25 15:20:00 +08:00
de0ba6d495
Fix GetQuerySegmentInfo() returns incorrect result after LoadBalance ( #17190 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-25 15:17:59 +08:00
5e1e7a6896
Fix an issue that causes flush hanging ( #17169 )
...
issue: #16628
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-05-25 14:34:00 +08:00
37d7d7baf8
Fix node state data race in querycoord ( #17198 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-25 10:43:59 +08:00
4293b640b2
Remove confusing log in segment id assigner ( #17195 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-05-25 10:26:00 +08:00
75ca64f8c7
Refine task type logs to string ( #17196 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-05-25 03:08:00 +08:00
a8829554eb
Merge multiple sets of expr's optypes in diff dirs ( #17192 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-24 21:56:00 +08:00
ec1103ca27
Simplify the merge logic of searchTask ( #17194 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-05-24 21:27:59 +08:00
a4ea2fb18a
Handle errors in DataNode and QueryNode flow graph ( #17096 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-24 21:11:59 +08:00
ffaead6ad9
Add load meta in hand off task. ( #17179 )
...
issue: #16842
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-05-24 18:24:00 +08:00
a0cef3a0a2
Fix sessionutil log always datanode ( #17184 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-24 16:05:59 +08:00
d05c24a0ff
Delete unused code ( #17182 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-05-24 14:49:59 +08:00
2512e668f7
Update timestmap according to gracefultime for Bounded Consistency ( #17171 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-05-24 12:05:59 +08:00
ea8e1623cd
Acquire nq from placeholdergroup incase of nq is zero ( #17168 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-05-24 10:05:58 +08:00
cce533c246
Fix unitest fail, change default index slice to 16 ( #17162 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-05-23 17:44:25 +08:00
08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks ( #17022 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-23 16:41:58 +08:00
3685ff9e0c
Mark indexing task to retry when minio occurs error ( #17153 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-23 15:47:58 +08:00
65269a4744
Remove rocksmq reader ( #17149 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-23 13:55:59 +08:00
a20e0dfc74
Refactor kafka msgstream implementation ( #17069 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-05-23 12:39:58 +08:00
d28a2db46c
move arrow from storage to core ( #17061 )
...
Signed-off-by: Enwei Jiao <jiaoew2011@gmail.com>
2022-05-22 20:03:58 +08:00
86728490a2
Fix partition not found ( #17132 )
...
issue: #16842
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-05-20 19:37:57 +08:00
e756fdccd4
Fix pool of lexer and parser ( #17129 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-05-20 18:47:57 +08:00
7746a5b742
Add NodeIds field for QuerySegmentInfo ( #17121 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-20 18:03:58 +08:00
90ee23df22
Fix shardLeader cache concurrent access ( #17120 )
...
Fix write map without mutex control
Also GetShards returns a copy of leader list instead of original one
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-20 14:33:57 +08:00
2f8a7e7793
Support tls/ssl connection to etcd ( #7703 ) ( #17012 )
...
Signed-off-by: lichaobao <1527563274@qq.com>
2022-05-20 12:29:19 +08:00
d525e95550
Bulkload not allow duplicate numpy file ( #17105 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-05-20 10:27:56 +08:00
70825a35cf
Make querynode LoadSegments interface idempotent ( #17109 )
...
This PR makes the following changes:
* separate LoadSegmentsTask into two phases: PreExecute and Execute
* filters out segments that are already loaded in PreExecute phase
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-05-20 09:15:57 +08:00
599763d9bf
Fix replicas info is not removed after release ( #17111 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-19 20:05:57 +08:00
e05cfe194e
Fix data race for indexcoord test ( #17057 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-19 17:25:56 +08:00
276ba69819
Replace plan parser with antlr ( #17090 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-19 17:15:57 +08:00
dcfe472586
Fix LoadBalance doesn't save the modification to replicas' shards ( #17064 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-19 16:51:57 +08:00
ae2864639e
Fix replica freeAll order ( #17106 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-19 14:53:56 +08:00
7eb6fcfb34
Limit the query node timetick log rate ( #17065 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-19 10:19:56 +08:00
9eeec4a2d5
Add collection load cache and InvalidateCollMetaCache by collID ( #16882 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-19 10:13:56 +08:00
b95681770b
Add deferred clean up for ShardCluster ( #17094 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-18 21:51:56 +08:00
cf08b5aa11
Fix 'TestChannelManager_StateTransfer' ut when etcd is slow ( #17082 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-05-18 17:19:57 +08:00
99b4042f8c
Disable segment small index ( #16935 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-18 15:27:56 +08:00
33c855dcd2
Fix LoadBalance doesn't remove the source nodes from segment ( #17051 )
...
If the triggerCondition isn't NodeDown, the removing won't happen.
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-18 11:55:56 +08:00
127dd34b37
Make proxy use roundrobin to choose replica ( #17063 )
...
Fixes : #17055
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-05-17 22:35:57 +08:00
b37b87eb97
The GetIndexFilePaths interface judges whether the index is complete ( #17052 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-17 20:41:56 +08:00
xige-16
Letian Jiang
yah01
groot
Jiquan Long
congqixia
Ten Thousand Leaves
zhenshan.cao
bigsheeper
Bingyi Sun
cai.zhang
Xiaofan
jaime
Enwei Jiao
ownbylichaobao
SimFG
XuanYang-cn