cai.zhang
|
9dd2e1dcd8
|
Use tt msg stream for consume delete msg (#21478) (#21500)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2023-01-05 11:03:35 +08:00 |
Enwei Jiao
|
89b810a4db
|
Refactor all params into ParamItem (#20987)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
|
2022-12-07 18:01:19 +08:00 |
jaime
|
039e9ce4bb
|
Refine msgstream interface (#20832)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-12-05 20:55:17 +08:00 |
liliu-z
|
aecf2e4f4b
|
Upgrade knowhere to 1.3.4 (#20914)
Signed-off-by: Li Liu <li.liu@zilliz.com>
Signed-off-by: Li Liu <li.liu@zilliz.com>
|
2022-12-02 00:33:21 +08:00 |
zhenshan.cao
|
9724ae5e27
|
Refine log level (#20904)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-12-01 20:07:15 +08:00 |
congqixia
|
a8e6d5d47e
|
Fix delete operation scope to vchannel (#20866)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-11-29 15:15:15 +08:00 |
xige-16
|
82570e057c
|
Limit MinDim to build disk index (#20724)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-11-21 17:43:10 +08:00 |
|
xige-16
|
ec617d4952
|
Avoid delete segment which has been loaded (#20730)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-11-21 16:33:12 +08:00 |
|
congqixia
|
b0a07983ce
|
Limit concurrency of decoded index file and do force gc (#20587)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-11-15 21:15:11 +08:00 |
|
congqixia
|
ad0cce8f70
|
Filter segments when doing FromDmlCPLoadDelete (#20388)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-11-08 11:47:02 +08:00 |
wei liu
|
c5cd92d36e
|
update target (#19296)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
|
2022-11-07 19:37:04 +08:00 |
|
Enwei Jiao
|
956c5e1b9d
|
Make Params singleton (#20088)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
|
2022-11-04 14:25:38 +08:00 |
Xiaofan
|
ded919a7a3
|
Refine Concurrent Load (#20220)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-11-01 19:25:37 +08:00 |
|
Xiaofan
|
2bfecf5b4e
|
Refine bloomfilter and memory usage (#20168)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-10-31 17:41:34 +08:00 |
|
xige-16
|
05a966afbe
|
Delete row num check before load (#20205)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-10-31 17:17:34 +08:00 |
|
jaime
|
48f5c60070
|
Refine msgstream close (#20194)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-10-31 15:13:33 +08:00 |
|
Xiaofan
|
4136009a9a
|
Support load segments/channels in parallel (#20036)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-10-31 13:55:33 +08:00 |
|
Xiaofan
|
3d316fc052
|
Fix Query Log Level (#19995)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-10-25 19:29:36 +08:00 |
|
Xiaofan
|
1f170ce1ba
|
Refine kafka consumer (#19846)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-10-25 13:23:30 +08:00 |
yah01
|
52cd40fbc4
|
Remove codes related to deprecated field (#19897)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-10-19 18:29:26 +08:00 |
SimFG
|
a55f739608
|
Separate public proto files (#19782)
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-10-16 20:49:27 +08:00 |
|
xige-16
|
a1db9038fb
|
Move disk index params to config file (#19714)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-10-14 17:51:24 +08:00 |
|
congqixia
|
838a633584
|
Add ctx parameter for ChunkManager methods (#19546)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-29 16:18:56 +08:00 |
|
Enwei Jiao
|
fc8061bb86
|
improve logs to debug growing segment load failed (#19419)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
|
2022-09-26 17:36:54 +08:00 |
|
xige-16
|
428840178c
|
Support diskann index for vector field (#19093)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-09-21 20:16:51 +08:00 |
|
congqixia
|
3759f23f88
|
Add error log for load segment file failure (#19227)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-19 14:08:48 +08:00 |
|
SimFG
|
d7f38a803d
|
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-09-16 16:56:49 +08:00 |
Bingyi Sun
|
626854cf0c
|
Refactor QueryCoord (#18836)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-15 18:48:32 +08:00 |
|
cai.zhang
|
e65ba6331e
|
Only store segmentID for flushed segments event (#19075)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2022-09-09 15:52:35 +08:00 |
|
congqixia
|
29c72cad15
|
Use segment statslog instead of separate statslog (#18775)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-02 10:34:59 +08:00 |
|
Xiaofan
|
56840da74f
|
Fix Segment Loader Log (#18883)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-08-29 15:30:57 +08:00 |
|
yah01
|
d76d6f42cd
|
Add unit test for case of stream closed (#18848)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-08-26 19:20:55 +08:00 |
|
yah01
|
63e08606e2
|
Fix load segment hangs forever (#18814)
Caused if the context is timeout
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-08-25 19:34:54 +08:00 |
|
wei liu
|
5c4f854271
|
fix load segment hangs (#18770)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
|
2022-08-23 16:52:52 +08:00 |
|
congqixia
|
179b496824
|
Add cgo worker pool for querynode (#18461)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-08-09 16:34:37 +08:00 |
|
Xiaofan
|
b427450593
|
Remove Load Delta Channel Request (#18497)
Fix #18393
remove watch delta channel task related logic
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-08-04 17:50:37 +08:00 |
|
yah01
|
9621b6615d
|
Limit the concurrency level for single load request (#18400)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-07-26 15:18:30 +08:00 |
|
zhenshan.cao
|
9bd35dd84e
|
Refine logs to reduce print (#17759) (#18028)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-07-04 11:10:20 +08:00 |
bigsheeper
|
6b79d4f7bc
|
Log segment type as possible in QueryNode (#17846)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-28 10:16:17 +08:00 |
|
congqixia
|
68d385137a
|
Fix: Miss channel info when load growing segment (#17789) (#17797)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: zhagnlu <1542303831@qq.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
|
2022-06-27 12:02:16 +08:00 |
|
yah01
|
a38790f586
|
Predict the loading memory usage more accurate (#17451)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-06-09 18:16:07 +08:00 |
|
yah01
|
70f8bea4b4
|
Avoid growing slice as deserializing binlogs (#17421)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-06-08 11:46:06 +08:00 |
|
yah01
|
4e83f37899
|
Improve load performance (#17273)
Load segment's fields concurrently
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-06-02 17:56:03 +08:00 |
|
bigsheeper
|
f55fe6be3c
|
Merge historical replica and streaming replica in QueryNode (#17217)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-05-31 13:42:03 +08:00 |
|
xige-16
|
e196caf604
|
Force reclamation of memory after loading (#17244)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-05-27 12:50:00 +08:00 |
|
xige-16
|
56778787be
|
Reverse data from scalar index (#17145)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-05-26 14:58:01 +08:00 |
|
zhenshan.cao
|
08a4dff41d
|
Add logic for search merging and a simple task scheduler for read tasks (#17022)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-05-23 16:41:58 +08:00 |
|
Xiaofan
|
338edcd3cc
|
Load binlog for different field in parallel (#17005)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-05-15 16:11:54 +08:00 |
Letian Jiang
|
b3eb2b1d0d
|
Support deltaLog loading on growing segment (#16903)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
|
2022-05-12 11:59:53 +08:00 |
Ten Thousand Leaves
|
216c45fbd6
|
Add tests where segments load delta logs (#16825)
issue: #16821
/kind improvements
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-05-10 17:59:52 +08:00 |