f1a389e910
close force sync for v2.2.5 ( #22991 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-03-25 12:04:51 +08:00
fce815e414
Use buffer size at memory sync policy ( #22797 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-21 12:11:57 +08:00
bbc21fe849
Disable datanode force sync ( #22818 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-17 14:53:56 +08:00
72264f656f
Fix concurrent loading diskann index timeout ( #22548 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-03-03 20:15:49 +08:00
5666e0a570
[skip e2e] add parameters inside milvus.yaml( #22324 ) ( #22472 )
...
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-03-03 17:31:49 +08:00
42f4d013c0
Merge task with larger segments first ( #22474 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-02-28 18:09:49 +08:00
91d251ab48
Change RocksMQ page size to 256M ( #22433 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-02-28 10:39:47 +08:00
ea039bbd37
Change the etcd session timeout to 20s ( #22400 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-02-27 18:11:48 +08:00
4cf8f2ec81
Add memory usage too large sync policy ( #22241 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-02-27 17:47:51 +08:00
8123161738
Add the retry op for all server ( #22274 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: jaime <yun.zhang@zilliz.com>
2023-02-24 17:51:47 +08:00
fbbbd6ea2f
Add tickle for datacoord watch event ( #21193 ) ( #22209 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-17 15:52:36 +08:00
d63bf18236
Support print log to file and console at the same time ( #22080 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-02-10 14:16:32 +08:00
68754f978b
Add a segment metric for count number of binlog files ( #22085 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-09 19:24:32 +08:00
d1cada2adb
Reduce maxFieldNum from 256 to 64 ( #22030 )
...
issue: #21077
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-02-08 10:08:32 +08:00
2feed29231
Remove hardcode max shards num ( #22004 ) ( #22011 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-02-07 10:11:54 +08:00
a10620c5e8
Modify default value of some configurations ( #22012 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-07 10:05:56 +08:00
f16bbe711d
Add a segment seal policy by number of binlog files ( #21941 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-06 14:55:54 +08:00
85dd8912eb
Reduce scheduler duration of index task from 1s to 500ms ( #21893 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-02 15:01:51 +08:00
cae6d48f36
Disable time-travel by default ( #21788 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-01-18 16:03:44 +08:00
1ac30c7bd8
Make the rbac error message clearer ( #21646 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-01-12 13:55:42 +08:00
4bcfad5e0d
Add the superuser config ( #21611 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-01-10 20:25:40 +08:00
080bed9083
Improvement apis and error messages about the graceful stop ( #21580 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-01-09 16:53:37 +08:00
3d0359f9a5
Support the graceful stop for the query node ( #21528 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-01-05 20:07:36 +08:00
fbeec8c487
Add guarantee and serviceable lag too large check ( #21441 ) ( #21467 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-05 16:53:36 +08:00
38f9ea5122
Fix invalid single compaction ( #21328 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-12-22 16:05:28 +08:00
7e85971a58
Small candidate compaction should only happen with >1 segments ( #21250 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-16 10:03:27 +08:00
c9ee4f084a
Reduce seal proportion from 0.25 to 0.23 ( #21011 )
...
When segment are sealed with > 0.25 * segment.maxSize, we won't be able to compact 4 segments like these because the total size will be slightly over 0.25 * 4 * segment.maxSize.
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 14:25:19 +08:00
6dee58685e
Increase MaxWatchDuration and make it configurable ( #21010 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 10:19:19 +08:00
3e62688eb6
Split small segment proportion and small segment compactable proportion ( #21012 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-07 10:15:19 +08:00
b8be79fe27
Limit the rpc to 64M ( #20844 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-07 10:09:19 +08:00
c5f215da67
Refactor task scheduler and executor ( #20828 ) ( #20900 )
...
Make the performance able to scale out
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-30 16:37:17 +08:00
5e63b84ff1
support pulsar tenant and auth ( #19727 ) ( #20762 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-25 17:11:12 +08:00
dbcbe4d8f9
Disable tt delay protection ( #20658 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-17 20:21:14 +08:00
6c651d25a4
Ensure compatibility of channel seek position and move syncPeriod to config ( #20504 ) ( #20597 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-15 19:39:18 +08:00
f857360cb4
enable delbuf auto flush function to avoid OOM when del msg accumulating ( #20213 ) ( #20512 )
...
issue: #19713
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2022-11-14 10:13:06 +08:00
2284378f87
Fix spell PQ error ( #20527 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-12 21:19:04 +08:00
aae2a2db1d
Reduce the memory used by load disk index ( #20470 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-10 20:39:04 +08:00
2e78872be8
Refresh targets if haven't make progress for 5mins ( #20382 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-08 19:05:03 +08:00
3c814f8999
Open c++ log ( #20347 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-04 20:37:01 +08:00
1dac462cae
Change default thread core coefficient ( #20120 ) ( #20328 ) ( #20333 )
...
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-04 17:49:35 +08:00
cb2591d1fe
Parallel operations of disk-ann file manager ( #20120 ) ( #20122 )
...
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-03 14:39:40 +08:00
9fac1476f3
Add support for GCS(GoogleCloudStorage) with IAM ( #20164 )
...
go mod tidy
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-11-01 11:07:35 +08:00
b949fa0ea9
Increase default ttProtection max delay ( #20125 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-27 17:37:32 +08:00
99df2d9b54
Add binlogSize and ttDelay metrics monitor ( #19872 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-19 15:13:26 +08:00
760e9c5df2
Enable rate limit and update quota unit ( #19816 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-17 16:23:25 +08:00
ae8ec28925
Delete the unrelated content in the yaml file ( #19812 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-17 15:45:25 +08:00
a55f739608
Separate public proto files ( #19782 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
a1db9038fb
Move disk index params to config file ( #19714 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-10-14 17:51:24 +08:00
22b32465e7
Make bulkLoad failed if quota exceeds and remove autoindex config ( #19770 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-14 14:27:25 +08:00
f1e330a997
Add read result rate protection ( #19728 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-13 14:57:24 +08:00
Xiaofan
yihao.dai
xige-16
MrPresent-Han
yah01
wayblink
SimFG
aoiasd
jaime
Ten Thousand Leaves
Jiquan Long
cai.zhang
Enwei Jiao
congqixia
wei liu
zhagnlu
shaoyue