milvus/pkg/util
XuanYang-cn 4926021c02
fix: Skip mark compaction timeout for mix and l0 compaction (#37118)
Timeout is a bad design for long running tasks, especially using a
static timeout config. We should monitor execution progress and fail the
task if the progress has been stale for a long time.

This pr is a small patch to stop DC from marking compaction tasks
timeout, while still waiting for DN to finish. The design is
self-conflicted. After this pr, mix and L0 compaction are no longer
controlled by DC timeout, but clustering is still under timeout control.

The compaction queue capacity grows larger for priority calc, hence
timeout compactions appears more often, and when timeout, the queuing
tasks will be timeout too, no compaction will success after.

See also: #37108, #37015

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-10-28 14:33:29 +08:00
..
cache fix: lru related issue fixup patch (#32916) 2024-05-10 19:17:30 +08:00
commonpbutil Refine state check (#27541) 2023-10-11 21:01:35 +08:00
compressor Fix getting incorrect CPU num (#28146) 2023-11-06 06:02:16 +08:00
conc feat: datacoord/node watch based on rpc (#32036) 2024-05-07 15:49:30 +08:00
contextutil fix: add request resource timeout for lazy load, refactor context usage in cache (#32709) 2024-05-07 16:33:30 +08:00
crypto Move some modules from internal to public package (#22572) 2023-04-06 19:14:32 +08:00
distance fix: fix cal_distance default implementation (#31245) 2024-03-15 15:37:11 +08:00
etcd feat: management WebUI homepage (#36822) 2024-10-23 11:29:28 +08:00
expr enhance: update the expr version to support automatic conversion of variable types (#36832) 2024-10-15 10:53:22 +08:00
funcutil feat: management WebUI homepage (#36822) 2024-10-23 11:29:28 +08:00
gc feat: [Sparse Float Vector] add sparse vector support to milvus components (#30630) 2024-03-13 14:32:54 -07:00
generic Optimize the generic zero value (#27102) 2023-09-14 19:05:20 +08:00
hardware enhance: [skip e2e] set logrus log level to reduce output error logs (#30479) 2024-02-12 08:32:51 +08:00
indexparams fix:support config index offsetcache and fix create same index again (#35985) 2024-09-08 18:23:05 +08:00
interceptor enhance: refine access log to support format access log by yaml and print name info. (#28319) 2023-11-28 15:32:31 +08:00
lifetime Refine state check (#27541) 2023-10-11 21:01:35 +08:00
lock enhance: Add `go-deadlock` as unittest only dependency (#33063) 2024-05-15 16:33:34 +08:00
logutil enhance: changes to propagate traceid from client (#32264) 2024-04-17 01:13:20 +08:00
merr feat: Support create collection with functions (#35973) 2024-09-12 10:43:06 +08:00
metautil feat: support embedding bm25 sparse vector and flush bm25 stats log (#36036) 2024-09-19 10:57:12 +08:00
metric feat: added more checks for function creation check (#36766) 2024-10-13 17:43:22 +08:00
metricsinfo feat: add tasks page into management WebUI (#37002) 2024-10-28 10:13:29 +08:00
netutil fix: port listen racing in mix or standalone mode (#36442) 2024-09-26 21:23:16 +08:00
parameterutil fix: Rename invalid parameterutil package path (#29334) 2023-12-21 11:40:42 +08:00
paramtable fix: Skip mark compaction timeout for mix and l0 compaction (#37118) 2024-10-28 14:33:29 +08:00
ratelimitutil enhance: set database properties to restrict read access (#35745) 2024-08-29 13:17:01 +08:00
requestutil enhance: access log support print with consistency level (#33503) 2024-06-05 17:13:50 +08:00
resource Fix the unstable resource manager testcase (#28033) 2023-11-03 11:00:17 +08:00
retry enhance: Remove stackerror imported unexpected (#35256) 2024-08-05 14:48:16 +08:00
symbolizer Move some modules from internal to public package (#22572) 2023-04-06 19:14:32 +08:00
syncutil enhance: add streaming client metrics (#36523) 2024-10-08 21:25:19 +08:00
testutils feat: add bulk insert support for Functions (#36715) 2024-10-12 17:19:20 +08:00
tikv Format the code (#27275) 2023-09-21 09:45:27 +08:00
timerecord enhance: optimize datanode cpu usage under large collection number (#33267) 2024-05-25 04:43:41 +08:00
tsoutil enhance: add streaming client metrics (#36523) 2024-10-08 21:25:19 +08:00
typeutil enhance: allow to delete data when disk quota exhausted (#37134) 2024-10-25 16:47:29 +08:00
uniquegenerator Move some modules from internal to public package (#22572) 2023-04-06 19:14:32 +08:00
vralloc feat: adding grouped virtual resource allocator (#33669) 2024-06-21 15:58:01 +08:00
OWNERS Move some modules from internal to public package (#22572) 2023-04-06 19:14:32 +08:00
constant.go enhance: the estimate method when loading the collection (#36307) 2024-10-09 17:35:19 +08:00