milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
19,186 Commits
142 Branches
117 Tags
571 MiB
Commit Graph

55 Commits (f3c56c83ab263507e5d8a3a727056bf08f10bd0d)

Author SHA1 Message Date
chyezh 211143c5e6
enhance: add basic information of milvus into metrics (#29665) 
add basic build information and runtime component dependency into
metrics.

issue: #29664

Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2024-01-29 15:47:02 +08:00
XuanYang-cn fd19e419f9
fix: Use size bucket for compacted segment size metric (#30028) 
See also: #29204

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-01-26 10:53:02 +08:00
XuanYang-cn 0ac37a4a0c
fix: Use longTime bucket for longer latency (#30175) 
See also: #30174

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-01-22 19:18:55 +08:00
yihao.dai c8a78465b4
enhance: Add a counter monitoring for the rate-limit requests (#30109) 
Add a counter monitoring metric for the ratelimited rpc requests with
labels: proxy nodeID, rpc request type, and state.

issue: https://github.com/milvus-io/milvus/issues/30052

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-01-21 14:44:59 +08:00
XuanYang-cn 86f48861c1
fix: Add more throughput in related metrics (#30038) 
This PR also fixes bugs in l0 compactor where
l0 results would never be removed from datanode

See also: #30099

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-01-19 11:34:54 +08:00
xige-16 9702cef2b5
feat: Support multiple vector search (#29433) 
issue #25639 

Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2024-01-08 15:34:48 +08:00
XuanYang-cn bebe1baf18
fix: Reigster CompactionTaskNum metrics (#29640) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-01-04 17:16:45 +08:00
smellthemoon b12c90af72
enhance:Add upsert vector metrics (#29226) 
add some metrics.

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-01-03 10:06:48 +08:00
XuanYang-cn 4b406e5973
enhance: Add CompactionTaskNum metrics (#29518) 
See also: #27606

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-12-28 15:46:55 +08:00
XuanYang-cn fe04598900
enhance: Add compaction type label to metrics (#29485) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-12-27 15:56:48 +08:00
XuanYang-cn 7a6aa8552a
fix: add back existing datanode metrics (#29360) 
See also: #29204

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-12-22 14:20:43 +08:00
wei liu cb0676153f
enhance: add metrics for stopping querynode balance progress (#29201) 
This PR add three metrics to track the stopping balance progress.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-12-21 10:14:52 +08:00
aoiasd 010d8362ad
fix: datanode L0 segment num wrong (#29050) 
relate:  https://github.com/milvus-io/milvus/issues/27675

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-12-20 11:20:44 +08:00
congqixia cbf0f9c527
enhance: change cp metric to absolute unix ts (#29328) 
See also #29327

Change channel checkpoint metrics to unix seconds instead of checkpoint
timestamp lag value

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-12-20 11:04:45 +08:00
yihao.dai 43abe9ce31
enhance: Delete datanode metric after flowgraph released (#29003) 
`DataNodeFlowGraphBufferDataSize` monitoring metric is leaked. This PR
resolve it.

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-12-07 17:00:35 +08:00
yah01 9b3e06ae86
enhance: add more metrics for level zero segments (#29029) 
- Add SegmentNum metric for level zero segments
- Add level zero segments size metirc

---------

Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-12-07 14:34:35 +08:00
congqixia dd682658da
enhance: Add channel checkpoint ts lag metric (#28767) 
See also #28765

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-11-28 07:00:28 +08:00
aoiasd 8a4cfb7d6a
enhance: add l0 metric and fix datacoord no need drop l0 segment when flush (#28373) 
relate: https://github.com/milvus-io/milvus/issues/27675

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-11-24 15:58:24 +08:00
congqixia 1d76565894
Add metrics for garbage collection (#27303) 
Also fix second metrics usage in compaction

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-22 18:47:25 +08:00
SimFG 26f06dd732
Format the code (#27275) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-21 09:45:27 +08:00
XuanYang-cn ea2b909c6d
Fix historm metrics buckets range for index (#26976) 
See also: #26743

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-09-13 17:21:18 +08:00
chyezh 791e6ef6c6
[Improvement] add pulsar metrics and fix timeout (#26907) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-09-13 12:03:19 +08:00
yihao.dai c6024a32f5
Add rate limit ratio monitoring (#26709) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-09-03 20:47:02 +08:00
XuanYang-cn ef75784715
Fix LoadSegmentLatency metric p99 (#26761) 
See also: #26743

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-09-01 11:07:07 +08:00
XuanYang-cn 8d54509e54
Fix CompactionLatency metrics (#26747) 
- Refine compactor logs

See also: #26743

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-08-31 17:35:03 +08:00
congqixia d343888f3c
Fix pkg codecov & static-check script (#26720) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-31 09:59:01 +08:00
yihao.dai 3c62acde05
Add coll and segState lebels to DataCoordNumStoredRows monitoring (#26299) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-08-17 15:52:17 +08:00
SimFG 8b54914287
Add go.mod file for the milvus/pkg package (#26359) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-08-16 14:49:32 +08:00
xige-16 1971d98897
Add disk metric info (#25675) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-08-11 10:35:42 +08:00
wei liu 05c87af146
fix unexpected score in look aside balancer (#26213) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-08-10 19:45:16 +08:00
MrPresent-Han 47392b0a0f
support metrics mutex to monitor cost of locks(#26102) (#26103) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-08-03 15:03:06 +08:00
MrPresent-Han b5e79e7f34
add metrics for assign-segment on proxy(#24570) (#25907) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-07-26 14:15:01 +08:00
wei liu 302897f866
refine look aside balance logic (#25837) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-25 18:51:01 +08:00
wei liu 2ff469771c
fix delegator insert/delete cost metrics (#25871) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-25 10:01:00 +08:00
wei liu 32827f538a
add metrics for delegator insert/delete cost (#25733) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-21 15:30:59 +08:00
yihao.dai 4c93495587
Add segment size metric in querynode (#25406) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-12 14:26:28 +08:00
congqixia bcd3abf644
Separate segments/shards reduce latency metrics (#25475) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-11 18:18:28 +08:00
wei liu c84496a1ba
fix sq count metrics (#25287) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 08:46:26 +08:00
wei liu 951c312ef9
refine grafana metrics for replica selection (#25319) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-05 17:00:25 +08:00
chyezh d7d61f529c
[Feature|Pick] enable scheduler policy and add user-task-polling policy (#24839) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-07-03 18:24:25 +08:00
wei liu 17796743dd
add metrics for replica selection (#25037) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-27 09:52:44 +08:00
xige-16 33c2012675
Add more metrics (#25081) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-26 17:52:44 +08:00
jaime 18df2ba6fd
[Cherry-Pick] Support Database (#24769) 
Support Database(#23742)
Fix db nonexists error for FlushAll (#24222)
Fix check collection limits fails (#24235)
backward compatibility with empty DB name (#24317)
Fix GetFlushAllState with DB (#24347)
Remove db from global meta cache after drop database (#24474)
Fix db name is empty for describe collection response (#24603)
Add RBAC for Database API (#24653)
Fix miss load the same name collection during recover stage (#24941)

RBAC supports Database validation (#23609)
Fix to list grant with db return empty (#23922)
Optimize PrivilegeAll permission check (#23972)
Add the default db value for the rbac request (#24307)

Signed-off-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-25 17:20:43 +08:00
yihao.dai e81eb56b92
Add metric of waiting for tSafe latency (#24765) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-09 11:26:35 +08:00
yihao.dai 19164ea753
Make binlog size metric to collect healthy binlog only (#24557) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-31 16:45:29 +08:00
MrPresent-Han b09e7aeaf7
support detailed task metrics(#23414) (#24507) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-30 14:59:28 +08:00
yihao.dai 3f96c335bb
Add receivedNQ metric and change receivedBytes metric to collection level (#24199) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-21 22:23:24 +08:00
smellthemoon 0b72cf2c2e
log out error (#24260) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-19 18:25:24 +08:00
yihao.dai fc010ee86b
Improve the metric of stored binlog size to the level of collection and segment (#23859) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-07 20:52:38 +08:00
wei liu 4fb8919a97
support collection level rate limit (#22767) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-25 15:54:35 +08:00