2035575941
fix: Datanode stop progress stuck at writer buffer memory check ( #38274 )
...
issue: #38273
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-12-06 18:20:39 +08:00
a1e14d62c7
enhance: refine lock granularity for produers in msgstream ( #38262 )
...
issue: #38261
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-12-06 17:14:40 +08:00
aa4eb2f6df
enhance: [GoSDK] Handle dynamic column & partial load output ( #38258 )
...
Related to #37853
Previous logic cannot handle partial load due to dynamic column
handling. This PR unifies the output translate logic.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-06 16:46:41 +08:00
8ed019735c
enhance: add disk stats within system metrics ( #38033 )
...
issue: ##36621
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-12-06 16:32:41 +08:00
60dd55f292
enhance: add end time stats for compaction and index build tasks ( #38048 )
...
issue: #36621
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-12-06 16:28:40 +08:00
0d4073bdd8
enhance: use require dbname for some db req ( #38267 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-12-06 16:26:46 +08:00
36946cc9ce
enhance: Set loaded collection/partition number to metrics ( #38271 )
...
Related to #36456
Previous PR: #38471 #38233
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-06 16:18:40 +08:00
f16232f834
fix: sparse inc mast less than uint32 max ( #38250 )
...
relate: https://github.com/milvus-io/milvus/issues/35853
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-12-06 15:14:41 +08:00
e1aebe8fce
enhance: Support collection name for ProxyDeleteVectors as well ( #38247 )
...
issue: https://github.com/milvus-io/milvus/issues/38242
Signed-off-by: Reid Chan <reidchan@apache.org>
2024-12-06 15:00:40 +08:00
edabfa8fa6
enhance: Remove pool from produer and consumer in kafka client ( #38264 )
...
issue: #38263
Revert "fix: Move init kafka pool into once (#37786 )"
Revert "enhance: Use pool to limit kafka cgo thread number (#37744 )"
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-12-06 14:08:40 +08:00
18bef5e062
fix: fix crash when enable standby and streaming ( #38239 )
...
issue: #38125
- connect kv at standby mode.
- make balancer initialization lazy.
Signed-off-by: chyezh <chyezh@outlook.com>
2024-12-06 11:52:40 +08:00
d7a5ad4eca
Update all contributors
...
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2024-12-06 00:01:30 +00:00
6ff19481f0
enhance: Resolve compilation error due to PR conflict ( #38252 )
...
Related pr: #38233 #38059
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-05 19:26:40 +08:00
c91bb5a655
enhance: report restful info to hook ( #38112 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-12-05 19:02:41 +08:00
051bc280dd
enhance: Make dynamic load/release partition follow targets ( #38059 )
...
Related to #37849
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-05 16:24:40 +08:00
32645fc28a
enhance: Unify querycoord meta metrics ( #38233 )
...
Related to #36456
Unify collection/partition number metrics to collection manager in case
of unwant missing modification
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-05 15:48:39 +08:00
7944538ade
enhance: Add ctx param to KV operation interfaces ( #38154 )
...
issue: #35917
Refine KV operation interfaces by adding a ctx param
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2024-12-05 15:16:41 +08:00
618f0cb728
enhance: Put release segment and other misc cgo call into pool ( #38186 )
...
Related to #30273
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-05 11:04:40 +08:00
af288a9c21
fix: compilation failed due to CI conflicts ( #38222 )
...
issue: #38224
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-12-05 10:59:38 +08:00
3c6a373a75
enhance: Fill version for load delta request ( #38212 )
...
Version is needed for load delta request in case of false alarm warning
about version go backward
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-05 10:54:39 +08:00
6d0a4fdb31
fix: Fix bug for Search fails with filter expression contains underscore ( #38085 )
...
Enhance the matching for elements within the UnaryRangeArray
https://github.com/milvus-io/milvus/issues/38068
---------
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2024-12-05 10:18:40 +08:00
9b60694975
enhance: [nightly ci] get log from loki instead of api-server ( #38204 )
...
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-12-05 09:42:40 +08:00
34d71289e5
enhance: [ci]get log from loki instead of api-server ( #38158 )
...
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-12-05 09:40:50 +08:00
5768dbbb5d
enhance: refine pular related mq interfaces ( #38007 )
...
issue: #35917
Refines the pulsar-related mq APIs to allow the ctx to be passed down
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2024-12-04 20:50:39 +08:00
73aa95f596
fix: Add version to the proxy cache to resolve concurrency issues ( #38067 )
...
issue: #36989
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-12-04 18:06:39 +08:00
a65d395ecd
fix: grant v2 collection name and privilege error typo ( #38195 )
...
issue: https://github.com/milvus-io/milvus/issues/38042
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-04 16:14:38 +08:00
262f6db3d8
enhance: Add mmap file usage metric ( #38193 )
...
issue: #38156 Add mmap file usage metric
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2024-12-04 16:12:47 +08:00
87aa9a0f2d
fix: empty analyzer params not use standard tokenizer ( #38148 )
...
relate: https://github.com/milvus-io/milvus/issues/35853
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-12-04 14:58:39 +08:00
1f66b9ebfb
feat: add config field to set internal tls sni ( #38124 )
...
/cc @xiaofan-luan @jaime0815 @nish112022
part of https://github.com/milvus-io/milvus/issues/36864
Signed-off-by: haorenfsa <haorenfsa@gmail.com>
2024-12-04 14:56:47 +08:00
cbba29677a
fix: update web ui ( #38137 )
...
issue: #36621
- add filters to most of lists
- add more options to the existing list filter
- fix the error list column in channels and resource group list
Signed-off-by: mimo.oyn <ning.ouyang@zilliz.com>
2024-12-04 14:32:39 +08:00
863639201d
enhance: Clean querynode metrics after collection released ( #38167 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-12-04 10:58:38 +08:00
f211e9970f
enhance: enable limiter for restful v1 ( #38160 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-12-04 10:42:38 +08:00
3445b8bd44
[automated] Update Knowhere Commit ( #38192 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-12-04 02:30:39 +08:00
d822edb9a8
enhance: add list aliases privilege into public role ( #38176 )
...
related issue: https://github.com/milvus-io/milvus/issues/37031
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-03 23:42:39 +08:00
db2ed2c044
fix: Fix inaccurate partition num metric ( #37996 )
...
The partition number has already been incremented in
`ChangePartitionState`, so there is no need to increment it again in
`AddPartition`.
issue: https://github.com/milvus-io/milvus/issues/37630
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-12-03 21:24:40 +08:00
e359725530
enhance: support db request in Restful api ( #38140 )
...
#38077
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-12-03 20:04:41 +08:00
6f1b1ad78b
enhance: [GoSDK] add operate privilege & privilege group API ( #38141 )
...
related issue: https://github.com/milvus-io/milvus/issues/37031
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-03 18:32:40 +08:00
4537e2cc46
fix: Fix timeout when listing meta ( #38151 )
...
When there are too many key-value pairs, the etcd list operation may
times out. This PR replaces `LoadWithPrefix` in list operations, which
could involve many keys, with `WalkWithPrefix`.
issue: https://github.com/milvus-io/milvus/issues/37917
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-12-03 16:28:39 +08:00
767b7e6218
enhance: Use fdopen, fwrite to reduce direct syscall ( #38157 )
...
`File.Write` and `File.WriteInt` use `write`, which may be just direct
syscall in some systems. When mappding field data and write line by
line, this could cost lost of CPU time when the row number is large.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-03 15:24:39 +08:00
28d39399e2
enhance: Refine clustering compaction log ( #38100 )
...
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-12-03 14:58:39 +08:00
9e008685ef
fix: Fix datacoord metrics ( #38163 )
...
issue: https://github.com/milvus-io/milvus/issues/38162
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-12-03 14:10:45 +08:00
e09f431891
fix: grant ManualCompact api doesn't work ( #38096 )
...
issue: #38086
cause ManualCompact api pass collection id in request, but RBAC requires
to check collection name, so grant ManualCompact api doesn't work.
This PR refine the ManualCompact api to accpet collection name in
request.
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-12-03 10:36:38 +08:00
a5e0a56a8e
fix: move grant/revoke v2 params check from rootcoord to proxy ( #38130 )
...
related issue: https://github.com/milvus-io/milvus/issues/37031
fixed issues #38042 : The interface "grant_v2" does not support empty
collectionName while the error says it does
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-02 19:48:37 +08:00
db453c063d
enhance: no need database check in restful sdk ( #38078 )
...
#38077
remove the check for two reason
1. server will do the same to make sure use the correct database;
2. each req has an additional overhead of calling the proxy to check
database.
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-12-02 17:04:38 +08:00
cb926688f7
enhance: support templates for expression in Restful api ( #38040 )
...
#36672
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-12-02 16:54:38 +08:00
3a7a8c7944
enhance: try compact small segments first if they may compose a full segment ( #37709 )
...
See #37234
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2024-12-02 16:12:38 +08:00
90064cd47b
fix: Fix variable redeclaration in term filter ( #38045 )
...
https://github.com/milvus-io/milvus/issues/38046
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-12-02 15:10:38 +08:00
4c623cebeb
enhance: [skip e2e] Update test plugin version ( #38106 )
...
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-12-02 12:00:37 +08:00
23dc313c44
fix: fix grant/revoke v2 meta and unclear error messages ( #38110 )
...
related issue: https://github.com/milvus-io/milvus/issues/37031
fixed issues:
#37974 : better error messages for grant v2 interface
#37903 : fix meta built-in privilege group object name
#37843 : better error messages for custom privilege group interface
#38002 : fix built-in privilege group meta to pass proxy interceptor
check
#38008 : fix revoke v2 to support revoking v1 granted privileges
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-02 11:36:39 +08:00
cfe56136a1
enhance: [skip e2e][mergify] Update unit test file list for client pkg ( #38105 )
...
This PR fix that unittest mergify rule failed to work for PR with
milvusclient unit test update only.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-02 10:20:38 +08:00
wei liu
jaime
congqixia
smellthemoon
aoiasd
Reid Chan
Zhen Ye
sre-ci-robot
tinswzy
Xianhui Lin
yellow-shine
cai.zhang
sthuang
shaoyue
MimoN
sre-ci-robot
yihao.dai
Ted Xu
Bingyi Sun
binbin