0d4073bdd8
enhance: use require dbname for some db req ( #38267 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-12-06 16:26:46 +08:00
36946cc9ce
enhance: Set loaded collection/partition number to metrics ( #38271 )
...
Related to #36456
Previous PR: #38471 #38233
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-06 16:18:40 +08:00
f16232f834
fix: sparse inc mast less than uint32 max ( #38250 )
...
relate: https://github.com/milvus-io/milvus/issues/35853
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-12-06 15:14:41 +08:00
e1aebe8fce
enhance: Support collection name for ProxyDeleteVectors as well ( #38247 )
...
issue: https://github.com/milvus-io/milvus/issues/38242
Signed-off-by: Reid Chan <reidchan@apache.org>
2024-12-06 15:00:40 +08:00
18bef5e062
fix: fix crash when enable standby and streaming ( #38239 )
...
issue: #38125
- connect kv at standby mode.
- make balancer initialization lazy.
Signed-off-by: chyezh <chyezh@outlook.com>
2024-12-06 11:52:40 +08:00
6ff19481f0
enhance: Resolve compilation error due to PR conflict ( #38252 )
...
Related pr: #38233 #38059
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-05 19:26:40 +08:00
c91bb5a655
enhance: report restful info to hook ( #38112 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-12-05 19:02:41 +08:00
051bc280dd
enhance: Make dynamic load/release partition follow targets ( #38059 )
...
Related to #37849
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-05 16:24:40 +08:00
32645fc28a
enhance: Unify querycoord meta metrics ( #38233 )
...
Related to #36456
Unify collection/partition number metrics to collection manager in case
of unwant missing modification
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-05 15:48:39 +08:00
7944538ade
enhance: Add ctx param to KV operation interfaces ( #38154 )
...
issue: #35917
Refine KV operation interfaces by adding a ctx param
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2024-12-05 15:16:41 +08:00
618f0cb728
enhance: Put release segment and other misc cgo call into pool ( #38186 )
...
Related to #30273
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-05 11:04:40 +08:00
af288a9c21
fix: compilation failed due to CI conflicts ( #38222 )
...
issue: #38224
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-12-05 10:59:38 +08:00
3c6a373a75
enhance: Fill version for load delta request ( #38212 )
...
Version is needed for load delta request in case of false alarm warning
about version go backward
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-05 10:54:39 +08:00
6d0a4fdb31
fix: Fix bug for Search fails with filter expression contains underscore ( #38085 )
...
Enhance the matching for elements within the UnaryRangeArray
https://github.com/milvus-io/milvus/issues/38068
---------
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2024-12-05 10:18:40 +08:00
5768dbbb5d
enhance: refine pular related mq interfaces ( #38007 )
...
issue: #35917
Refines the pulsar-related mq APIs to allow the ctx to be passed down
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2024-12-04 20:50:39 +08:00
73aa95f596
fix: Add version to the proxy cache to resolve concurrency issues ( #38067 )
...
issue: #36989
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-12-04 18:06:39 +08:00
a65d395ecd
fix: grant v2 collection name and privilege error typo ( #38195 )
...
issue: https://github.com/milvus-io/milvus/issues/38042
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-04 16:14:38 +08:00
262f6db3d8
enhance: Add mmap file usage metric ( #38193 )
...
issue: #38156 Add mmap file usage metric
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2024-12-04 16:12:47 +08:00
87aa9a0f2d
fix: empty analyzer params not use standard tokenizer ( #38148 )
...
relate: https://github.com/milvus-io/milvus/issues/35853
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-12-04 14:58:39 +08:00
1f66b9ebfb
feat: add config field to set internal tls sni ( #38124 )
...
/cc @xiaofan-luan @jaime0815 @nish112022
part of https://github.com/milvus-io/milvus/issues/36864
Signed-off-by: haorenfsa <haorenfsa@gmail.com>
2024-12-04 14:56:47 +08:00
cbba29677a
fix: update web ui ( #38137 )
...
issue: #36621
- add filters to most of lists
- add more options to the existing list filter
- fix the error list column in channels and resource group list
Signed-off-by: mimo.oyn <ning.ouyang@zilliz.com>
2024-12-04 14:32:39 +08:00
f211e9970f
enhance: enable limiter for restful v1 ( #38160 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-12-04 10:42:38 +08:00
3445b8bd44
[automated] Update Knowhere Commit ( #38192 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-12-04 02:30:39 +08:00
d822edb9a8
enhance: add list aliases privilege into public role ( #38176 )
...
related issue: https://github.com/milvus-io/milvus/issues/37031
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-03 23:42:39 +08:00
db2ed2c044
fix: Fix inaccurate partition num metric ( #37996 )
...
The partition number has already been incremented in
`ChangePartitionState`, so there is no need to increment it again in
`AddPartition`.
issue: https://github.com/milvus-io/milvus/issues/37630
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-12-03 21:24:40 +08:00
e359725530
enhance: support db request in Restful api ( #38140 )
...
#38077
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-12-03 20:04:41 +08:00
4537e2cc46
fix: Fix timeout when listing meta ( #38151 )
...
When there are too many key-value pairs, the etcd list operation may
times out. This PR replaces `LoadWithPrefix` in list operations, which
could involve many keys, with `WalkWithPrefix`.
issue: https://github.com/milvus-io/milvus/issues/37917
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-12-03 16:28:39 +08:00
767b7e6218
enhance: Use fdopen, fwrite to reduce direct syscall ( #38157 )
...
`File.Write` and `File.WriteInt` use `write`, which may be just direct
syscall in some systems. When mappding field data and write line by
line, this could cost lost of CPU time when the row number is large.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-03 15:24:39 +08:00
28d39399e2
enhance: Refine clustering compaction log ( #38100 )
...
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-12-03 14:58:39 +08:00
9e008685ef
fix: Fix datacoord metrics ( #38163 )
...
issue: https://github.com/milvus-io/milvus/issues/38162
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-12-03 14:10:45 +08:00
e09f431891
fix: grant ManualCompact api doesn't work ( #38096 )
...
issue: #38086
cause ManualCompact api pass collection id in request, but RBAC requires
to check collection name, so grant ManualCompact api doesn't work.
This PR refine the ManualCompact api to accpet collection name in
request.
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-12-03 10:36:38 +08:00
a5e0a56a8e
fix: move grant/revoke v2 params check from rootcoord to proxy ( #38130 )
...
related issue: https://github.com/milvus-io/milvus/issues/37031
fixed issues #38042 : The interface "grant_v2" does not support empty
collectionName while the error says it does
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-02 19:48:37 +08:00
db453c063d
enhance: no need database check in restful sdk ( #38078 )
...
#38077
remove the check for two reason
1. server will do the same to make sure use the correct database;
2. each req has an additional overhead of calling the proxy to check
database.
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-12-02 17:04:38 +08:00
cb926688f7
enhance: support templates for expression in Restful api ( #38040 )
...
#36672
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-12-02 16:54:38 +08:00
3a7a8c7944
enhance: try compact small segments first if they may compose a full segment ( #37709 )
...
See #37234
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2024-12-02 16:12:38 +08:00
90064cd47b
fix: Fix variable redeclaration in term filter ( #38045 )
...
https://github.com/milvus-io/milvus/issues/38046
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-12-02 15:10:38 +08:00
23dc313c44
fix: fix grant/revoke v2 meta and unclear error messages ( #38110 )
...
related issue: https://github.com/milvus-io/milvus/issues/37031
fixed issues:
#37974 : better error messages for grant v2 interface
#37903 : fix meta built-in privilege group object name
#37843 : better error messages for custom privilege group interface
#38002 : fix built-in privilege group meta to pass proxy interceptor
check
#38008 : fix revoke v2 to support revoking v1 granted privileges
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-02 11:36:39 +08:00
7fb0c281f2
fix: Fix checkGeneralCapacity slowly ( #37976 )
...
Cache the general count to speed up `checkGeneralCapacity`.
issue: https://github.com/milvus-io/milvus/issues/37630
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-12-01 18:28:38 +08:00
2319018fcb
fix: Check if the dynamic fields contain any static fields ( #38025 )
...
issue: #38024
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-12-01 18:06:37 +08:00
108434969f
enhance: Add collection id to search request count metrics ( #38069 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-11-29 17:28:38 +08:00
61f73d552f
fix: Return thread watcher goroutine after closed ( #38091 )
...
Resolves #38090
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-29 15:10:36 +08:00
a9080d8d96
enhance: the actual number of databases should equal the config value ( #38006 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-11-29 14:44:36 +08:00
48ed586167
enhance: pre allocate space to prevent slice grow ( #38065 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-11-29 14:26:43 +08:00
9d3035c8ab
enhance: Fix conflict complication error ( #38087 )
...
Related to #37957 #37989
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-29 12:00:36 +08:00
5e152767a3
fix: Handle the error of the compaction queue being full ( #37989 )
...
issue: #37988
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-11-29 11:10:36 +08:00
c6dcef7b84
enhance: move segcore codes of segment into one package ( #37722 )
...
issue: #33285
- move most cgo opeartions related to search/query into segcore package
for reusing for streamingnode.
- add go unittest for segcore operations.
Signed-off-by: chyezh <chyezh@outlook.com>
2024-11-29 10:22:36 +08:00
0894ed0016
[automated] Update Knowhere Commit ( #38082 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-11-29 01:08:36 +08:00
e6af806a0d
enhance: optimize self defined rust error ( #37975 )
...
Prepare for issue: https://github.com/milvus-io/milvus/issues/37930
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-11-28 20:30:36 +08:00
302650ae0e
fix: use the default partition for the limit quota when the request partition name is empty ( #38005 )
...
- issue: #37685
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-11-27 11:00:36 +08:00
49ee46ec1d
enhance: support to config the default db properties ( #38035 )
...
- issue: #38034
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-11-27 10:04:34 +08:00
smellthemoon
congqixia
aoiasd
Reid Chan
Zhen Ye
tinswzy
jaime
Xianhui Lin
cai.zhang
sthuang
shaoyue
MimoN
sre-ci-robot
yihao.dai
wei liu
Ted Xu
Bingyi Sun
SimFG