a4f3e01a3a
fix: add the range search params check in proxy ( #30423 )
...
if check in Segcore, will not do the it when not insert data.
so, check "radius" and "range_filter" in proxy.
related with #30365
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-02-28 11:24:58 +08:00
77477d6340
fix: wrong context passing into NewClient, error handling lost in session_util ( #30817 )
...
issue: #30799
Signed-off-by: chyezh <chyezh@outlook.com>
2024-02-28 10:40:09 +08:00
a0531b72aa
fix: reorder hybridsearch result for L2 metric ( #30739 )
...
#30694
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-02-26 14:18:55 +08:00
d970a9fc6c
enhance: refine error log of json parse error ( #30671 )
...
add more error info when json format does not match.
relate to https://github.com/milvus-io/milvus/issues/29837
Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
2024-02-24 12:32:14 +08:00
c5363c70db
fix: fix upsert using wrong field to compute partition key ( #30772 )
...
#30607
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-02-23 09:54:53 +08:00
e5353ad049
enhance: access log should get get client info by get method ( #30502 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-02-22 14:58:52 +08:00
77eb6defb1
feat: support groupby on growing and non-indexed sealed egment( #30307 ) ( #30644 )
...
related: #30308
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
2024-02-21 14:02:53 +08:00
81d6cb1a0c
enhance: The error information is not clear ( #30658 )
...
issue:#30516
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-02-21 10:16:53 +08:00
40ca98f57f
enhance: Skip timestamp allocation when search/query consistency level is eventually ( #29773 )
...
issue: #29772
1. Skip timestamp allocation when search/query consistency level is
eventually.
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-02-21 09:52:59 +08:00
c863b82476
enhance: Return parse expression failed error with reason ( #30548 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-02-20 16:02:52 +08:00
bbff9193d9
enhance: support clean paramtable config event in test ( #30534 )
...
relate: https://github.com/milvus-io/milvus/issues/30441
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-02-20 14:16:51 +08:00
941dc755df
feat: add collection level flush rate control ( #29567 )
...
flush rate control at collection level to avoid generate too much
segment.
0.1 qps by default.
issue: #29477
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2024-02-18 15:32:50 +08:00
bb93b22c84
fix: should return collectionName in response of ListAliases ( #30532 )
...
issue : https://github.com/milvus-io/milvus/issues/30369
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2024-02-12 08:30:55 +08:00
23aa136444
enhance: access log method support get status when method only return error instead of status ( #30409 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-02-04 16:35:05 +08:00
6959630652
fix: donot set l0 segment as growing when savebinlogs ( #29194 )
...
This PR fixes negative growing L0 segments in Metrics
See also: #29204 , #30441
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-02-04 10:21:06 +08:00
05ebe7b6ae
fix: fix hybrid search panic when has multi shard ( #30464 )
...
/kind bug
issue:#30457
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2024-02-02 17:25:12 +08:00
02de84239d
fix: add more requests to the database interceptor ( #30452 )
...
issue: #30368
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-02-02 16:49:06 +08:00
0a78b38bb8
fix: fix requery without partitionIDs in hybrid search ( #30444 )
...
issue: #30412
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2024-02-02 16:47:13 +08:00
dcdf85977c
enhance: [skip e2e] add alter collection task ut ( #30447 )
...
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-02-02 15:25:04 +08:00
1c1dd48b71
fix: Deprecated shard leader cache while deprecating collection ( #30446 )
...
Resolves : #30445
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-02-02 09:11:05 +08:00
e22e8b30d4
enhance: check load state before altering collection ( #30399 )
...
/kind improvement
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-02-01 18:03:04 +08:00
060c8603a3
fix: Support mvcc with hybrid serach ( #30114 )
...
issue: https://github.com/milvus-io/milvus/issues/29656
/kind bug
Signed-off-by: xige-16 <xi.ge@zilliz.com>
---------
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2024-02-01 16:03:03 +08:00
f619d792c0
enhance: Break down the granularity of collection info cache expired ( #29977 )
...
issue: #29772
1. `DropPartition` only invalidates the cache related to the partition.
2. `CreateAlias` does not invalidate the cache.
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-01-30 16:45:02 +08:00
6abbab12fa
feat: restful phase two ( #29728 )
...
issue: #29732
Signed-off-by: PowderLi <min.li@zilliz.com>
2024-01-28 16:03:01 +08:00
8fc4ebfa11
fix: empty MetricType ( #30216 )
...
issue: #30102 #30225
we should read MetricType from SearchResult,
because query node never
1. read metricType from LoadMeta
2. store to collection
3. set SearchRequest.MetricType
Signed-off-by: PowderLi <min.li@zilliz.com>
2024-01-28 15:33:02 +08:00
d87726e4c7
enhance: Don't expire ShardLeaders cache actively ( #29879 )
...
issue: #29772
The shardLeaders cache does not actively expire, update the cache when
search/query fails.
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-01-26 14:13:01 +08:00
8e8ac213aa
enhance: Utilize partition key optimization in reQuery ( #30253 )
...
See also #30250
This PR add requery flag in query task. When reQuery flag is true, query
task shall skip partition name conversion and use pre-calculated
partitionIDs passed from search task.
TODO: hybrid search does not have partition id information. we shall
apply same logic for hybrid search later.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-25 11:05:07 +08:00
4f25066aa7
fix: Fix requery without limit during HybridSearch ( #30220 )
...
issue: #29990
/kind bug
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2024-01-25 11:03:00 +08:00
38746dfc2b
fix: Remove useless lock which cause porxy meta cache recursive lock ( #30203 )
...
relate: https://github.com/milvus-io/milvus/issues/30193
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-01-23 23:56:55 +08:00
463765922e
enhance: support related privilege for grant api ( #30153 )
...
/kind improvement
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-01-23 15:56:54 +08:00
4142743128
enhance: fix access log can't print SDK version when client connect ( #29680 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-01-22 17:22:54 +08:00
a81d2b4780
enhance: refine proxy metacache for concurrent safe ( #29872 )
...
relate: https://github.com/milvus-io/milvus/issues/29675
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-01-22 14:28:55 +08:00
c8a78465b4
enhance: Add a counter monitoring for the rate-limit requests ( #30109 )
...
Add a counter monitoring metric for the ratelimited rpc requests with
labels: proxy nodeID, rpc request type, and state.
issue: https://github.com/milvus-io/milvus/issues/30052
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-01-21 14:44:59 +08:00
4ef6217fc0
enhance: add pool for scheduler dmQueue task ( #30103 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-01-19 14:20:54 +08:00
ddccccbcab
enhance: add the bytes data type for merge data and format some code ( #30105 )
...
/kind improvement
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-01-18 22:18:55 +08:00
fc56ed5c27
fix: Proxy restful api doesn't register ( #30072 )
...
issue: #30074
This PR fix that management restful api in proxy doesn't register to
http service
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-01-18 20:28:52 +08:00
631ebb1f07
fix: CollectionSchema.autoID is deprecated ( #30002 )
...
issue: #30000
related to: [milvus-proto
#202 ](https://github.com/milvus-io/milvus-proto/pull/202 )
1. replace collSchema.AutoID with primaryField.AutoID
2. show `enableDynamic` & `enableDynamicField` at the same time
3. avoid data race about the access to metacache
Signed-off-by: PowderLi <min.li@zilliz.com>
2024-01-18 16:16:52 +08:00
91aa81b4d7
fix: Add more checks to rank params ( #29950 )
...
issue: #29840 #29867
/kind bug
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2024-01-17 20:28:58 +08:00
04e21564b6
enhance: delete should inc ProxyFunctionCall metric failed label when run failed instead abandon ( #29621 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-01-17 19:16:55 +08:00
80465a01b5
enhance: change some important request log level to Info ( #30062 )
...
Some important request log level shall be at least Info level
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-17 17:48:53 +08:00
1c8ce33eea
fix: report error if the altering index doesn't support mmap ( #29832 )
...
this also checks the param value
fix #29909
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2024-01-17 16:40:54 +08:00
7f059b1025
fix: record apply pk latency metric to ms ( #29987 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-01-17 10:11:03 +08:00
fb4fbcf48c
fix: Dynamic update rate limit config with wrong value ( #29901 )
...
when apply dynamic config changes, we should format the value to proper
unit
This PR fix update rate limit config with wrong value.
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-01-15 09:52:51 +08:00
8c89ad694e
fix: Fix error message for indexing ( #29898 )
...
issue: #29897
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-01-12 19:44:51 +08:00
1df3f90696
feat: Implement DescribeAlias and ListAliases interfaces ( #29641 )
...
#22882
/kind feature
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-01-11 19:12:51 +08:00
797847904c
enhance: Change some frequency log to rated level ( #29720 )
...
This PR change some frequency log to rated level
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-01-11 16:30:50 +08:00
e429965f32
Add float16 approve for multi-type part ( #28427 )
...
issue：https://github.com/milvus-io/milvus/issues/22837
Add bfloat16 vector, add the index part of float16 vector.
Signed-off-by: Writer-X <1256866856@qq.com>
2024-01-11 15:48:51 +08:00
73cfdab776
fix: Release collection delete proxy collection meta ( #29854 )
...
pr: https://github.com/milvus-io/milvus/issues/29675
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-01-10 21:54:49 +08:00
8a6e1a4b27
enhance: pre-allocate result FieldData space to reduce copy & growslice ( #29726 )
...
See also: #29113
Add a new utitliy function in `pkg/util/typetuil` to pre-allocate field
data slice capacity acoording to search limit. This shall avoid copying
the data during `AppendFieldData` when previous slice is out of space.
And shall also save CPU time during high paylog.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-09 15:48:55 +08:00
f030f31d92
enhance: make the error of parsing expression to `ParameterInvalid` ( #29681 )
...
before this, the error is unexpected error
Signed-off-by: yah01 <yang.cen@zilliz.com>
2024-01-09 15:36:47 +08:00
smellthemoon
chyezh
zhagnlu
Xiaofan
aoiasd
MrPresent-Han
cai.zhang
chyezh
zhenshan.cao
XuanYang-cn
xige-16
SimFG
Bingyi Sun
congqixia
PowderLi
yihao.dai
wei liu
yah01
wayblink
Xu Tong