578c38a2f7
enhance: Bump milvus version to v2.3.18 ( #33909 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-18 16:30:00 +08:00
aea3cfefce
fix: [2.3] Prevent use captured iteration variable partitionID ( #33912 )
...
Cherry-pick from master
pr: #33906
See also #33902
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-17 23:14:00 +08:00
2e01ae9141
fix: filter results less than topk ( #33930 )
...
issue: #33933
Signed-off-by: min.tian <min.tian.cn@gmail.com>
2024-06-17 22:54:01 +08:00
deb2c7854d
enhance: add restful api to trigger component stop ( #32076 ) ( #33798 )
...
issue: #32698
pr: #32076
This PR add two rest api for component stop and status check:
1. `/management/stop?role=querynode` can stop the specified component
2. `/management/check/ready?role=rootcoord` can check whether the target
component is serviceable
---------
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-06-17 20:46:01 +08:00
518c86236b
fix: Fix insert not limited when set collection.insertRate.max.mb=0 ( #33725 )
...
issue: #33722
pr: #31070
/kind bug
---------
Signed-off-by: xige-16 <xige2016@gmail.com>
Signed-off-by: gexi <gexi@didiglobal.com>
Co-authored-by: gexi <gexi@didiglobal.com>
2024-06-17 20:07:59 +08:00
963f601a96
enhance:[Cherry-pick] Check by proxy rate limiter when delete get data by query. ( #30891 ) ( #33794 )
...
relate: https://github.com/milvus-io/milvus/issues/30927
pr: https://github.com/milvus-io/milvus/pull/30891
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-06-17 19:36:00 +08:00
284e79cf3a
enhance: Execute bloom filter apply in parallel to speed up process delete ( #33870 )
...
issue: #33610
pr: #33611 #33793
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-06-17 12:06:04 +08:00
c62e092463
enhance: [2.3] Make applyDelete work in paralell in segment level ( #32291 ) ( #33841 )
...
Cherry-pick from master
pr: #32291
`applyDelete` used to be serial for delete entries on each segments.
This PR make it work in parallel with errgroup to improve performance
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-13 23:09:56 +08:00
56d39fa92b
enhance:[skip e2e] make more retries on codecov uploader ( #33701 )
...
pr: #33683
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-12 20:40:01 +08:00
9d6af07107
fix: [2.3] Write back dbid modification for nonDB id collection ( #33641 ) ( #33695 )
...
Cherry-pick from master
pr: #33641
See also #33608
Make `fixDefaultDBIDConsistency` also write back collection dbid
modification when nonDB id collection is found.
This fix shall prevent dropped collections of this kind show up again
after dropping and restart.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-11 10:38:01 +08:00
636be02777
enhance: [2.3] Print UseDefaultConsistency param in read requests ( #33617 ) ( #33645 )
...
Cherry-pick from master
pr: #33617
`UseDefaultConsistency` param is crucial for debugging slow query
problems. It could be confusing when guarantee timestamp is 1 while this
param is not logged
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-06 14:19:56 +08:00
168724b2cd
fix: [2.3] Use milliseconds in apply pk latency metrics for upsert ( #33580 )
...
Cherry pick from master
pr: #29987
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-04 16:43:47 +08:00
6d0e167f69
fix: Fix exception info is missing ( #33393 ) ( #33395 )
...
Replace based std::exception to prevent "object slicing"
issue: https://github.com/milvus-io/milvus/issues/33392
pr: https://github.com/milvus-io/milvus/pull/33393
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-06-04 15:19:47 +08:00
84bc1781f8
[automated] Bump milvus version to v2.3.17 ( #33526 )
...
Bump milvus version to v2.3.17
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-05-31 18:55:50 +08:00
cc1bf63336
enhance: Bump milvus version to v2.3.17 ( #33509 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-05-31 17:29:45 +08:00
0d4ee287e1
fix: query iterator lack results( #33137 ) ( #33468 )
...
related: #33137
pr: https://github.com/milvus-io/milvus/pull/33422
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
2024-05-31 13:54:07 +08:00
e94fa9e2ae
test: add partition key verify in import test ( #33347 )
...
pr: https://github.com/milvus-io/milvus/pull/33253
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-05-27 14:47:43 +08:00
d40929857c
fix:[cherry-pick]Panic if ProcessActiveStandBy returns error ( #33371 )
...
pr:#33369
issue:#33368
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-05-27 10:13:41 +08:00
df4a1c2185
[automated] Bump milvus version to v2.3.16 ( #33296 )
...
Bump milvus version to v2.3.16
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-05-23 10:09:41 +08:00
078f252aa9
fix: [cherry-pick][restful v2]role operations need dbName ( #33292 )
...
issue: #33220
master pr: #33283
2.4 pr: #33291
use dbName as part of privilege entity, so
1. grant / revoke a privilege need dbName
2. we can describe the privileges of the role which belong to one
special database
Signed-off-by: PowderLi <min.li@zilliz.com>
2024-05-23 09:57:41 +08:00
653af7108c
fix: Break the dead loop of downloading binlog during compaction ( #33246 )
...
issue: #33245
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-05-22 17:29:40 +08:00
1007e6d562
enhance: [2.3] check the auth in some rest v2 api ( #33254 )
...
/kind improvement
pr: #33256
link 2.3 proto:
https://github.com/milvus-io/milvus-proto/blob/2.3/proto/milvus.proto
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-05-22 14:43:39 +08:00
0ae4c8a11c
enhance: Bump milvus & proto version to v2.3.16 ( #33127 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-05-21 16:39:40 +08:00
eb98f20316
enhance: update knowhere version ( #33215 )
...
/kind branch-feature
Fix diskann PQ train dead loop
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2024-05-21 16:37:44 +08:00
e325ec0a35
enhance: [2.3]Try LatestMessageID when checkpoint unmarshal fails ( #33159 )
...
Cherry-pick from master
pr: #33158
See also #33122
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-05-21 14:13:40 +08:00
76b7c23a66
fix: try best to get enough query results ( #33177 )
...
issue: https://github.com/milvus-io/milvus/issues/33137
pr: https://github.com/milvus-io/milvus/pull/32567
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: MrPresent-Han <chun.han@zilliz.com>
---------
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2024-05-21 14:07:45 +08:00
23e7155a48
fix: avoid memoryleak in rendezvousFlushManager ( #33112 )
...
issue: https://github.com/milvus-io/milvus/issues/33110
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2024-05-20 22:19:40 +08:00
7a617e2921
doc: [skip e2e] change milvus docker image version to v2.3.15 ( #33186 )
...
pr: https://github.com/milvus-io/milvus/pull/33170
Signed-off-by: ping.liu <ping.liu@zilliz.com>
2024-05-20 17:05:39 +08:00
f848e82971
enhance: [2.3] Add param item to ignore bad message id in checkpoint ( #33128 )
...
Cherry-pick from master
pr: #33123
See also #33122
This pr add param item `mq.ignoreBadPosition` to control behavior when
mq failed to parse message id from checkpoint
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-05-20 11:31:39 +08:00
b073407119
fix: check array field data is nil before getting the type ( #33119 )
...
issue: https://github.com/milvus-io/milvus/issues/33074
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-05-18 17:18:49 +08:00
62848d3aed
enhance: Make sure every segment only trigger flush task once by channel.flushTs. ( #33034 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-05-17 18:57:37 +08:00
bbf3a27472
fix: avoid concurrent sync and segment tasks ( #33087 )
...
issue: https://github.com/milvus-io/milvus/issues/33089
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-05-17 14:27:42 +08:00
d842efbff3
enhance: enable stopping balance after balance has been suspended ( #32812 ) ( #32941 )
...
issue: #32811
pr: #32812
This PR enable stopping balance after balance has been suspended, in
case of global balance has been suspend, then query node get a sigterm,
if stopping balance won't be triggered, the query node exit progress
will stuck
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-05-17 11:53:37 +08:00
0abc0d05a4
fix: etcd txn exceeds limit due to too many fields ( #33040 ) ( #33049 )
...
fix : #33038
pr: #33040
---------
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2024-05-15 10:07:34 +08:00
bfd88670ef
fix: metric milvus_rootcoord_indexed_entity_num ( #33002 )
...
issue: #31272
pr: #32307
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2024-05-13 17:01:34 +08:00
c5935667d5
[automated] Bump milvus version to v2.3.15 ( #32983 )
...
Bump milvus version to v2.3.15
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-05-11 16:37:31 +08:00
39b07adff1
enhance: Bump milvus & proto version to v2.3.15 ( #32947 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-05-10 19:41:31 +08:00
7555b4a00f
fix: Set segment to delegator failed due to wrong time unit in segment version ( #32923 )
...
issue: #31468
pr: #31643
the fix in #31643 try to update segment version when set segment to
delegator, but use wrong time unit as segment version, which make set
segment failed, and block the balance channel.
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-05-10 16:37:31 +08:00
996b79c76c
enhance: Add channelCPs in FlushResponse ( #32683 )
...
#32609
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-05-10 09:55:31 +08:00
89e6b6aea0
fix: [2.3] Make compactor able to clear empty segments ( #32690 )
...
Add more informative logs
See also: #32553
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-05-08 16:35:30 +08:00
a631856321
fix: [2.3] Validate num of rows for insert field data with schema ( #32770 ) ( #32845 )
...
Cherry-pick from master
pr: #32770
See also #32769
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-05-08 16:25:30 +08:00
f72e89b549
fix: [2.3] skip to check auto id when inserting data ( #32840 )
...
/kind improvement
issue: #32591
pr: #32775
related pr: #32592
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-05-08 14:25:31 +08:00
2facf61c37
enhance: check field data type of input ( #32777 ) ( #32790 )
...
issue: #32769
pr: #32777
---------
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2024-05-07 14:09:30 +08:00
4e82bc4970
enhance: use soft node affinity instead of hard nodeSelector ( #32676 )
...
pr: #32677
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-29 14:25:36 +08:00
3a7154b796
enhance: [2.3] add the skip auto id and partition key check config ( #32671 )
...
/kind improvement
issue: #32591
pr: #32592
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-04-29 10:19:31 +08:00
114e3056c2
enhance: [2.3] Make querycoordv2 collection observer task driven ( #32441 ) ( #32615 )
...
Cherry-pick from master
pr: #32441
See also #32440
- Add loadTask in collection observer
- For load collection/partitions, load task shall timeout as a whole
- Change related constructor to load jobs
---------
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-28 13:19:26 +08:00
d56bec07fb
enhance: bind e2e to dedicated nodes ( #32578 )
...
pr:#32600
---------
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-26 14:13:30 +08:00
bf2c5def8d
enhance: [Cherry-Pick] access log support get sdk type by user agent ( #30760 ) ( #32554 )
...
Support get sdk type by user agent when we can't get sdk version by
connection in access log.
---------
pr: https://github.com/milvus-io/milvus/pull/30760
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-04-25 16:37:27 +08:00
c36b54cb57
enhance: [2.3] Use different interval for gc scan ( #31363 ) ( #32551 )
...
Cherry-pick from master
pr: #31363
See also #31362
This PR make datacoord garbage collection scan operation using differet
interval than other opeartion.
This interval is a newly added param item, which default value is 7*24
hours.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-25 16:07:26 +08:00
560e167214
fix: add score compute consistency config for knowhere ( #32584 )
...
issue: #32583
/kind branch-feature
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2024-04-25 14:07:25 +08:00
congqixia
Min Tian
wei liu
xige-16
aoiasd
sammy.huang
yihao.dai
sre-ci-robot
Chun Han
zhuwenxing
wayblink
PowderLi
cai.zhang
SimFG
Gao
Jiquan Long
zhenshan.cao
pingliu
Bingyi Sun
XuanYang-cn
foxspy