fd971a434f
test: add case for sparse vector and verify group by ( #32217 )
...
add case for sparse vector and verify group by
---------
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-04-15 19:39:31 +08:00
70e3d5b495
fix: wrong node id in TestCheckNodesInReplica ( #32268 )
...
issue: #31930
Signed-off-by: chyezh <chyezh@outlook.com>
2024-04-15 17:38:17 +08:00
ae8f46f431
fix: panic when get empty ids ( #32220 )
...
#32223
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-04-15 16:53:23 +08:00
c93ae72d92
fix: more comprehensive check on sparse index and value ( #32250 )
...
issue: #29419
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-04-15 16:51:24 +08:00
0d849a6c0a
fix: fix collectionInfo leak in datacoord ( #32175 )
...
issue: #32029
lack of logic to clean collection info in datacoord's meta, This PR
clean collection info after drop channel, to avoid collection info leak
in datacoord
---------
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-04-15 16:33:19 +08:00
b87f41128b
fix: [skip e2e] Make channel balance test accept flushing segments ( #32229 )
...
See also #30973
Make the case stable since the segment state may be flushing when suite
tries to check segment state.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-15 11:27:18 +08:00
4822b109bd
fix: Skip to load l0 segment on old version query node ( #32124 )
...
issue: #32107
during rolling upgrade progress, skip to load l0 segment on old version
query node
---------
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-04-15 11:23:23 +08:00
dc11cbd123
enhance: Maintain collection-patitions mapping in qc meta ( #32227 )
...
Related to #32165
Add collection to partitionIDs mapping to avoid interation on all
partitions loaded when trying to get all partitions with collection id
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-15 10:05:19 +08:00
14977b84d1
test: enable bf16 and f16 test cases ( #32082 )
...
issue: #31625
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-04-15 09:55:18 +08:00
48fe977a9d
enhance: declarative resource group api ( #31930 )
...
issue: #30647
- Add declarative resource group api
- Add config for resource group management
- Resource group recovery enhancement
---------
Signed-off-by: chyezh <chyezh@outlook.com>
2024-04-15 08:13:19 +08:00
e26cc9bfb5
Update README.md
2024-04-14 16:29:51 -07:00
337cc0756d
fix: lack good results for insufficient ef( #29883 ) ( #32080 )
...
related: #29883
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
2024-04-13 22:13:23 +08:00
aa96843d31
fix: Fix import hanging and improve logging output ( #32166 )
...
Fix import hanging when the previous import task failed, and improve
parquet import logging outout.
issue: https://github.com/milvus-io/milvus/issues/31834
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-04-13 22:03:23 +08:00
4fb85be525
fix: put inverted index into local storage ( #32209 )
...
issue: https://github.com/milvus-io/milvus/issues/32154
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2024-04-13 21:57:19 +08:00
610a65af14
fix: restful v2 ( #32144 )
...
issue: #31176
1. cannot get dbName correctly while describe alias #31978
2. return a valid json string even if the user doesn't have the whole
privileges to describe collection #31635
3. rename IndexParam.IndexConfig to IndexParam.Params
4. FieldSchema.ElementTypeParams, IndexParam.Params can not only accept
string
Signed-off-by: PowderLi <min.li@zilliz.com>
2024-04-13 21:55:29 +08:00
ab6ddf6929
enhance: [skip e2e] use pull_request_target event instead ( #32236 )
...
issue: #32235
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-13 21:17:17 +08:00
674991d07c
fix: Wait StandBy server ready for testcase ( #32216 )
...
See also #32069
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-12 23:49:18 +08:00
b7ff85638d
fix: mvcc database space exceeded for embed etcd ( #32048 )
...
Fix #30314
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2024-04-12 21:39:19 +08:00
2944971507
enhance: fix the dev docker yaml and use `go install` to install the gotestsum ( #32197 )
...
/kind improvement
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-04-12 19:17:18 +08:00
06e0c8baac
fix: fix estimate float16 field data size wrong ( #32193 )
...
Issue: #32192
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2024-04-12 16:29:26 +08:00
88c6828d6c
fix: failed to raise metric_type not match error ( #32202 )
...
issue: https://github.com/milvus-io/milvus/issues/32176
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2024-04-12 16:19:18 +08:00
c012e6786f
feat: support rate limiter based on db and partition levels ( #31070 )
...
issue: https://github.com/milvus-io/milvus/issues/30577
co-author: @jaime0815
---------
Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
2024-04-12 16:01:19 +08:00
fb376fd1e6
enhance: Refine varchar length exceeds max length error message ( #31521 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-04-12 15:01:19 +08:00
4617d22482
enhance: Use channel manager interface in server_test ( #31621 )
...
Tidy the following test codes
- Remove channel in newTestServer
- Remove newTestServerWithMeta
- Remove newTestServer2
- Remove testDataCoordBase
- Use the same func for handleTTmsg and handleRPCTTmsg
See also: #31620
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-04-12 14:59:20 +08:00
33801c32c4
fix: in milvus check sparse index to be less than uint32 max ( #32199 )
...
issue: #29419
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-04-12 14:25:19 +08:00
c0fa169d9a
enhance: Make write buffer memory check do until safe ( #32172 )
...
See also #27675 #26177
Make memory check evict memory buffer until memory water level is safe.
Also make `EvictBuffer` wait until sync task done.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-12 10:55:18 +08:00
68dec7dcd4
fix: Use correct ts to avoid exclude segment list leak ( #31991 )
...
issue: #31990
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-04-12 10:39:19 +08:00
43a9be2cce
enhance: support access log dynamic config and prepare for support resutful interface access log ( #29638 )
...
relate: https://github.com/milvus-io/milvus/issues/29637
https://github.com/milvus-io/milvus/issues/31823
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-04-12 10:37:27 +08:00
454984aa4e
[automated] Update Knowhere Commit ( #32181 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-04-12 01:25:19 +08:00
371e6d2c1a
enhance: refine sync memory watermark configuration ( #32140 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-04-11 20:07:24 +08:00
b5455d176e
fix: dynamically resolve whether SVE is available for bitset ( #32137 )
...
Issue: #32129
This PR adds a dynamic SVE detection for ARM CPU families for the bitset
code.
Also, allows the code to be compiled if the compiler does not support
NEON (arm-v7).
Signed-off-by: Alexandr Guzhva <alexanderguzhva@gmail.com>
2024-04-11 19:27:18 +08:00
3d5fe7b45c
feat: adding cache stats support ( #32068 )
...
See #32067
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2024-04-11 19:19:18 +08:00
5e8c580fa1
[automated] Update Pytest image changes ( #32148 )
...
Update Pytest image changes
See changes:
4bf32bbc87sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-04-11 19:07:18 +08:00
b9a487608a
fix: Make `ResourceGroup.nodes` concurrent safe ( #32159 )
...
See also #32158
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-11 17:53:18 +08:00
0bfe130991
fix: fix metric about ProxySearchVectors ( #32152 )
...
issue :https://github.com/milvus-io/milvus/issues/25639
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2024-04-11 16:13:17 +08:00
2c63f848bf
fix: upgrade nats server to fix security vulnerabilities ( #32021 )
...
issue: #32022
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-04-11 16:07:18 +08:00
52ae47c850
enhance: gather materialized view search info once per request ( #31996 )
...
issue: #29892
This PR:
1. Move the process of gathering materialized search info to when the
search plan is created, before it goes to each segment, to avoid
repeated work and access the plan node under multi-threaded
circumstances.
2. Enforce the supported MV type to `VARCHAR`
3. Add integration test
Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
2024-04-11 15:21:19 +08:00
4bf32bbc87
test: Update pymilvus version to 2.5.0rc8 ( #32111 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-04-11 11:03:18 +08:00
dc5ea6f17c
feat: adding binlog streaming writer ( #31537 )
...
See #31679
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2024-04-11 10:33:20 +08:00
273df98e20
enhance: Add binlog import intergration test ( #32112 )
...
issue: https://github.com/milvus-io/milvus/issues/28521
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-04-11 10:31:18 +08:00
a938951eea
enhance: [skip e2e] fix upload code cov if syntax ( #32128 )
...
The re-upload step is always true since the syntax is wrong
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-11 10:05:19 +08:00
789e014c74
enhance: add the db id for the describe collection response ( #32114 )
...
/kind improvement
issue: #32110
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-04-10 21:23:20 +08:00
d4fd6c7283
enhance: add db label on binlog size metrics ( #32003 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-04-10 21:01:20 +08:00
1a98ce39f5
enhance: Remove useless logic about FromShardLeader ( #32029 )
...
issue: #32047
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-04-10 20:11:19 +08:00
2fdf1a6e76
feat: [Sparse Float Vector] added some integration tests ( #31062 )
...
add some integration tests for sparse float vector support
https://github.com/milvus-io/milvus/issues/29419
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-04-10 19:57:18 +08:00
25a1c9ecf0
fix: Make coordinator `Register` not blocked on ProcessActiveStandby ( #32069 )
...
See also #32066
This PR make coordinator register successful and let
`ProcessActiveStandBy` run async. And roles may receive stop signal and
notify servers.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-10 18:49:18 +08:00
a697e80a3f
test: use strong as default consistency level ( #32095 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-04-10 17:55:18 +08:00
5ddeec877a
test: fix vulnerability of python lib ( #32109 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-04-10 17:53:18 +08:00
a3d6110957
fix: ut failure ( #32120 )
...
issue: #30647
Signed-off-by: chyezh <chyezh@outlook.com>
2024-04-10 17:30:48 +08:00
1b5554c8cb
enhance: Support $meta key for json import ( #32013 )
...
During JSON import:
1. Allow the specification of the $meta key
2. Prohibit duplicated keys within the $meta field, for instance,
`{"id": 1, "vector": [], "x": 6, "$meta": {"x": 8}}`
issue: https://github.com/milvus-io/milvus/issues/31835
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-04-10 17:27:17 +08:00
zhuwenxing
chyezh
smellthemoon
Buqian Zheng
wei liu
congqixia
binbin
Xiaofan
Chun Han
yihao.dai
Jiquan Long
PowderLi
sammy.huang
edward.zeng
SimFG
Cai Yudong
zhenshan.cao
aoiasd
XuanYang-cn
sre-ci-robot
jaime
Alexander Guzhva
Ted Xu
Patrick Weizhi Xu