0d7ea8ec42
enhance: Enhance and correct exception module ( #33705 )
...
#33704
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-06-23 21:22:01 +08:00
6c1d815894
enhance: Remove the unused compaction logic from shard ( #33932 )
...
1. Remove the `compactTo` field in `SegmentInfo`.
2. Remove the target segment not match and its retry logic in
`SyncManager`.
issue: https://github.com/milvus-io/milvus/issues/32809
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-06-23 21:12:01 +08:00
b77ab76d74
enhance: get environment variable from .env ( #34081 )
...
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-23 09:34:07 +08:00
e1b64e2318
Update all contributors
...
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2024-06-22 12:00:53 +00:00
fb870d2426
fix: Do compressBinlog to fix logID 0 ( #34060 )
...
issue: https://github.com/milvus-io/milvus/issues/34059
Do compressBinlog to ensure that reloadFromKV will fill binlogs' logID
after datacoord restarts.
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-06-22 16:14:01 +08:00
e0e06fc9e0
enhance: [skip e2e] Update mergify.yml to skip cov checker ( #34072 )
2024-06-22 16:12:00 +08:00
259a682673
enhance: async search and retrieve in cgo ( #33228 )
...
issue: #30926 , #33132
related pr: #33133
---------
Signed-off-by: chyezh <chyezh@outlook.com>
2024-06-22 09:38:02 +08:00
c85644e1b3
test: modify test case about upsert partition ( #33919 )
...
issue: #33902
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-06-21 18:50:00 +08:00
f3f390ea43
test: Update tests for range search and add test for query with dup ids ( #34057 )
...
related issue: #33883
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-06-21 18:48:02 +08:00
380d3f4469
fix: Fix memory buffer error & some renaming ( #33850 )
...
#30633
---------
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-06-21 17:30:01 +08:00
2f691f1e67
enhance: Unify DeleteLog parsing code ( #34009 )
...
See also #33787
The parsing delete log is distributed in lots of places, which is not
recommended and hard to maintain.
This PR abstract common parsing logic into `DeleteLog.Parse` method to
unify implementation and make it easier to replace json parsing lib.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-21 16:54:01 +08:00
622be36ad7
fix: fix l0 compaction may miss some sealed segments ( #33980 )
...
issue: https://github.com/milvus-io/milvus/issues/33955
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-06-21 16:52:15 +08:00
958ecd500b
feat: adding grouped virtual resource allocator ( #33669 )
...
See #33559
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2024-06-21 15:58:01 +08:00
03a5f7e6c0
test: update the lib of bf16 ( #34043 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-06-21 14:20:08 +08:00
e653ad27e2
fix: metrics database_num is 0 after restarting rootcoord ( #34011 )
...
issue: #34041
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-06-21 11:36:00 +08:00
66710008d6
enhance: Support queryOption WithLimit for milvusclient ( #33978 )
...
See also #31293
---------
Signed-off-by: coldWater <254244460@qq.com>
2024-06-21 10:52:02 +08:00
35ea775c14
enhance: Add rules and fix for go_client e2e code style ( #34033 )
...
See also #31293
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-21 10:32:02 +08:00
4e414fb7fc
test: optimizing variable names ( #34035 )
...
Signed-off-by: elstic <hao.wang@zilliz.com>
2024-06-21 10:14:00 +08:00
d9f986439d
[automated] Update Knowhere Commit ( #34040 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-06-21 01:50:01 +08:00
dac20d41c0
fix: fix milvus gpu compile error ( #33995 )
...
NVIDIA RAFT uses customized versions of spdlog and fmt, which conflict
with the versions provided by Conan. Therefore, it is necessary to
isolate the build environment for knowhere to avoid these conflicts.
issue: https://github.com/milvus-io/milvus/issues/33991
Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
2024-06-20 20:30:01 +08:00
04edb07d82
enhance: Add deltaRowCount in l0 compaction ( #33997 )
...
See also: #33998
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-06-20 17:46:01 +08:00
dc4437ff82
enhance: use segment id and type to register in MmapChunkManager and opt malloc in variableChunk ( #33993 )
...
issue: https://github.com/milvus-io/milvus/issues/32984
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2024-06-20 17:42:02 +08:00
5be9929d64
enhance: upgrade build-env to ubuntu 22.04 and gcc12 ( #33959 )
...
issue: #33960
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-20 15:22:02 +08:00
935bc1fb71
fix: Fix GetReplicas API return nil status ( #33715 )
...
issue: #33702
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-06-20 14:40:15 +08:00
ce3d7070ac
test: change the number of insertion vectors ( #34014 )
...
pr: https://github.com/milvus-io/milvus/pull/33916
1. Fix case: test_collection_multi_sparse_vectors
2. Reduce the amount of data generated
Signed-off-by: elstic <hao.wang@zilliz.com>
2024-06-20 13:58:05 +08:00
5f02e52561
enhance: Refactor data codec deserialize ( #33923 )
...
#33922
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-06-20 11:17:59 +08:00
31ef0a1fe8
enhance: Add trace for bf cost in l0 compactor ( #33860 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-06-20 10:10:05 +08:00
f3d902cf16
test: add test case for bulkwriter ( #33879 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-06-20 09:24:04 +08:00
0264588df9
enhance: update pymilvus version ( #33905 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-06-20 09:22:18 +08:00
cc77363b66
enhance: Set maxPartitionNum default value to 1024 ( #33949 )
...
See also #30059
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-20 09:11:59 +08:00
6a15b6e2be
fix: Remove loopclosure issue in ChannelManagerImplV2 ( #33989 )
...
See also #33987
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-19 21:25:59 +08:00
2a1356985d
enhance: support null in go payload ( #32296 )
...
#31728
---------
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-06-19 17:08:00 +08:00
eb3197eb1e
enhance: update amazonlinux2023 image builder ( #33948 )
...
#32982
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-06-19 16:44:01 +08:00
1216a4bcd8
test: Add more sparse test cases ( #33916 )
...
issue: https://github.com/milvus-io/milvus/issues/31483
Signed-off-by: elstic <hao.wang@zilliz.com>
2024-06-19 15:24:09 +08:00
6d5747cb3e
feat: adding deltalog stream reader and writer ( #33844 )
...
See #31679
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2024-06-19 14:42:01 +08:00
7b9462c0d3
enhance: fix copying hits of inverted index twice ( #33968 )
...
issue: https://github.com/milvus-io/milvus/issues/29793
The custom `VecCollector` have already transformed the results into
vector of offsets, no need to copy them twice.
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2024-06-19 12:40:01 +08:00
5fac2fa1d2
fix: Panic if ProcessActiveStandBy returns error ( #33369 )
...
#33368
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-06-19 11:16:00 +08:00
02945959d9
enhance: Avoid to iterate whole segment list for each task's process ( #33943 )
...
when querycoord process segment task, it will try to iterate whole
segment list to checke whether segment is loaded, which cost too much
cpu if there has thousands of segments.
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-06-19 10:19:58 +08:00
298e50b834
enhance: check index with data type ( #33880 )
...
issue: https://github.com/milvus-io/milvus/issues/22837
related: https://github.com/milvus-io/milvus/pull/33878
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2024-06-19 10:15:59 +08:00
2f6f964bc8
enhance: [skip e2e] modify gc configuration document ( #33946 )
...
issue: #31740
Signed-off-by: chyezh <chyezh@outlook.com>
2024-06-19 09:57:59 +08:00
0d20303e54
fix: fix binary vector data size ( #33750 )
...
issue: https://github.com/milvus-io/milvus/issues/22837
- fix byte size wrong for binary vectors
- fix the expect/actual error msg
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2024-06-18 21:39:59 +08:00
a789c60380
enhance: autoindex for multi data type ( #33868 )
...
issue: #22837
contain https://github.com/milvus-io/milvus/pull/33625
https://github.com/milvus-io/milvus/pull/33867
https://github.com/milvus-io/milvus/pull/33911 which already merged to
2.4 branch
Signed-off-by: chasingegg <chao.gao@zilliz.com>
Co-authored-by: foxspy <xianliang.li@zilliz.com>
2024-06-18 21:34:01 +08:00
74186091d4
Update all contributors
...
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2024-06-18 12:00:57 +00:00
b460862537
fix: can't find Chunk struct after growing support mmap ( #33951 )
...
issue: https://github.com/milvus-io/milvus/issues/32984
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2024-06-18 18:37:58 +08:00
5cb0760187
fix: Small fixs of major compaction ( #33929 )
...
#30633
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-06-18 16:53:58 +08:00
3fdaae8792
fix: Return record with largest timestamp for entires with same PK ( #33936 )
...
See also #33883
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-18 15:55:59 +08:00
5772123ca2
fix: Check the correct return error in MultiRemove ( #33926 )
...
See also #33925
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-18 15:23:59 +08:00
5e906fd17f
enhance: Force to reset coord connection for unavailable error ( #33908 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-06-18 14:53:59 +08:00
32f685ff12
enhance: growing segment support mmap ( #32633 )
...
issue: https://github.com/milvus-io/milvus/issues/32984
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2024-06-18 14:42:00 +08:00
ec64499536
fix: Check nodeID wildcard when removing pkOracle ( #33895 )
...
See also #33894
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-18 14:11:58 +08:00
zhagnlu
yihao.dai
sammy.huang
sre-ci-robot
zhikunyao
chyezh
nico
yanliang567
wayblink
congqixia
Bingyi Sun
Ted Xu
zhuwenxing
jaime
coldWater
elstic
sre-ci-robot
presburger
XuanYang-cn
cqy123456
wei liu
shaoting-huang
smellthemoon
Jiquan Long
Gao