Commit Graph

21507 Commits (b16d04d7cc91e911fb7c93d8f1f39ec18120d289)

Author SHA1 Message Date
wei liu b16d04d7cc
fix: Fix update loading collection's load config doesn't work (#38737)
issue: #38594 
pr: #38595

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-12-25 15:02:50 +08:00
Zhen Ye 52de43dbeb
enhance: add multiply factor when loading index (#38722)
issue: #38715
pr: #38716

Signed-off-by: chyezh <chyezh@outlook.com>
2024-12-25 10:50:58 +08:00
yihao.dai bca21bde30
fix: [2.5] Fix 0 read count during import (#38695)
issue: https://github.com/milvus-io/milvus/issues/38693

pr: https://github.com/milvus-io/milvus/pull/38694

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-12-24 22:08:49 +08:00
congqixia 91130909a5
fix: [2.5] Remove sync task after finished (#38681) (#38687)
Cherry-pick from master
pr: #38681
Related to #38680

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-24 19:02:49 +08:00
MimoN 18cc83b9f6
fix: [skip e2e]update webui collection and query pages (#38701)
pr:  #38700
issue: #36621

* enhance collection detail page list columns
* enhance query page segments state detail logic

Signed-off-by: mimo.oyn <ning.ouyang@zilliz.com>
2024-12-24 17:34:49 +08:00
Xianhui Lin c51b458156
fix: [2.5]fix altercollectionfield interceptor dbname (#38663)
fix altercollectionfield interceptor dbname
issue: https://github.com/milvus-io/milvus/issues/37436
master pr: https://github.com/milvus-io/milvus/pull/38662

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2024-12-24 10:54:50 +08:00
cai.zhang bb3d993da5
fix: [2.5] Decode unicode for json key in expression (#38653)
issue: #38626 

master pr: #38651

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-12-23 13:58:49 +08:00
sre-ci-robot 7d46a8f17e
[automated] Bump milvus version to v2.5.0 (#38636)
Bump milvus version to v2.5.0
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-12-23 11:48:54 +08:00
cai.zhang 7fe2cd0518
fix: [2.5] Support hybrid search with expression template (#38625)
issue: https://github.com/milvus-io/milvus/issues/38616

master pr: https://github.com/milvus-io/milvus/pull/38623

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-12-20 18:28:20 +08:00
MimoN 8cbe8da9a7
fix: [skip e2e]update webui (#36621) (#38632)
issue: #36621

* add collection detail page 
* enhance query page segments & channels state display

Signed-off-by: mimo.oyn <ning.ouyang@zilliz.com>
2024-12-20 18:27:04 +08:00
jaime 11bedf5e76
fix: Revert "Expose metrics of stanby coordinators (#27698)" (#38621)
issue: #38608
pr: #38620

Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-12-20 18:04:47 +08:00
Xianhui Lin 3cf9b6bae5
enhance: [2.5]field stringtype maxlength raise to 1M (#38614)
enhance: field stringtype maxlength raise to 1M
issue: https://github.com/milvus-io/milvus/issues/37436
master pr: https://github.com/milvus-io/milvus/pull/38592

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2024-12-20 17:08:45 +08:00
congqixia b132438c03
enhance: Bump milvus & proto verison to v2.5.0 (#38610)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-20 14:30:46 +08:00
congqixia c39db11509
enhance: [GoSDK] Sync API names and add missing APIs (#38603)
Related to #31293

- Rename `UsingDatabase` to `UseDatabase`
- Uncomment default value methods
- Add missing RBAC APIs
- Add some resource group APIs

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-20 11:52:46 +08:00
XuanYang-cn ca7ec23198
enhance: Use partitionID when delete by partitionKey (#38231)
When delete by partition_key, Milvus will generates L0 segments
globally. During L0 Compaction, those L0 segments will touch all
partitions collection wise. Due to the false-positive rate of segment
bloomfilters, L0 compactions will append false deltalogs to completed
irrelevant partitions, which causes *partition deletion amplification.

This PR uses partition_key to set targeted partitionID when producing
deleteMsgs into MsgStreams. This'll narrow down L0 segments scope to
partition level, and remove the false-positive influence
collection-wise.

However, due to DeleteMsg structure, we can only label one partition to
one deleteMsg, so this enhancement fails if user wants to delete over 2
partition_keys in one deletion.

See also: #34665

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-12-20 11:18:46 +08:00
congqixia a728646534
enhance: [GoSDK] Add content-type header for bulk import req (#38581)
Related to #31293
Previous PR: #38493

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-20 10:28:47 +08:00
XuanYang-cn c0b855dc75
fix: ChannelManager concurret Release and Watch bug (#38590)
See also: #38589

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-12-19 22:50:47 +08:00
zhagnlu 8fcb33c21d
fix:fix delete record assert failed (#38580)
#38472

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-12-19 18:22:47 +08:00
congqixia 3d360c0624
fix: SyncSegments rpc always failed (#38578)
miss the patch due to code branching
previous pr: #38032

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
2024-12-19 15:40:45 +08:00
Zhen Ye b537a72309
fix: interted index out of range (#38577)
issue: #38546, #38486

Signed-off-by: chyezh <chyezh@outlook.com>
2024-12-19 15:20:47 +08:00
cai.zhang 306e5e6898
enhance: clean compaction task in compactionHandler (#38170)
issue: #35711

---------

Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
Co-authored-by: wayblink <anyang.wang@zilliz.com>
2024-12-19 12:36:47 +08:00
congqixia 01cfb1fd97
enhance: [GoSDK] support expression template (#38568)
Related to #36672

This PR add
- Expression template for search, query & hybrid search
- fix hybrid search rerank param
- add reranker interface(migrate from go sdk old repo)

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-19 11:20:47 +08:00
jaime 78438ef41e
fix: revert optimize CPU usage for CheckHealth requests (#35589) (#38555)
issue: #35563

Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-12-19 00:38:45 +08:00
smellthemoon 134d06f7e6
fix: need pass parameter to listPrivilegeGroups (#38562)
issue: https://github.com/milvus-io/milvus/issues/38563

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-12-18 20:28:51 +08:00
sthuang de8858931a
fix: rbac revoke check if there is same privilege in other privilege groups granted (#38558)
related: https://github.com/milvus-io/milvus/issues/38557

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-18 18:46:45 +08:00
jaime 1639779b5d
fix: [skip e2e]metrics josn tag unmarshall failed (#38554)
issue: #38551

Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-12-18 18:02:46 +08:00
cai.zhang a348122758
fix: Support get segments from current segments view (#38512)
issue: #38511

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-12-18 18:00:54 +08:00
foxspy 06d410b70f
enhance: update knowhere version (#38544)
related: #37730

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2024-12-18 16:52:45 +08:00
zhagnlu 87056be748
fix: fix snapshot or size when query (#38549)
#38472

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-12-18 16:42:45 +08:00
Bingyi Sun 894c203f27
enhance: allow hyphen in partition name (#38494)
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-12-18 15:04:45 +08:00
zhenshan.cao 5394f47866
enhance:[skip e2e] Add new maintainers (#38547)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2024-12-18 12:54:20 +08:00
zhagnlu 6ee94d00b9
fix:fix calculate arrow nest type and add ut (#38527)
#37767

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-12-18 11:54:44 +08:00
nico fb0e689617
test: update sdk version and add cases (#38478)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-12-18 10:10:57 +08:00
sre-ci-robot ffd3c5d2f5
[automated] Update Knowhere Commit (#38542)
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-12-18 01:24:47 +08:00
cai.zhang 7a05b5bbea
fix: Fix stats task wrong RootPath when upload binlog (#38539)
issue: #38336

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-12-18 00:18:45 +08:00
yihao.dai 1aa31e2a9b
fix: Fix inaccurate general count (#38524)
Checking general count should only count healthy collections and
partitions.

issue: https://github.com/milvus-io/milvus/issues/37630

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-12-17 23:24:45 +08:00
Zhen Ye b18a3cfce2
fix: kafka use shared channel to receive produce result (#38532)
issue: #38531

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2024-12-17 23:10:45 +08:00
jaime 4d5572d7ed
enhance: [skip e2e] refine display format (#38537)
issue: #36621

Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-12-17 22:30:44 +08:00
Chun Han decdfdae10
fix: growing-groupby-crush(#38533) (#38538)
related: #38533

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2024-12-17 21:05:12 +08:00
congqixia 1ec858434f
enhance: [GoSDK] Refine search params and add some examples (#38523)
Related to #31293

This PR
- Add some example test code for some basic operations
- Refine search params and add some predefined one
- Split search & hybrid search option

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-17 20:52:44 +08:00
Bingyi Sun f0096ec292
fix: Fix IsMmapSupported for scalar index (#38135)
https://github.com/milvus-io/milvus/issues/38134

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-12-17 20:30:44 +08:00
zhagnlu 9afcc5bc5c
fix:fix incorrect dir operations when create or load inverted index (#38359)
#37944

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-12-17 20:06:45 +08:00
aoiasd 93fba1d5ab
fix: access log remove new log not the old and skip rotate empty log (#38309)
relate: https://github.com/milvus-io/milvus/issues/38293

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-12-17 19:16:44 +08:00
jaime 29e620fa6d
fix: sync task still running after DataNode has stopped (#38377)
issue: #38319

Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-12-17 18:06:44 +08:00
zhagnlu d0a7e98a27
fix:remove incorrect assert for delete query (#38509)
#38472

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-12-17 17:48:44 +08:00
sthuang b9d8c5c1d7
fix: privilege group privileges granted from ClusterAdmin permission denied (#38514)
related: https://github.com/milvus-io/milvus/issues/38460

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-17 17:34:44 +08:00
Zhen Ye 8916fbf122
fix: use new path for streamingnode recovery info (#38516)
issue: #38399

Signed-off-by: chyezh <chyezh@outlook.com>
2024-12-17 17:10:45 +08:00
congqixia e19a4f764a
enhance: [GoSDK] Add bulk import restful API wrapper (#38493)
Related to #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-17 16:56:47 +08:00
zhuwenxing b694e06488
test: add lib for supporting higher python version (#38475)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-12-17 14:48:50 +08:00
yihao.dai d3c174b0f1
enhance: Accelerate observe collection (#38028)
1. A collection should observe the channel only once.
2. A collection should check the CollectionLoadPercent for updates only
once.
3. Skip saving coll/partition meta if there are no changes, primarily to
accelerate collection observation after recovery.

issue: https://github.com/milvus-io/milvus/issues/37630

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-12-17 14:14:45 +08:00