milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
21,549 Commits
125 Branches
112 Tags
555 MiB
Commit Graph

21549 Commits (update_knowhere_commit_af0315f19073713758b273a63deb68a0b735184d)

Author SHA1 Message Date
github-actions[bot] f7644df0ac Update knowhere commit 2024-12-30 15:06:35 +00:00
cai.zhang af0315f190
fix: Release compaction task lock when return function (#38856) 
issue: #38851

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-12-30 22:44:49 +08:00
codingjaguar 43a50d71bd
doc: Update readme to refine wording and reflect changes in 2.5 version (#38761) 
Update readme to refine wording and reflect changes in 2.5 version

---------

Signed-off-by: codingjaguar <jiang.chen@zilliz.com>
 2024-12-30 20:43:59 +08:00
Xiaofan cb6eca8e91
fix: drop partition can not be successful if load failed (#38793) 
fix #38649
when partition load failed, the partition drop will also fail due to the
wrong error message

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
 2024-12-30 19:42:52 +08:00
cai.zhang ba3c2e6fb1
fix: Only generate the index_null_offset file when the field support null value (#38833) 
issue: #38832

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2024-12-30 18:02:52 +08:00
Zhen Ye 07c1f43d95
fix: the retrieve plan on heap is used after free when reduce (#38840) 
issue: #38731

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-12-30 17:50:51 +08:00
Zhen Ye 56c5b66619
fix: the close operation of rmq consumer is not sync (#38734) 
issue: #38399

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-12-30 16:04:51 +08:00
SimFG ecc820e030
enhance: update expr version to support method parameter type conversion (#38780) 
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-12-30 15:59:06 +08:00
zhuwenxing e19b8f2114
test: update default value of pytest addoption (#38836) 
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-12-30 14:34:51 +08:00
Reid Chan dd81a13821
fix: used wrong label for query received_nq metrics (#37987) 
issue: #37982

Signed-off-by: Reid Chan <reidchan@apache.org>
 2024-12-30 11:10:52 +08:00
sre-ci-robot 445b93790e Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-12-27 12:00:38 +00:00
congqixia c39452f384
enhance: [GoSDK] Support alter properties APIs (#38812) 
Related to #31293

This PR:

- Add AlterDatabaseProperties API
- Add DropDatabaseProperties API
- Add DescribeDatabase API
- Rename AlterCollection to AlterCollectionProperties
- Add DropCollectionProperties API
- Add AlterCollectionFieldProperties API

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-12-27 18:26:50 +08:00
Bingyi Sun 2557e3f2a9
enhance: Initialize field id to avoid negative number (#38789) 
Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-12-27 18:00:50 +08:00
zhuwenxing d433b754ce
test: [skip e2e]remove secure=True in connections (#38779) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-12-27 16:58:50 +08:00
Zhen Ye 4ba0ed3178
enhance: speed up streaming barrier timetick (#38787) 
issue: #38399

- use last allocate but not last confirmed id to make barrier. 
- move the barrier logic into the timetick allocator.
- try to sync up local allocator and remote allocator when first barrier
check not pass to speed up.

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-12-27 15:08:50 +08:00
congqixia a882f341f4
enhance: [GoSDK] Add APIs for backup tool (#38791) 
Related to #31291

This PR:

- Add Backup&Restore RBAC APIs
- Add GetPersistentSegmentInfo API
- Add GetServerVersion API
- Add flush task stats

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-12-27 14:20:51 +08:00
sre-ci-robot 18a3bc7794
[automated] Bump milvus version to v2.5.1 (#38802) 
Bump milvus version to v2.5.1
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-12-27 13:58:58 +08:00
congqixia 19052ef3e5
enhance: Add buffered writer to reduce fwrite syscall (#38570) 
Related to previous PR #38157

If mmapped row is too small, frequent fwrite call still cost too much
cpu time for context switching. This PR add buffered write to avoid this
bad case with extra buffer per variable field.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-12-27 12:20:50 +08:00
XuanYang-cn 4df444ef25
fix: Aviod add negative missing count (#38748) 
See also: #34665

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-12-26 18:58:56 +08:00
sthuang 94955e5292
fix: expand privilege group when list policy in rootcoord (#38758) 
related: https://github.com/milvus-io/milvus/issues/38757

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2024-12-26 15:38:50 +08:00
Zhen Ye 5001878b8a
enhance: only use streaming service on e2e and nightly e2e (#38743) 
issue: #38399

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-12-26 11:32:50 +08:00
Patrick Weizhi Xu 85f462be1a
enhance: speed up search iterator stage 1 (#37947) 
issue: #37548

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
 2024-12-26 10:32:49 +08:00
wei liu f49d618382
fix: Querycoord will trigger unexpected balance task after restart (#38630) 
issue: #38606

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-12-25 19:30:48 +08:00
aoiasd bc15ad24f2
fix: sealed segment get empty index params when brute force search for bm25 (#38707) 
relate: https://github.com/milvus-io/milvus/issues/38236

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-12-25 19:06:51 +08:00
Gao 363d7f31ef
fix: report error when hints not supported (#38717) 
issue: #38705

---------

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-12-25 19:02:56 +08:00
aoiasd c7ea09a8be
enhance: return exception type name when segcore return unkonwn exception (#38326) 
relate: https://github.com/milvus-io/milvus/issues/38265

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-12-25 18:58:50 +08:00
wei liu 25f0c82ceb
fix: Fix update loading collection's load config doesn't work (#38595) 
issue: #38594

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-12-25 18:02:51 +08:00
sthuang 6bc799061e
fix: fix privilege group list and list collections (#38684) 
related: #37031
* built-in privilege group privileges in listPrivilegeGroups() should be
the same as in milvus.yaml
* collections granted by collection level built-in privilege group
should be list in showCollections()

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2024-12-25 18:00:51 +08:00
ThreadDao ea339c13c6
test: add cases for async milvus client (#38699) 
issue: #38697

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-12-25 16:54:50 +08:00
wei liu 9c3f59dbbe
fix: Prevent balancer from overloading the same QueryNode (#38719) 
issue: #38718
The balancer calculates the workload of executing tasks as an ongoing
score for target nodes. However, a logic issue arises when
GetSegmentTaskDelta or GetChannelTaskDelta is called with
collectionID=-1, which incorrectly returns zero.

Due to the incorrect global score, the executing task's workload is not
properly reflected for each collection. Consequently, each collection
submits its own balance task, leading to the balancer assigning
excessive tasks to the same QueryNode.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-12-25 16:36:49 +08:00
Ted Xu acc8fb7af6
enhance: eliminate compile warnings (part2) (#38535) 
See #38435

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-12-25 15:30:50 +08:00
Zhen Ye 5395ec19ad
enhance: add mem size for index file and fallback to multiply with serialized size (#38716) 
issue: #38715

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-12-25 14:46:49 +08:00
XuanYang-cn c731357538
enhance: Add missing delete metrics (#38634) 
Add 2 counter metrics:
- Total delete entries from deltalog:
milvus_datanode_compaction_delete_count
- Total missing deletes: milvus_datanode_compaction_missing_delete_count

See also: #34665

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-12-25 10:24:50 +08:00
Zhen Ye 285289d5b0
enhance: implement kafka for wal (#38598) 
issue: #38399

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-12-25 10:22:50 +08:00
Zhen Ye 05d9f8562f
fix: fix complie error generated by conflict pr (#38729) 
issue: #38399

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-12-25 10:14:49 +08:00
Zhen Ye 118678bd91
enhance: make runtime config into a global environment table (#38671) 
issue: #38399

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-12-24 21:00:49 +08:00
Zhen Ye 69a9fd6ead
enhance: enable rmq for streaming (#38669) 
issue: #38399

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-12-24 20:24:48 +08:00
yihao.dai 2b53b0905e
fix: Fix 0 read count during import (#38694) 
issue: https://github.com/milvus-io/milvus/issues/38693

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-12-24 20:06:49 +08:00
binbin 5304707393
test: Add test cases for rbac v2 (#38556) 
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2024-12-24 18:06:48 +08:00
MimoN c458dec206
fix: [skip e2e]update webui collection and query pages (#38700) 
issue: #36621

* enhance collection detail page list columns
* enhance query page segments state detail logic

Signed-off-by: mimo.oyn <ning.ouyang@zilliz.com>
 2024-12-24 17:36:48 +08:00
congqixia 636e107e44
fix: Remove sync task after finished (#38681) 
Related to #38680

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-12-24 13:34:48 +08:00
sre-ci-robot 877cd80d93 Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-12-24 00:01:37 +00:00
yanliang567 6884319d03
test: [CP] add alter tests (#38659) 
related issue: https://github.com/milvus-io/milvus/issues/38471

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-12-23 19:42:49 +08:00
Xianhui Lin d718bbb4de
fix: fix altercollectionfield interceptor dbname (#38662) 
fix altercollectionfield interceptor dbname 
issue: https://github.com/milvus-io/milvus/issues/37436

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
 2024-12-23 18:24:48 +08:00
laurazhao0611 82d85e8c57
test: modify part of milvus client test cases with load func (#38654) 
/kind improvment
/cc @yanliang567 @binbinlv

Signed-off-by: laurazhao0611 <laura.zhao@zilliz.com>
 2024-12-23 17:16:48 +08:00
cai.zhang bb5f38e574
enhance: Return collection not loaded rather than not found on querynode (#38593) 
issue: #38586

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-12-23 14:36:48 +08:00
cai.zhang 2356425530
fix: Support hybrid search with expression template (#38623) 
issue: #38616

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-12-23 14:32:51 +08:00
cai.zhang 205231b9c7
fix: Decode unicode for json key in expression (#38651) 
issue: #38626

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-12-23 13:40:49 +08:00
sre-ci-robot 9e1bb3bd8f
[automated] Bump milvus version to v2.5.0 (#38640) 
Bump milvus version to v2.5.0
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-12-23 11:48:54 +08:00
jaime 5afd0c0a2b
fix: Revert "Expose metrics of stanby coordinators (#27698)" (#38620) 
issue: #38608

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-12-23 11:46:57 +08:00