milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
20,660 Commits
153 Branches
123 Tags
551 MiB
Commit Graph

2948 Commits (10kcp)

Author SHA1 Message Date
smellthemoon 46692d7525
enhance: support upsert autoid==true in Restful API and fix some bugs(#37072)(#37487) (#37766) 
pr: #37072
pr: #37487

---------

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-11-18 19:44:31 +08:00
nico bbd96e1829
test: update pymilvus version and test cases (#37711) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-11-18 14:14:32 +08:00
smellthemoon b3e6482367
enhance: add search params in search request in restful(#36304) (#37673) 
pr: #36304 
pr: #36714 
pr: #36448

---------

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-11-15 17:54:30 +08:00
wei liu 1bd502b585
fix: Delegator stuck at unserviceable status (#37694) (#37702) 
issue: #37679
pr: #37694

pr #36549 introduce the logic error which update current target when
only parts of channel is ready.

This PR fix the logic error and let dist handler keep pull distribution
on querynode until all delegator becomes serviceable.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-11-15 14:52:30 +08:00
nico 2bf8773d58
enhance: update sdk version (#37661) 
pr: #37660

Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-11-14 17:46:39 +08:00
wei liu 7d1c899155
fix: Search may return less result after qn recover (#36549) (#37610) 
issue: #36293 #36242
pr: #36549
after qn recover, delegator may be loaded in new node, after all segment
has been loaded, delegator becomes serviceable. but delegator's target
version hasn't been synced, and if search/query comes, delegator will
use wrong target version to filter out a empty segment list, which
caused empty search result.

This pr will block delegator's serviceable status until target version
is synced

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-11-12 19:16:30 +08:00
sthuang 9e8b6ace6d
enhance: [2.4] RBAC custom privilege group (#37560) 
Cherry-pick from master
pr: https://github.com/milvus-io/milvus/pull/37087,
https://github.com/milvus-io/milvus/pull/37558
issue: #37031

---------

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2024-11-11 14:20:29 +08:00
nico a3c1fc1848
test: update test cases (#37476) 
pr: #36841

Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-11-07 16:56:25 +08:00
wei liu 349924615b
fix: [skip e2e]unstable integration test TestNodeDownOnSingleReplica(#37480) (#37499) 
issue: #37289
pr: #37480

cause pr #37116 introduce retry on get shard leader, which make search
won't fail during query node down.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-11-07 16:48:26 +08:00
smellthemoon 60f963102e
enhance: refactor createIndex in RESTful API(#37235) (#37237) 
pr: #37235 
2.5: #37236

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-11-07 14:18:31 +08:00
XuanYang-cn 20534a3f7b
fix: [cp24]Saperate L0 and Mix trigger interval (#37319) 
See also: #37108
pr: #37190

- Add MixCompactionTriggerInterval, default 60s
- Add L0CompactionTriggerInterval, default 10s
- Export Single related compaction configs
- Raise SingleCompactionDeltaLogMaxSize from 2MB to 16MB

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-11-06 11:10:26 +08:00
wei liu 3c09d42bfc
fix: [skip e2e] TestNodeDownOnSingleReplica has unstable result (#37288) (#37350) 
issue: #37289
pr: #37288
those test case use search to verify replica's status, but if the search
gap is 1s, the node down's effect may be fixed up by balance.

This PR remove the 1 second gap between search operation.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-11-01 13:48:22 +08:00
nico 771fad51b3
test: update pymilvus version and test cases (#37301) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-10-31 09:40:22 +08:00
yihao.dai da897e41f4
fix: Fix collection leak in querynode (#37061) (#37079) 
Unref the removed L0 segment count.

issue: https://github.com/milvus-io/milvus/issues/36918

pr: https://github.com/milvus-io/milvus/pull/37061

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-10-25 18:19:39 +08:00
yanliang567 80db377586
test: [cherry pick]Add alias tests for rename collection (#37008) 
related issue: https://github.com/milvus-io/milvus/issues/36963
pr: https://github.com/milvus-io/milvus/pull/36978

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-10-21 18:45:32 +08:00
sre-ci-robot 4d2f44d536
[automated] Update Pytest image changes (#36900) 
Update Pytest image changes
See changes:
b90cda2e5d
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-10-17 18:39:24 +08:00
yanliang567 89f28cf498
test: Add Diskann for grouping search (#36909) 
related issue: https://github.com/milvus-io/milvus/pull/36813
pr: #36853

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-10-16 16:11:24 +08:00
yanliang567 b90cda2e5d
test: [cherry pick]Add upsert in row test (#36855) 
related issue: https://github.com/milvus-io/milvus/issues/36710
pr: #36820

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-10-16 10:29:24 +08:00
nico 40259d47d1
test: update test cases (#36839) 
pr: #36853

Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-10-16 09:55:23 +08:00
yanliang567 a645ab87a0
test: [cherry pick]Add json key in [] test to verify issue (#36810) 
related issue: https://github.com/milvus-io/milvus/issues/36718
pr: https://github.com/milvus-io/milvus/pull/36738

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-10-12 18:03:21 +08:00
sre-ci-robot a081bf394d
[automated] Update Pytest image changes (#36689) 
Update Pytest image changes
See changes:
f10806650a
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-10-09 08:51:19 +08:00
nico f10806650a
test: update pymilvus version and test case (#36590) 
pr: #36589

Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-10-08 17:25:24 +08:00
jaime da2d3fb430
enhance: enable manual compaction for collections without indexes (#36581) 
issue: #36576
pr: #36577

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-10-08 14:51:20 +08:00
Zhen Ye e34fa0461b
fix: port listen racing in mix or standalone mode (#36459) 
issue: #36441
pr: #36442

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-09-26 21:01:15 +08:00
wei liu 975a9797a2
enhance: Enable dynamic update loaded collection's replica (#36417) 
issue: #35821
pr: #35822
After collection loaded, if we need to increase/decrease collection's
replica, we need to release and load it again.

milvus offers 4 solution to update loaded collection's replica, this PR
aims to dynamic change the replica number without release, and after
replica number changed, milvus will execute load replica or release
replica in async, and the replica loaded status can be checked by
getReplicas API.

Notice that if set too much replicas than querynode can afford，the new
replica won't be loaded successfully until enough querynode joins.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-26 10:43:15 +08:00
yanliang567 7218a58477
test: [Cherry Pick]Add partial load tests (#36432) 
related issue: #36037
pr: #36427

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-09-23 17:11:13 +08:00
congqixia 210adbaffc
fix: [2.4] Wait check node id goroutine in case of data race (#36302) (#36377) 
Cherry-pick from master
pr: #36302
Resolves: #36301

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-20 13:03:12 +08:00
sre-ci-robot a63badab5d
[automated] Update Pytest image changes (#36298) 
Update Pytest image changes
See changes:
2df9309b4a
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-09-18 19:31:12 +08:00
nico 2df9309b4a
test: update pymilvus version and skip some cases (#36283) 
pr: #36281

Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-09-14 17:57:14 +08:00
sre-ci-robot 97ddf1e29d
[automated] Update Pytest image changes (#36136) 
Update Pytest image changes
See changes:
33054d5723
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-09-12 17:29:12 +08:00
Buqian Zheng 089790a459
enhance: [2.4]Allow empty sparse row (#36061) 
pr: #34700

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-09-12 10:13:09 +08:00
nico 33054d5723
test: update pymilvus version and test cases (#36032) 
pr: #35867

Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-09-10 10:39:09 +08:00
wei liu ceca666e2a
fix: Fix privilege group hasn't been register for validate (#35938) 
issue: #35471
pr: #35937

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-05 18:09:11 +08:00
yihao.dai b578064869
fix: Fix DB limiter nodes are mistakenly cleaned up (#35991) (#35992) 
This issue only occurs for a short time right after a table is created.
To avoid this, we simply reduce the frequency of cleaning up invalid
limiter nodes.

issue: https://github.com/milvus-io/milvus/issues/35933

pr: https://github.com/milvus-io/milvus/pull/35991

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-09-05 17:31:05 +08:00
jaime a044a590cc
enhance: add IT for rate limit using db properties (#35931) 
issue: #35929
pr: #35930

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-09-04 14:35:05 +08:00
wei liu da026b1e28
enhance: Add depguard rules to ban deprecated proto lib (#35140) (#35818) 
See also #34394 #34252
pr: #35140

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: congqixia <congqi.xia@zilliz.com>
 2024-08-30 14:13:01 +08:00
yellow-shine 8cd75d627c
enhance: [ci] organize values file in the form of milvus deployment o… (#35839) 
https://github.com/milvus-io/milvus/issues/35842
https://github.com/milvus-io/milvus/pull/35832

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-30 13:07:15 +08:00
nico 498c9470de
test: update test cases (#35718) 
pr: #35640

Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-08-28 19:23:01 +08:00
yellow-shine e331288b78
enhance: [skip e2e] Fix test script always skip pip install (#35775) 
https://github.com/milvus-io/milvus/pull/35766

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-28 17:05:06 +08:00
yellow-shine 03627150d3
enhance new jenkinsfile for nightly and e2e (#35715) 
https://github.com/milvus-io/milvus/pull/35672

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-27 14:23:05 +08:00
XuanYang-cn ff68eb53d7
fix: [skip e2e]unstable l0 it (#35613) 
See also: #35617 
pr: #35612

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-08-26 18:53:04 +08:00
sre-ci-robot 216f33c529
[automated] Update Pytest image changes (#35639) 
Update Pytest image changes
See changes:
d7d4525c2e
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-08-22 19:18:58 +08:00
wei liu 421a00bfe8
enhance: Refresh proxy cache after restore rbac meta (#35636) 
issue: #35443
pr: #35635

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-22 19:09:01 +08:00
yanliang567 d7d4525c2e
test:[cherry-pick] Add upsert with autoid and update init collection method (#35624) 
Related issue: https://github.com/milvus-io/milvus/issues/32653
pr:  #35596

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-08-22 14:00:57 +08:00
wei liu e2542a1bf5
enhance: Update protobuf-go to protobuf-go v2 (#34394) (#35555) 
issue: #34252
pr: #34394 #35072 #35084

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-21 18:50:58 +08:00
wei liu 4bf4cbad85
enhance: Mark query node as read only after suspend (#35492) (#35586) 
issue: #34985 #35493
pr: #35492
after querynode has been suspended, it's not allow to load
segment/channel on it, which means the node is read only. to be
compatible with resource group design, after query node has been
suspend, we remove it from it's original resource group, make it a read
only query node in replica. then two things will happens:
1. it's original resource group will be lacking of query nodes, query
coord will assign new node to it.
2. querycoord will try to move out all segments/channels after querynode
has been suspended

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-20 19:00:56 +08:00
wei liu 4610dafb2e
enhance: make configure load param feature be compatible with old sdk(#35520) (#35573) 
issue: #31570 #35521
pr: #35520 #35546

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-20 18:20:57 +08:00
Chun Han cf8494ef45
enhance: support httpv1/v2 throttle and add it for httpV2(#35350) (#35504) 
related: #35350
pr: https://github.com/milvus-io/milvus/pull/35470

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-08-20 16:32:56 +08:00
XuanYang-cn 4a5e6bc6f6
enhance: Add integration tests for l0 (#35430) 
pr: #35429
See also: #34796

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-08-19 10:54:55 +08:00
wei liu 248a6ea401
enhance: Add BackupRBAC/RestoreRBAC API to enable rbac backup (#35444) (#35513) 
issue: #35443
pr: #35444

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-18 13:42:55 +08:00