milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
18,944 Commits
135 Branches
115 Tags
565 MiB
Commit Graph

18944 Commits (2.3)

Author SHA1 Message Date
yellow-shine cc7746f3c6
enhance: [ci] separate ccache by branch for e2e pipeline (#36874) 
https://github.com/milvus-io/milvus/pull/36870

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-10-15 15:25:28 +08:00
yellow-shine e545925b90
enhance: able to upload pytest logs when test is done (#36862) 
https://github.com/milvus-io/milvus/pull/36842

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-10-15 12:59:34 +08:00
sre-ci-robot cf9dd39712
[automated] Bump milvus version to v2.3.22 (#36681) 
Bump milvus version to v2.3.22
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-10-08 15:23:20 +08:00
congqixia 5a32103045
enhance: Bump milvus version to v2.3.22 (#36671) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-10-08 11:53:20 +08:00
yellow-shine 66d03b7dbb
enhance: use pull request number as image tag in ci (#36286) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-09-20 16:15:37 +08:00
yellow-shine 2af1af59c2
enhance: git clone with retry mechanism (#36262) 
https://github.com/milvus-io/milvus/pull/36256

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-09-14 09:45:01 +08:00
yellow-shine 271e23a52d
enhance: fix a security vulnerability (#36155) 
https://github.com/milvus-io/milvus/pull/36154

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-09-10 19:11:08 +08:00
yellow-shine f4ced53e94
enhance: [pipeline] list all status before uninstall helm release (#36043) 
https://github.com/milvus-io/milvus/pull/36040

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-09-10 19:09:27 +08:00
yellow-shine 05b586d722
enhance: [nightly pipeline] add more timeout for log and list all pods status (#36013) 
https://github.com/milvus-io/milvus/pull/36011

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-09-05 19:32:02 +08:00
yellow-shine 2bbd2085e8
enhance: [ci] organize values file in the form of milvus deployment o… (#35838) 
https://github.com/milvus-io/milvus/issues/35842
https://github.com/milvus-io/milvus/pull/35832

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-30 13:07:15 +08:00
yellow-shine abb58a6c1b
enhance: friendly for docker cache (#35793) 
https://github.com/milvus-io/milvus/pull/35789

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-30 13:05:34 +08:00
yellow-shine 7985b6e2eb
enhance: show pod status and delete pvc during pipeline dear down stage (#35786) 
https://github.com/milvus-io/milvus/pull/35783

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-29 09:57:06 +08:00
yellow-shine 5b0f1cbf02
enhance: [skip e2e] Fix test script always skip pip install (#35776) 
https://github.com/milvus-io/milvus/pull/35766

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-28 17:05:06 +08:00
yellow-shine 3cf453f1a8
enhance: [2.3] fix new nightly pipeline (#35751) 
https://github.com/milvus-io/milvus/pull/35747

---------

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-28 15:51:00 +08:00
yellow-shine 07c22ffb16
enhance: nightly pipeline (#35729) 
https://github.com/milvus-io/milvus/pull/35730

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-27 17:51:05 +08:00
yellow-shine 49fd76ac64
enhance: turnoff USE_ASAN in ci (#35722) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-27 14:01:11 +08:00
wei liu 9b5033f9b6
fix: Fix proxy panic after getImportState failed (#35541) 
issue: #35539
pr: #35540

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-21 17:50:57 +08:00
SwechchhaSinha b34f6588ee
fix: [cherry-pick] changes to propagate traceid from client (#32264) (#34640) 
https://github.com/milvus-io/milvus/issues/32321
PR merged to master -
[#32264](https://github.com/milvus-io/milvus/pull/32264)

Issue Description:
Tracing is an important means of identifying bottleneck points in a
system and is crucial for debugging production issues. Milvus(or any DB)
is generally the most downstream system for an user call -- a user call
can originate from UI and pass through multiple components, in
micro-services architecture, before reaching Milvus. So, when an user
experiences a glitch, one would debug the call trace via logs using a
common trace id. As of now, Milvus generates a new trace id for every
call and this request is to make sure client can pass the trace id which
will be used for all the logs across the Milvus sub-components so that
one can fetch logs for a user call across the components -- including
Milvus.

Signed-off-by: Shreesha Srinath Madogaran <smadogaran@salesforce.com>
Signed-off-by: Swechchha Sinha <swechchha.sinha@salesforce.com>
Co-authored-by: madogar <36537062+madogar@users.noreply.github.com>
Co-authored-by: Shreesha Srinath Madogaran <smadogaran@salesforce.com>
 2024-08-16 14:12:54 +08:00
sre-ci-robot 36278fe33b
[automated] Bump milvus version to v2.3.21 (#35459) 
Bump milvus version to v2.3.21
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-08-14 11:16:53 +08:00
Chun Han 20e26588af
fix: enable limiter for restful server(#35350) (#35354) 
related: #35350

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-08-13 15:36:21 +08:00
congqixia 032096150d
enhance: Bump milvus version to v2.3.21 (#35419) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-13 11:44:20 +08:00
wei liu bfd20d5f99
fix: delete by expr failed at retry progress (#35241) (#35421) 
issue: #35240
pr: #35241
delete by expr shard the same err object between channels, so if one
channel's query failed, it will fail all channel, which will break
channel level retry policy, and make delete operation failed.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-12 16:16:20 +08:00
wei liu 8a7c00d2c7
fix: datacoord binlog size metrics include dropped segment (#35338) (#35420) 
issue: #35337
pr: #35338

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-12 14:46:21 +08:00
congqixia f75b886096
fix: [2.3] Use k locations only for basic BF test location (#35390) 
Cherry-pick from master
pr: #35380
Related to #35379

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-09 21:37:16 +08:00
wei liu e5681e5b9c
enhance: make delegator delete buffer holding all delete from cp (#29626) (#35074) 
See also #29625
pr: #29626 

This PR:
- Add a new implemention of `DeleteBuffer`: listDeleteBuffer
  - holds cacheBlock slice
  - `Put` method append new delete data into last block
  - when a block is full, append a new block into the list
- Add `TryDiscard` method for `DeleteBuffer` interface
  - For doubleCacheBuffer, do nothing
- For listDeleteBuffer, try to evict "old" blocks, which are blocks
before the first block whose start ts is behind provided ts
- Add checkpoint field for `UpdateVersion` sync action, which shall be
used to discard old cache delete block

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: congqixia <congqi.xia@zilliz.com>
 2024-08-09 18:48:18 +08:00
Jiquan Long d8bfc077a4
enhance: add metric to record disk quota (#35305) (#35320) 
https://github.com/milvus-io/milvus/issues/35177
pr: https://github.com/milvus-io/milvus/pull/35305

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-08-08 10:06:17 +08:00
Jiquan Long 621ca8b564
fix: comparision operations between incompatible operands (#35264) (#35308) 
fix: https://github.com/milvus-io/milvus/issues/34139
pr: https://github.com/milvus-io/milvus/pull/35264

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-08-07 14:44:21 +08:00
Jiquan Long 6027647c00
fix: error message when input is not aligned (#35322) (#35324) 
fix: https://github.com/milvus-io/milvus/issues/35321
pr: https://github.com/milvus-io/milvus/pull/35322

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-08-07 14:32:22 +08:00
yihao.dai 52fcd3f48b
fix: [2.3] Reduce duplicate PKs in segcore (#34267) (#35291) 
issue: https://github.com/milvus-io/milvus/issues/34247

pr: https://github.com/milvus-io/milvus/pull/34267

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-07 14:30:17 +08:00
yellow-shine b59ba81349
feat: [skip e2e] effective way to use cache (#35233) 
issue: https://github.com/milvus-io/milvus/issues/34876
https://github.com/milvus-io/milvus/pull/35109

---------

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-06 10:12:27 +08:00
yihao.dai 080ed6d96a
fix: Fix datanode cannot watch channel (#35136) 
Panic when `checkWatchedList` failed, this can avoid unnoticed quit of
the channel watch goroutine.

issue: https://github.com/milvus-io/milvus/issues/35135

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-05 15:24:17 +08:00
yihao.dai 20dca130c6
enhance: [cherry-pick] Retry on incomplete query result (#35061) 
This PR cherry-picks the following PRs:

1. Return specific error codes when encountering incomplete requery
results error. https://github.com/milvus-io/milvus/pull/31343
2. Retry on incomplete requery result in proxy.
https://github.com/milvus-io/milvus/pull/31713

issue: https://github.com/milvus-io/milvus/issues/34820

pr: https://github.com/milvus-io/milvus/pull/31343,
https://github.com/milvus-io/milvus/pull/31713

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-05 15:22:16 +08:00
wei liu ff7c1a79ee
enhance: Reduce delegator memory overloaded factor to 0.1 (#35092) (#35165) 
pr: #35092

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-05 15:12:16 +08:00
wei liu 199560da8e
enhance: Skip manual stopped component during health check (#34953) (#35122) 
pr: #34953
after manual stop component by management restful api, `healthz` may
return unhealthy state. k8s may restart the pod to save the unhealthy
sate, and the manual stop operation will got unexpected result.

to solve this, we make `healthz` API skip the manual stopped component.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-05 14:52:17 +08:00
yihao.dai f0402e0c65
fix: Fix deadlock on compaction when stopping datanode (#35199) 
Stop compaction tasks in parallel to avoid interdependencies and prevent
deadlocks.

issue: https://github.com/milvus-io/milvus/issues/35198

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-05 11:00:17 +08:00
Jiquan Long 6ea7147321
enhance: add metric to record maxInsertRate and queryNodeMemoryHighWaterLevel (#35185) (#35193) 
pr: https://github.com/milvus-io/milvus/pull/35185
fix: https://github.com/milvus-io/milvus/issues/35177

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-08-05 10:26:17 +08:00
sre-ci-robot eb079c99a7
[automated] Update Builder image changes (#35247) 
Update Builder image changes
See changes:
c5212a42b6
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-08-05 09:24:33 +08:00
yellow-shine c5212a42b6
enhance: upgrade conan version (#35217) 
https://github.com/milvus-io/milvus/pull/35215

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-02 19:37:45 +08:00
yellow-shine 2df654274f
enhance: docker-compose first then try to use docker compose (#35228) 
https://github.com/milvus-io/milvus/issues/35209
https://github.com/milvus-io/milvus/pull/35208

---------

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-02 19:37:25 +08:00
Gao 0a122533d0
enhance: change autoindex default metric type (#34328) 
issue: #34304 
pr: #34261

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-08-02 16:22:20 +08:00
chyezh 923278b75d
enhance: the datacoord gc should fast quitable (#35057) 
issue: #35049
pr: #35050

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-08-01 14:32:13 +08:00
yihao.dai 289336a617
enhance: Avoid panic due to nil schema (#35063) (#35065) 
/kind improvement

issue: https://github.com/milvus-io/milvus/discussions/25620

pr: https://github.com/milvus-io/milvus/pull/35063

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-07-30 20:19:49 +08:00
yellow-shine 55802b368d
enhance: [skip e2e] enlarge timeout of UT for go up to 90 mins (#35036) 
pr: #35035

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-07-29 15:53:57 +08:00
Jiquan Long 256817da2d
feat: record the number of times milvus turns into force-deny-writing states (#34960) (#34990) 
/kind improvement
fix: https://github.com/milvus-io/milvus/issues/34961
pr: #34960

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-07-25 15:45:46 +08:00
sre-ci-robot fb2ca5d9e5
[automated] Bump milvus version to v2.3.20 (#34966) 
Bump milvus version to v2.3.20
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-07-24 19:21:46 +08:00
sre-ci-robot 93e457645d
[automated] Update Builder gpu image changes (#34878) 
Update Builder gpu image changes
See changes:
abc7c84699
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: yellow-shine <sammy.huang@zilliz.com>
 2024-07-24 16:25:47 +08:00
zhagnlu a6c3056df3
fix: fix parse plan proto failed for search type (#34945) 
pr: #34944

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-07-24 14:59:45 +08:00
SimFG fe786fff57
enhance: [2.3] init the hook when creating the proxy object (#34936) 
- issue: #34885
- pr: #34887

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-07-24 13:11:43 +08:00
sre-ci-robot a6ac268c6d
[automated] Update Builder image changes (#34875) 
Update Builder image changes
See changes:
abc7c84699
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-07-24 09:45:45 +08:00
congqixia a5deaa1d4b
enhance: Bump milvus verions to v2.3.20 (#34915) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-07-23 14:57:43 +08:00