49a85e1636
Read information from the credential specified by BSL
...
Read information from the credential specified by BSL
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-10-30 17:28:10 +08:00
929af4f734
Add check for owner reference in backup sync, removing if missing
...
Signed-off-by: Jeffrey Koehler <koehler@streem.tech>
2023-10-29 22:06:14 -05:00
23921e5d29
add description markers for dataupload and datadownload CRDs ( #7028 )
...
add changelog file
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
2023-10-27 11:05:10 -04:00
9ff4b1e079
Merge pull request #7026 from blackpiglet/6376_fix
...
Add HealthCheckNodePort deletion logic in Serivce restore
2023-10-27 16:40:04 +08:00
a94918026c
Add HealthCheckNodePort deletion logic in Service restore.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-10-27 14:13:52 +08:00
1e0fc77e4d
Fix issue 6913 ( #6914 )
...
add changelog file
keep canceling phase const
fix data download as well
address PR feedback
minor fixes
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
2023-10-26 09:39:38 -04:00
481cb60493
Make Kopia file parallelism configurable
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-10-26 02:28:36 +00:00
45ed3bf613
Record platform limitation of the Kopia block mode uploader in docs. ( #7013 )
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-10-25 19:43:46 +05:30
30bf6bd28c
Merge pull request #7011 from Lyndon-Li/issue-fix-6964-2
...
Issue 6964: use preparingTimeout for snapshot readiness wait
2023-10-25 11:11:27 +08:00
0eade6c615
issue 6964: use preparingTimeout for snapshot readiness wait
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-25 10:51:08 +08:00
d5f238c83c
kopia/repository/config/aws.go: Set session.Options profile from config
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-10-24 14:05:47 -04:00
941dd0039f
Merge pull request #6968 from blackpiglet/6585_fix
...
Check whether the action is a CSI action and whether CSI feature is
2023-10-25 00:39:58 +08:00
317db25d20
Merge pull request #6923 from reasonerjt/aws-sdk-v2
...
Bump up aws sdk to aws-sdk-go-v2
2023-10-24 23:53:16 +08:00
b71d2b3898
Bump up aws sdk to aws-sdk-go-v2
...
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-10-24 17:01:26 +08:00
61d333a31a
Merge pull request #6989 from blackpiglet/support_windows_build_main
...
[cherry-pick][main]Make Windows build skip BlockMode code.
2023-10-24 16:58:03 +08:00
908e2c63ba
Check whether the action is a CSI action and whether CSI feature is
...
enabled, before executing the action.
The DeleteItemAction is not checked, because the DIA doesn't have a
method to get the action's plugin name.
This should be OK, because the CSI will check whether the VS and VSC
have a backup name annotation. If the VS and VSC is not handled by
the CSI plugin, then they don't have the annotation.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-10-24 16:54:38 +08:00
d3a1a83c6d
bump to kopia 0.15.0
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-23 12:03:21 +08:00
3d841dd8f1
udmrepo use region specified in BSL when s3URL is empty
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-20 19:58:54 +08:00
ecc6e1621e
Make Windows build skip BlockMode code.
...
PVC block mode backup and restore introduced some OS specific
system calls. Those calls are not available for Windows, so
add both non Windows version and Windows version code, and
return error for block mode on the Windows platform.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-10-20 19:39:44 +08:00
79c75718ca
Change controller-runtime List option from MatchingFields to ListOptions.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-10-19 17:09:12 +08:00
fd8350f919
Merge pull request #6976 from Lyndon-Li/issue-fix-6964
...
Issue 6964: get volume size from source PVC if it is invalid in VS
2023-10-19 13:53:57 +08:00
329c128279
issue 6964: get volume size from source PVC if it is invalid in VS
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-19 11:50:28 +08:00
19f38f9623
Merge pull request #6947 from 0x113/SGLAB-CLOUDCASA-oidc-auth
...
Issue #6933 : Import auth provider plugins
2023-10-18 16:01:50 +08:00
265d285b1d
Import auth provider plugins
...
Signed-off-by: Sebastian Glab <sglab@catalogicsoftware.com>
2023-10-18 08:53:35 +02:00
5ff5073cc3
Add volume types filter in resource policies ( #6863 )
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-10-16 17:36:54 -04:00
7ca33f8f12
Add MSI Support for Azure plugin. ( #6938 )
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-10-16 09:47:53 +05:30
b4fb2d9644
Merge pull request #6918 from Ripolin/main
...
Add WaitForReady flag to check container readiness state before exec a hook
2023-10-15 13:27:34 +08:00
069c280f03
Fix node-agent missing metrics-addr parms to define the server start.
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-10-13 03:33:18 +01:00
e5af7f5cea
Add WaitForReady flag to check container readiness state before exec a hook
...
Signed-off-by: Ripolin <florent.david@gmail.com>
2023-10-12 20:31:36 +02:00
ad114f8f65
Merge pull request #6723 from sseago/restore-get-perf
2023-10-12 07:57:40 -07:00
741b696180
Merge pull request #6946 from Lyndon-Li/issue-fix-6668
...
Issue fix 6668: add a limitation for fs restore parallelism with other types of restore
2023-10-12 14:53:29 +08:00
b14bd2cd75
issue 6668: add a limitation for fs restore parallelism with other types of restores
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-12 11:58:26 +08:00
74ed994e5e
Merge pull request #6830 from sseago/retry-generateName
...
issue #6807 : Retry failed create when using generateName
2023-10-11 08:50:14 -07:00
7750e12151
Perf improvements for existing resource restore
...
Use informer cache with dynamic client for Get calls on restore
When enabled, also make the Get call before create.
Add server and install parameter to allow disabling this feature,
but enable by default
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-10-11 10:51:39 -04:00
19d5bee572
Merge branch 'main' into rm-improvement
2023-10-10 19:02:16 +08:00
09be1f7995
issue #6807 : Retry failed create when using generateName
...
When creating resources with generateName, apimachinery
does not guarantee uniqueness when it appends the random
suffix to the generateName stub, so if it fails with
already exists error, we need to retry.
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-10-09 17:38:37 -04:00
e5e99c75a0
Fix dep package describe and ci words spell. ( #6924 )
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-10-09 12:12:14 +05:30
d8d66381e7
issue 6734: spread backup pod evenly
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-08 20:01:12 +08:00
0d4e61eb24
Merge pull request #6649 from sseago/orphaned-partially-failed
2023-10-06 10:35:57 -07:00
06ed9dcc71
add changelog
...
Signed-off-by: lou <alex1988@outlook.com>
2023-10-04 16:02:23 +08:00
7f73acab16
Proposal to support JSON Merge Patch and Strategic Merge Patch in Resource Modifiers ( #6797 )
...
* Proposal to support JSON Merge Patch and Strategic Merge Patch in Resource Modifiers
Signed-off-by: lou <alex1988@outlook.com>
* add changelog
Signed-off-by: lou <alex1988@outlook.com>
* add conditional patches
Signed-off-by: lou <alex1988@outlook.com>
* update design
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
---------
Signed-off-by: lou <alex1988@outlook.com>
2023-10-04 09:29:09 +05:30
0d79afe049
Replace the base image with paketobuildpacks image ( #6883 )
...
Replace the base image with paketobuildpacks image
Fixes #6851
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-09-29 12:19:51 -04:00
8e01d1b9be
Add support for block volumes ( #6680 )
...
Signed-off-by: David Zaninovic <dzaninovic@catalogicsoftware.com>
2023-09-28 09:44:46 -04:00
af43d96ac9
Merge pull request #6885 from Lyndon-Li/issue-fix-6880
...
Issue 6880: set ParallelUploadAboveSize as MaxInt64
2023-09-28 14:24:08 +08:00
3e3ffec7cd
issue 6880: set ParallelUploadAboveSize as MaxInt64
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-28 12:34:30 +08:00
73ea00b477
issue 6861: fill repoIdentifier only for restic repo ( #6872 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-27 16:49:35 -04:00
563f1ccee1
Merge pull request #6475 from nilesh-akhade/main
...
Add `--or-selector` for backup and restore command
2023-09-27 20:09:07 +08:00
2e71cffe0e
issue: move plugin depdending podvolume functions to util pkg
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-26 16:39:33 +08:00
c3ec7b71c5
Merge pull request #6715 from nilesh-akhade/metric
...
Remove schedule-related metrics on schedule delete
2023-09-25 10:24:04 -07:00
cda722cf9d
Fix the metrics backup_last_status not report right value when the schedule down unexpectation.
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-09-19 15:25:21 +08:00
3a291e368a
Make Kopia support Azure AD
...
This commit introduces our own Azure storage provider by wrapping Kopia's implementation rather than contributing to upstream based on the following considerations:
1. Velero needs the capability to interact with the repository concurrently while Kopia doesn't, this will increase the complexity of Kopia if we contribute to upstream
2. The configuration items provided by Velero and Kopia are conflict, e.g. Velero supports customizing storage account URI which is a full path while Kopia supports customizing storage account domain which is part of the URI. We need to consider the backward compatibility and upgrade case if we contribute to upstream which needs extra efforts
3. Contribute to upstream is a longer cycle when we need to introduce new changes. With this commit, we no longer depends on upstream for the Azure storage provider part and is easy for us to maintain
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-09-19 11:28:04 +08:00
5af664d361
bump kopia to v0.14 ( #6833 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-18 21:05:21 +08:00
cf3cb9c4ed
Merge pull request #6712 from kaovilai/jobs-label-k8s1.27
...
On restore, delete Kubernetes 1.27 job controller uid label
2023-09-18 16:49:50 +08:00
c85638ddb6
Merge pull request #6827 from Lyndon-Li/issue-fix-6786
...
Issue 6786:always delete VSC regardless of the deletion policy
2023-09-15 14:18:38 +08:00
53489b10ad
issue 6786:always delete VSC regardless of the deletion policy
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-15 12:10:20 +08:00
9b1cffc007
check pod status before hook ( #5211 )
...
Signed-off-by: cleverhu <shouping.hu@daocloud.io>
Co-authored-by: cleverhu <shouping.hu@daocloud.io>
2023-09-13 14:49:46 +08:00
246831de7b
use old namespace in resource modifier ( #6724 )
...
* use old namespace in resource modifier
Signed-off-by: lou <alex1988@outlook.com>
* add changelog
Signed-off-by: lou <alex1988@outlook.com>
* update docs
Signed-off-by: lou <alex1988@outlook.com>
* updated after review
Signed-off-by: lou <alex1988@outlook.com>
---------
Signed-off-by: lou <alex1988@outlook.com>
2023-09-08 15:29:46 +05:30
a4b5b0a79e
add csi snapshot data mover doc ( #6637 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-08 17:17:42 +08:00
f72afc8a5a
Merge pull request #6760 from blackpiglet/6752_fix
...
Fix #6752 : add namespace exclude check.
2023-09-06 15:44:20 +08:00
79b810ed25
Fix #6752 : add namespace exclude check.
...
Add PSA audit and warn labels.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-09-06 14:44:30 +08:00
da6ac026d1
Update restore controller logic for restore deletion
...
1. Skip deleting the restore files from storage if the backup/BSL is not found
2. Allow deleting the restore files from storage even though the BSL is readonly
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-09-06 09:19:42 +08:00
8cb04d4f69
Merge pull request #6751 from Lyndon-Li/issue-fix-6647
...
Fix issue 6647
2023-09-06 09:03:00 +08:00
c9e1ade1f7
fix issue 6753 ( #6757 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-05 10:58:28 +08:00
778feba3ae
fix issue 6647
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-04 16:55:36 +08:00
5dd7c5cd46
add label selector in Resource Modifiers ( #6704 )
...
* add label selector in resource modifier
Signed-off-by: lou <alex1988@outlook.com>
* add ut
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
---------
Signed-off-by: lou <alex1988@outlook.com>
2023-08-31 10:36:59 +05:30
c7c441364c
Remove schedule-related metrics on schedule delete
...
Signed-off-by: Nilesh Akhade <nakhade@catalogicsoftware.com>
2023-08-28 20:52:32 +05:30
f6e8c208ad
changelog
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-08-28 10:45:55 -04:00
3e613862e6
Merge pull request #6635 from 27149chen/skip-subresource
...
skip subresource in resource discovery
2023-08-22 13:39:12 +08:00
8d0a8bac34
Update changelogs/unreleased/6649-sseago
...
Co-authored-by: Tiger Kaovilai <passawit.kaovilai@gmail.com>
Signed-off-by: Xun Jiang/Bruce Jiang <59276555+blackpiglet@users.noreply.github.com>
2023-08-22 10:37:59 +08:00
9e2acc987d
Add v1.12 changelog
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-08-18 16:05:50 +08:00
0b30adb35a
Merge pull request #6608 from shawn-hurley/feature/add-provider-interface-blockmod
...
Feature/add provider interface for block mode
2023-08-16 11:09:36 +08:00
563a16c10f
adding block mode to uploader/provider interfaces
...
Signed-off-by: Shawn Hurley <shawn@hurley.page>
2023-08-15 15:33:23 -04:00
f890033ee8
Merge branch 'main' of https://github.com/qiuming-best/velero into perf-test
2023-08-15 07:57:01 +00:00
3b45830012
Add performance E2E test
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-08-15 01:46:36 +00:00
441a32a861
Deal with PartiallyFailed orphaned backups as well as Completed ones
...
Fixes https://github.com/vmware-tanzu/velero/issues/6648
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-08-14 13:40:32 -04:00
797267c89a
add changelog
...
Signed-off-by: lou <alex1988@outlook.com>
2023-08-11 10:11:24 +08:00
0f9e582fd9
add changelog
...
Signed-off-by: lou <alex1988@outlook.com>
2023-08-11 10:05:23 +08:00
28c5dc9fda
fix: load AWS config and assume role
...
Signed-off-by: Luis Davim <dluis@vmware.com>
2023-08-09 13:26:30 +01:00
f78dd073bf
Merge pull request #6558 from kaovilai/s3profilefix
...
GetS3Credentials pass profile from config to NewSharedCredentials
2023-08-07 16:38:25 +08:00
69bc84cf0c
fix issue 6571
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-08-03 14:46:02 +08:00
bb96c2155c
fix issue 6575 ( #6587 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-08-02 10:27:05 -04:00
289aae1581
GetS3Credentials pass profile from config to NewSharedCredentials
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-07-28 11:26:40 -04:00
a6d79fc272
Merge pull request #6481 from blackpiglet/6444_fix
...
Remove PVC's selector in backup's PVC action.
2023-07-27 15:43:27 +08:00
f666667e5b
Merge pull request #6547 from reasonerjt/del-moved-snapshot
...
Delete moved snapshots when the backup is deleted
2023-07-27 15:10:33 +08:00
b0a343cd48
Delete moved snapshots when the backup is deleted
...
This commit introduces a deleteItemAction which writes a temporary configmap to
record the snapshot info so that the controller can trigger repo manager
to remove the snapshot
This process is a bit chatty and we should consider to refactor the code
so it's easier to connect to the repo directly in the DIA
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-07-27 13:27:33 +08:00
33b21a380c
Remove PVC's selector in backup's PVC action.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-07-27 10:09:00 +08:00
6997e4a694
Merge pull request #6476 from reasonerjt/del-inprog-dbr
...
Delete the expired deletebackuprequests that are stuck in "InProgress"
2023-07-26 16:13:58 +08:00
6dbdc54dc7
check if restore crd exist before operating restore
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-07-25 18:54:42 +08:00
9c8275eda7
Merge pull request #6533 from Lyndon-Li/data-mover-wrong-bsl-after-sync
...
Data mover wrong bsl after sync
2023-07-25 14:20:10 +08:00
74bf03b272
data mover wrong bsl after sync
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-07-25 12:38:09 +08:00
913b610196
fix: Typos and add more spell checking rules to CI ( #6415 )
...
* fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
* fixup! fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
* fixup! fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
* fixup! fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
* fixup! fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
* fixup! fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
* fixup! fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
* fixup! fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
---------
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
2023-07-21 17:25:24 -04:00
8396163e77
add missing CompletionTimestamp and metrics when restore moved into terminal phase ( #6397 )
...
Signed-off-by: Nutrymaco <efim7299@icloud.com>
2023-07-21 17:22:01 -04:00
32262babc4
Merge pull request #6479 from allenxu404/i2697
...
add restore finalizer to clean up external resources
2023-07-20 19:07:02 +08:00
2548b20db9
Track the skipped PV in a backup and print the summary in backup log ( #6496 )
...
Partially address the requirements in #5834
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-07-20 16:13:48 +08:00
b4181ef803
restict namespace to node-agent cache ( #6523 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-07-19 16:23:28 -04:00
0bb509ccdd
add restore finalizer to clean up external resources
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-07-19 18:56:35 +08:00
d9a7e2b6ca
Add 'orLabelSelector' for backup, restore command
...
Signed-off-by: Nilesh Akhade <nakhade@catalogicsoftware.com>
2023-07-19 16:16:35 +05:30
c8f970a4f1
Merge branch 'main' into resourcemodifier
...
Signed-off-by: Anshul Ahuja <anshul.ahu@gmail.com>
2023-07-19 11:11:40 +05:30
9e515ac397
Remove dependency of the legacy client code from pkg/cmd directory part 2.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-07-17 17:04:53 +08:00
b5bd55fc56
fix issue 6490 ( #6491 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-07-14 14:05:51 -04:00
Wenkai Yin(尹文开)
Jeffrey Koehler
Shubham Pampattiwar
Xun Jiang/Bruce Jiang
Xun Jiang
Ming
lyndon
Lyndon-Li
Tiger Kaovilai
Daniel Jiang
Sebastian Glab
Yang Gang
Ripolin
Shubham Pampattiwar
Scott Seago
lou
Guang Jiong Lou
David Zaninovic
Clever Hu
Nilesh Akhade
allenxu404
Shawn Hurley
Luis Davim
Mateus Oliveira
Efim Smykov
Anshul Ahuja