1efd533d0d
Fix wrong logs in markDataDownloadsCancel() and add missiong license file.
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-10-19 14:04:41 +01:00
8e01d1b9be
Add support for block volumes ( #6680 )
...
Signed-off-by: David Zaninovic <dzaninovic@catalogicsoftware.com>
2023-09-28 09:44:46 -04:00
5485616abf
Fix data mover bugs #6550 #6563 #6600
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-08-14 08:37:19 +00:00
9f5162ece3
add wait timeout for expose prepare
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-07-10 17:32:10 +08:00
e205e2122d
Retrieve DataUpload into backup result ConfigMap during volume snapshot restore.
...
Fix issue #6117 .
Add CSI plugin needs builder functions.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-06-30 11:18:36 +08:00
4208208f6b
Merge branch 'main' into 6117_fix
...
Signed-off-by: Xun Jiang/Bruce Jiang <59276555+blackpiglet@users.noreply.github.com>
2023-06-30 11:15:21 +08:00
ec4bb42117
Retrieve DataUpload into backup result ConfigMap during volume snapshot restore.
...
Fix issue #6117 .
Add CSI plugin needs builder functions.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-06-30 11:13:04 +08:00
89ae6cc29b
Merge pull request #6436 from qiuming-best/data-download-controller
...
Add data download controller
2023-06-30 10:12:53 +08:00
1bfcee776c
Add data download controller
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-06-29 13:28:19 +00:00
4cea533865
Add more unit test cases for cmd/util/output
...
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-06-27 00:37:31 +08:00
cd68dd369b
Add Unit test cases for pkg/cmd/util/output ( #6359 )
...
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-06-26 08:16:36 +08:00
a5c28ad423
Add warning message for volume snapshotter in data mover case.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-06-12 17:57:01 +08:00
9743a7ce56
Fix #6118 : Do not persist VolumeSnapshot and VolumeSnapshotContent for snapshot DataMover case. ( #6366 )
...
1. Because VolumeSnapshot and VolumeSnapshotContent CRs are not kept after backup completed,
don't persist them in the backup metadata.
2. Add some builder methods needed by CSI plugin.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-06-08 17:05:17 +08:00
9f2f563568
Add data mover related options in CLI
...
Add data mover related options in CLI
Fixes #6128
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-06-07 16:34:40 +08:00
b3e99a7eb2
Add Dataupload controller
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-06-06 05:46:38 +00:00
443f732e51
Enable more linters, and remove mal-functioned milestoned issue action.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-25 23:31:51 +08:00
bbc1e2e151
Enable stylecheck linter and resolve found issues.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-25 14:37:02 +08:00
56f93393d8
Modify new scope resource filters name.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-06 18:11:55 +08:00
fc692c49e6
Update Golang version to v1.19 for branch main.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-04 12:00:19 +08:00
15d44724e7
Modify golangci.yaml file. Resolve found lint issues. ( #6008 )
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
Co-authored-by: Xun Jiang <blackpiglet@gmail.com>
2023-03-24 12:15:08 +08:00
a3cef5b0d3
Adjust match resource policies
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-03-23 03:48:26 +00:00
086dbd344f
Handle backup of volume by resource policies ( #5901 )
...
* Handle backup of volume by resource policies
Signed-off-by: Ming <mqiu@vmware.com>
2023-03-21 14:39:25 +08:00
2155b2b215
RIAv2 async operations controller work
...
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-03-17 14:30:39 -04:00
a1e4f54488
Add new resource filters can separate cluster and namespace scope resources.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-03-14 07:07:22 +00:00
c3d1d83da5
BIAv2 async operations controller work
...
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-03-01 11:49:17 -05:00
4d0c3ac83f
Restore finalizer and managedFields ( #5853 )
...
Restore finalizer and managedFields of metadata during the restoration
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-02-20 10:26:45 +08:00
660841dfbd
Merge pull request #5471 from ywk253100/221021_lib
...
update k8s.io dependencies to 0.24.0
2022-10-24 14:46:43 +08:00
5027aae194
Add more nil pointer check for CSI related code in backup controller. ( #5388 )
...
Add some corner cases checking for CSI snapshot in backup controller.
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2022-10-24 10:42:08 +08:00
b146a880c6
update k8s.io dependencies to 0.24.0
...
* This also required an update to use github.com/bombsimon/logrusr/v3
* 'WithClusterName' removed as per the k8s doc reasoning:
* https://github.com/kubernetes/apimachinery/blob/release-1.24/pkg/apis/meta/v1/types.go\#L257-L259
* ('ClusterName was a legacy field that was always cleared by the system and never used')
* Test was updated accordingly
Signed-off-by: Kira Boyle <kira@replicated.com>
2022-10-21 11:16:21 +08:00
c81f0db886
rename pvbr param ( #5370 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2022-09-23 09:13:36 +08:00
596114b427
Add credentials to volume snapshot locations.
...
This is analogous to the BSL creds work that was done previously, but for VSLs instead.
Signed-off-by: Scott Seago <sseago@redhat.com>
2022-09-08 08:59:17 -04:00
a5f4f8f9fc
Merge branch 'main' into 5048-CSI-snapshot-timeout-configurable
2022-08-08 17:18:44 +08:00
f8d9cfdb84
Make CSI snapshot creation timeout configurable for backup and schedule.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2022-08-08 17:07:26 +08:00
e8da5df57a
Reduce CRD size.
...
1. Make the Restore hook.InitConatianer server side field pruing disable.
2. Remove restore patch in update-generate-crd-code.sh.
3. Modify related testcases.
4. Add Container fields validation in Restore Init hook.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2022-08-02 19:45:01 +08:00
bfdb68a35a
add multiple label selector support to backup API
...
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
remove backup CLI bits
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
labelselectors spec option for velero restore
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
add changelog file
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
update spec name to OrLabelSelectors
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
minor fixes
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
add validations for labelSelector and orLabelSelectors
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
update crds.gp after fixing conflicts
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
fix CI and add unit tests
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
updated OrLabelSelector spec description and added validation failure unit tests
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
add comments and change log level
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
update site docs
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
wrap pager client calls in a function
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
resolve confilcts and update crds.go
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
rebase and update crds.go
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
combine listing items for a given label
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
2022-05-11 09:57:47 -04:00
e3106f3e10
add existingResourcePolicy to Restore API
...
add updateall policy option
fix updating labels
dump updateAll policy option
remove updateAll policy refs
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
add changelog file
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
update docs
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
patch labels for sa if policy is update
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
fix existingResourcePolicy for serviceaccounts
modularize changes and add unit tests
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
fix conflicts and update crds.go
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
change log level from info to error
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
update crds.go
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
2022-05-09 13:36:24 -04:00
2dd85c9c42
Convert PodVolumeBackup to Kubebuilder framework
...
Signed-off-by: F. Gold <fgold@vmware.com>
2022-01-26 20:09:24 -08:00
62779bbcc6
Check the existence of the expected service when ignoring the NodePort already allocated error
...
Check the existence of the expected service when ignoring the NodePort already allocated error
Fixes 2308
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2022-01-12 15:06:42 +08:00
69f6c8d0cd
Fix statefulsets volumeClaimTemplates storageClassName after use Changing PV/PVC Storage Classes ( #4375 )
...
* fix statefulsets volumeClaimTemplates storageClassName after use Changing PV/PVC Storage Classes
Signed-off-by: Box-Cube <64300761+Box-Cube@users.noreply.github.com>
* Fix (vmware-tanzu#4373)
Signed-off-by: Box-Cube <64300761+Box-Cube@users.noreply.github.com>
* Fix StatefulSet volumeClaimTemplates storageClassName(vmware-tanzu#4373)
Signed-off-by: Box-Cube <64300761+Box-Cube@users.noreply.github.com>
* Fix StatefulSet volumeClaimTemplates storageClassName(vmware-tanzu#4373)
Signed-off-by: Box-Cube <64300761+Box-Cube@users.noreply.github.com>
* Fix StatefulSet volumeClaimTemplates storageClassName(vmware-tanzu#4373)
Signed-off-by: Box-Cube <64300761+Box-Cube@users.noreply.github.com>
* Change the isStorageClassExist logic
Signed-off-by: Box-Cube <64300761+Box-Cube@users.noreply.github.com>
* Fix StatefulSet volumeClaimTemplates storageClassName(vmware-tanzu#4373)
Signed-off-by: Box-Cube <64300761+Box-Cube@users.noreply.github.com>
2021-12-16 14:50:56 +08:00
5878a52843
Read Availability zone from nodeAffinity requirements
...
Velero to read the AZ info from `NodeAffinity` of a PV when it's taking
the snapshot.
Fixes #4332
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2021-11-16 09:44:12 +08:00
550efddd88
Verify group before treating resource as cohabitating ( #4126 )
...
Signed-off-by: Scott Seago <sseago@redhat.com>
2021-11-03 18:11:32 -04:00
d98c65f69e
Use appropriate CRD API during readiness check ( #4015 )
...
* Use appropriate CRD API during readiness check
The readiness check for the Velero CRDs was still using the v1beta1 API.
This would cause the readiness check to fail on 1.22 clusters as the
v1beta1 API is no longer available. Previously, this error would be
ignored and the installation would proceed, however with #4002 , we are
no longer ignoring errors from this check.
This change modifies the CRD readiness check to check the CRDs using the
same API version that was used when submitting the CRDs to the cluster.
It also introduces a new CRD builder using the V1 API for testing.
This change also fixes a bug that was identified in the polling code
where if the CRDs were not ready on the first polling iteration, they
would be added again to the list of CRDs to check resulting in
duplicates. This would cause the length check to fail on all subsequent
polls and the timeout would always be reached.
Signed-off-by: Bridget McErlean <bmcerlean@vmware.com>
* Remove duplicate V1 CRD builder and update comment
Signed-off-by: Bridget McErlean <bmcerlean@vmware.com>
2021-08-05 15:17:14 -04:00
ae6e1df9aa
Add Labels field to BackupSpec ( #3641 )
...
* Add metadata.Labels to schedule.Spec.Template and it's copy logic to Backup
Signed-off-by: Arush Salil <me@aru.sh>
* document metadata.labels
Signed-off-by: Klavs Klavsen <klavs@enableit.dk>
* adjust text per suggestion.
Signed-off-by: Klavs Klavsen <klavs@enableit.dk>
* Rewrite labels copy logic, add comments, and debug log messages
Signed-off-by: Arush Salil <me@aru.sh>
* Rephrase label copy debug log
Signed-off-by: Arush Salil <me@aru.sh>
* Add initialized logger to FromSchedule
Signed-off-by: Arush Salil <me@aru.sh>
* use info log level per request.
Signed-off-by: Klavs Klavsen <klavs@enableit.dk>
Co-authored-by: Klavs Klavsen <klavs@enableit.dk>
2021-06-17 11:18:37 -07:00
7566962b95
Support pulling plugins by digest ( #3803 )
...
Previously `WithPlugins` only supported passing image URIs "by tag" --
e.g. `gcr.io/my-repo/my-image:v0.1.2`. With this commit, we add support
for pulling "by digest" -- e.g.
`gcr.io/my-repo/my-image@sha256:a75f9e8c3ced3943515f249597be389f8233e1258d289b11184796edceaa7dab`
Signed-off-by: Eric Fried <efried@redhat.com>
2021-05-18 13:27:49 +08:00
32c3820b8a
🐛 Fix plugin name derivation from image name ( #3711 )
...
* 🐛 Fix plugin name derivation from image name
Signed-off-by: Ashish Amarnath <ashisham@vmware.com>
* changelog
Signed-off-by: Ashish Amarnath <ashisham@vmware.com>
2021-04-21 20:57:00 -04:00
b9a8c0b254
Pass configured BSL credential to plugin via config ( #3442 )
...
* Load credentials and pass to ObjectStorage plugins
Update NewObjectBackupStore to take a CredentialsGetter which can be
used to get the credentials for a BackupStorageLocation if it has been
configured with a Credential. If the BSL has a credential, use that
SecretKeySelector to fetch the secret, write the contents to a temp file
and then pass that file through to the plugin via the config map using
the key `credentialsFile`. This relies on the plugin being able to use
this new config field.
This does not yet handle VolumeSnapshotLocations or ResticRepositories.
Signed-off-by: Bridget McErlean <bmcerlean@vmware.com>
* Address code reviews
Add godocs and comments.
Improve formatting and test names.
Signed-off-by: Bridget McErlean <bmcerlean@vmware.com>
* Address code reviews
Signed-off-by: Bridget McErlean <bmcerlean@vmware.com>
2021-03-04 13:43:15 -08:00
11bfe82342
Convert DownloadRequest resource/controller to kubebuilder ( #3004 )
...
* Migrate DownloadRequest types to kubebuilder
Signed-off-by: Carlisia <carlisia@vmware.com>
* Migrate controller to kubebuilder
Signed-off-by: Carlisia <carlisia@vmware.com>
* Migrate download request cli to kubebuilder
Signed-off-by: Carlisia <carlisia@vmware.com>
* Format w make update
Signed-off-by: Carlisia <carlisia@vmware.com>
* Remove download file
Signed-off-by: Carlisia <carlisia@vmware.com>
* Remove kubebuilder from backup/restore apis
Signed-off-by: Carlisia <carlisia@vmware.com>
* Fix test description
Signed-off-by: Carlisia <carlisia@vmware.com>
* Import cleanups
Signed-off-by: Carlisia <carlisia@vmware.com>
* Refactor for controller runtime version update
Signed-off-by: Carlisia <carlisia@vmware.com>
* Remove year from the copyright
Signed-off-by: Carlisia <carlisia@vmware.com>
* Check for expiration regardless of phase
Signed-off-by: Carlisia <carlisia@vmware.com>
* Fix typos and godoc
Signed-off-by: Carlisia <carlisia@vmware.com>
* Fix test setup and fix a test case
Signed-off-by: Carlisia <carlisia@vmware.com>
2021-03-01 13:28:46 -05:00
9dbd238c89
Use controller-runtime client to get restic secrets ( #3320 )
...
* Use kubebuilder client for fetching restic secrets
Instead of using a SecretInformer for fetching secrets for restic, use
the cached client provided by the controller-runtime manager.
In order to use this client, the scheme for Secrets must be added to the
scheme used by the manager so this is added when creating the manager in
both the velero and restic servers.
This change also refactors some of the tests to add a shared utility for
creating a fake controller-runtime client which is now used among all
tests which use that client. This has been added to ensure that all
tests use the same client with the same scheme.
Signed-off-by: Bridget McErlean <bmcerlean@vmware.com>
* Add builder for SecretKeySelector
Signed-off-by: Bridget McErlean <bmcerlean@vmware.com>
2021-02-18 10:30:52 -08:00
63301213bd
Improve name formatting logic and add more tests
...
Signed-off-by: Carlisia <carlisia@vmware.com>
2020-12-14 18:32:37 -08:00
2de7c7924c
Better name format for init containers
...
Signed-off-by: Carlisia <carlisia@vmware.com>
2020-12-14 14:14:12 -08:00
yanggang
David Zaninovic
Ming Qiu
Lyndon-Li
Xun Jiang
Xun Jiang/Bruce Jiang
lyndon
Daniel Jiang
Wenkai Yin(尹文开)
Xun Jiang
Scott Seago
Kira Boyle
Shubham Pampattiwar
F. Gold
Box-Cube
Bridget McErlean
Arush Salil
Eric Fried
Ashish Amarnath
Carlisia Thompson